About

Abhishek Rai is a data engineer and data scientist with 3 years of experience in building data systems that collect, manage, and convert raw data into usable information, ensuring data accessibility for performance efficiency. He is proficient in Python, SQL, Azure, Machine Learning, and GCP. Abhishek has been working as a Data Engineer for an energy firm analyzing large-scale data, performing data cleaning, data ingestion, storing data on Azure Blob Storage and Azure Data Lake. Abhishek has been part of a project that involved building and developing pipelines/ infrastructure to migrate company's data to Azure Data Factory, creating data flows, data pipelines, and triggers for automatic data ingestion. He has been automating continuous ingestion of data in Azure Data Factory with the help of Pipelines, Triggers, Data Flow, and various other activities. Abhishek is skilled in creating Python notebooks on Azure Databricks to ingest data, perform operations/modifications using PySpark, Spark, and storing final processed data in Pickle, parquet, or other file formats as per requirement. Abhishek Rai is looking for a transition into Machine Learning and Data Science. He has assisted in providing solutions to user stories for the clients following the best practices and taking ownership and completed quality and timely deliverables. Abhishek holds a Bachelor of Technology in Computer Science & Engineering from IMS Engineering College, Ghaziabad. Abhishek's tech stack includes Data Engineering, Azure, Python, Data Scientist, Research Scientist, SQL, ML, Databricks, Spark, GCP, infra, and Pandas. He has 3.86 years of relevant experience in the field of data engineering and data science.