About

Amitava Ghosh is a skilled Data Engineer with over 2 years of experience in the IT industry. He is currently working at adidas as a Data Engineer, where he is responsible for developing and maintaining metadata-driven data ingestion pipelines. Amitava has designed and created many batch and near-realtime streaming data pipelines using Azure and AWS services. He is proficient in Python, Spark, Big Data, SQL, Azure services, AWS services, Databricks, Airflow, Bitbucket, Sourcetree, and Confluence. Amitava is a team player who loves to work in an energetic team. He is flexible enough to work as an individual contributor if needed. He strives to become an asset to the team he is working with. Amitava's past work experience includes working as a Programmer Analyst at Cognizant, where he maintained and enhanced metadata-driven data ingestion frameworks based on Azure Data Factory and Databricks. He performed data ingestion activities from different sources such as Oracle, SQL Server, SAP HANA, CSV, Parquet, excel, REST APIs, etc., by designing and creating batch data pipelines using various activities in Azure Data Factory. He also worked on data transformation and data cleansing using Azure Databricks and managed several SQL operations and data validation using Spark SQL. Amitava has a Bachelor of Technology degree from Maulana Abul Kalam Azad University of Technology, West Bengal, formerly WBUT. His tech stack includes Data Engineering, SQL, Azure, Databricks, AWS, Spark, Python, Apache Airflow, Big Data, C, Pandas, Amazon Athena, Kafka, and Apache Hive. Amitava has relevant experience of 2.77 years in the industry.