About

Sohrab Ahmed is a seasoned Data Engineering Specialist with over 6 years of experience in various types of Data and Advanced Analytics. He has a passion for identifying competitive advantages by transforming raw data into powerful information using cutting-edge technologies. Sohrab is an expert in Big Data Platform, Azure Cloud, Cloudera, and Hadoop. He has extensive experience in Azure Products such as Data Factory, Logic App, and DevOps, as well as in Scala, Spark, SQL, Databricks, and ETL. Currently, Sohrab is working as a Data Engineer Specialist, II at PPG Industries. He has developed a scalable Delta Lake platform with ACID, time travel, dynamic schema evolution, audit history features, and hard delete, which can hold Type 1 & 2 SCDs data for different project requirements. He has also developed a metadata-driven framework and automated ingestion and integration pipeline for multiple structured and semi-structured sources using ADF, Databricks, Logic App, AAS, ADLSGen2, and Azure Synapse. Sohrab has implemented logics to integrate multiple ERPs invoice data into centralized spend visibility report developed in Spark Scala using Azure resources. He has also developed CI-CD for Databricks code using Azure DevOps pipeline and redesigned AAS models and Power BI Dataset refresh process to allow parallel refresh in secured with time-saving and same cost using Logic App. In the past, Sohrab has worked as a Big Data Developer at Neustar and as a Data Engineer at Hotels.com. At Neustar, he developed a process to create data quality reports on fill rate generation for business analysts to review and approve as per tolerated threshold limit. He built an automated data quality framework to fix inconsistencies and unexpected values using Spark SQL and Shell script. At Hotels.com, Sohrab worked on designing and implementing an automated data ingestion framework for the seamless flow of data from source to data lake with change data. He productionized the entire pipeline stack, including job scheduling in Azkaban, monitoring in Power-BI, and alerting in Slack. He also implemented GDPR and built the business solution in Cloud (AWS, Qubole), enhancement of on-premise Hadoop and Teradata systems. Sohrab holds a Bachelor of Technology in Computer Science & Engineering from Dr. A.P.J. Abdul Kalam Technical University and is currently pursuing a Master of Technology in Computing Systems & Infrastructure from Birla Institute of Technology and