About

Chirag Dhawan is a Data Engineer with over 5 years of experience in the development of data pipelines using big data technologies for processing high volume patient-level data sets. He has a strong background in defining business/ETL rules for standardization of different data sources to a common data model. Currently, Chirag is working as a Data Engineer at Amazon, where he is responsible for developing and maintaining data pipelines using Spark, Python, and other big data technologies. Prior to his current role, Chirag worked at g42 healthcare as a Data Engineer, where he set up ETL pipelines for transforming patient-level data to a common data model using an in-house application developed in Scala. He also worked on optimizing Spark jobs and applying business rules for data transformation. Chirag has expertise in SQL, Python, Docker, and K8s. Chirag has also worked as a Senior Business Technology Analyst at ZS Associates, where he was part of the Real-World Data & Insights team. He developed pipelines for processing high volume patient-level data sources using Spark on an EMR cluster and orchestrated processes using Airflow. Chirag has expertise in Spark SQL, AWS, and other big data technologies. Chirag holds a Bachelor of Technology degree in Information Technology from Jaypee Institute of Information Technology. He is skilled in data engineering, Spark, Python, SQL, ETL, AWS, Docker, Apache Airflow, Postgres, and other backend technologies. Chirag is a software engineer with experience in data warehousing, NoSQL, Flask, web development, and Apache Hive.