About

Dipak Shaw is a highly motivated and driven Data Engineer with over 7 years of experience in the data engineering and analytics fields. He is currently working at Microsoft as a Software Engineer and Data Engineer, responsible for building the ingestion pipeline to ingest and consume data from multiple sources, clean, transform, and export it into the target table and destination location for reporting using Azure services, Databricks, Power BI, SQL Server, etc. Dipak has expertise in Telecom, Retail, Logistics, and HR domains with multiple data-driven solutions, which has matured him as an IT professional with strong execution, methodology, and coding skills. Dipak's skills highlight includes Hadoop Components (HDFS, Hive, HBase, Sqoop, Map Reduce, Oozie, etc), Hortonworks, Cloudera, Spark, Scala, Python, AWS, Azure, Aurora, RabbitMQ, Shell Script, CICD, GitHub, Data Modeling & Designing, Data Warehousing, and many more. He has worked with HCL Technologies and Brillio Analytics, helping customers build data lakes, use an ETL pipeline to bring data into them from multiple sources, and analyze data to gain more insight into the business. Dipak is also experienced in performing RCA on data and processes to answer specific business questions and identify opportunities for improvement. Dipak has a Bachelor's degree in Computer Science & Engineering from MCKV Institute of Engineering. He is an independent individual who never stops at one thing and keeps on upgrading himself. He believes in moving forward and motivating people to achieve great things. Dipak is a quick learner and has a strong learning curve, which has enabled him to get involved in tasks that demand new technologies. In summary, Dipak Shaw is a highly skilled and experienced Data Engineer with expertise in various domains, including Telecom, Retail, Logistics, and HR. He is a quick learner, highly motivated, and driven individual who never stops upgrading himself. Dipak's skills highlight includes Hadoop Components, Hortonworks, Cloudera, Spark, Scala, Python, AWS, Azure, Aurora, RabbitMQ, Shell Script, CICD, GitHub, Data Modeling & Designing, Data Warehousing, and many more.