About

Deepak Rai is a highly experienced Cloud Architect with over 13 years of experience in Data Engineering and Cloud Technology. He has extensive knowledge in designing, planning, coding, and testing various Data Lake implementations using Azure Cloud Services. Deepak has a strong background in cloud migration of on-premise Teradata Data Warehouse to ADLS using Data Bricks clusters. He is proficient in using Spark, Pyspark, HIVE, Python, ADF, Azure Synapse, and other utilities of Azure Data Bricks Cluster. He has also worked on CICD pipelines for deployments using Azure DevOps and Github. Deepak has experience in data cleaning and data validation using Azure functions and mail trigger using LOGIC app in Azure. He has built Machine learning-based advanced analytics solutions to enable intelligent data ingestion. He is well versed in various file systems like Parquet, ORC, AVRO, etc., and has advanced knowledge of file system DataBricks delta which supports ACID feature, versioning, etc. Deepak is proficient in cloud-based SQL warehouse and Azure Synapse, which is a MPP (Massively Parallel Processing) EDW. He has experience in injecting real-time data to SQL warehouse using Microsoft Azure Event Hub using Lambda architecture. Deepak has worked with various companies like HDFC Bank, EY, and Maersk Global Service Centres in the past. He has a degree in Electrical, Electronics and Communications Engineering from GLA University. Deepak is proficient in various technologies like Azure, Data Engineering, Databricks, Spark, SQL, Python, Senior Software Engineer, test, Apache Hive, ML, Hadoop, Data Warehouse, Kafka, DevOps, ETL, Integration, AI, NoSQL, and Scala.