About

Gaurav Soni is a highly skilled and enthusiastic software engineer with over 5 years of experience in Big Data and Distributed System Architecture. Currently working at Paytm as a Software Engineer Big Data, Gaurav has an impressive track record of implementing features for the Merchant and Consumer Model on top of consumer Cibil Data. He has also worked on data validation checks on partners' datasets, partner matching exercises, and implemented the DRE exercise on top of partner banks' data for credit card allocation. Gaurav's past experience includes working as a Data Engineer and Associate Data Engineer at Celebal Technologies, where he worked on different graph problems using Spark Graph Frames and implemented Dispatch Scheduler of India's largest clients for automating their Bogie Alumina Tank Wagons (BTAPs) to achieve the maximum supply from the required Plants and ports. He also implemented data pipelines using Spark streaming and spark structured streaming and solved data spike problems using feedback loop in spark. Gaurav has also worked on classical machine learning algorithms using Apache Spark and automated data pipelines using Azure Data Factory. Gaurav's educational background includes a Master of Computer Applications - MCA from JECRC University, where he studied Computer Science. He has a strong technical skill set, including expertise in Big Data, Spark, Azure, Java, SQL, Data Engineering, Databricks, ML, AWS, HDFS, Hadoop, Scala, Kafka, Python, ETL, Apache Airflow, Elastic Search, Salesforce, Data Warehouse, Docker, Data Scientist, Neural Networks, Search, Flask, GCP, and Apache Hive. Gaurav is a hard-working and dedicated professional with a passion for technology. He is constantly seeking to expand his knowledge and skills and is always eager to take on new challenges. With his extensive experience and technical expertise, Gaurav is a valuable asset to any organization.