About

Suraj Tripathi is a skilled Data Engineer with over 6 years of experience in the media and telecom industry. He holds a bachelor's degree in Electronics and Communication Engineering from Malaviya National Institute of Technology. Suraj has expertise in designing, developing, and maintaining end-to-end data pipelines, converting data into informational insights, and helping organizations make data-driven decisions. His technical skills include languages such as Python, SQL, PySpark, and R, databases such as MS SQL Server, Snowflake, and Oracle, cloud tools such as AWS EC2 and AWS S3, and IDEs such as VS Code, Spyder, Jupyter Notebook, PyCharm, and R Studio. Suraj also has experience with data analysis and machine learning modeling techniques such as supervised learning, classification, regression, decision trees, and unsupervised learning. Suraj has worked on several key responsibilities, including migrating over 8000 databases from SQL server to Snowflake, optimizing job execution time, and writing clean and readable code while doing peer code-review. He has also achieved several key accomplishments, such as reducing daily mapping job execution time from 20 hours to less than 2 hours, implementing a scalable and fault-tolerant end-to-end data pipeline for data migration, and optimizing several codes to run 100 times faster than before. Currently, Suraj is working as a Data Engineer II at Microsoft, where he has created an event streaming solution for the movement of data using Pyspark on Synapse with the Azure event hub as the source and the delta lake as the target. He has also participated in Azure boot camp and various learning sessions and created CI/CD build and release pipelines using Azure DevOps for smooth deployment between development and production environments. Suraj has previously worked as a Data Engineer at Genpact, where he designed and implemented a scalable and fault-tolerant end-to-end data pipeline for migration of semi-structured data to Snowflake using Python, SQL, and S3 buckets. He also automated the daily ETL process and email generation using triggers in the Dataiku scenario and led the migration of 8000 databases from SQL server to Snowflake using Python. Suraj has also worked as a Machine Learning Intern at Ineuron, where he worked on anomaly detection in the logs of wireless transmission and identifying the KPIs. Suraj's technical stack includes data engineering, SQL, Snowflake, Python, ML, AWS, Azure, Jupyter, supervised learning