About

Amit Singh is a highly skilled Senior Data Engineer with 3.60 years of relevant experience in the field. Currently working as a Software Engineer Intern at irctc, Amit has previously worked at Indian Institute of Technology, Delhi as a Summer Research Intern where he worked on the verification of an SVM-based algorithm that minimized network traffic between power stations by optimally predicting metrics and auto-correcting when changes exceeded specified error threshold. Amit has also worked as a Data Engineer at Oyo where he developed a report scheduling platform for 200+ analysts and mentored 10+ people data engineers. He has automated infrastructure workflows for EMR, Kafka, and Airflow, and led and developed a single stop portal for all data needs such as new syncing requests, report scheduling, Kafka topic creation, aggregate table creation, etc. Amit has enhanced ELT pipelines by adding features such as auto schema evolution, view-based table persistence, support for Confluent Avro as a data source, etc. He has worked on at least 100+ data pipeline setups (at table level), by hand, before automating the process and migrated various such as Presto, Kafka Connect, Presto Gateway, Metabase, Kafka metrics exporter, etc. from EC2 to Kubernetes. This led to better load and cost efficiency with easy scale up and scale down of services. Amit has a Bachelor of Technology degree in Computer Science from NIT Delhi, completed in 2019. His tech stack includes Data Engineering, Kafka, Apache Airflow, Kubernetes, and infra. Amit is a proactive problem solver with a passion for data engineering and a keen eye for detail. He is a team player with excellent communication skills, always willing to go the extra mile to ensure the successful delivery of projects. Amit is now seeking a challenging role that will allow him to leverage his skills and experience to drive innovation and growth in an organization.