About

Amit Singh Sansoya is a skilled software engineer with a passion for building web applications and sophisticated automated ETL pipelines. He is experienced in working with C++, Python, Scala, Spark, Java, Airflow, and AWS. Currently, he is working as a Senior Software Engineer at Browserstack, where he has developed the orchestration layer for the ETL pipeline for the TVD-M product, involving API-based request processing over the ETL pipeline using AWS services (Lambda, SQS, EMR), Airflow, Flask, and MySql. He has also designed custom APIs to monitor various jobs of ETL, perform operations over the dataset, generate a report over the data stored in the AWS S3, and identify the corrupt partitions in data stored in the S3. Amit has regularly worked on various datasets, improving their quality, resolving bugs, and customer issues. He is involved in the exploration of datasets using Scala, Spark, Python, AWS (Athena & EMR), and Qubole. He has also migrated various ETL pipelines to the Distributed Airflow environment to manage the job loads, reducing the ETL failure rate of the pipeline by 83.5% by adding auditing and restarting algorithms. Prior to Browserstack, Amit worked as a Software Engineer at TiVo, where he migrated the codebase of the Weekly ETL Pipeline to the new design using design patterns like Abstract Factory Design and Strategy Design Pattern. He also developed an Inhouse Metric Application that allows you to onboard metrics generation and ingestion from various Query Processors and Databases (Athena, MySql, Influx). Amit has a Bachelor's degree in Computer Science from Lovely Professional University, where he graduated in 2020. He has also completed a Programming Workshop from Programming Pathshala in 2019. Before that, he completed his Higher Secondary education in Science from Khalsa Model Senior Secondary School in 2016. Amit's technical skills include AWS, ETL, Software Engineering, Spark, Python, Amazon Athena, Apache Airflow, Flask, Scala, MySQL, Web, Designer, Jenkins, Javascript, and UI. With 2.79 years of relevant experience, Amit is a competent software engineer who is always exploring and learning about the world of distributed and scalable systems.