About

Vinay Danepalli is a highly skilled Systems Engineer with 2.35 years of relevant experience in the field. He is currently working at TCS, where he has built end-to-end data pipelines to migrate batch and near real-time data from on-premises to GCP using Apache Kafka, Apache Nifi, CDC, and GCP Services like Google Cloud PubSub, Google Cloud Managed Instances, Google Cloud Storage, Airflow, Python, and SQL. He has also developed python-based applications automating data ingestion pipeline and performing ETL on big data, thereby reducing 99% manual labor. Vinay has generated data visualization reports using Data Studio, Qlik Sense, and Tableau and automated the pipeline to load data from different file types, including but not limited to EBCDIC/ASCII encoded fixed-width files placed in Google Cloud Storage as ASCII data in Big Query enterprise data warehouse. The automation reduced the load time to an hour (without manual intervention) from multiple days (involving manual intervention and monitoring at every step). Vinay has also developed and scheduled Cross-DAG dependent jobs using Airflow to run automation scripts and Machine Learning models that consume ingested data for model training and evaluation on Dataproc clusters. In his previous role at TCS, he provided production support to trace existing data quality issues to their roots and resolve them to improve model training efficiency by 70%. He also developed pipelines to automate data ingestion and ETL operations using Python, Google Cloud PubSub, Google Cloud Managed Instance Groups, and Stack Driver. Vinay has a Bachelor of Technology in Computer Science and Engineering from Vardhaman College of Engineering (VCEH) and is currently pursuing a Masters in Computer Science from Purdue University, which will be completed in May 2024. He also has an Intermediate degree from Sri Chaitanya Junior Kalasala. Vinay is proficient in Python, ML, Data Science, Apache Airflow, SQL, GCP, Data Warehouse, Big Data, Kafka, ETL, and software engineering. He is a highly motivated and dedicated individual who is passionate about using data to solve complex problems.