About

Abi Vignesh is a highly skilled Data Engineer with over 4 years of professional experience in Big Data and Analytics. Currently working as a Data Engineer at Groupon, he specializes in Search Marketing Analytics and Revenue Management. Abi is proficient in a range of technical skills including Java, Python, Hadoop ecosystem, MySQL, Teradata, AWS EMR, S3, EC2, CloudFormation, SNS, GCP Dataproc, Storage, Composer, Airflow, Oozie, Snowflake Data Warehouse, Shell and Unix Commands, CI/CD tools like Azure DevOps and Jenkins, Version control (Git), Agile Development, and Search Engine Marketing (Google Adwords, Bing Ads). Abi is a problem solver with the ability to debug and identify root causes for bugs in a timely manner. He is a strong communicator who can talk tech to business people. Collaborative by nature, Abi can work with product owners and data scientists to understand their needs and fulfill them. He is a team player who can work with engineers and leaders of all levels and continuously aid and learn from them. Abi has worked for Groupon as a Data Engineer 2 and now as a Data Engineer 3. In his current role, he is responsible for end-to-end delivery of data products including requirement gathering, development, testing, and deployment to production. He has developed and production-ized multiple data projects handling ~500 GB per day from multiple sources using PySpark, Hive, Python, Airflow & Teradata. Abi has also automated multiple manual jobs that moved data from spreadsheets to HDFS and introduced pipeline testing in Hadoop using Python. He improved the performance of existing applications through analysis and property tuning, reducing SLA by 1-hour every day, thus providing data early to analysts and data scientists for their use. As a side project, he built a SLA Monitoring Dashboard that displays the daily running status of all data pipelines owned by his team. Abi has also catered to multiple adhoc data/report requests from data analysts and business people. Prior to Groupon, Abi worked for Caterpillar as a Software Engineer/Senior Associate Engineer. He designed and developed highly scalable ETL pipelines involving a combination of Spark programs, Hive, and MySQL queries. He created and executed complex ETL workflows using Apache Oozie for real-time monitoring and management. Abi played a key role in migrating the entire application from running on on-pre