About

Ayush Trivedi is a highly skilled Senior Software Engineer with extensive experience in developing big data applications. He is particularly interested in exploring the vast horizons of big data and its usage with the help of machine learning and AI. Ayush has a proven track record of working on churning and analyzing data related to the CPG industry. Ayush has used advanced SQL queries on AWS Redshift/Azure SQL to build complex logic for big chunks of data. He is also proficient in migrating the entire data to AWS S3 data lake/Azure data lake and scaling up the present spark ETL processes on AWS EMR/Azure hdinsight. Ayush leverages multiple libraries in Python for data pre-processing and is capable of orchestrating end-to-end processes from data processing to modeling using shell scripting and putting it into a single working framework. Ayush has migrated from the existing usage of On-demand EC2 instance to Spot EC2 instance, which reduced the overall churn cost by around 70%. He has also developed ANTLR grammar and listener that converted 40k lines of SAS code to the required structure in 2 seconds, which reduced manual effort. Currently, Ayush is working as a Senior Software Engineer at Thales. Prior to this, he worked as a Senior Engineer at Mindtree. Ayush completed his Bachelor of Technology (B.Tech.) in Computer Science from Jaypee Institute of Information Technology, Noida in 2017. Ayush is proficient in AWS, SQL, Azure, Big Data, Spark, Java, ETL, AI, ML, Python, HDFS, Data Engineering, MapReduce, and Hadoop. He has relevant experience of 5.86 years and is always eager to learn new technologies and explore new domains.