About

Shivam Gupta is a highly skilled Senior Engineer in Data Engineering at Qualcomm with a strong background in Fullstack and DevOps development. He has over 2 years of professional experience in the field and is proficient in a variety of technologies, including AWS, Python, Web, CI/CD, Big Data, Django, ML, MySQL, and NoSQL. At Qualcomm, Shivam has been instrumental in driving the success of several key projects. He has performed cost analysis and resource optimization for AWS cloud, saving approximately $5K/month. He mentored a Junior Engineer and performed a disaster recovery drill, implementing an AWS CDK that allowed for the deployment of a complete data pipeline in under 20 minutes. He solved a major bottleneck in scaling due to IP starvation by reimplementing VPC Infrastructure, and he completely automated Cloud Infrastructure Deployment by adopting AWS CDK to achieve true "Infrastructure is code" status. Shivam also developed a customized CI/CD from scratch and integrated 3+ highly customized jobs that are active in production, saving hours of manual work. He conducted comprehensive comparison-based research on Big data file format selection and got AVRO adopted as the primary storage format. He received appreciation for developing a Cloud Formation script for a notifier based on Lambda for a confidential gov entity. Shivam's educational background includes a Master of Technology in Computer Science from Delhi University and Netaji Subhas Institute of Technology, as well as a Bachelor of Technology in Computer Science from Jaypee University of Information Technology. With 2.86 years of relevant experience, Shivam is a highly motivated and skilled professional who is passionate about using his expertise to drive innovation and success in the field of data engineering.