About

Amogh Shivappa is a Senior Staff Engineer at Qubole, where he leads the technical development of Qubole's Spark-as-a-service offering on the cloud. With over 14 years of relevant experience, Amogh has played a pivotal role in driving the growth of Qubole's customer base by 70% YoY in "Qubole hours" and 2X in Spark commands and clusters. Amogh's projects and responsibilities at Qubole include designing and open-sourcing ACID support for Apache Spark, leading multiple performance-related projects and query optimization, and improving reliability, usability, and governance for Qubole Spark. He is also responsible for conducting design and code reviews, mentoring, developing best practices and processes, creating technical roadmaps, and communicating with customers. Prior to his current role, Amogh served as a Staff Engineer at Qubole, where he developed Presto-as-a-service on the cloud and led several projects, such as SQL optimizations, workload-based auto-scaling clusters, and S3 optimizations. He also worked on developing a Big Data Intelligence Framework that analyzes customers' Big Data stacks and provides automated insights, alerts, and recommendations to improve data models and performance/cost of the stack. Amogh holds an MS degree in Computer Science from the Indian Institute of Science, where he studied from 2010 to 2012. He is proficient in several technologies, including Spark, AWS, SQL, Apache Hive, product management, integration, senior software engineering, big data, and software engineering. Overall, Amogh is a highly experienced and skilled engineer with a proven track record of driving innovation and growth in the Big Data industry. His technical expertise, leadership abilities, and commitment to excellence make him a valuable asset to any organization.