About

Abhishek Modi is a highly skilled Senior Staff Software Engineer at Google, with a passion for solving complex engineering problems in distributed systems and big data space. With over 11 years of relevant experience, Abhishek has worked with some of the leading technology companies in the world, including Microsoft and Google. At Google, Abhishek is responsible for developing innovative solutions for complex engineering problems, leveraging his expertise in Spark, Azure, Hadoop, and other cutting-edge technologies. He is committed to delivering high-quality software solutions that meet the needs of his clients and customers. Prior to joining Google, Abhishek worked as a Principal Engineering Manager at Microsoft, where he led the Apache Spark team in India. During his time at Microsoft, Abhishek worked on making Apache Spark performant, resilient, scalable, and cloud-native. He improvised Spark catalyst optimizer to improve query performance by more than 2x and leveraged the flexibility of the cloud to scale-up and scale-down Spark clusters based on job requirements. Abhishek also used hardware accelerators (FPGA) to speed up some of the heavily used Spark operators and developed a native execution layer for Spark operators like hash aggregation and sorting. Abhishek's expertise in distributed systems and big data space is evident from his work at Microsoft, where he led the Apache Hadoop team to run Cosmos, a 300 thousand node cluster. He developed Yarn Federation, Yarn opportunistic container support, HDI auto-scaling, and Dhalion, a generic healing and auto-scaling platform. He also started the Apache Spark India team for improvement on Apache Spark. Abhishek holds a BTech in Electronics Engineering from the Indian Institute of Technology, Varanasi, and an Intermediate degree in Physics, Chemistry, and Mathematics from Birla Senior Secondary School. His tech stack includes Senior Software Engineer, Software Engineer, Spark, Azure, Big Data, and Hadoop. Abhishek is a highly motivated and passionate engineer, committed to delivering high-quality software solutions that meet the needs of his clients and customers. He is a valuable asset to any team, and his expertise in distributed systems and big data space is highly sought after in the industry.