About

Rahul Shivu Mahadev is a highly skilled software engineer at Databricks with a focus on distributed systems and databases. With almost 4 years of experience in the tech industry, he has worked on a variety of projects that have honed his skills in big data, research, and blockchain technologies. Currently, Rahul is a part of the Stream team at Databricks and is working on Delta Lake, a storage layer that brings ACID transactions to big data workloads. His role involves designing and implementing distributed systems that can handle large-scale data processing and storage. Prior to joining Databricks, Rahul worked as a software engineering intern at Cloudera where he worked on Apache Impala. He implemented Distributed Runtime Filtering Aggregation, which changed the way runtime filters are aggregated in Impala. This led to a 200% improvement in memory consumption and a 5% improvement in query performance. His work was recognized with the Best Intern Project award in 2018. Rahul also worked as a Graduate Research Assistant at Decentralized Systems Lab where he worked on HoneybadgerMPC, a scalable and robust asynchronous multi-party computation framework. He helped scale the system to 200 geo-replicated EC-2 nodes and published his work in the 2019 ACM CCS. Additionally, he worked on Cloaking Fabric, a confidentiality layer for Hyperledger Fabric blockchain, which he built using HoneybadgerMPC as a system chaincode. Rahul holds a Master of Science degree in Computer Science from the University of Illinois at Urbana-Champaign, where he graduated in 2019. He also holds a Bachelor of Engineering degree in Information Technology from PES University, where he graduated in 2016. Rahul completed his schooling at Bishop Cotton Boys' School, where he received a Bachelor of Engineering and a Bachelor's degree. Rahul's technical skills include software engineering, big data, research, blockchain, and decentralized systems. He is a highly motivated and skilled engineer who is constantly seeking out new challenges and opportunities to grow and develop his skills.