About

Rishul Aggarwal is an experienced Engineering Manager with a strong background in designing and developing distributed systems for petabyte scale and millisecond latencies. He is currently working at Prophecy, a low code data engineering platform for Spark and Airflow, where he leads the engineering efforts for the Spark Execution team. In this role, Rishul is responsible for hands-on development and end-to-end ownership of highly optimized and distributed Spark code execution in Prophecy SaaS and On-premise deployments on the cloud. Prior to his current role, Rishul worked as an Engineering Manager and Senior Software Engineer at Domino Data Lab, where he was part of the MLOps team that created an industry-leading Model Monitoring system to enable enterprises to handle ML operations in production at scale. During his time at Domino, Rishul scaled the compute engine of the Domino Model-Monitor by 1000x to support computing Model Quality metrics for machine learning models with datasets up to a few terabytes in size. He also led the project to improve the security posture of the enterprise Domino Model-Monitor product, reducing the number of security vulnerabilities to almost 10% of the original number. Rishul holds a Bachelor of Engineering in Computer Engineering from Netaji Subhas Institute of Technology and completed his high school education in Mathematics and Computer Science from Delhi Public School, Dwarka. He has over 8 years of relevant experience and is highly skilled in Senior Software Engineering, Spark, Search, AWS, Data Engineering, Apache Airflow, NoSQL, Big Data, ML, Python, Scala, Java, MySQL, Microservices, PHP, Spring, Backend, and Web. Rishul is a dynamic and results-oriented professional who is passionate about building high-quality distributed systems that can scale to meet the demands of modern enterprises.