About

Rahul P. is an experienced Software Engineer with over 5 years of experience in the internet industry. He is skilled in Python, Statistical Data Analysis, Scala, and Big Data Platforms. Rahul holds a Dual Degree in Industrial Engineering from IIT Kharagpur. Currently, Rahul works as a Senior Site Reliability Engineer at Shopify, where he is responsible for the development and maintenance of a log collection and processing system that handles around 10k events per second. He has also developed a real-time data analysis infrastructure to detect key performance parameters on the go and generate corresponding alerts. Rahul has revamped the existing real-time, near real-time ETL pipelines to achieve higher data quality and 40% savings over infrastructure cost. He has also headed and mentored a team of four people responsible for handling transaction-related data analysis for over 30 merchants. Prior to Shopify, Rahul worked as a Senior Data Engineer at Grab, where he was responsible for the development and maintenance of the Presto system spanning over various clouds and supporting more than 3000 users across the company. He also developed an in-house orchestration platform that handles all cluster deployments to provide a cost-effective way to process data in case of both ETL and ad-hoc workload. Rahul has also worked as a Software Development Engineer (Data) at Juspay, where he was responsible for the development and maintenance of a log collection and processing system that handles around 10k events per second. He developed a real-time data analysis infrastructure to detect key performance parameters on the go and generate corresponding alerts. Rahul also revamped the existing real-time, near real-time ETL pipelines to achieve higher data quality and 40% savings over infrastructure cost. He headed and mentored a team of four people responsible for handling transaction-related data analysis for over 30 merchants. Rahul's technical expertise includes SRE, infra, ETL, Software Engineering, Data Engineering, Big Data, Python, and Scala. He has a demonstrated history of working in the internet industry and is a strong engineering professional.