About

Rakesh Raushan is a Senior Data Engineer with a passion for Apache Spark and Scala. With over 3 years of development experience in Apache Spark, he has become an active open-source contributor in the Spark community. Currently, Rakesh is working with Visa as a Senior Data Engineer. In his previous role as a Software Engineer at Huawei, Rakesh's focus was on Spark SQL and Catalyst. He introduced incremental statistics to Spark, which automatically updates stats after every data-changing command, making CBO performant and reliable. Additionally, he worked on dynamic UDF, allowing users to update their UDF without restarting the session. Rakesh also upgraded Spark's built-in Hive version to 3.1 and contributed some of his work back to open source, including 25+ commits, two built-in functions, refactoring of pagination framework, 10+ bug fixes, and some documentation changes. Rakesh holds a Master of Technology in Computer Science from the Indian Institute of Technology, Delhi, and a Bachelor of Technology in Computer Science from Amity School of Engineering and Technology, IPU Delhi. His technical skills include Data Engineering, Spark, SQL, Scala, ETL, Apache Hive, Software Engineering, and Python. With 3.70 years of relevant experience, Rakesh is a skilled data engineer with a strong focus on Spark and Scala. His passion for open source and contribution to the Spark community showcase his commitment to staying up-to-date with the latest technologies and trends in the field.