About

Utkarsh Rai is an aspiring software architect and a Data Engineer at C2FO. He has a Bachelor of Engineering in Computer Science from Birla Institute of Technology and Science, Pilani. With over 3 years of experience in the field of Data Engineering, Utkarsh has a strong background in Spark, Python, Hadoop, AWS, Scala, Kafka, Apache Airflow, and Elastic Search. At C2FO, Utkarsh is a part of the File Ingestion and Profile Management team, where he writes modules in Scala and Python to translate large volumes of JSON and XML data into familiar schemas for other teams to analyze. He also ideates data flow pipelines and constructs them on Apache Airflow for orchestration and management. He works on their deployment on Apache Spark using Hadoop-friendly clusters on Amazon EMR. Prior to C2FO, Utkarsh worked as a Data Engineer at Jio, where he primarily worked with machine log parsing. He created Kafka connectors using Scala to ingest logs sent on the particular topic and process them as per the design requirements. He also implemented the Streaming Parsing of System Event Logs using LCS for better analysis of new logs. Utkarsh has also worked as a Consultant - Software Development at Pritzker School of Molecular Engineering at the University of Chicago, where he was a part of the Thoreau project under Prof. Guha. He implemented a CSV to dashboard pipeline using Django and Postgres and worked on image layering on maps using the Mapbox API. In addition to his technical skills, Utkarsh has experience in AI, ML, and Data Science. He is a Senior Software Engineer with expertise in Javascript, Search, and Postgres. With his diverse skill set and experience, Utkarsh is a valuable asset to any organization looking for a skilled Data Engineer or Software Architect.