About

Rohan Gupta is a skilled Data Engineer II at Expedia with a background in software development for Big Data. With 3.78 years of relevant experience, he has honed his skills in working on Spark data processing pipelines and their deployment and automation requirements. Rohan started his career as a Software Engineer at Guavus, where he primarily worked on developing Spark-based data processing applications in Java/Scala to calculate KPIs for telecom operators. He is fluent in Spark-SQL and has intermediate working knowledge of Spark Internals. He has also worked on different frameworks inside the Hadoop ecosystem, including HDFS, YARN, Hive, and Kafka. At Guavus, Rohan developed end-to-end automation of Spark-structured streaming data pipelines using Guavas' proprietary automation framework based on Python. He also worked on developing CI/CD pipelines on Jenkins and Ansibles and Helm charts for Dockerized applications. He has working knowledge of Kubernetes, which he has used to deploy and manage containerized applications. Rohan is a Bachelor of Technology (BTech) graduate in Computer Science from iiit, where he studied from 2015 to 2019. His TechStack includes Data Engineering, Spark, Kubernetes, Kafka, Jenkins, Big Data, Software Engineering, Docker, Spring Boot, Spring, ETL, Scala, Java, SQL, HDFS, CI/CD, Hadoop, and Apache Hive. With his expertise in Big Data and software development, Rohan is an asset to any organization looking to build and deploy data processing pipelines at scale.