About

Saurabh Dubey is a highly skilled Lead Data Engineer with over 6 years of experience in application development and data analytics, specializing in SQL and Big Data technologies. He is currently working at Enquero, where he brings his expertise in Big Data solutions using frameworks like Spark and Hadoop ecosystems like HDFS, Map Reduce, Hive, and Sqoop. Saurabh has in-depth knowledge of Spark architecture, including Spark core, Spark SQL, dataframe, and RDD, and has extensive experience in Hadoop ecosystem tools like Hive, Pig, Sqoop, HDFS, and Yarn. He is also proficient in coding with Python and has worked with Python libraries like Pandas and NumPy. Saurabh's experience includes writing complex SQL queries and working with different RDMBS sources like Oracle, MySQL, SQL Server, and Aurora DB. With his experience in Agile/Scrum process models, Saurabh has excellent communication, creative, technically competent, problem-solving, and leadership skills. He has also worked with different file formats in HDFS, migrated coding from SQL to Hive scripts, and used Apache Airflow for job orchestration. Saurabh has created data ingestion pipelines for Datalake and has experience in writing shell scripts. Before joining Enquero, Saurabh worked as a Data Engineer at Brilio and a Senior Software Engineer at CenturyLink Technology Solutions. He holds a B.tech degree in Electronics and Communication Engineering from Maharishi Arvind Institute of Engineering and Technology. Saurabh's technical skills include Data Engineering, SQL, Spark, Python, HDFS, Hadoop, Big Data, Apache Hive, Apache Airflow, Pandas, MySQL, and Software Engineering. With 8.36 years of relevant experience, Saurabh Dubey is a highly skilled Lead Data Engineer with a proven track record of delivering successful projects in the field of data analytics and application development.