About

Rohit Pandey is a highly skilled Senior Data Engineer with 8 years of experience in building data-intensive applications. He has a strong background in distributed systems and processing large-scale data streams, including design and development of Big Data applications with Cloud technologies based on microservices architecture. Rohit is an enthusiastic Python programmer with a deep understanding of Hadoop Ecosystem, Cloud Technologies, Web Frameworks, Container Technology & Orchestration, Databases, and Tools & Platforms. Currently, Rohit is working as a Staff Engineer at Nagarro, where he designs and develops Data Engineering ETL pipelines using Kedro framework on Databricks platform to process real-time agronomic, biological, climatological, economic, and geospatial data. He has also designed Delta Lakes on Databricks platform to simplify data architectures and enable data storage. Rohit has analyzed and cleaned the datasets with millions of data points on global agriculture from hundreds of government and non-government agencies and made them available for insights. He has created REST APIs using Python to fetch the data from millions of data points and load data into Databricks Delta Table and PySpark datasets in the form of a parquet file. In addition to his current role, Rohit has previously worked as a Senior Software Engineer at Nokia and Autogrid, where he designed and developed data ingestion pipelines and frameworks, implemented REST APIs using Python and Flask, and created workflows for automating tasks. He has experience in analyzing large datasets with in-memory data structures using Pandas and evaluating and researching emerging technologies in IoT and Analytics, and building new practices within the firm to capitalize on these new sectors. Rohit holds a Bachelor's degree in Computer Software Engineering from RGTU Bhopal. He is proficient in AWS, Databricks, Python, Redis, MySQL, Kubernetes, Docker, Data Engineering, Kafka, Flask, Azure, Django, Spark, ETL, Amazon Athena, Web, SQL, Software Engineer, Microservices, Big Data, AWS Glue, Backend, Hadoop, Jenkins, Search, Pandas, and Research Scientist. Rohit has a relevant experience of 8.44 years and is a highly motivated and dedicated individual who strives to deliver high-quality work.