About

Ajay Dubey is a skilled Data Engineer with over 13 years of experience in designing and developing big data projects. He has expertise in Spark Streaming, Kafka, AWS, Azure, C#, Java, Scala, Hadoop, Hive, Airflow, Distributed Systems, DevOps, Data Warehouse, Spark, Data Lake, Snowflake, Microservices, and Kubernetes. Ajay has managed end-to-end software development lifecycle of products and projects with a geographically distributed team of people working in open source and latest technologies/products, delivering multiple big data solutions. In his current role as a Senior Technical Lead Big Data at Airtel, Ajay is responsible for guiding the full lifecycle of a real-time and batch distributed data platform solution. He has built a Generic Real-Time processing platform to cater to both batch and real-time data pipelines use cases on a massive scale. Prior to Airtel, Ajay worked as Technical Lead Big Data at Macquarie Group, where he was responsible for implementing PoCs for big data, expanding the team size, and creating the architecture for data lake solution on AWS Cloud. He also worked as a Senior Associate Big Data at Publicis Sapient, where he was involved in gathering business requirements, performing data mapping for different user stories in agile mode, and implementing big data solutions using Scala, Hive, and Spark in IntelliJ IDE. Ajay holds a B.Tech. degree in Electronics & Communication from Netaji Subhas University of Technology, East Campus, and a Bachelor of Technology (B.Tech.) degree in Electrical, Electronics and Communications Engineering from Kala Niketan Sr Secondary. He is proficient in languages like Java, Scala, C#, and Python, and has expertise in Hadoop/Spark eco-systems, NoSQL databases, databases like SQL Server, Sybase, and PostgresSQL, message queues like Kafka, Rabbit-MQ, and ZeroMq, microservices like Spring Boot, Web API, Docker, and Kubernetes, cloud providers like Azure and AWS, orchestration tools like Oozie and Airflow, and data pipelining tool Nifi. Ajay is a Senior Software Engineer with relevant experience of 14.53 years. He has a strong technical background in performance improvements, system design, and distributed systems.