About

Kunal Bhattacharya is a highly skilled Data/Software/Backend Engineer with almost 10 years of experience in building analytical solutions to address complex business questions related to data storage, processing, and cleaning. He is an expert in developing optimized ETL pipelines and low latency data-intensive systems and works with huge and disparate data sets using a variety of technologies such as BigData, RDBMS, Data Management, Programming Language, NoSQL, ALM Tools, CI/CD, File Systems, Schedulers, AWS, Azure, and Containerization. Kunal has worked on several high-impact projects, including leading the architectural re-platform data team for Provider Finder - Find Care application at Carelon Global Solutions. He was responsible for developing the entire backend data pipeline that powers Find Care using big data and cloud technologies, implemented 2000+ business rules using AWS and PySpark for multiple markets, and was a key contributor to the architectural redesign to shift from Apache Solr to ElasticSearch for faster and more accurate search responses. He also removed daily full load dependency by developing delta capabilities using Apache Hudi, reducing the end-to-end data load time from 36 hours to 3 hours. Kunal has also worked as a Senior Engineer - Data Engineering at Enquero, where he worked on the design and development of data lake for a client, delivered a PoC to migrate the ETL solution of an FMCG client to AWS, and implemented a reconciliation algorithm for 200+ portfolios using PySpark and Bash. Kunal is a keen student of software development and is currently learning to contribute to open source projects on GitHub. He has a Bachelor of Engineering in Civil Engineering from Jadavpur University and has also completed self-learning courses in Computer Science. In his free time, Kunal enjoys watching football, reading books, and collecting stamps.