About

Dibyendu Karmakar is a highly skilled Software Engineer with 6.87 years of relevant experience in the field. Currently, he is working as an SDE III at Swiggy, where he is a part of the Data Intelligent Platform Team. He is responsible for designing, developing, and maintaining platforms for Big data & Analytics use cases, Data science use cases, and feature engineering. Dibyendu has contributed to various projects at Swiggy, including building a Data Lake with Change Data Capture, designing an end-to-end fully automated and self-serve Data Lake with CDC pipeline, and building a machine learning platform to serve high throughput and low latency model prediction requests. He has also led multiple initiatives to optimize costs, performances, etc. He has used various technologies such as Apache Hudi, Spark, Kafka, Snowflake, Databricks Delta, Databricks runtime, EMR, S3, etc. to build these systems. Prior to Swiggy, Dibyendu worked at Huawei's Hadoop kernel team, where he worked on HDFS kernel development and HDFS router-based federation. He has also worked at Cognizant as a Programmer Analyst. Dibyendu holds a Master of Technology (MTech) degree in Computer Science from the Indian Institute of Technology, Kharagpur, and a Bachelor of Technology (B.Tech.) degree in Computer Engineering from Jalpaiguri Government Engineering College. He also has a Higher Secondary degree in Science from Kenduadihi High School. Dibyendu has a strong technical background and is proficient in various technologies such as HDFS, Snowflake, Spark, Databricks, Kafka, Big Data, ML, Data Scientist, MySQL, Hadoop, ETL, Senior Software Engineer, Research Scientist, Apache Hive, Scala, Golang, and Java. He has also made several open-source contributions to Apache Hadoop.