About

Debdeep Banerjee is a Senior Software Engineer at Visa Inc. with a passion for computers and technology. He has a keen eye for building products that solve real-world problems and believes in the power of programming to transform and improve people's lives. Debdeep loves to code and has a diverse skillset in various Big Data frameworks such as Spark, Hive, Sqoop, Kafka, Oozie, and Scala. Currently working for a telecom giant in the UK, Debdeep has streamlined various data preprocessing, deduplication, transformations, and imputations using Spark, shell scripts, and optimized various Spark jobs using different caching, parallelism mechanisms, and vcore optimization. He has also worked on Azure Data Factory and Azure Databricks and created pipelines in ADF using Linked Services/Datasets/Pipeline Activities and integrated custom Databricks notebooks written in PySpark into ADF Pipelines for an automobile giant in the US. In addition, Debdeep has worked for a US Fashion company with PySpark, AWS EMR, Glue, Redshift, and Apache Airflow and implemented various transformations, joins, imputations, and deduplication on datasets. He has also worked on a cloud migration project for migrating on-premise Oracle Hyperion Planning and Oracle Hyperion Financial Management to their cloud version, namely Oracle Planning and Budgeting Cloud Services and Oracle Financial Consolidation and Close Cloud. Debdeep has completed his Bachelor of Technology in Electrical Engineering from Maulana Abul Kalam Azad University of Technology, West Bengal, formerly WBUT, and a Nanodegree in Product Manager and Data Engineering from Udacity. He also holds a Bachelor of Technology in Electrical Engineering from Techno India Salt Lake. Debdeep has a diverse tech stack that includes Software Engineering, Spark, AWS, Azure, Databricks, Apache Airflow, Big Data, Kafka, Scala, Java, and Apache Hive. With 2.86 years of relevant experience, Debdeep is a highly skilled software engineer with a passion for building innovative solutions to real-world problems.