About

Dipayan Som is an accomplished Data Engineer with a strong background in designing and developing scalable Data Pipelines for processing Terabytes of data per day. He is currently working as a Software Engineer II at PayPal, where he leverages his expertise in Spark, SQL, Python, Scala, and Data Warehouses to handle massive data-driven use cases. Dipayan is also certified in AWS Solutions Architecture and DataBricks Certified Spark Developer. Dipayan has a proven track record of working with product teams to understand business requirements and designing Data Pipelines at scale. He has developed these pipelines using Spark, PySpark, Scala/Python, and cloud platforms like AWS and GCP. Dipayan has also released products for consumers, showcasing his ability to work collaboratively with cross-functional teams. Prior to joining PayPal, Dipayan worked as an Associate-projects at Cognizant, where he received six awards in two years. He worked in the Healthcare/Retail Domain as a PySpark Developer/AWS Data Engineer, building data pipelines using distributed compute platforms like Spark, Redshift, and native AWS technologies. Dipayan also programmed with Python and SQL and worked with NoSQL databases like DynamoDB and DWH AWS Redshift. Dipayan holds a B.Tech in Computer Science & Engineering from West Bengal University of Technology, where he graduated in 2019. He also completed his 10+2 in Science from West Bengal Council of Higher Secondary Education in 2015 and his 10th grade from West Bengal Board of Secondary Education in 2013. In addition to his technical skills, Dipayan is well-versed in FinTech, having gained a strong understanding of it while working at PayPal. His tech stack includes AWS, Spark, Data Engineering, GCP, Databricks, SQL, Python, Scala, ETL, Kafka, NoSQL, MongoDB, HDFS, Neural Networks, Hadoop, Apache Hive, Web, Apache Airflow, Big Data, Cassandra, and Mobile. With almost four years of relevant experience, Dipayan is a highly skilled Data Engineer with a proven ability to work on complex projects and deliver results.