About

Divyank Khandelwal is a highly skilled Senior Big Data Engineer with 7 years of experience in data engineering, specializing in data migration and transformation through different layers. With expertise in working with huge data sets, he has worked with different file formats such as Avro, Parquet, Orc, and text files. Divyank has extensive experience working with different databases like PostgreSQL, Oracle, SQL Server, and MySQL. He is well-versed with Agile methodologies and has worked in an Agile team. Divyank has worked on Big Data Ecosystems such as Hadoop, MapReduce, Spark, HDFS, Yarn, Zookeeper, Hive, Sqoop, Oozie, Flume, Hue, Kafka, MongoDB, Apache Nifi, Databricks, Neo4J, Hbase, and Azure. He has implemented Scala Code for the Ingestion and Cleanse Layer to ingest data through SFTP Server to Databricks and ADLS location. He has improved the performance of the Ingestion job by parallelizing the ingested files using Scala Futures, and improved the code vulnerability such as Heap Memory Leakage using SealedObjects. Divyank has also designed and presented ideas related to notification generation, wrote Python code for Azure Trigger Functions, and worked with Azure KeyVault to create EventHub. He has worked on success and failure email notification and used Azure Databricks Notebook for different POCs. He has used SQL Server to store metadata info and worked with Azure DevOps to run pipelines. Divyank holds a Bachelor's degree in Information Technology from Sardar Patel Institute of Technology and a Science degree from Navrachana University. He is proficient in SQL, Data Engineering, Databricks, Big Data, Spark, Azure, Snowflake, Python, MongoDB, Hadoop, Kafka, Scala, Apache Hive, Neo4j, HDFS, Software Engineering, MapReduce, MySQL, and DevOps. Divyank is seeking a responsible position in a dynamic organization where he can utilize his full potential for the organization's growth and his professional development. He is a CCA Spark and Hadoop Developer with 9.35 years of relevant experience.