About

Arpan Samariya is an aspiring Data Engineer with over three years of relevant experience in building and architecting multiple data pipelines, end-to-end ETL and ELT processes for data ingestion and transformation using Spark, Scala, HDFS, Hive, SQL, Kibana, ElasticSearch, and Apache Airflow. He is currently working as a Data Engineer I at HealthifyMe, where he is responsible for building microservices for NRT jobs using Spark Stream, Apache Kafka, and Spring. Arpan has previously worked as a Data Engineer at Optum, where he extensively built data pipelines with ETL architecture and scheduled them on Airflow. He also developed NRT jobs with Apache Kafka and Spring Boot and built frameworks and reusable components to ease the development process for multiple jobs. He was actively involved in exploring and developing POCs for migration from on-prem to Azure Databricks. Arpan has also worked as a Remote Developer at Outstrip, where he worked on an integrated social media platform Facebook and integrated Twitter into the product. He fetched data through API calls and displayed the results obtained after processing them. Arpan holds a Bachelor of Technology (B.Tech.) degree in Computer Science from the National Institute of Technology Hamirpur and completed his senior secondary education from Vindhyachal Academy, Dewas. He is proficient in a wide range of technologies, including Azure, Databricks, SQL, Spark, Kafka, Microservices, ETL, Scala, Spring, HDFS, Elastic Search, Web, MongoDB, Spring Boot, AWS, Python, Apache Hive, Javascript, Terraform, Big Data, RabbitMQ, Kubernetes, Docker, Research Scientist, Hadoop, DevOps, Flask, and Software Engineer. Arpan is always up for challenging roles and is currently learning and exploring Databricks, DeltaLake, and Azure. He has also built various frameworks and reusable components to enhance development processes. With his expertise and experience, Arpan is a valuable asset to any organization looking for a skilled and dedicated Data Engineer.