About

Harsh Jangid is an experienced Big Data Engineer and Cloud Computing expert with a strong background in Spark/Hadoop development. He is currently working as a Data Engineer at Envestnet, where he is responsible for developing and managing data pipelines for various data sources using Apache Spark and Hadoop ecosystem. Harsh has also worked as a Data Engineer at WebbMason Analytics and as a Big Data Engineer at Oalva, Inc. During his tenure at these companies, he worked with clients in the finance domain to migrate from traditional databases to Hadoop Data Lake. He has extensive experience in working with various Big Data technologies such as AWS infrastructure, Hortonworks platform, and Hive metastore interaction, among others. Harsh has a passion for Machine Learning and AI and has contributed to a new project using TensorFlow to build an application to prevent ATM skimming. He has also used Spark for interactive queries, processing of streaming data, and integration with DynamoDB NoSQL database for huge volumes of data. Harsh has a strong technical background in Cloud Technologies such as Amazon Web Services (AWS), including EC2, S3, EBS, RDS, EMR, IAM, Athena, and VPC. He has experience in job management, monitoring, and scheduling of dependent and independent jobs triggering using Oozie workflows. Harsh is skilled in performance tuning of Spark applications using parallelism, Broadcasts in Spark, Effective & efficient Joins, Parquet and ORC dataset optimization, memory, and resources with Transformations and other during ingestion. He has worked on JSON, CSV, XML, and fixed-width format data and created processed data/table in Parquet and ORC data formats to store in to table in HDFS and S3. Harsh holds a Master of Science in Computer Science from the University of Central Missouri and a Bachelor of Technology in Mechanical Engineering from the National Institute of Technology Raipur. He has a strong Tech Stack, including Data Engineering, Spark, Big Data, Hadoop, AWS, HDFS, ETL, infra, Apache Hive, AI, Amazon Athena, Scala, ML, TensorFlow, NoSQL, DevOps, Salesforce, Integration, and Web. He has relevant experience of 8.96 years.