About

Harsh Kapoor is a highly skilled Software Development Engineer with over 10 years of relevant experience in the field of Big Data and Data Engineering. He has worked with some of the top companies in the industry, including Amazon and Deloitte, and is currently working as an SDE3 at Embibe. Harsh is an expert in designing and implementing Big Data projects using Hadoop Ecosystem tools such as Hive, Apache Spark, Kafka, Spark SQL, Hadoop MR, Python, Scala, and Core Java. He has experience in application design and development, data migration, and data transformations. He is also well-versed in Spark/YARN Architecture, Spark SQL, MR, and Core Java. Harsh has a proven track record of building and maintaining multi-terabyte data pipeline systems, managing processes in production, and performance testing. He is skilled in performance tuning of Spark Core, Spark SQL, and ingestion jobs, and has experience in maintaining workflows that generate data from various data ingestion pipelines. In addition to his technical skills, Harsh has hands-on experience in writing Hive queries to process data and has worked on scheduling/monitoring jobs in Unix/Linux servers. He also has exposure to working with AWS, Cloudera, and Google Cloud Platform. Harsh's area of expertise includes Developer skills in Spark, Python, Spark SQL, YARN, Mapreduce, Hive, Kafka, and Git, as well as reporting skills in Tableau, Zeppelin, Apache Solr, and Pentaho. He is proficient in Python, Scala, and Java. Harsh holds a Bachelor of Technology (B.Tech.) in Computer Science from the LNM Institute of Information Technology. He is also skilled in Spark, AWS, SQL, Python, Kafka, Scala, Azure, Big Data, Hadoop, Apache Hive, Data Engineering, MapReduce, NoSQL, ETL, AWS Glue, ML, Research Scientist, and Mobile. Overall, Harsh Kapoor is a highly skilled and experienced Software Development Engineer with a proven track record of success in the field of Big Data and Data Engineering.