About

Gaurav Kumar is a seasoned Data Engineer and Data Consultant with more than 7 years of experience in the Big Data domain. He is an expert in Apache Spark, Hadoop, Python, and Cloud Services like GCP and Microsoft Azure. Gaurav has business domain expertise in Healthcare, Pharma, and Finance. He is a Cloud Computing, Distributed Computing, and Big Data enthusiast. Gaurav possesses a wide range of technical skills including programming languages such as Python and Core Java, Big Data technologies like Apache Spark, Hadoop, Hive, YARN, HDFS, Spark UI, Oozie, Sqoop, HUE, and Hadoop Distributions like Cloudera. He is proficient in GCP Services like Big Query, DataFlow, DataProc, Cloud Storage, Big Tables, Cloud SQL, Cloud IAM, and Compute Engine, as well as Azure Services like Data Factory, Functions, Blob, and Data Lake Store. Gaurav is also skilled in version control tools like Git, databases like MySQL and Postgres, scripting languages like Shell and Bash, and UI technologies like HTML5. He is experienced in data visualization tools like MicroStrategy and Tableau, project management and documentation tools like JIRA, Scrum, Sphinx, and Jenkins, and data validation tools like DataComPy. Currently, Gaurav is working as a Senior Consultant at EY, where he designed a three-layered Data Warehouse architecture for Banking operations in the UK region. He is harnessing state-of-the-art Big Data technologies like HDFS, Hive, PySpark, Airflow, etc., producing Spark scripts with a high focus on optimization for resource and cost efficiency. Gaurav also built a Data Quality Framework for Data Warehouse/Mart with huge data volume and is exploring emerging open-source Data Quality frameworks for Spark on Big Data. He leverages different tools and services like Dataproc, Big Query, Cloud storage, Cloud Big Table, AppEngine, Compute Engine, and PySpark to develop reports for analysis, visualization, automation, and distribution of reports. Prior to EY, Gaurav worked as an Associate Consultant at IQVIA, where he excelled in end-to-end Project Management, successfully delivering several Big Data Development, Testing & Maintenance Projects. He extensively worked on Big Data Management & Database Projects using Hadoop Architecture and underlying Hadoop Framework, Spark Data Frames and optimization, Jira 6.4 for project tracking, Bug tracking and Project Management, several