About

Vishal Sharma is a Big Data Engineer at KPMG India with over 7 years of relevant experience. He is a creative thinker, a continuous learner, and a technologist with great technical skills and a passion for resolving complex problems with ease. Vishal has expertise in analyzing big data, conceptualizing and implementing data pipelines, and converting data into informational insights, helping organizations make data-driven decisions. Vishal's current focus is on leveraging the power of the cloud by architecting and implementing scalable and distributed solutions on AWS. He has experience working with various AWS tools such as Glue, EMR, Lambda, Redshift, DMS, Appflow, Athena, Cloudwatch, SNS, DynamoDB, VPC, and Redshift Spectrum. Vishal is also proficient in programming languages such as Python and SQL and has experience working with databases like Postgres, Oracle, and MS-SQL. He is skilled in big data tools like Spark and Hive and is well-versed in version control using Git and scheduling with Apache Airflow. In his current role as a Big Data Consultant at KPMG, Vishal has designed an AWS serverless framework to ingest source data into a data lake with a centralized configuration table on DynamoDB to handle ETL pipeline. He has also developed Pyspark Glue jobs for ingestion of source data from Oracle, SAP HANA, and MYSQL to the data lake. Additionally, Vishal has designed a data warehouse on Redshift with the implementation of SCD Type 2 to cater to the reporting of KPIs on PowerBI with audit logging of user activities in the Redshift cluster. Prior to his current role, Vishal worked as an Application Development Analyst at Accenture, where he worked on model migration from legacy to modern setups for a leading client in Banking, which helped in improved and better quality lending decisions, greater flexibility in managing business logic, and more streamlined and on-demand support for many downstream systems. Vishal was also responsible for the development of ETL jobs to load data into Hive tables from Teradata DB and the conversion of SAS code to Pyspark jobs for business logics. Vishal holds a Bachelor of Technology degree in Electrical, Electronics, and Communications Engineering from Amity University, where he graduated in 2015. Overall, Vishal is a highly skilled Big Data Engineer with a strong technical background and extensive experience in data engineering, AWS, Spark, SQL, ETL, and data warehousing.