About

Gopal Nigotiya is an accomplished Azure Data Engineer with over 11 years of experience in data engineering, web development, and digital technologies industries. He is currently working as a Cloud Engineer at IBM (Shell PLC) and has previously worked as a Data Engineer at TCS for Walmart and Sam's Club. Gopal has 3+ years of experience in data engineer platforms and is currently working with Walmart on data modernization and data migration to the cloud (Azure). He has a strong background in building data pipelines, Delta lake for batch process and streaming eComm and CDP data using Azure services such as Azure Blob, Azure Data bricks, Azure Data Factory, and Azure SQL DB. He is also proficient in Airflow Job scheduler and has experience with very large (more than 1TB) databases and data warehousing. Gopal has good knowledge of the Hadoop Ecosystem, including Hive, Flume, Pig, and Sqoop. He is an expert in Hive Query Language and is skilled in performance tuning, especially tuning complex queries, procedures, and indexing strategies. Gopal has strong interpersonal skills, which he uses to resolve problems in a professional manner and lead working groups. He has the ability to work with a variety of teams and clients, mentor junior resources, and effectively handle multiple tasks/deadlines with success. Gopal is an excellent communicator with exceptional documentation skills, especially when communicating with business users. He has implemented structured streaming processes to create workflows aggregating real-time data from various source systems in over 20+ delta tables. Gopal's technical skills include Azure Services (Azure Blob, Delta lake, data lake, Azure Data bricks, Azure Data Factory, and Azure SQL DB), Hadoop Ecosystem (Hadoop, HDFS, Hive, MapReduce, Sqoop), Python, Pyspark, Spark, Airflow, Teradata, SQL, Oracle, and Automic. He holds a Master's degree in Electronics & Communication from the School of Electronics, DAVV Indore, and a Bachelor's degree in Mathematics and Physics from Bundelkhand University. Overall, Gopal has 10.86 years of relevant experience and is a highly skilled and experienced Azure Data Engineer with a strong track record of success in data engineering, cloud computing, and digital technologies.