About

Amandeep Singh is an experienced Software Engineer at Microsoft with a strong understanding of the Software Development Life Cycle. He is skilled in C#, .NET, Microsoft Azure, SQL Server, Power Shell Scripting, and DevOps. Amandeep has 3.43 years of relevant experience in building ETL pipelines and Data Warehousing solutions using Microsoft technologies. Amandeep is a Microsoft Certified Azure Developer Associate and Azure Data Engineer Associate. He has worked on a team that developed a warehouse and reporting system to provide key KPIs to the business regarding all trade-related processes in Microsoft. He has also worked on aligning existing ETL processes to an organization-wide domain Data Lake strategy and changes in processes in the upstream. Amandeep has experience in migrating ETL processes to adopt a reference model and build a modern data platform. He has reduced the problem of data duplication across multiple data warehouses, removed the need for copying raw data, and reduced storage space required which has reduced storage costs by 70%. He has also reduced the need for dedicated SQL data warehouses and instead allowed the adoption of a serverless model and Spark pools which in turn reduced the cost of compute by 40%. Amandeep has allowed separation of storage from compute and allowed the shift from using multiple components into one unified platform (Azure Synapse). Amandeep has designed and implemented Metadata driven ETL processes to consume large volumes of data and generate business-critical reports. Data transformation logic using Spark SQL and Pyspark. He has automated the process of deploying Azure Synapse workspace and all associated resources to allow on-demand provisioning of Dev and Test environments. Amandeep holds a Bachelor of Engineering in Computer Engineering from Thapar University. His tech stack includes Software Engineer, SQL, Azure, ETL, Spark, test, Data Engineering, and DevOps.