About

Akshay Gupta is a seasoned Azure Data Engineer with over 6 years of experience in ETL design, Data warehousing, and Data modelling. He possesses extensive experience using Python, PySpark, Spark-SQL, RDMS, ETL pipelines, and Data wrangling. He has worked on several technologies covering areas like Data integration, Data ingestion, Cloud, CDC, and Data warehousing technology. Akshay has worked extensively on creating data pipelines in Azure Data Factory, Azure Data Lake (ADL), and Apache Spark on Azure Databricks. He also has experience working on AWS (Lambda, S3, Aurora RDS). Akshay has a functional knowledge of HL7, U.S. Healthcare, and Energy domain. He has good critical thinking and problem-solving abilities, which he has used to develop scripts using Python for automating manual tasks and improving the performance of adapters by visualizing and analyzing trends of volume, incident, and connectivity. He has also suggested XML parameters for optimization. Currently, Akshay is working as a Senior Data Engineer at Fractal. In his previous role as a Senior Software Engineer at R Systems, he was responsible for architecting Data Pipelines along with ETL transformation using Azure Data Factory for a variety of data sources. He translated business logic into quantitative queries using Python, PySpark, and SQL and collected/cleaned the necessary data. He also implemented Change Data Capture (CDC) on Delta Lake using PySpark and loaded up Data and created Views onto Synapse. Akshay used Logic Apps for support to ADF pipelines and handled data movement to and from between Salesforce and Azure. He also developed applications on Raspberry Pi and Windows (Cross-platform app) and wrote AWS Lambda functions for sync of data between RPI and Cloud. Akshay's previous experience also includes working as a Middleware Specialist at Dell, where he worked with a US Healthcare client at the provider side. He developed, tested, troubleshot, and reviewed HL7 interfaces using Integration tools like IBM IIB10 and WMQ 8. Akshay has a Bachelor of Technology degree in Computer Science and Engineering from APJ Abdul Kalam Technological University. His tech stack includes Data Engineering, SQL, AWS, Azure, Databricks, Python, ETL, Spark, Integration, Software Engineer, Salesforce, and test. With 8.20 years of relevant experience, Akshay is a skilled and knowledgeable Data Engineer with a passion for data-driven solutions