About

Apoorv Tyagi is a skilled Senior Data Engineer with over 3 years of relevant experience in the field of Data Engineering. He is currently working as a Data Engineer at Lumiq, where he is responsible for creating a Datalake for storing clean transformed data and Datamart for reporting and representing the data. He is working on a tech stack for AWS services like DMS, SQS, EMR, S3, Athena, Glue, IAM along with Spark Scala for handling business transformation logic and PySpark for reporting. He is proficient in handling AWS services and triggers using Apache Nifi on top of the Master Node of EMR. For logging ELK stack is been utilised. Prior to Lumiq, Apoorv worked as a Big Data Developer at Deloitte, where he worked for an E-commerce client to develop a General ledger System for finance data transformation. He also worked on migration of ADLS storage system to GCP storage, real-time deployment and testing of code in Cluster, YAML code for data reading and conversion, ETL Utilities testing of functionalities to handle a large set of data. He also worked on performance optimization by setting up spark memory and executors for jobs. He developed Microservices to handle error logging and handling, handle Kafka streaming data, and set up CI/CD pipeline like Jenkins Looper, Sonar, Hygiea, Concord. Apoorv also worked as an ETL Tester at Deloitte, where he worked in Fin-tech Project on testing of transformation logic and recon validation of finance transactional data. He worked as QA for functional understanding and testing on automation tools using queries for happy and unhappy path. He actively engaged in multiple defect triage calls for identifying and resolving issues, Requirement Analysis, Master test strategy, Test plan, Test scenario Test case creation Review, Test case execution. He has experience in End to End, Regression, and UAT Testing. Apoorv holds a Bachelor of Technology degree in Computer Science from VIT Vellore. He is a problem solver, Java developer, Python enthusiast, and has experience in AWS cloud Data Engineer Tech stack, Apache Nifi, Oracle Cloud ERP (Reporting, Analysis), SQL developer, ETL testing experience (Big Data, Agile Framework), Big Data developer (Spark SQL, DataFrames and RDD with scala) using GCP storage. He is proficient in Data Engineering, AWS, SQL, test, Spark, Big Data, Python, Scala