About

Karthik N is a highly skilled Senior Data Engineer with expertise in Spark, Spark SQL, AWS stack, mapR, HDFS, Azure Cloud, Hive, Apache Kafka, Sqoop, Airflow, Python, Pyspark, Matplotlib, Eclipse, Linux, Teradata, Jenkins, Oracle, Git, and Tableau. With almost 6 years of relevant experience, Karthik is currently working at Fifth Third Bank as a Senior Data Engineer. His current role involves using AWS data pipeline for data extraction, transformation, and loading from homogeneous or heterogeneous data sources, migrating on-premises Informatica ETL process to AWS cloud and Snowflakes, and developing ETL integration patterns using Python on Spark. In his previous role as a Big Data Engineer at Davita Healthcare, Karthik gained experience in Microsoft Azure providing data movement and scheduling functionality to cloud-based technologies such as Azure Blob Storage at Azure SQL Database. He also utilized Spark streaming API to ingest data from various sources, monitored Spark cluster using Log Analytics and Ambari Web UI, and managed resources and scheduling across the cluster using Azure Kubernetes Service (AKS). Karthik has also worked as a Data Engineer at Pfizer, where he utilized Spark SQL API to extract and load data and perform SQL queries and built and maintained data pipelines and triggered those data pipelines and Databricks jobs using Apache Lambda. Karthik holds a Master's degree in Industrial Technology/Technician from Pittsburg State University, which he is expected to complete in May 2022. He has a strong tech stack that includes Spark, AWS, SQL, Data Engineering, Azure, Python, HDFS, Kafka, Apache Airflow, Snowflake, Apache Hive, Jenkins, Hadoop, ETL, Databricks, AWS Glue, UI, MapReduce, Amazon Athena, Data Warehouse, MongoDB, Elastic Search, DevOps, Integration, Big Data, MySQL, CI/CD, Kubernetes, Cassandra, Web, and Search. Overall, Karthik is a highly motivated and results-driven data engineer with a proven track record of delivering high-quality solutions to complex data problems. He is an excellent team player, with strong communication and collaboration skills, and is always eager to learn and stay up-to-date with the latest technologies and trends in the industry.