About

Bharath Shivaiah is a Lead Data Engineer at Annalect with over 10 years of experience in the field. He is an expert in executing multiple assignments from scratch, delivering cost-effective scalable solutions, and incorporating automations to boost development lifecycle. Bharath is highly skilled in working around multiple technologies and is currently playing with AWS, Python, and MYSQL. His main goal is to achieve Big-Data Solutions using Hadoop, Spark, and related BigData Technologies. Bharath has a great passion for Data Warehousing and Big Data Analytics. He enjoys collecting and integrating billions of data records to provide a 360-degree view of data. He has been involved in designing and developing DataLake ecosystems and Cloud Platforms. Bharath is responsible for designing Data Pipeline and ETL processes from planning to deployment. He is proficient in programming languages like Python, SQL, and HiveQL. He has knowledge of one or more Hadoop distributions, e.g., Hortonworks, Cloudera. Bharath has worked in key areas like PLSQL, SHELL SCRIPT, PYTHON, and has very strong experience in Data Analysis. He is familiar with data architecture, including data ingestion pipeline design, Hadoop information architecture, data modeling, data mining, and advanced data processing. Bharath has experience optimizing ETL workflows. Currently, Bharath is working at Annalect as a Lead Engineer. He is responsible for designing and developing Data pipeline using Apache Spark, AWS S3, EMR, Apace Airflow, etc., and also responsible for Application development to streamline the data consumption. In the past, Bharath has worked with companies like Buddhimed Technologies and State Street Corporate Services Mumbai Private Limited. Bharath has a Bachelor's Degree in Electrical and Electronics Engineering from New Horizon College. His tech stack includes AWS, Spark, Data Engineering, Senior Software Engineer, Python, Hadoop, ETL, SQL, Big Data, Apache Airflow, MySQL, infra, Data Scientist, Research Scientist, Software Engineer, and Data Warehouse.