About

Ganesh Annamalai is a Google Certified Professional Data Engineer with over 10 years of experience in the IT industry as a Big Data Analyst and Developer. He is currently working as a Senior Data Engineer at Wells Fargo, where he is responsible for planning the roadmap of the transformation of the legacy data warehouse system and application to big data. He is also the technical lead for strategy building, designing, and implementing the Big Data Spark-based ETL architecture. Ganesh has sound knowledge of banking and health domains and is currently working on the Google Cloud Platform. He has gained proficiency in big data technologies such as Spark and Hadoop. He has experience in all phases of the software development life cycle, from requirement gathering to deployment and functional testing. At Wells Fargo, Ganesh has built data pipelines in Apache Airflow in GCP for ETL related jobs using different airflow operators. He has used cloud shell SDK in GCP to configure the services Data Proc, Storage, and BigQuery. He has good knowledge of using cloud shell for various tasks and deploying services. Ganesh has expertise in using cloud data flow and Apache beam. Ganesh has also worked at Optum as a Senior IT Data Analyst, where he created ETL pipelines for batch data using Hive, Spark, Scala, and HBase. He was responsible for mapping, extracting, transforming, and loading data into the Clusters from different data sources using Talend. He has optimized the performances of the long-running Spark jobs and implemented partitioning, dynamic partitions, and buckets in Hive. Ganesh has a Bachelor of Engineering degree in ECE from Anna University. His technical skills include Data Engineering, Spark, Big Data, GCP, Scala, Python, ETL, Apache Airflow, Data Warehouse, SQL, Apache Hive, Hadoop, and Software Engineering. Ganesh has 11.44 years of relevant experience in the industry.