About

Ganesh G. is a highly experienced Senior Big Data Engineer with over 7 years of experience in data engineering and big data technologies. He has a proven track record of dealing with large volumes of data, comprising loading from multiple sources to HDFS, effective storing, complex processing using various Hadoop frameworks, and providing processed data to different environments. Ganesh has extensive knowledge of Hadoop, Spark architectures, and various components such as HDFS, Resource Manager, Application Master, Node Manager, Name Node, Data Node, and Map-Reduce concepts, Executor, Driver, Cluster Manager. Ganesh has excellent technical, communication, analytical, trouble-shooting capabilities, problem-solving skills, and able to get along well with people including cross-cultural backgrounds. He has good exposure to monitoring, maintaining / managing Amazon EC2 Cloudera Distribution of Hadoop clusters using Cloudera Manager. Ganesh is also proficient in version Controlling Systems like Apache Subversion and Git (Bitbucket / GitHub), and Jenkins for better control over building projects. Currently, Ganesh is working as a Senior Big Data Engineer at MX Player, where he designed a framework for CDP user segmentation that helped boost the company's revenue. He used different optimization techniques to reduce the cost of the EMR cluster by 60% and optimized the usage of Redshift by 40%. Ganesh also designed a dynamic airflow pipeline to manage different applications by having cross-dependencies between airflow tasks from different airflow dags. He trained and guided the junior team on optimization techniques for various Amazon web services such as EMR, EC2, S3, and Redshift. Ganesh has previously worked as a Senior Software Engineer at Tescra and a System Engineer / Spark and Hadoop Developer at TCS. At Tescra, he worked in complete Software Development Life Cycle (plan, design, develop, deploy and support) adhering to Agile Methodologies. He developed user-defined functions (UDF) in Java/scala when necessary to use in Spark and Hive queries, and optimized spark application which includes data integrity checks to process different file formats and compression codec data. At TCS, Ganesh worked with the admin team to automate cluster creation using AWS and Red hat ansible tower and Tibco. He was involved in migration of existing project to Cloud AWS environment. Ganesh has a Bachelor of Technology - BTech degree in Computer Science from n b k r institute of science & technology, vidyanagar,