About

Balamurugan Arumugam is a seasoned Big Data Engineer with over 12 years of experience in software design and development. He is currently employed as a Senior Data Engineer at Credit Karma, where he utilizes his expertise in large-scale distributed systems, big data analytics, and information retrieval technologies. Balamurugan is a pragmatic programmer with strong coding skills and has a strong background in object-oriented design and big data systems architecture. Balamurugan's skillset includes proficiency in Java, Hadoop, MapReduce, Apache Spark, HBase, Parquet, Apache Solr, Apache Nutch, Redis, Impala, Presto, Oozie, CDH5, Python, Scala, and AWS. He holds certifications in Machine Learning with Spark from UC Berkeley Extension and Apache Spark Fundamentals from IBM. Additionally, he has completed the Fundamentals of Project Planning and Management course from the University of Virginia. In his previous roles, Balamurugan served as a Staff Big Data Software Engineer at Bazaarvoice Inc., where he was responsible for engineering lead for big data analytics applications. He designed, architected, developed, and maintained analytics applications for consumer-generated content for 3500+ brands and clients. His expertise in Hadoop, MapReduce, Apache Spark, HBase, Parquet, Impala, Presto, Oozie, CDH5, and Java was instrumental in the success of the project. Balamurugan also served as a Senior Software Engineer at Ask.com, where he was the technical project lead for the Q&A Solr-based search engine application. He designed, architected, developed, and maintained the web crawler and indexer (Solr) for 700+ million QA pairs index. His proficiency in Java, Hadoop, MapReduce, Apache Solr, HBase, Apache Nutch, Redis, and other technologies was essential in the project's success. Balamurugan holds a Bachelor of Technology in Information Technology from the University of Madras. He has a relevant experience of over 19 years in the field of Data Engineering, Spark, Big Data, MapReduce, AWS, Information Retrieval, Hadoop, Java, Redis, Software Engineering, ML, Senior Software Engineering, Python, Scala, QA, and Search.