About

Sivakumar Mahalingam is a highly skilled Big Data and Cloud Architect with over 9 years of relevant experience. He has extensive expertise in developing and troubleshooting Hadoop technologies such as HDFS, MapReduce, Spark, Hive, and Sqoop, among others. Sivakumar has experience working with Cloudera and Hortonworks distribution and is proficient in both Azure and Amazon Web Services (AWS) cloud. As a Lead Data Engineer at Innova Solutions, Sivakumar is capable of processing large sets of structured, semi-structured, and unstructured data and supporting systems application architecture. He has designed and developed optimized and standardized solutions for Data Integration, Data Cleansing, Data Transformation, and Data Delivery to downstream systems. Sivakumar is also experienced in developing and maintaining Spark Batch and Streaming applications and has worked with Agile development processes using scrum methodology. Sivakumar's technical skills include proficiency in languages such as Python, Scala, SQL, Java, C#, and Shell Scripting. He has worked with various databases such as Oracle, SQL Server, MySQL, and Teradata, and has experience in DevOps tools like Docker, Jenkins, and Git. Sivakumar has also worked with API Frameworks such as Python Flask and has experience in Log Analytics tools like ElasticSearch, Logstash, and Kibana. Sivakumar has worked in various domains such as Healthcare, Banking, Insurance, and Retail. He has worked with Infosys as a Technology Architect, where he worked on Azure POCs like ADLS, Delta Lake, Databricks, and EventHubs. He has also worked with Accenture as a Data Engineering Specialist, where he implemented end-to-end Big Data applications from scratch in Hadoop ecosystem, migrated on-premises Big Data application from Hadoop to Cloud (AWS), and optimized data ingestion applications for higher performance. Sivakumar has also developed several automation tools in Python for workflows and to reduce manual work. Sivakumar holds a Master of Technology degree in Software Systems specialization in Software Engineering from Birla Institute of Technology and Science, Pilani, and a Bachelor of Engineering degree in Computer Science and Engineering from Anna University. Sivakumar's tech stack includes AWS, Data Engineering, Azure, Big Data, Spark, SQL, Python, Hadoop, Databricks, Kafka, DevOps, Jenkins, Apache Hive, Integration, MapReduce, Docker, MySQL, Elastic Search,