About

Shantanu Singh is a Senior Application Ops Engineer at Intuit with over 7 years of experience in the IT industry. He has a proven track record in setting up IT infrastructure, architecture design, and implementing large networked systems, real-time data pipelines, highly available and scalable web platforms, database and data-store infrastructure, systems engineering and administration, process automation, backups strategy, disaster recovery, monitoring, and security. Shantanu has a solid understanding of end-to-end data pipelines setup and has worked on Cloudera Hadoop, Hive, Oozie, HBase, Kafka, Kafka-Connect, Spark, and other technologies used in real-time streaming pipelines. He has a very good understanding of traditional as well as NoSQL databases, such as Cassandra. He is proficient in scripting languages like Bash and Python and has a good understanding of AWS concepts. Shantanu has worked on deployment tools like Chef, Rundeck for deployments, and has a very good understanding of monitoring tools like Nagios, Check_MK, Splunk, NewRelic, etc. He has experience working in CI/CD pipelines using Jenkins, Github, etc. Prior to Intuit, Shantanu worked as a Senior Software Engineer at Nichepro Technologies, where he was part of the pipeline design discussion from scratch, took care of all network connectivity between different pipeline components, worked on deployment automation, and was involved in architecture designing meetings. He also managed the Kafka cluster in Dev/QA/Prod environment, monitored the Spark jobs, and automated application failover for pipeline components like Kafka Connect, Datomic Transactor, etc. Shantanu has a Bachelor of Technology in Information Technology from Meerut Institute of Engineering and Technology and has also worked as a Software Engineer at Yahoo. He has experience troubleshooting HDFS, Spark, and Oozie related issues and has handled on-calls. Overall, Shantanu has relevant experience of 13.54 years and is highly skilled in Spark, Kafka, New Relic, AWS, infra, Cassandra, Hadoop, Jenkins, CI/CD, HDFS, Software Engineering, Python, NoSQL, Web, Apache Hive, QA, and Frontend.