About

Vivek Pemawat is a passionate software engineer with over 12 years of relevant experience. Currently, he is serving as an Engineering Manager at Cloudera, where he leads the Infrastructure and Tools team. His expertise lies in designing and implementing workflow management platforms using Apache Airflow to run generic pipelines for product certification. He is also leading the Smart Analysis project, which automates the process of analyzing failures in system test runs and CI runs. Vivek is also responsible for maintaining the infrastructure for the Engineering team for system testing and CI runs. Apart from this, Vivek has also led the development of a log search tool that eases the process of collecting terabytes of logs using EFK stack on Kubernetes. He has also led the development of a monitoring infrastructure to monitor all services, databases, and jobs, which includes whitebox and blackbox monitoring using Prometheus and Grafana. Vivek has also led the Data Centre Inventory project to have complete data centre inventory information. Vivek has worked with Cloudera in the past as a Senior Staff Engineer and a Staff Software Engineer. He has a Bachelor of Technology degree in Information Technology from IIIT, where he studied from 2006-2010. He also completed his high school education from St. Anselms in 1990. Vivek's technical skills include Java, Scala, Akka, Python, Ansible, Mongod, MySQL, Kubernetes, Airflow, ELK (Elasticsearch), fluentd, Prometheus, Grafana, and Netbox. His expertise in these technologies and his experience in software engineering make him a valuable asset to any organization.