About

Thirumalai Raj is a highly skilled developer and distributed systems enthusiast with over 5 years of relevant experience in the field of data engineering. He is currently the Co-Founder of xillion, where he is building xillionapp.com. Prior to this, he worked at Flipkart as a Data Engineer 2, where he was responsible for the development and scaling of Euclid, an in-house clickstream analytics product that processes a scale of peak 1M QPS traffic. He was also responsible for the design and development of Unified Metrics Store (UMS), an OLAP processing engine plus datastore over Hadoop where users can configure MOLAP cubes over different kinds of source data from Kafka(realtime) and Hive(batch) tables. He used Spark as a computation engine, Flink for real-time ingestion, HBase as key/value and columnar store, dropwizard for microservice layer, Azkaban for orchestration, MySQL for metadata persistence, and Ansible for HBase cluster deployment and maintenance. Thirumalai also worked as a Data Engineer 1 at Flipkart, where he designed and developed real-time Checkout Pipeline for reporting live sale metrics, poll-based batch ingestion pipeline to stitch and ingest raw clickstream data from Adobe Analytics to internal Hadoop cluster, real-time Value Added Services pipeline to track the sale performance of bundled products, and scaled real-time pipelines for BBD 2019 and other festive sales to handle 5M peak QPS. Thirumalai holds a Bachelor of Engineering (B.E.) in Computer Science from Thiagarajar College of Engineering. He also has experience working with Apache Spark, Ansible, Hadoop, MySQL, Kafka, Microservices, Apache Hive, and UI. Thirumalai is a highly motivated and results-driven individual who is passionate about building complex distributed systems. He is a team player with excellent communication skills and the ability to work effectively in a fast-paced and dynamic environment.