About

Deepak Agarwal is a highly skilled computer professional with over 12 years of experience in data engineering and backend software development. He is an avid learner who spends most of his time working on projects and solving computing problems efficiently. Deepak's interest lies in using computers in the best possible manner to achieve optimal results. Currently, he is working as a Staff Engineer in the Data Engineering Infrastructure group at Slack. His primary focus is on building ingestion infrastructure systems at scale. Deepak has built systems to ingest PBs of relational databases into their data warehouse, constantly improving their architecture for efficiency and cost. He is also actively working on building the next-gen data warehouse stack at Slack with incremental processing and event-based architectures. Before joining Slack, Deepak worked as a Software Engineer at Onera, where he was responsible for airflow-based data pipelines for retail data processing. He improved the data pipeline runtime by writing better algorithms and moving heavy workloads into GCP Spark on-demand datapro clusters. At Trulia, he worked as a Principal Software Engineer in the backend engineering team, where he focused on data processing aspects of listings. He developed API services and data models to provide data objects to the frontend for consumption and showing up on the live site. Currently, he is working on a real-time pipeline for their backend listings. Deepak has a Master of Science degree in Computer Science from the University of California, Irvine, and a Bachelor of Technology degree in Computer Engineering from the National Institute of Technology, Karnataka. He is highly skilled in various technologies, including distributed systems, data mining, Hadoop, HBase, Hive, Cassandra, CouchDB, MongoDB, MySQL, Hudson, Maven, Java, Perl, Python, Matlab, Mallet, PHP, Javascript (YUI), Nagios, and monitoring. Overall, Deepak is a highly experienced and skilled data engineer with a strong focus on building efficient and cost-effective solutions to complex computing problems. He is constantly learning and improving his skills to stay ahead of the curve in the rapidly evolving world of technology.