About

Aniket Deshpande is a highly skilled Data Engineer with over 6 years of experience in the field. He possesses expertise in Python, Java, SQL, Spark, and Airflow, and has a proven track record of delivering complex data engineering projects. Currently, he works as a Data Engineer at meta, where he supports data architect efforts for Human Ops Platform inside the Community Integrity stream to design and build data infra to monitor efficiency and effectiveness of the ecosystem. Aniket has also led the data architecture efforts for new products launched to support the world's largest and most complex human review platform, collaborating across multiple cross-functional teams. He has designed the analytics layer for effectively tracking the progress of new products with tools ranging from Dataswarm (Airflow), Unidash, Presto, and Spark. Aniket has also led efforts to optimize the performance of data pipelines using Dataswarm, Presto, and Spark to effectively manage the compute resources and to improve SLAs for core datasets. He has launched an org-wide initiative for improving and standardizing logging of critical data. Previously, Aniket worked as an Advanced Data Platform Engineer at Kabbage, Inc, where he built the Kabbage data lake using Databricks (Spark), Databricks Delta, and AWS Athena. He also designed and built multiple data pipelines via Airflow and Databricks (using Spark) to ingest and process data from multiple sources into the Kabbage Data Lake. Aniket has a Master of Science (M.S.) in Computer Science from the University at Buffalo and a Bachelor of Technology (BTech) in Computer Science from Visvesvaraya National Institute of Technology. He has experience in various technologies such as Terraform, Amazon Athena, Elastic Search, Microservices, Postgres, test, Kafka, Docker, and Integration. Aniket has relevant experience of 7.78 years in the field of Data Engineering and is seeking H1B sponsorship.