About

Aman Ahluwalia is a Technical Team Lead at Zyte (formerly Scrapinghub) with over 4 years of relevant experience in software engineering. He is skilled in Machine Learning, Data Extraction, and Backend Development. Aman is responsible for leading the technical team of 15 developers, including 2 Technical Leads, in a project that involves extracting and processing huge quantities of data using the open source Python framework Scrapy. Aman's expertise lies in creating and maintaining core components that are responsible for extracting data. He has developed around 3500 Scrapy spiders, middlewares, and pipelines that extract data from approximately 2000 websites. He has also reverse-engineered sites with anti-bot protections and integrated different projects with the cloud platform and third-party platforms through different APIs. Aman has set up the solution from scratch for competitor product matching using machine learning techniques. He has created Backend Services and APIs to support features, including caching of responses in the scale of terabytes of data. Before joining Zyte, Aman worked as a Senior Software Engineer at Zyte (formerly Scrapinghub) and as a Data Engineer & Backend Developer at Revcloud. At Zyte, he designed, developed, and maintained Scrapy web crawlers to perform distributed information extraction, retrieval, and data processing. He also created Backend Services and APIs to support features, including caching of responses. At Revcloud, he designed and created an ETL pipeline to retrieve, store, and extract information for the continuously evolving data store. Aman holds a Master's degree in Computer Science from the Georgia Institute of Technology, a Nanodegree in Artificial Intelligence and Machine Learning from Udacity, and a Bachelor's degree in Technology in Computer Science from Jaypee University of Engineering and Technology. He is proficient in Backend, Python, Docker, ML, Software Engineering, SQL, MongoDB, MySQL, Data Engineering, test, Pandas, Web, CNN, RNN, NLP, Javascript, ETL, and Pytorch.