About

Vikas Avnish is an experienced Python and Golang Developer with over 8 years of relevant experience. Currently working as a Software Developer at Valuelabs, he is responsible for creating and optimizing crawling, data extraction, storage, and retrieval systems. In his current role, he has developed architecture to improve system performance and cost, including replacement of costly AWS Lambda with Python multiprocessing queue (alternative implementation of Celery). He also focuses on safe and better extraction of data using Elasticsearch while minimizing data transfer size, better introspection, and better controls. Vikas is proficient in using Dockers to run most of their tasks. Based on a decoupled architecture, they can update and improve parts of the application without stopping it. He is currently working on micro-second search latency while searching for data from a stack of billions of records. Their aim is to store and retrieve multi-TB data without spending too much for it. In his previous role at Wizikey, Vikas developed and deployed a News Crawler System using Scrapy, Redis, S3, Elasticsearch, and MYSQL. To deploy, he used Docker, AWS, Jenkins, and Git, leveraging CI/CD for the crawler to enable rapid updates. He has also worked as a Data Analyst at Credihealth. Vikas holds a Bachelor of Technology (B.Tech.) degree in Mechanical Engineering from Ch. Devi Lal University, Sirsa. He is proficient in a wide range of technologies, including Python, AWS, Golang, Elasticsearch, Redis, MySQL, Search, CI/CD, Docker, Jenkins, Microservices, UI, and Backend. As a software developer, his core interest lies in designing and implementing cost-effective and reliable systems.