About

Abhinav Sharma is a highly skilled Data Engineer with over 4 years of experience in Backend Development, Data Engineering, and Cloud Computing. He is currently working as a Software Engineer at Velotio, where he manages a large distributed data ingestion system with 10+ clusters running 1000+ workers to scrape data from various sources. He has also integrated the data warehouse to external data sources through serverless ELT data pipelines and manages the data warehouse on Elastic search cluster with 90+ Nodes. Abhinav is well-versed with Distributed Systems, Data Architectures, and Managing Infrastructure through Code using Terraform. He has developed APIs in Django and FastApi frameworks. Abhinav has previously worked at Ecom Express Private Limited as a Senior Software Developer, where he developed an algorithm "address validator and geocoder" to validate and geocode the authentic address for the prevention of misrouting in the last-mile delivery. He also owned a module to find the shortest path between the two locations within the specified time limit and optimally allocated the vehicle in that path. Abhinav has experience in writing ETL scripts and creating automated data pipelines to integrate MySQL tables with the Elasticsearch index. He has also used AWS sqoop for data lake formation from MySQL tables to the S3 bucket. Abhinav has also worked at Innoplexus as an Associate Software Engineer, where he designed an algorithm for the classification of webpages based on the structure of the webpage. He wrote queries on Elasticsearch for fast text-based search and used NLP for sentiment and NER tagging. Abhinav sourced and mined the digital world of life sciences using advanced data mining tools. He analyzed data using python packages such as Pandas, Numpy, and Matplotlib and has hands-on experience in Data handling using MongoDB. Abhinav holds a Bachelor of Technology degree in Electrical and Electronics Engineering from Sharda University. He possesses a strong technical skill set, including Data Engineering, Software Engineering, Data Warehouse, Elastic Search, Backend, Infra, Django, Terraform, MySQL, Search, AWS, ETL, NLP, Python, Pandas, and MongoDB. Abhinav has relevant experience of 5.12 years.