About

I am Vighnesh Buddhivant, a passionate Data Engineer with expertise in designing scalable data pipelines, optimizing ETL processes, and leveraging big data technologies like Apache Spark, Kafka, and Hive to extract meaningful insights from large datasets. Proficient in Python, Scala, and SQL, I have hands-on experience with AWS services, including S3, Glue, RDS, Redshift, Kinesis, and Lambda, to build end-to-end data solutions. At Horitech Payroll Software Solution, I developed entity extraction pipelines and a probability scoring system for fraud detection, achieving high accuracy and efficiency. Previously, at ADP, I optimized ETL workflows and automated key processes using Apache Airflow, enhancing data quality and operational efficiency. My commitment to continuous learning and innovation drives me to create impactful, data-driven solutions. Connect with me to explore opportunities and collaborations!