About

Kunal Trivedi is a highly skilled and dynamic Data Engineer III at Walmart Global Tech with over 6.78 years of relevant experience. He has prolific knowledge in the field of Core Programming, Data structures, Algorithms, Big Data, and Information and Network Security. Kunal's skillset includes expertise in platforms and languages such as SCALA, Java, J2EE, and SQL. He is also proficient in Big Data technologies like SPARK, KAFKA, Hadoop, HBase, and Hive. Kunal has experience working with schedulers such as Airflow and OOzie, and NoSQL databases like InfluxDB, Redis, and MongoDB. He also has experience in distributed computing using ZooKeeper, and API/REST frameworks such as SpringBoot and Sparkola. In addition to his technical skills, Kunal possesses strong analytical and people management skills. He has excellent verbal and interpersonal communication skills, accuracy and attention to detail, and an unyielding passion for constant improvement. Kunal has the ability to take quick and effective decisions, and excellent organization and prioritization skills. Kunal has previously worked as a Data Engineer at DBS Bank, where he was involved in optimizing the existing system and migrating data from source systems collected periodically to Hadoop, Hive. He also developed Spark Batch jobs to move data from mainframes to Hive/HDFS. He has also worked as a Big Data Developer at Techolution, where he worked on KAFKA for building real-time streaming data pipelines, developed a KAFKA application for data ingestion from NetSuite to DataLake on HDFS cluster provided by SparkHDInsights at Azure cloud, and developed a TestSuite for big data application in order to adhere to Test Driven Development. Kunal holds a Master of Technology (MTech) in CSE Information and Network Security from Nirma University, Ahmedabad, Gujarat, India, and a Bachelor of Technology (BTech) in Information Technology from Ganpat University. He also has a background in science from Cu Shah High Sec School and St. Joseph High School. Kunal has a diverse tech stack, including experience in Data Engineering, Spark, NoSQL, Hadoop, Kafka, SQL, Azure, Big Data, test, Apache Hive, Java, Scala, HDFS, MongoDB, Apache Airflow, Redis, Spring Boot, infra, Research Scientist, Search, ML, Sentiment Analysis, iOS, NLP, Kubernetes, Docker, Pandas