About

Divyanshu Soni is a highly skilled Software Engineer II at Microsoft with over 7 years of relevant experience in developing machine learning pipelines using Apache Spark, handling NLP problems, and building recommendation systems. He has a strong background in developing Java web applications in a cloud multitenant architecture, and developing public REST APIs using Spring framework. Divyanshu has hands-on experience with Kafka messaging platform, Docker, TensorFlow, Pytorch frameworks, and NoSQL MongoDB. He has previously worked at SAP as a Developer Associate, where he was responsible for optimizing data processing by implementing v2 batching framework on high DB load background jobs. Divyanshu has also optimized and refactored complex SQL queries to support high DB load by leveraging advantages offered by a column-based in-memory database, resulting in the SQL query execution time reduction by 4 times in specific cases. In addition, Divyanshu has a strong background in Machine Learning and has integrated and worked on end-to-end machine learning pipelines for Course Recommendation systems that use Neural Collaborative Filtering and Transformer models. He has integrated the Topic matching ML algorithm based on LDA and LSTMs with the main app and consumed/integrated the output REST APIs from Course recommendation/Topic matching system into the main web app and vice versa. Divyanshu holds a B.Tech degree in Computer Science and Engineering from Jaypee University of Engineering & Technology, Guna. He has experience in performing load testing, UI testing, and functional testing, and has developed end-to-end automation test scripts using Selenium to test LMS app. Divyanshu's tech stack includes Software Engineering, Recommendation systems, ML, Java, SQL, Web, NLP, Spark, Docker, TensorFlow, Kafka, Spring, Pytorch, Keras, NoSQL, MongoDB, Backend, Selenium, and UI. With his strong technical skills and experience, Divyanshu is a valuable asset to any organization.