About

Sundar Shankar is a highly skilled Data Engineer with over 10 years of relevant experience in building large scale data lake pipelines using Spark and Scala. He is currently working as a Resident Solutions Architect at Databricks, where he helps the world's greatest companies solve their data science and machine learning challenges. Sundar has a proclivity towards learning new technologies and languages. His interest areas include Machine Learning/Deep Learning with fast.ai ML Flow, Web 3.0, Blockchain, and DeFi. He completed his PGD in ML & AI from IIIT-B & Upgrad and is a Databricks Certified Associate Developer for Apache Spark 3.0. In his previous role at Databricks as a Sr. Resident Solutions Engineer, Sundar designed and developed Scala & Apache Spark based schema parsing, change data capture, and other functionalities using various Spark APIs like DataFrames, DataSets, and RDDs. He also developed various re-usable Spark & Scala code components to be used across different modules. Sundar's experience at IQVIA as a Manager/Sr Application Dev Spec was equally impressive. He was part of the Advanced Engineering Team, leading a team of engineers working on a new age MDM solution for IQVIA using Big Data Tools and Technologies. He researched and implemented Containers for their Akka HTTP application and deployed it in a Mesos cluster. He also performance-tuned the application to bring down the CDC execution time 6x by implementing an ACID compliant datastore. Sundar's education history includes a PGD in Machine Learning & Artificial Intelligence from International Institute of Information Technology Bangalore + Upgrad, a Bachelor of Technology in Electrical Engineering Technologies/Technicians from NIT Kurukshetra, and a High School degree from St. Johns Matriculation Higher Secondary. Sundar's tech stack includes Databricks, Senior Software Engineer, ML, Spark, AI, Blockchain, DeFi, Scala, Data Engineering, Deep Learning, Data Scientist, Web, Kafka, Big Data, CI/CD, and Jenkins. With his vast experience and expertise, Sundar is a valuable asset to any organization looking to solve complex data science and machine learning challenges.