About

Amol Kale is a highly skilled and experienced Spark and Hadoop Developer with over 9 years of relevant experience. He has a Bachelor of Engineering in Electronics and is currently pursuing a Master of Science in Data Science and Engineering from UC San Diego Jacobs School of Engineering. Amol is currently working as a Senior Software Engineer at Neustar, where he has worked on sophisticated platforms that process petabytes of data on Big Data stack using the Spark framework. He has collaborated with cross-functional teams to convert product and platform priorities to user stories and epics in Jira and has specified their completion criterion. Amol has developed, tested, and supported new features in entity resolution and analytics projects using Java and Scala programming languages to improve identity resolution accuracy and functionality. Amol has extensive experience in developing new Java/Scala and Python code to migrate existing projects into an incremental framework. He has also developed new code and setup for Kubernetes for microservice architecture, developed new code to do load balancing of incoming messages using RabbitMQ messaging service, and developed new code to use Redis, which is an in-memory key-value store. Amol has created new designs and developed code to be run using GCP tools such as Dataproc, BigTable, Cloud Composer, and GKE. He has planned and communicated product and platform releases to internal and external stakeholders. Amol has performed Hive or Spark queries of datasets to catch errors in identity resolution or data transformation processes. Amol has worked with clients to understand their usage patterns of data to identify where discrepancies lie. He has defined and documented processes that the Data Quality team implements to ensure consistency of build processes. Amol has developed code to test the ability of the system to meet its stated requirements and collaborated with Quality Assurance (QA) on test cases. He has also led a team of four software engineers for the ‘People offline’ project. In his previous roles, Amol has worked as a Technical Analyst at Shiksha Infotech and as a Technology Analyst at Infosys. He has worked on various projects such as migrating ETL originally in Netezza and Abnitio to HDFS, developing trigger-based jobs using Oozie Datasets to trigger Hive-based jobs for Customer Desktop application, and ingesting XML files and transformation of XML files into structured format using MapReduce program by invoking JAXB parser using raw XSD files for the XML. Amol's technical skills include Spark, Software Engineer, Hadoop, Data Scientist, HDFS, test, QA,