About

Sonali Singh is a skilled Data Engineer with 2 years of extensive experience in designing and implementing Big Data projects using Spark, Analytics, Pyspark, and Scala. She has a strong background in processing large datasets of structured and semi-structured data using Pyspark, Scala, and Python. Sonali has experience in managing large datasets on dbeaver, S3, and Glue catalog, and has developed wrapper and EMR steps jobs in Python for serverless orchestration. She is also involved in developing step functions to deploy end-to-end solutions for Big Data projects. Sonali has a strong knowledge of SQL, Python, Pyspark, and Scala, and has experience in creating and managing EMR clusters for different Big Data project requirements. She has expertise in testing, debugging, and validating Python, Pyspark, and Scala codes in Zeppelin and EMR clusters. Sonali has also developed Glue jobs for SQL scripts and has experience in monitoring job clusters status and node status on EMR. She has been involved in developing validation SQL scripts for the same data processed on two different machines. Sonali has experience in refactoring SQL server scripts into Pyspark data frames, Scala data frames, and Scala RDD for execution optimization. In addition to her technical skills, Sonali has a Bachelor of Technology degree in Computer Science and Engineering from Lovely Professional University. She has also completed a Web Developer Internship at United Fashion Company (Social Dukan), where she worked on front-end and back-end using DHTML, CSS, JavaScript, jQuery, PHP, and other web technologies. Sonali's technical skills include SQL, Data Engineering, Scala, Big Data, Python, Spark, test, Web, PHP, Frontend, and Backend. With her relevant experience of 2.20 years, she is currently working as a Data Engineer at Datagrokr.