About

Baishali Jaiswal is a skilled Data Science & Engineering professional with over 6 years of experience in the industry. Currently working at Microsoft as a Data Science & Engineering II, she has in-depth knowledge of real-time & batch data processing, analysis, reconciliation, and visualization of data using various tools like Apache Spark, Spark SQL, Apache Flink, Kafka, Big Query, Postgres, Python, Scala, Azure Data Factory, and Azure Function App. She is also experienced in orchestration and generation of CI/CD pipeline using Jenkins, GIT, ADF, and DataBricks for ETL/ELT data pipelines and data analytics. Baishali has worked on various projects throughout her career, including developing an automation tool to create an ADF pipeline by reading the configuration or definition of the pipeline from the Metadata table. She has also worked on developing real-time processing pipelines using Scala, Flink, Kafka, and distributed systems. Additionally, she has written many batch processing ETL/ELT jobs for extracting data from DataLake-s3 in parquet format after transformation and loading these aggregated data in BigQuery. Baishali holds a BTECH in Computer Science and Engineering from West Bengal University of Technology, where she graduated in 2017. She also completed her Higher Secondary (12th) in Computer Science from Shree Jain Vidyalaya for Girls. Her tech stack includes Spark, Data Scientist, Python, SQL, Kafka, Data Engineering, Big Data, Azure, Databricks, AWS, ETL, Scala, CI/CD, Postgres, Jenkins, Apache Hive, Jupyter, HDFS, Data Warehouse, Pandas, MySQL, MongoDB, Integration, and Software Engineer. Overall, Baishali has 5.78 years of relevant experience in the field and is a highly skilled and knowledgeable data science & engineering professional.