About

Surjeet Jaiswal is a Big Data Developer at Target India with close to 6 years of experience in the IT industry. He has a strong background in analysis, design, development, and tuning of Spark applications, PySpark, ETL, Big Data architecture, Hadoop, YARN, HBase, HDFS, Parquet file format, Hive, SQL, NoSQL databases, and more. He has experience in working with developing, branching, merging, code reviews, and agile methodologies (Scrum). Surjeet is a creative problem solver with strong communication skills. He has experience in writing AWS Lambda python scripts and working with AWS services like Athena, S3, SQS, QuickSight, and more. He has over 1.2 years of experience in Python and Machine Learning, Probability, Statistics, and Analytical methodology. He is passionate about learning new technologies and has experience in collaborative working with multiple vendors and globally distributed teams. Currently, Surjeet is working as a Senior Software Engineer at Globant. He has automated Spark jobs in Scala to dump data from Google Spreadsheet to PostgreSQL tables and also created the corresponding JSON file with validations on the attributes. He has implemented end-to-end Spark ETL jobs, including UDAF, to extract device ID and domain name count from URL data requested by users and store the final processed data frame into HBase tables. He has also created HBase tables and scanned data from HBase tables and dumped it to HDFS in parquet format. In the past, Surjeet has worked as a Senior Software Engineer at Cybage and Senior System Engineer at Infosys. At Cybage, he developed CI/CD python scripts in AWS Lambda using Boto3 API for generating SQL queries from the request raised by the user, generating reports on given data, and storing the output as a CSV file in S3 bucket. At Infosys, he developed PySpark programs using Python and Spark SQL to analyze and process data in pipeline mode. Surjeet holds a Bachelor of Technology degree in Computer Science & Engineering from the Indian Institute of Information Technology, Design and Manufacturing, Jabalpur. He has a strong tech stack that includes AWS, Spark, Software Engineering, Big Data, SQL, Python, HDFS, Amazon Athena, ETL, Data Engineering, Hadoop, Apache Hive, Docker, ML, NoSQL, CI/CD, Postgres, and Scala. With 7.70 years