About

Sahdev Kumar Rana is a Senior Data Engineer at Mastercard's AI Garage, with over 7 years of experience in the field of Data Engineering. He has a proven track record of developing highly scalable Spark applications using Spark Core, Spark-SQL, and Spark Streaming APIs in Scala. Sahdev is an expert in ingesting, processing, storing, querying, and analyzing structured and semi-structured data. Sahdev has worked with Cloud Services for Big Data and has experience in developing data pipelines using Spark, Scala, and Hive on Google Cloud and AWS platforms. He is well-versed in ETL processes and has experience in working with Hadoop. Prior to joining Mastercard, Sahdev worked as a Data Engineer III at Walmart. He worked on data pipelines to forecast the budget for omni-channel and developed POC to transform Spark jobs to GPU-based Dask CUDA Python jobs, reducing execution time and platform cost by a minimum of 30%. Sahdev has also worked as a Senior Big Data Developer for a banking domain project at Tavant, where he worked on multiple data pipelines to collect data from multiple alternative sources and generate output values with some aggregation and other transformations to solve business problems. Sahdev holds a Bachelor of Technology degree from Noida Institute of Engineering & Technology. He has a wide range of technical skills, including Data Engineering, Spark, SQL, AI, Big Data, Scala, Apache Hive, Hadoop, ETL, Java, AWS, GCP, and Software Engineering. With 7.53 years of relevant experience, Sahdev is a highly skilled Data Engineer with a passion for developing scalable and efficient data pipelines.