About

Fnu Diwankar is a Software Engineering Specialist at Equifax with over 7 years of relevant experience. He is currently serving as a Technical Lead Manager at Equifax and has contributed to various data ingestion projects, both structured and unstructured. Fnu has expertise in automating jobs and developing data pipelines through shell and python scripting. He has also worked on EMR and S3 in AWS and created DAGS through airflow scheduler to automate and process jobs on EMR. Fnu has explored Spark to improve the performance and optimization of existing algorithms in Hadoop using Spark Context, Spark-SQL, and Spark YARN. He has also worked on Cassandra to sqoop data. Before joining Equifax, Fnu worked as a Senior Application Developer at Nike and as a Senior Hadoop Developer at Aetna. At Nike, he performed various data ingestion projects and contributed to continuous development for the reporting platform. At Aetna, Fnu worked on Pig and Hive wrapper and analyzed business requirements to develop a framework. He exported data from HDFS to Netezza through Sqoop and used Sqoop for loading existing metadata in Netezza to HDFS. Fnu was also involved in creating Hive tables, loading and analyzing data using hive queries, and creating datasets to load data into hive. He developed scripts and batch jobs to schedule various Hadoop programs and used Spark API over Hortonworks Hadoop YARN to perform analytics on data in Hive. Fnu holds a Master's degree in Management Information Systems from the University of Texas and a Bachelor's degree in Mechanical Engineering from PES University. He has a strong tech stack that includes Spark, SQL, AWS, Hadoop, Apache Airflow, Python, Cassandra, Apache Hive, and HDFS. Fnu is a Senior Software Engineer who is passionate about data engineering and has a track record of delivering successful projects.