About

Dhrubajyoti Sadhu is a seasoned Software Development Engineer II with over 8 years of experience in the field of data platform development. He has an in-depth understanding of data structures and algorithms with expertise in Big Data, Hadoop, Apache Spark, Python, Hive, AWS, Amazon Redshift, Amazon S3, EMR, EC2, Apache Kafka, Spark Streaming, SQL, Oracle, SQL server, DevOps, Terraform, Ansible, Docker, and Jenkins. Currently, Dhrubajyoti is working as a Big Data Developer at Expedia Group, where he is responsible for writing Spark programs in Python, Scala, and Hive scripts. He has hands-on experience in the development of jobs that comprise writing bash shell scripts, HQL, UDFs in Python, Airflow workflow, and dealing with HDFS & AWS (Redshift, S3, EMR, EC2). He is proficient in all aspects of big data development, right from Requirement Analysis, Database Design, Application Development, Debugging, Testing, and Documentation. Dhrubajyoti's specialties include proficiency in languages like Python, Java, Shell Script, and Scala, query languages like SQL and PostgreSQL, and technologies like AWS (Redshift, S3, EMR, EC2), Spark, HDFS, Hadoop, Kafka, and Presto. He is also well-versed in RDBMS like MSSQL, Oracle BD2, and tools like PyCharm, IntelliJ, Git, Jenkins, HPQC, TOAD, Workbench, Jira, and Rally. He has experience working with operating systems like macOS, Ubuntu, and Windows 10. In his current role at Expedia Group, Dhrubajyoti is responsible for designing and developing the horizontally scalable ETL platform using Airflow, Terraform, Ansible, Git, Jenkins (Continuous Integration Tool), and Redis (Messaging broker). He has also automated the SES key rotation task, which saves manual effort for the team. He has worked with stakeholders to understand the data and data flow of the Google 360 API and compare it with the Adwords API currently being used. Dhrubajyoti has previously worked as a Senior Big Data Engineer and Big Data Engineer at Tavant. He has a Master of Computer Applications (MCA) degree from R. V. College of Engineering, Bangalore, and a Bachelor's degree in Computer Science from Techno India College