About

Vishnu Dutta is a highly skilled Java and Big Data Developer with over 12 years of hands-on experience in the banking and financial domain. He has extensive experience in distributed systems, including approximately 6 years in Big Data and Microservices. Vishnu has a strong background in data acquisition, governance, management, distributed processing, and high availability. Vishnu has expertise in extracting, loading, and transforming (ETL) data using Java/Spark on Hadoop. He has hands-on experience in building data products using Big Data technologies such as Hadoop, Spark, Kafka, Flink, HBASE, Sqoop, YARN, and Zookeeper. He has set up a multitenant platform for Confluent Kafka and Vervarica Flink for stream processing. Vishnu also has experience in SQL/NOSQL technologies such as Elasticsearch, MongoDB, Cassandra, and Solr, and has worked with RDBMS databases such as Oracle and MySQL. Vishnu has designed and developed large-scale multi-tenant platforms and apps. He has a good understanding of data lineage, data transformation, and data visualization. He has experience in designing and developing large-scale microbatch and stream processing using Apache Spark, Storm, and Flink. He has also used widely distributed messaging systems such as MQ, Apache Kafka, and Event Hub Azure. Vishnu has set up a secure Kafka cluster with SSL and LDAP by following norms in the financial industry. He has successfully implemented a large-scale data lake and is an expert in building big data pipelines using standard patterns accepted by the industry. He has experience with Lambda and Kappa arch and has designed and developed horizontally scalable event-driven microservice applications with Spring Boot and Kafka. Vishnu has experience with Docker, Kubernetes, and YARN as a resource manager for HA and scalable system design. He has used widely DevOps tools such as Jenkins, Git, Terraform, and environment setup for deploying new apps. He has done automation using Gradle, Docker, and Terraform for setting up Kafka clusters and topic creation. He has migrated an in-house Kafka cluster to Azure VM cloud space. Vishnu has considerable understanding of data warehouse concepts and Snowflakes. He has designed and set up Confluent Kafka HA recovery and Confluent replicator setup to migrate/backup data between clusters. He has experience with Azure Blob, Event Hub, VM setup, and Azure function. Vishnu's coding expertise is in Java 8