About

Shubham A. is a highly skilled Big Data and Cloud Expert with over 4 years of experience in various domains like AdTech, Banking, Security, Life Science, Pharma, and Biotech. He is proficient in Big Data architecture and large-scale distributed data processing for Big Data Analytics using the Hadoop ecosystem. Currently, he is working as a Senior Big Data Engineer at 6sense, where he is responsible for building high-performance APIs, libraries, and microservices that scale to meet/exceed the demands of processing over a 100 million transactions and TBs of data per day. Shubham has experience in developing large-scale (TBs/day) data warehouse, data lake, Big Data, and Analytics solutions over the on-premise and cloud platform. He is specialized in Big Data architecture and has hands-on experience in implementing ETL pipelines with Big Data technologies. He has worked with AWS services like S3, EMR, DynamoDB, Athena, and GCP services like GCS, Dataflow, Bigtable, Bigquery, Cloud composer, etc. Shubham has a strong understanding of Data Structures & Algorithms and is proficient in data processing with Spark-Scala, PySpark, and Python. He has hands-on experience with Elasticsearch, Logstash, Kibana, Beats, MongoDB, Hadoop, Cassandra, and Redis. He has also worked on data crawling using Beautiful Soup and Selenium and implementing Near-Real-Time (NRT) Search using ELasticsearch. Shubham has worked with CI/CD pipeline having Jenkins, Bamboo, Ansible, and Git and has hands-on experience with Terraform, Docker, and Kubernetes. He holds a PG-Diploma in Big Data Technology from the Centre for Development of Advanced Computing and a Bachelor's degree in Information Technology from Walchand College of Engineering. Overall, Shubham is a highly skilled Big Data and Cloud Expert with a strong understanding of various Big Data technologies and has hands-on experience in developing large-scale data solutions.