Say no to manually filling long application forms
Visit any careers page and a lightning button will pop up on any compatible page with a form
Use ChatGPT to auto-fill job forms
Ask for Referral for any job post
Koushik Dutta
Lead Data Engineer @Deloitte USI | Distributed System
About
Koushik Dutta is a highly skilled and experienced Big Data Engineer with over 6 years of experience in the field of Data Engineering, AWS, Microservices, and API development. He is proficient in various Big Data tools and technologies, including Hadoop, Spark, Kafka, and Data Streaming. Koushik is passionate about learning new technologies and enjoys taking on new challenges. He is currently exploring Data Mining and Feature Engineering. Koushik has a strong background in Cloud App Engineering and is well-versed in AWS, including services such as Fargate, Kinesis, Lambda, CFn, DynamoDB, API Gateway, Cognito, Step Function, and SQS. He is also proficient in various databases, including Oracle, MySQL, DynamoDB, MongoDB, and Neo4J. Koushik has experience with Redshift, Hive (HiveQL), and Google BigQuery for Data Warehousing, and Plotly, Seaborn, and Google Data Studio for Data Visualization. In terms of scheduling, Koushik is well-versed in Cron Job and Airflow, and he has experience with Spark for Big Data Frameworks. He is also proficient in Kafka and AWS Kinesis for Streaming Technology. Koushik is skilled in several programming languages, including Scala, Python, SQL, and Golang. He has experience with AWS Glue for ETL service, AWS Step Function for Workflow Service, and Git for Version Control. Koushik is currently working as an Application Development Team Lead at Accenture, where he is responsible for ingesting data into AWS S3 from OnPrem Oracle and DB2 instances using AWS DMS, implementing preemption logic in the pipeline using AWS Lambda and Step Function, and creating a streaming pipeline using Kinesis data streams with 1 min 25 sec of latency. He has also designed a star schema and crafted dimensional models. Prior to his current role, Koushik worked as a Data Analyst at TCS, where he built end-to-end data pipelines for batch processing and near-real-time data streams. He also developed real-time monitoring toolkits using Elastic Search and Kibana and data preprocessing toolkits using Python. Koushik has also worked as a C Python Developer at Python Software Foundation, where he helped to build several Python modules and worked as an active member of the Django Community and Mail Group. Koushik holds a B.Tech degree in
Education Overview
• kalyani government engineering college 102
Companies Overview
• deloitte
• accenture
• tcs
• python software foundation
Experience Overview
9.4 Years
Find anyone’s contact
Experience
Skills
Boost your visibility and stand out to employers with referrals from your LinkedIn connections.
Airflow
Amazon Athena
Amazon Dynamodb
Amazon Elastic MapReduce (EMR)
Amazon Redshift
Amazon S3
Amazon Simple Notification Service (SNS)
Amazon Web Services (AWS)
analytics
apache
Apache Airflow
Apache Hive
Apache NiFi
Apache Spark
API Development
Application Programming Interfaces (API)
Automation
AWS Glue
AWS Lambda
Big Data
Confluence
d3DotJs
Data Analytics
Data Engineering
Data Pipelines
Data Processing
Data Warehousing
DB2
Design
Docker
Education
Extract, Transform, Load (ETL)
Feature Engineering
Git
GitHub
Grafana
Hive
infra
Kafka
Kibana
Kubernetes
Logic and Reasoning
Microservices
MongoDB
MySQL
Neo4j
PostgreSQL
Prioritization
pyspark
pytest
Python
Representational State Transfer (REST)
REST
Scala
Seaborn
Snowflake
SQL
test
testing
Web
Contact Details
Email (Verified)
dotXXXXXXXXXXXomMobile Number
+91XXXXXXXX32Education
kalyani government engineering college 102
B.Tech
2011 - 2015
Frequently asked questions
Find anyone’s contact and let Weekday reach out to them on your behalf
Start hiring nowStop manually filling job applications. Use AI to auto-apply to jobs
Look for jobs now