About

Varun Joshi is a curious and enthusiastic data engineer with 5 years of experience in various sub-sectors of data. He has expertise in writing ETL for big data, automating data pipelines, data modelling, building visualisations, and building organised, clean and structured data warehouses. His skills include Google Cloud Platform Services, BigQuery, Apache Spark (PySpark, SparkSQL), Airflow, HDFS, Python (Pandas, pyodbc, bokeh, pymongo, pysftp, paramiko,) for data viz, data munging and data pipelining, Apache Airflow, MSFT SQL Server and Amazon Redshift for data warehousing, Amazon EC2, Power BI and Tableau for data viz. Varun is always looking for new challenges that take him to the next level. He is currently working as a Data Engineer II at Confluent, where he works closely with the Go to Market (GTM), FieldOps and Customer Success business partners to build new end-to-end solutions through data pipelining, data modelling, and data warehousing along with maintaining existing workflows. He independently leads communication and develops relationships with business partners and understands their requirements along with deep business context. He designs optimised efficient end-to-end solutions, performs data modelling for requirements involving the development of a full-fledged data warehouse, builds pipelines using Apache Airflow, and creates/accesses new data sources for business partners using API methodologies or third-party integrations. Varun has previously worked as a Senior Data Engineer at Searce Inc., where he worked cross-functionally with the Pre-Sales, Solutioning, and Delivery teams in different roles. He independently worked with clients to understand their existing architecture and identify the problem statement. He collaborated with the design team to design an efficient solution on GCP for data migration and created, tested, and implemented data pipelines to migrate data for various sizes to the GCP environment using various GCP products like Dataflow, Cloud Functions, Pub/Sub, etc. He also conducted hands-on demonstrations/workshops of GCP Products for clients and delivered an end-to-end solution for clients with possible add-on values. Varun has also worked as a Data Science and Engineering Consultant, where he helped Indian software companies design end-to-end data solutions for their clients across the world. He used his experience in data so far to help organisations get insights into their business by organising their data and building interactive reports off this data for them as per their requirements