About

Dilawar Hassan Shaik is a seasoned Sr. Data Engineer with over 5 years of experience in the field of data engineering. He has worked with some of the top companies in the industry, including HDW and StanChart, and currently works as a Senior Data Engineer at head digital works. Dilawar's expertise lies in SQL, NoSQL, and ETL, and he has extensive experience in Data Warehousing, Data Modelling, and creating Data Pipelines. He is passionate about working with new technologies and is seeking to grow his career in data engineering. He is particularly interested in working with Apache Spark and Kafka. Dilawar has a wide range of technical skills, including Python, Java, Shell Scripting, Oracle, MySQL, Vertica, PostgreSQL, MS SQL Server, Dynamo DB(AWS), Mongo DB, MicroStrategy, Tableau, Cron, Apache Airflow, Jira, Confluence, Hadoop, HDFS, Pentaho(ETL tool), AWS (S3,Redshift,Glue,Athena) REST APIs, Pandas, yaml, and boto3. At his current company, Dilawar has designed data pipelines using Airflow as a scheduler to run parallel runs and dump data into WH. He has used decorators in the dags of Airflow, which efficiently reduced the code size by 33%. Dilawar has crafted solutions and optimized the ETL performance by tuning the SQL queries. He has also fetched data forms like(Flat Files, Structured and Unstructured) into Warehouse using Python. Dilawar has driven the ML algorithms by writing complex SQLs and helping Data Analysts and Scientists. He has designed and built pipelines to get data from data service APIs. Dilawar has a BTech in Computer Science and Engineering from VIT, where he graduated in 2017. He also has a High School degree from St. Ann's School, Ponnur, Andhra Pradesh. In summary, Dilawar is a highly skilled and experienced Sr. Data Engineer with a passion for working with new technologies. He has a wide range of technical skills and has worked with some of the top companies in the industry. Dilawar is seeking to grow his career in data engineering and is particularly interested in working with Apache Spark and Kafka.