About

Vigneshwaran Vadivel is a Senior Data Engineer with over 5 years of experience in the field of data engineering. He holds a Master's degree in Electrical and Computer Engineering from the University of Windsor and a Bachelor's degree in Electrical and Electronics Engineering from Anna University. Vigneshwaran has a strong background in application development and has worked on various ETL projects, including client interfacing for gathering requirements, implementation, testing, deployment, documentation, and production stabilization. He has experience with ETL tools like Informatica Powercenter, BDM, and SSIS and has created data pipelines from various sources, including databases, structured and unstructured files. He is well-versed in working with Oracle database and HDFS and has created and modified SQL queries as per business requirements. Vigneshwaran is expanding his skills in Tableau and Python scripting to become a wholesome Data Engineer. He is always seeking an opportunity to utilize his skills to learn and grow in his professional career. Currently, Vigneshwaran is working as a Senior Data Engineer at BMO, where he is responsible for developing data pipelines on AWS EMR environment for data extracts, leveraging the internal spark framework. He has also engineered and deployed SSIS applications for the portfolio with the logics handled in the SQL query. At BMO, he has supported data migration from heterogeneous sources and different formats into a relational data warehouse, hive, and AWS region using complex code. Prior to BMO, Vigneshwaran worked as an Intermediate ETL/SQL Developer at BMO Financial Group and as an Associate (ETL/Talend Lead Developer) at Cognizant. At Cognizant, he developed Talend applications to extract data from the source, transform, and then load into a data-lake hosted in AWS cloud. He also managed AWS resources for the S3 and EC2 Instances and the respective database objects for the MS SQL server. Vigneshwaran's tech stack includes Data Engineering, AWS, SQL, Big Data, ETL, HDFS, Python, Spark, Data Warehouse, designer, and Apache Hive. He has a keen interest in testing and has performed and documented unit tests and system testing of the ETL process and various scripts/extracts.