About

Anil Varma.G is a Senior Software Engineer at CGI with over 4.5 years of relevant experience in the field of Data Engineering. He possesses a strong technical background and a deep understanding of various technologies, including AWS Redshift, AWS Athena, AWS EMR, AWS Glue, S3, Apache Sqoop, Yarn, HDFS, Scala, Spark streaming, Hive, HBase, Linux, Airflow, SQL, and Ex CTS. Anil has worked extensively on the design and development of solutions for Big Data using the Hadoop Eco System technologies, such as HDFS, Sqoop, Hive, Spark, HBase, Kafka, and spark streaming. He has hands-on experience in developing Spark applications using RDD transformations and Data Frames with Spark SQL Functions. He has also performed complex data analytics with Spark on JSON and XML formats and has processed structured, semi-structured, and complex data using Spark. Anil is proficient in Hive-HBase integration and has working experience on Spark-hive integration. He is capable of processing large sets of structured and semi-structured data and has experience with different file formats such as AVRO, ORC, CSV, JSON (Complex JSON), XML, and PARQUET. He has also worked on AWS Components like Glue, S3, EMR, ATHENA, and REDSHIFT. Anil has a Master of Technology degree in Computer Science from jntu, and he has previously worked as a Data Engineer at CGI, where he gained exposure to various aspects of data engineering. He has also worked as an Associate at Cognizant. Anil's tech stack includes AWS, Spark, SQL, HDFS, Data Engineering, Hadoop, Software Engineer, Databricks, Amazon Athena, AWS Glue, Apache Airflow, Scala, Apache Hive, Kafka, Big Data, Integration, NoSQL, MySQL, infra, test, Mobile, and Web. He is a highly motivated individual with a passion for learning and keeping up with the latest technologies in his field.