About

Avni Gupta is a skilled Hadoop Administrator with over 7 years of relevant experience in administering Hadoop, CDH, Spark, DevOps, Kerberos, Ansible, Linux, and various technologies running alongside Hadoop. Currently, she is working as a Senior Engineer at dunnhumby. Avni has worked with various companies in the past, including dell as a Data Engineer and cgi as an Associate Software Engineer. At dell, she worked on Big Data/Ingestion framework using SpringXd and RabbitMQ as the messaging queue. She also supported the Hadoop framework through monitoring tools like Ambari and Cloudera Manager. Additionally, Avni worked on another Ingestion framework built upon Steamsets, Kafka, and burrow tools. She managed unstructured data using NoSQL database- MongoDB, which is actively used to store metadata. Avni has expertise in Cassandra and supporting global customers. She also has support knowledge on Greenplum database and is familiar with ETL techniques and frameworks such as Flume. She has development knowledge on Sqoop/Hive/ PIG/ HUE, and Spark, and implemented Spark for log analysis. At cgi, Avni worked on Pig, Hive, Sqoop, HBase, and Clouded Manager. She worked on data export/import using Sqoop from HDFS to RDBMS and imported data into Hive using Sqoop. Avni performed log analysis on text logs using Apache Spark. She worked on modal databases, including HBase and MongoDB, and was familiar with MapReduce programming. She also has experience in installation, configuration, and supporting Jboss and Websphere application server and built and deployed applications in Jboss and Websphere application server. Avni completed her B.Tech in IT from abes in 2015 and attended Dayawati Modi Public School. Her tech stack includes Hadoop, Spark, Ansible, Data Engineering, MongoDB, DevOps, Big Data, RabbitMQ, NoSQL, Cassandra, Kafka, ETL, Apache Hive, Software Engineer, HDFS, and MapReduce. Avni is a highly skilled Hadoop Administrator with a proven track record of success in the field.