About

SreenivasaRao Venigalla is an experienced Information Technology professional with a demonstrated expertise in the field of Big Data Analytics, Enterprise Application Development, and system admin task automation framework. He has an overall 9 years of domain exposure on Power sector, Banking, Credit Reporting, and financial sector and understanding business/functional requirements and proving best possible technical deliverables. As a Big Data Engineer at Experian, SreenivasaRao has been responsible for data consumption, filtering, transformation, and report generation workflow along with monitoring of distributed computing environment. He has a good understanding of complex processing needs of big data and has expertise in developing codes and modules to address those needs. He is adept at articulating complex technical solutions to clients of varying technical understanding. SreenivasaRao is well versed with complex data structures, algorithms, common operating systems, and programming languages like Java, Scala, and Python with a proven ability to master new tools and technologies. His specialties include Big Data Analytics, Apache Spark 1.6 and 2.3 (Spark Core, Spark SQL, Spark Streaming, and Structured Streaming), Hadoop (Cluster setup, File system management), Hadoop Eco System (HIVE, PIG, basics of HBASE, SQOOP), Cloudera CDH 5.5.4, CDH 5.12 Impala, HUE Oozie, Zookeeper, KAFKA, Auttunity, AWS S3, EKS, MSK, Aurora, EFS, GCP data proc, cloud storage, Big query Cassandra, RocksDB, Solace JMS Messaging, Scala, Java, Python, J2EE (Spring, Hibernate Frameworks), Junit, Scala Test, Oracle, MySQL SQL, JIRA, GitHub, Jenkins, Shell script, Puppet, Redhat Linux 6. SreenivasaRao has previously worked as a Senior Software Engineer at Experian and Senior Software Engineer (Onsite Assignment - UK) at HCL. He has experience in developing ETL processes using Spark applications to provide end-to-end data transformation and deep insight by calculating profit & loss (PnL) and value at risk (VaR) from raw market data. He has integrated several data sources like Oracle database, HDFS raw files, Hive table data, and data from NFS mount into Spark data abstraction called RDD and DataFrame where data are filtered and transformed and persisted back to hive