About

Deepak Singh is a Senior Data Engineer at Paytm with over 8 years of relevant experience in the field of Data Engineering. He has a strong background in Big Data technologies such as Hadoop, Hive, PIG, SQOOP, NoSQL (HBASE), and Spark (Spark Core and Spark SQL). He is also proficient in programming languages such as Python, Scala, and Java (Core Java, Struts, Spring, Hibernate, EJB, Web Services (Rest and SOAP) API's) and ORACLE. Deepak's expertise lies in designing and implementing large-scale data processing systems and building data pipelines that can handle massive amounts of data. He has experience in data ingestion to HDFS from RDBMS and archived files using Sqoop, applied ETL operations for data cleansing and processing using Pig, and exposed the cleansed data in a tabular format using Apache Hive to other APIs. He has also developed a centralized store for capturing customer information using NoSQL Columnar DB, HBase, for random read and write operations. Deepak has also developed UDFs using Java in Hive for custom operations resulting in fewer queries and analyzed millions of transactional log files using Apache Spark (PySpark) to predict the customer's transactional behavior and thus improving customer experience. Prior to joining Paytm, Deepak worked as a Senior Software Engineer/Hadoop Developer at Nucleus Software, where he was responsible for developing and implementing data processing systems. He also worked as a Software Trainee at Nucleus Software, where he worked on the Customer Acquisition System related to lending money to customers. Deepak holds a Bachelor of Technology in Computer Engineering from PTU and a Master of Science in Computer Science from Lovely Professional University. His technical skills include Data Engineering, Spark, Java, SQL, Hadoop, NoSQL, Apache Hive, Big Data, Web, HDFS, Spring, Software Engineer, ETL, Python, and Scala.