About

Rohit Anurag is a Data Engineering Lead at PerpetualBlock with over 7 years of relevant experience in the field. He is a big data enthusiast and loves deploying large-scale data processing programs on multiple nodes communicating with each other using network protocols. Rohit is involved in maintaining and updating the company's data pipeline from crawling to search analysis. Rohit is an experienced professional in Apache Open Source Project, including Spark, Kafka, HDFS, Hadoop, etc. He is currently developing a proprietary database for Life Science that combines the power of storage, graph, and search database into one platform. Rohit is an expert in Python language and has a deep understanding of data engineering, HDFS, search, Spark, Kafka, Elastic Search, and big data. Rohit has previously worked at Innoplexus as a Senior Member Of Technical Staff and Member Of Technical Staff. At Innoplexus, he led a team of 4 people into developing Innoplexus's own Life Science's compliant database. He rewrote 3 Open Source storage, graph, and search database's codebases into one unified database. He built a synchronization layer between HDFS and ElasticSearch Platform and developed a Data Ingestion Pipeline through which raw crawled data is converted into searchable format. Rohit also built a MongoConnector Plugin which replicates operation from MongoDB Oplog for data insertion into ElasticSearch(ES). Rohit holds a Bachelor of Technology (BTech) in Computer Science and Engineering from Indian Institute of Technology, Kanpur. He also holds a CBSE Board Passing Certificate in Science from Chinmaya Vidyalaya, Bokaro Steel City. Rohit's tech stack includes Data Engineering, HDFS, Python, Search, Spark, Kafka, Elastic Search, Big Data, Software Engineer, Hadoop, Golang, Tokenization, Javascript, and MongoDB. He is a skilled data engineer with a passion for solving complex problems and delivering high-quality results.