About

Chen Zheng is a highly skilled Data Engineer with 7.79 years of relevant experience in the field. Currently working at Facebook as a Data Engineer, Chen has previously worked as a Big Data Engineer at Vectorworks where he was responsible for designing, implementing, and maintaining ETL pipelines for various data. At Vectorworks, Chen successfully implemented automated Spark batch processing pipelines for user logs data using Spark, collected user logs stored in S3, ran daily batch jobs on Spark EMR to process user logs, and stored processed data in Elasticsearch, Redshift, and S3. He also provided Kibana dashboards for log search and Tableau workbook for aggregation metrics. Chen utilized Spark, Linux Shell, Pandas, and AWS EMR for this project. Chen also designed and implemented a real-time data pipeline which symbolizes and categorizes crash data, developed a Flask web application which engineers and QAs use to search frequent crashes and respond promptly to critical bugs, and provided metrics and reports to ensure product stability can be measured, monitored, and evaluated. He utilized AWS API gateway, SQS, Kinesis, Lambda, EC2, CloudFormation, DynamoDB, Elasticsearch, Flask, and Plotly for this project. Furthermore, Chen designed and implemented data pipelines for Marketing, Content, and Publications teams, collected log data from various locations, cleaned and transformed data using Python/Pandas on Lambda or EC2, and provided KPI dashboards to help different teams monitor the effectiveness and popularity of their work. He also worked with distributors in different countries to create customized metrics in their market and delivered customized reports in daily updated Tableau workbooks to help them understand their customers and product modules better. Chen holds a Master's Degree in Management Information Systems from Carnegie Mellon University and Bachelor's Degrees in Management Information Systems, General from Tsinghua University and International Business from the International School of Management. His technical skills include Data Engineering, Spark, Elastic Search, AWS, Pandas, Search, Flask, Big Data, Python, Web, ETL, Software Engineer, test, and Django.