Z

Zhiwei

Data Solution Architect | Building enterprise-grade data platforms

I’m a Senior Data Engineer / Tech Lead who builds cloud-native data platforms that are reliable, scalable, and easy to operate. I’ve worked across real-time + batch data systems, from legacy warehouse modernization to modern lakehouse CDP and master data management (MDM) .

  • What I build: customer data platforms (CDP), data warehouses/lakehouses, MDM systems, data migration factories, and developer productivity tooling
  • How I work: pragmatic architecture, strong data quality/governance, IaC + CI/CD, and automation-first delivery (including regulated / isolated client environments)
  • Tech highlights: AWS (S3, Redshift, Glue, Lambda, Step Functions, Athena), Azure (Power Platform/Dataverse/Cosmos DB), Spark/Flink/Kafka, Python/SQL, Terraform, GitHub Actions/GitLab CI
  • Leadership: led/mentored engineers, owned end-to-end delivery, and partnered closely with business stakeholders

Senior Data Engineer

MegaConsulting Tech Solutions Ltd.

2022-11 — Present
AWSAzureCloud MigrationCDPMDMDatabricksSparkPython

Technical lead for BioLife Sciences, driving digital transformation through cloud migration and modern data architecture.

Senior Data Engineer
+2

Resume as Code

Personal Project

2025-12 — Present
LLMAI AgentsPrompt EngineeringYAMLAutomationResume Generation

AI-powered system to automate the creation of highly tailored resumes.

Retail Master Data Management Platform

MegaConsulting

2025-05 — 2025-12
Power PlatformDataverseAzureCosmos DBReactTypeScriptPython

Architected a comprehensive Retail MDM System leveraging Microsoft Power Platform.

AWS Knowledge: AWS Graviton

AWS Training and Certification

2025-12
AWSGravitonCloud

Recognized verified knowledge in leveraging Arm-based Graviton processors.

AWS Knowledge: AWS Graviton

AWS Certified Developer – Associate

AWS Training and Certification

2024-09
AWSDeveloperCloud

Comprehensive understanding of application life-cycle management on AWS.

AWS Certified Developer – Associate

AWS Certified Data Analytics – Specialty

AWS Training and Certification

2024-01
AWSData AnalyticsCloud

In-depth understanding of how to use AWS services for data collection, storage, and processing.

AWS Certified Data Analytics – Specialty

BioLife Sciences Customer Data Platform (CDP)

MegaConsulting Tech Solutions Ltd.

2022-11 — Present
AWSCDPIaCTerraformPythonSnowflakeDatabricks

Architected and engineered the cloud-native CDP to unify fragmented customer data.

Enterprise Data Warehouse Migration to AWS

MegaConsulting Tech Solutions Ltd.

2022-11 — 2023-05
AWSRedshiftPythonSQL ServerData MigrationStep Functions

Spearheaded the strategic modernization of a legacy 10TB+ Enterprise Data Warehouse.

Data Engineer

Patsnap Information Technology (Suzhou) Co. Ltd.

2021-06 — 2022-11
SparkFlinkTiDBAWSData LakeReal-time Data WarehousePython

Served as a core Big Data Developer for the TFFI (Technology & Innovation Finance) SaaS product.

Data Engineer

Intsig Information Co., Ltd.

2019-06 — 2021-06
PythonETLRedisKafkaMySQLMongoDBCI/CDDevOps

Spearheaded data engineering initiatives for Qixinbao, a leading enterprise business intelligence platform.

Large-scale Distributed Functional Dependency Mining

City University of Technology

2018-03 — 2019-06
SparkBig DataDistributed AlgorithmsData Mining

Research and implementation of a distributed functional dependency mining algorithm based on Apache Spark.

Bachelor of Computer Science and Technology

City University of Technology

2015-09 — 2019-07
Computer ScienceCloud ComputingSparkData Mining

Awarded Third Prize in the 4th National University Cloud Computing Application Innovation Competition (2018).

Software Engineering Intern

StartupHub Inc.

2021-08 — 2022-06
React NativeMobileTypeScript

Summer internship focusing on mobile app development.

Best Innovation Award

Global Hackathon 2021

2021-05
HackathonAI

First place winner among 500+ global teams.

Best Innovation Award
+3

ACM-ICPC Regional Contest

International Collegiate Programming Contest

2020-11
AlgorithmC++Competitive Programming

Silver Medalist in the Asia Regional Contest.