CITCO / DATA PLATFORM
A shared foundation
for enterprise data.
Reusable platform capabilities that help business teams onboard data products with consistent engineering and governance.
THE ENGINEERING
- Configuration-driven Python and PySpark frameworks for pipeline development and centralized execution auditing.
- Bronze, Silver, and Gold pipelines within a Data Mesh, with incremental ingestion from Oracle, SQL Server, and SharePoint.
- Reusable DQX checks, platform-wide column masking, and lineage-aware schema-change approvals.
More about my contribution
I work with Data Stewards and business teams to translate business rules into production pipelines. My work also includes Terraform and Databricks Asset Bundles deployments, and Spark optimization through incremental processing, partitioning, clustering, and selected DLT-to-job migrations.
