[ Projects ] · 3 of 9
Data engineering
- 03Coding agent for loading files whose layout keeps changingPartner files arrive by email and their layout drifts. A known layout runs an approved loading script with no model call; a new one goes to a sandboxed coding agent, then to automated checks and a human approval.
- 04Agent-assisted migration of legacy ETL jobs to PySparkLegacy ETL jobs and master-data (MDM) flows rebuilt one for one in PySpark. Plain code writes the skeleton, an agent fills only the marked gaps, and a job is accepted when its outputs match today's.
- 07Predictive purchase models in the data warehouseSeven models of what drives customers to buy, built and scored inside the business's data warehouse, with automated deployments and indicators for analysts.