Data Engineering & AI Ops
The plumbing that decides whether AI works at all
- Duration
- 14 weeks
- Level
- Intermediate
- Effort
- 12–15 hrs/week
- Format
- Live online + project labs
Next cohort intake is open · instalments available
Every failing AI project we have audited failed at the data layer, not the model layer. This track covers the unglamorous half that decides everything: reliable pipelines, well-modelled warehouses, orchestration that recovers from failure, and the operational discipline to run models in production.
What you will be able to do
- Build ingestion pipelines that are idempotent and recover from failure
- Model a warehouse that analysts and applications can both use
- Orchestrate scheduled and event-driven workflows with proper alerting
- Operate vector stores and embedding pipelines at production scale
- Serve and monitor models, and detect drift before users report it
- Attribute and control infrastructure and inference cost
Entry expectations
If you are close but not quite there, tell us at application. We would rather get you ready than turn you away.
- 01Python and SQL fundamentals
- 02Basic command line and Git
- 03Some exposure to databases
The route, module by module
8 modules over 14 weeks. Every one ends in something deployed to a real URL and reviewed line by line.
- Batch and streaming, file formats, partitioning, idempotency, and why most pipelines break on the second run
- Advanced SQL, dimensional modelling, slowly changing dimensions, and building marts people trust
- Airflow or Dagster, dependencies, retries, backfills, data contracts and quality tests
- Chunking at scale, embedding pipelines, index maintenance, incremental updates and permission filtering
- Packaging, batching, GPU and CPU trade-offs, autoscaling, and latency budgets under real traffic
- Data quality monitoring, model performance monitoring, drift detection, and alerts that mean something
- Storage lifecycle, compute right-sizing, caching, token accounting and per-tenant cost attribution
- An end-to-end pipeline feeding a served model, with quality tests, dashboards and a cost report
What you will have built
- 01An idempotent ingestion pipeline with data quality tests
- 02A dimensional warehouse with documented contracts
- 03An embedding pipeline with incremental index updates
- 04Capstone: a monitored, cost-attributed production data and model platform
Roles this prepares you for
Before you apply
Not the right track? Try these
AI Engineering & Applied LLMs
Build AI features that survive production, not demos that survive a slide
View trackFull-Stack SaaS Development
Learn to build multi-tenant products, not another todo app
View trackFrappe & ERPNext Developer
A specialist skill with more open roles than qualified people
View trackReady to build things that ship?
Apply for the next cohort. The first conversation is an honest assessment of where you are and what it will take.