Module 2: Pipelines, orchestration, and quality

Module 2: Pipelines, orchestration, and quality#

AINS6006 — Big Data Management for AI Applications

Essential Question#

How do data pipelines fail, and how are failures detected?

Core Moves#

  • Define the problem boundary

  • Identify evidence and assumptions

  • Build or evaluate the artifact

  • Communicate limits and next actions

Lab & Assignment#

Build a small quality-checked pipeline.

Use the assignment notebook to turn lab evidence into a defensible recommendation.