Skip to content

PATTERN Cited by 1 source

Nested composable workflows

Description

Build complex ML pipelines from smaller, reusable sub-workflows via nesting and joining. Each sub-workflow is a self-contained pipeline that can be developed, tested, and run independently, then composed into larger pipelines without reimplementation.

This separates: - Workflow definition — each team owns their sub-workflow independently - Workflow composition — higher-level pipelines reference sub-workflows by name/version - Execution — the orchestrator handles dependency resolution and execution ordering across nested boundaries

Seen In

(Source: sources/2026-06-10-atlassian-architecting-scalable-ml-platforms)

Last updated · 542 distilled / 1,571 read