PATTERN Cited by 1 source

S3 event-triggered composition

Definition

S3 event-triggered composition is the activation pattern where uploading a specification file to an Amazon S3 bucket triggers pipeline assembly via an S3 event notification → Lambda invocation. The uploaded specification is the only input needed to define, validate, and start a data transformation pipeline.

Flow

1. User/system uploads a specification (JSON/YAML) to an S3 bucket.
2. S3 event notification invokes a Lambda composer function.
3. The composer reads the specification from S3, validates it, queries the capability registry, and assembles a Step Functions workflow.
4. The workflow begins processing.

Benefits

• Zero-code pipeline creation — a new pipeline is launched by uploading a file, not deploying code.
• Auditability — the S3 object (specification) is the immutable record of what was requested.
• Flexible triggering — the same composer can also be invoked via EventBridge schedules, API Gateway, or direct Step Functions StartExecution for different use cases.

(Source: sources/2026-07-09-aws-specification-driven-composition-for-flexible-data-workflows)

Seen in

• sources/2026-07-09-aws-specification-driven-composition-for-flexible-data-workflows — AWS Architecture Blog (2026-07-09): S3 event notification as the primary trigger for pipeline composition.