S3 sources and path mappings
S3 source pipelines, enabled for selected companies, map explicit paths to destination tables and checkpoint objects only after a successful flush.
S3 source pipelines can be enabled for selected companies and configured with explicit path mappings to destination tables. Artie validates the source bucket and connection before deployment, and checkpoints each processed object only after its data flushes successfully.
Why this matters
- Control which S3 objects map to which destination tables
- Validate S3 connectivity before a pipeline goes live
- Resume safely without advancing past unflushed objects