Quickstart

Artie is a fully managed CDC streaming platform that allows you to replicate data from your source database to your destination in real-time. From capturing changes to merging data, Artie manages the entire data ingestion lifecycle.

Creating your first pipeline

Click + New pipeline and specify the source you want Artie to replicate from.

1. Select your source database

   How would you like Artie to connect to your source?

   Connection options

   Artie’s fixed IPs, instructions for setting up SSH tunnels, and more.

   Source setup guides

   Setup steps and service account scripts for each source, starting with PostgreSQL.

2. Select the tables you want to replicate

   Select the tables you’d like Artie to replicate. Additionally, you can enable history mode History mode will create a separate table with the __history suffix which is an audit log table that tracks every change, type of database operation, and timestamp for specific tables that you would like to have additional tracking.

   To change settings for one table, click the gear icon in its Advanced settings column.

   Table settings

   Specify settings like table alias, column exclusion, merge predicates, and more.

3. Select your destination

   Choose your destination and provide destination-specific details.

   Destination setup guides

   Connection details and permissions for each destination, starting with Snowflake.

   Once the destinations have been filled out, you can optionally change any of these advanced settings.

   Add 'Artie updated at' column

   When enabled, Artie will add a new column __artie_updated_at to your tables. This is useful for incremental models.

   Add 'database updated at' column

   When enabled, Artie will add a new column __artie_db_updated_at to your tables. This is the database time for when the transaction occurred.

   Drop deleted columns

   By default, Artie never drops destination columns. Turn this on to drop any destination column that isn’t in the source, including columns deleted or renamed in the source and columns added only in the destination.

   Soft-delete rows

   By default, Artie will hard delete rows. If this is enabled, we will start to soft delete rows. Soft-deleted rows have __artie_delete set to true.

Monitoring

Once your pipeline is live, you can monitor its status from the analytics portal and stay up to date on your schema changes from our schema change notifications.