■ Pipelines
8 pipelines — 1 running, 1 errors
■ idle
sales_analytics_daily
Sync sales orders, customers, and products from PostgreSQL to Snowflake for BI dashboards.
💾
Extract
PostgreSQL
►
⚙
Transform
filter cancelled
►
⚙
Transform
normalize currency
►
⚙
Transform
join customers
►
⚙
Transform
aggregate daily
►
☁
Load
Snowflake
SCHEDULE
Daily at 02:00 UTC
LAST RUN
12m ago success
SUCCESS RATE
ROWS / 30 DAYS
2.4M
AVG DURATION
14s
■ idle
inventory_sync
Pull product inventory from REST API every 2 hours and upsert into operational MySQL database.
📡
Extract
REST API
►
⚙
Transform
map fields
►
⚙
Transform
filter inactive
►
⚙
Transform
validate sku
►
💾
Load
MySQL
SCHEDULE
Every 2 hours
LAST RUN
1h ago success
SUCCESS RATE
ROWS / 30 DAYS
117K
AVG DURATION
7s
■ idle
product_catalog_export
Nightly export of full product catalog from MongoDB to S3 in Parquet format.
💾
Extract
MongoDB
►
⚙
Transform
flatten nested
►
⚙
Transform
convert to parquet
►
⚙
Transform
partition by category
►
📁
Load
Amazon S3
SCHEDULE
Daily at 01:30 UTC
LAST RUN
3h ago success
SUCCESS RATE
ROWS / 30 DAYS
430K
AVG DURATION
22s
■ idle
finance_ledger_sync
Sync accounting ledger from MySQL to BigQuery for finance reporting. PII anonymised in transit.
💾
Extract
MySQL
►
⚙
Transform
anonymize pii
►
⚙
Transform
cast amounts
►
⚙
Transform
validate balances
►
☁
Load
BigQuery
SCHEDULE
Every 12 hours
LAST RUN
4h ago success
SUCCESS RATE
ROWS / 30 DAYS
104K
AVG DURATION
9s
■ idle
crm_contacts_delta
Incremental sync of CRM contact changes from Salesforce into internal PostgreSQL replica.
◫
Extract
Salesforce
►
⚙
Transform
delta detect
►
⚙
Transform
map sf fields
►
⚙
Transform
upsert by contact id
►
💾
Load
PostgreSQL
SCHEDULE
Every 15 minutes
LAST RUN
5h ago partial
SUCCESS RATE
ROWS / 30 DAYS
271K
AVG DURATION
19s