LIVE 3
■ idle

sales_analytics_daily

Sync sales orders, customers, and products from PostgreSQL to Snowflake for BI dashboards.

💾
Extract
PostgreSQL
Transform
filter cancelled
Transform
normalize currency
Transform
join customers
Transform
aggregate daily
Load
Snowflake
SCHEDULE
Daily at 02:00 UTC
LAST RUN
12m ago success
SUCCESS RATE
99.1%
ROWS / 30 DAYS
2.4M
AVG DURATION
14s
▶ running

user_events_stream

Real-time streaming of user behaviour events from Kafka into BigQuery for product analytics.

Extract
Kafka
Transform
parse json
Transform
enrich geo
Transform
deduplicate by id
Transform
cast timestamps
Load
BigQuery
SCHEDULE
Continuous Stream
LAST RUN
now running
SUCCESS RATE
88.2%
ROWS / 30 DAYS
88.2M
AVG DURATION
<1s
■ idle

inventory_sync

Pull product inventory from REST API every 2 hours and upsert into operational MySQL database.

📡
Extract
REST API
Transform
map fields
Transform
filter inactive
Transform
validate sku
💾
Load
MySQL
SCHEDULE
Every 2 hours
LAST RUN
1h ago success
SUCCESS RATE
97.8%
ROWS / 30 DAYS
117K
AVG DURATION
7s
☓ error

marketing_attribution

Joins ad spend data from multiple sources, applies attribution model, loads to Redshift.

Extract
Segment
Transform
merge channels
Transform
apply attribution model
Transform
aggregate by campaign
Load
Redshift
SCHEDULE
Daily at 06:00 UTC
LAST RUN
2h ago failure
SUCCESS RATE
72.5%
ROWS / 30 DAYS
0
AVG DURATION
28s
■ idle

product_catalog_export

Nightly export of full product catalog from MongoDB to S3 in Parquet format.

💾
Extract
MongoDB
Transform
flatten nested
Transform
convert to parquet
Transform
partition by category
📁
Load
Amazon S3
SCHEDULE
Daily at 01:30 UTC
LAST RUN
3h ago success
SUCCESS RATE
100.0%
ROWS / 30 DAYS
430K
AVG DURATION
22s
■ idle

finance_ledger_sync

Sync accounting ledger from MySQL to BigQuery for finance reporting. PII anonymised in transit.

💾
Extract
MySQL
Transform
anonymize pii
Transform
cast amounts
Transform
validate balances
Load
BigQuery
SCHEDULE
Every 12 hours
LAST RUN
4h ago success
SUCCESS RATE
100.0%
ROWS / 30 DAYS
104K
AVG DURATION
9s
■ idle

crm_contacts_delta

Incremental sync of CRM contact changes from Salesforce into internal PostgreSQL replica.

Extract
Salesforce
Transform
delta detect
Transform
map sf fields
Transform
upsert by contact id
💾
Load
PostgreSQL
SCHEDULE
Every 15 minutes
LAST RUN
5h ago partial
SUCCESS RATE
95.3%
ROWS / 30 DAYS
271K
AVG DURATION
19s
▮▮ paused ▮ disabled

log_archive

Archive CloudWatch application logs to S3 Glacier for long-term retention and compliance.

Extract
CloudWatch
Transform
compress gzip
Transform
partition by date
📁
Load
S3 Glacier
SCHEDULE
Weekly Sunday 03:00 UTC
LAST RUN
6h ago success
SUCCESS RATE
100.0%
ROWS / 30 DAYS
12.4M
AVG DURATION
47s