Liner Notes / 03 Pipeline

Pipeline / Operations

A snapshot of the two Fivetran connectors, each dbt model layer, raw lake freshness, and the CloudFront deployment that serves this site. Snowflake is the destination for both connectors.

Connectors

Two custom Fivetran Connector SDK pipelines. Spotify syncs hourly; MusicBrainz runs daily against the 96-album essentials.

Spotify Web API

Schedule Every hourLast sync 12 minutes agoFivetran ID liner_notes_spotifyOpen in Fivetran

recently_played1,847 rows synced

top_tracks_short_term50 rows synced

top_tracks_medium_term50 rows synced

top_tracks_long_term50 rows synced

top_artists_short_term50 rows synced

top_artists_medium_term50 rows synced

top_artists_long_term50 rows synced

saved_tracks2,341 rows synced

MusicBrainz API

Schedule DailyLast sync 2 hours agoFivetran ID liner_notes_musicbrainzOpen in Fivetran

artists74 rows synced

releases96 rows synced

release_groups96 rows synced

labels38 rows synced

dbt Models

16 models across 4 layers. 101 / 102 tests passing.

Staging

view

44/44 tests

stg_spotify__recently_played

14 min ago

stg_spotify__top_tracks

14 min ago

stg_spotify__top_artists

14 min ago

stg_spotify__saved_tracks

14 min ago

stg_mb__releases

2 hr 8 min ago

stg_mb__artists

2 hr 8 min ago

int_canon_enriched

14 min ago

int_play_history_deduped

14 min ago

marts / core

snowflake table

26/26 tests

dim_albums

14 min ago

dim_artists

14 min ago

fct_plays

14 min ago

marts / listening

snowflake table

16/17 tests

1 warn

mart_top_tracks

14 min ago

mart_top_artists

14 min ago

mart_faves_vs_reality

14 min ago · 1 warn

marts / curation

snowflake table

15/15 tests

essentials

14 min ago

mart_pipeline_health

14 min ago

Test suite101 passing · 1 warnings · 0 errors

Snowflake Table Freshness

Raw Snowflake tables in the LINER_NOTES database. Bars show relative row volume per day over the last 7 days, oldest left. Landed by Fivetran on each connector sync.

raw_spotify

recently_played

Latest partition

2026-05-20 09:47 UTC

Age

12 min ago

top_tracks

Latest partition

2026-05-20 09:47 UTC

Age

12 min ago

top_artists

Latest partition

2026-05-20 09:47 UTC

Age

12 min ago

saved_tracks

Latest partition

2026-05-20 09:47 UTC

Age

12 min ago

raw_mb

releases

Latest partition

2026-05-20 07:38 UTC

Age

2 hr ago

artists

Latest partition

2026-05-20 07:38 UTC

Age

2 hr ago

release_groups

Latest partition

2026-05-20 07:38 UTC

Age

2 hr ago

labels

Latest partition

2026-05-20 07:38 UTC

Age

2 hr ago

App Deployment

Static Next.js export on S3, served via CloudFront. build_snapshot.py writes the JSON files that this site reads.

Deployed — healthyus-east-1

Build hash

a3f8c12

Built at

2026-05-20 09:51 UTC

CF distribution

E2QK3XVBJ9MNOP

Last invalidation

9 minutes ago

Edge cache hit rate

94.2%

Deploy chain

terraform→fivetran sync→dbt run→build_snapshot.py→next build→s3 sync→cf invalidation

Colophon · Build-time snapshot

These figures are frozen at build time, the same way analytics-layer numbers freeze when a dbt model lands its last successful run. The two Fivetran connectors, the dbt project, and the Terraform that spins up Snowflake plus CloudFront all live in this repo under /connectors, /transform, and /infra — point your own warehouse at them to see live row counts.