Plans012 2026 02 23 Pipeline Workflow Unification
Completed
- T-001: Refactor CLI argument parser
- T-002: Add sync command
- T-004: Create _pipeline_runs table
- T-005: Add transform command
- T-006: Add publish command
- T-007: Create unified report command
- T-008: Implement quarterly report aggregation
- T-009: Add staleness check
- T-010: Implement dimension resolver for db_person
- T-011: Implement dimension resolver for db_organization
- T-012: Implement db_account creation for orders
- T-003: Update root package.json scripts
- T-013: Update AGENTS.md pipeline commands
- T-014: Update architecture.md deployment section
- T-015: Update @packages/pipeline AGENTS.md
- T-016: Deprecate old
runcommand
In Progress
- None yet
Blocked
- None
Pending
- None
Learnings
- Parsing month ranges centrally (
parseMonth) prevents command-specific validation drift. - Pipeline metadata helpers are easier to compose when table bootstrap is idempotent in DuckDB.
syncorchestration stays readable when stage boundaries are explicit and logged per step.- Wrapping dbt invocation in a command module makes standalone
transformand chainedsyncflows share the same behavior. - Publish dimension resolution is safer when caches are keyed by normalized natural keys and scoped to entity context.
- Runtime lookup maps from LibSQL reference tables reduce hard-coded ID coupling inside pipeline command logic.
- Range-based report assembly is easiest to evolve when report generation and JSON writing are separated into reusable helpers.
- Staleness checks are operationally safer as warnings (not hard failures) with explicit
--forceoverride. - Root script ergonomics improve adoption when primary workflows are promoted and stage commands remain available for debugging.
- Keeping
runas a warning alias provides migration safety without preserving outdated behavior.
Questions
Should→ Keep as-isclean-reportcommand be kept as-is or folded intoreport?Should→ Deprecate with warningruncommand be deprecated or kept as alias?
Next
- Run
/plan.reviewfor final compliance and closure notes. - Prepare commit(s) with pipeline + docs + plan artifact updates.
- Propose
@plan/state.mdupdate to reflect completed workflow unification.