Roast & Rise

Published by Roast & Rise

AI-Ready Data Foundation Sprint

Make one AI workflow's data fit for purpose, accessible, owned, and monitored.

Map the data one AI workflow uses, test its fitness and access, fix the blocking gaps, and assign ownership for ongoing review.

A cinematic still life showing a layered architectural foundation of translucent, warm-toned blocks beneath a softly glowing, minimal structure. Some blocks are missing or shadowed; a beam of warm light highlights the gaps and guides attention to newly reinforced layers. No visible people, hands, text, or screens. Editorial, minimal, orange and warm-neutral palette, generous space.
AI work depends on records, access paths, transformations, and owners that teams can trace and test.

Course thesis

Data becomes AI-ready in context. Map one workflow, test the data against its real requirements, expose blocking failure modes, fix the smallest coherent set, and monitor the conditions that could make the data unfit again.

What you leave with

You will leave with a workflow-specific data map, fitness tests, a ranked blocker register, a focused fix plan, and named monitoring ownership.

For

Founders, operations and IT leaders, data owners, product teams, and sponsors preparing or reviewing an AI workflow.

Workflow

Map one workflow's data, test fitness and access, rank blocking failure modes, close the smallest set of gaps, and monitor drift and change.

Change

Move from broad data-readiness claims and cleanup backlogs to workflow-specific tests, evidence-backed blockers, focused fixes, and owned monitoring.

What you can do

Use these as checks while you move through the plan.

Define AI-ready data for a specific workflow and decision

Trace exact sources, transforms, manual steps, permissions, and evaluation data

Test quality, representativeness, freshness, provenance, access, and leakage risk

Connect blocking failure modes to workflow consequences and controls

Verify focused fixes through acceptance tests

Assign monitoring, escalation, revalidation, and retirement ownership

Chapters

01

Map the Data for One AI Workflow

Trace the data used by one AI workflow from origin through transforms and manual workarounds to the decision, output, and evaluation record.

A tidy, warm-lit tabletop scene showing a blank, branching flowchart on thick white paper, surrounded by different colored cards and folders—some precise, others slightly askew or sticking out as if recently discovered. A soft orange glow highlights a few 'edge' folders, suggesting shadow systems just brought into view. No visible text, screens, or body parts. Generous space, editorial, with a subtle tension between official and newly surfaced elements.
Map the systems, records, manual steps, and unofficial copies that feed the workflow.

AI-ready data is data fit for a specific AI workflow, with known origin, permissions, quality, representativeness, freshness, access path, owner, limitations, and monitoring. A generic claim that the organization's data is clean does not establish readiness.

Map the workflow before the platform. Name the decision or task, the people affected, the inputs used at each step, any labels or outcomes used for evaluation, and the systems that create, transform, join, export, or manually correct the data.

For industrial AI, the map may cross sensors, a historian, MES and ERP records, equipment identifiers, timestamps, units, maintenance logs, operator notes, and local spreadsheets. Asset identity, time alignment, operating state, and units belong in the map because a plausible join can still describe the wrong machine or moment.

NIST's AI Risk Management Framework asks teams to document intended use, context, data, dependencies, assumptions, limitations, and affected parties. Source: NIST, AI Risk Management Framework 1.0. The Workflow Data Map turns that guidance into a source-to-use inventory.

Worked example

Illustrative industrial map: a maintenance workflow joins sensor readings with equipment identity, operating state, work orders, and failure outcomes. The map requires the asset key, timezone, sampling interval, unit conversion, transform owner, and the manual spreadsheet used to correct work-order codes.

Quality checklist

The map covers one named workflow and decision

Exact records, transforms, joins, and manual steps are visible

Identity, time, units, and operating context are documented where material

Permissions and accountable owners are named

Evaluation outcomes or labels are included

Business and technical owners confirm the map

Common mistakes

Mapping systems without the exact records used

Leaving manual corrections and local extracts out of the flow

Joining data without checking identity, time, unit, or operating context

Ignoring the outcome or label needed to evaluate the workflow

Naming a technical custodian but no workflow owner

Turning unknowns into assumptions instead of marking them

Checkpoint

Can the workflow owner trace every material input from origin to use and explain how the output will be evaluated?

Exercise

Trace One Workflow from Source to Decision

Choose one live or proposed AI workflow and walk it with a business owner and a technical owner.

For each input, record:

  • Workflow step and decision supported
  • Record or signal used
  • Source system and exact object, table, stream, file, or field
  • Origin and collection method
  • Transformations and joins
  • Identifier, timestamp, unit, and operating context where relevant
  • Manual workaround or shadow copy
  • Permission and access path
  • Data owner and workflow owner
  • Evaluation label or outcome record
  • Known limitation or unknown

Output to complete

Workflow Data Map

Copyable template

AI workflow and decision:

Workflow step:

Record or signal:

Source system and exact object:

Origin and collection method:

Transformations and joins:

Identifier, timestamp, unit, and context:

Manual workaround or shadow copy:

Permission and access path:

Data owner and workflow owner:

Evaluation label or outcome:

Known limitation or unknown:

Use this at work tomorrow

Walk one AI workflow with its operator and data owner, then add the manual step or shadow source missing from the architecture diagram.

Core idea

AI-ready data starts with one workflow map that exposes origin, transforms, permissions, owners, and evaluation data.

02

Test Fitness, Quality, and Access

Translate workflow requirements into evidence-based tests for quality, representativeness, freshness, provenance, permissions, and reliable access.

A still life of a physical scorecard: a thick white paper with clear columns, a few colored disks or markers (orange shades) deliberatively placed in scoring boxes, and a stubby graphite pencil lying nearby. Some scoring areas are highlighted with warm light; others remain faded, showing gaps or issues yet to be addressed. No visible writing, text, hands, or UI. Editorial, minimal, and human in its arrangement—warm orange palette on a clean white surface.
A simple, shared scorecard—run in the open—lets your team confront which data feeds are strong, patchy, or broken before hidden flaws sink the project.

Data is ready only when it is suitable for the intended workflow and evaluation. Test the dimensions that can change the decision: correctness, completeness, consistency, freshness, representativeness, provenance, label quality, permission, retrieval reliability, and leakage risk.

Define each test from the workflow requirement. Freshness means something different for live equipment alerts, quarterly forecasting, and policy retrieval. A high average score can hide one blocking field, class, site, or access rule.

NIST's AI RMF Playbook asks teams to examine data suitability, representativeness, quality, provenance, assumptions, limitations, and ongoing measurement. Source: NIST, AI RMF Playbook.

The Workflow Data Fitness Scorecard uses pass, watch, or block for each requirement and attaches the test method, evidence, threshold, affected segment, owner, and action. A block stops the dependent test or release until resolved or explicitly accepted.

Worked example

Illustrative industrial test: for a predictive-maintenance input, define asset-ID match rate, timestamp alignment, unit consistency, operating-state coverage, failure-label lineage, access reliability, and leakage checks. Enter actual results only after running each test on the relevant equipment and period.

Quality checklist

Tests are tied to the intended workflow and decision

Thresholds are set before results are interpreted

Population, period, and weak segments are visible

Provenance, permissions, access, and leakage are included where relevant

Every watch or block has an owner and action

Business and technical owners can challenge the evidence

Common mistakes

Using a generic maturity score with no workflow threshold

Testing only averages and missing weak sites, classes, or operating states

Calling data representative without naming the target population

Checking availability but not permission or reliable retrieval

Using outcome information that would not exist at prediction time

Changing the pass threshold after seeing the result

Checkpoint

Can the workflow owner explain why each threshold is sufficient for the decision and which failed test blocks progress?

Exercise

Test One Critical Input

Select the input whose failure would most affect the workflow. Define tests before inspecting results.

For each requirement, record:

  • Requirement and why it matters
  • Dimension: correctness, completeness, consistency, freshness, representativeness, provenance, label quality, permission, retrieval, or leakage
  • Population and segment tested
  • Test method and source evidence
  • Pass threshold
  • Result: pass, watch, or block
  • Limitation or uncertainty
  • Owner and action

Have the workflow owner confirm that the threshold reflects operational risk, not only technical convenience.

Output to complete

Workflow Data Fitness Scorecard

Copyable template

Critical input:

Workflow requirement:

Fitness dimension:

Population and segment:

Test method and source evidence:

Pass threshold:

Result: pass/watch/block

Limitation or uncertainty:

Owner and action:

Workflow-owner confirmation:

Use this at work tomorrow

Define and run one blocking fitness test for the most important input in the target AI workflow.

Core idea

Data fitness is a set of workflow-specific tests with evidence and thresholds, not a general maturity label.

03

Find the Blocking Data Failure Modes

Turn failed fitness tests and map unknowns into a short register of the data conditions that can block safety, usefulness, evaluation, or value.

A focused, editorial tabletop showing a small stack of warning-red cards at the center of a wide white surface, each with a vivid orange edge revealed by soft angled light. Around them, neutral blank cards form a loose, ordered perimeter. The lighting and composition lock focus on the few urgent issues. No text, hands, or icons—just the tension between crisis (colored threat cards) and calm (blanks around). Warm, minimal, and cinematic.
Separate blocking data failures from lower-impact hygiene work so owners know what must be fixed before the workflow proceeds.

A blocking failure mode is a data condition that makes the intended workflow unsafe, unusable, unevaluable, or economically unjustified. Rank failure modes by their effect on the workflow, not by the number of fields affected.

Common blockers include unknown origin, incompatible identifiers, misaligned timestamps or units, stale extracts, missing outcome labels, target leakage, permission mismatch, unreliable retrieval, unrepresentative samples, undocumented manual corrections, schema drift, and no accountable owner.

The U.S. Government Accountability Office's AI Accountability Framework calls for attention to data origin, reliability, processing, intended use, performance, and ongoing monitoring. Source: U.S. GAO, AI Accountability Framework.

The Blocking Data Failure Register connects each failure mode to the affected workflow step, evidence, consequence, current control, detectability, decision status, owner, and required proof of closure.

Worked example

Illustrative industrial failure modes: asset identifiers do not match across historian and maintenance records; sensor timestamps use inconsistent timezones; units change after a firmware update; failure outcomes are recorded only for one site; an analyst corrects labels in an untracked spreadsheet. Each condition needs evidence and a workflow consequence before it enters the blocking queue.

Quality checklist

Each failure mode names an observable condition

Evidence links back to the map or fitness test

Workflow consequence and affected segment are explicit

Current control and detectability are recorded

Block, mitigate, accept, or investigate status has an authorized owner

Closure requires a rerun or other defined evidence

Common mistakes

Calling every quality issue a blocker

Writing vague failure modes such as bad data

Ignoring conditions that affect only a small but critical segment

Listing a risk without its current control or detectability

Accepting a blocker without an authorized decision owner

Closing a failure mode without rerunning the relevant test

Checkpoint

Can the sponsor explain why each item blocks or constrains the workflow and what evidence would close it?

Exercise

Convert Failed Tests into Failure Modes

Review the Workflow Data Map and every watch or block in the fitness scorecard.

For each failure mode, record:

  • Failure condition
  • Affected workflow step and decision
  • Evidence and source
  • Consequence for safety, usefulness, evaluation, compliance, or value
  • Population or operating condition affected
  • Existing control and detectability
  • Status: block, mitigate, accept, or investigate
  • Decision owner
  • Required proof of closure

Rank the register by workflow consequence and dependency. Keep lower-impact hygiene work visible but outside the blocking queue.

Output to complete

Blocking Data Failure Register

Copyable template

Failure condition:

Affected workflow step and decision:

Evidence and source:

Consequence:

Affected population or condition:

Existing control and detectability:

Status: block/mitigate/accept/investigate

Decision owner:

Required proof of closure:

Use this at work tomorrow

Write the one data failure condition that could invalidate the target workflow, attach its evidence, and ask the sponsor to confirm its decision status.

Core idea

A blocking data failure mode names the condition, affected decision, evidence, consequence, control, owner, and proof required for closure.

04

Fix the Smallest Set of Blocking Gaps

Choose focused interventions that clear the workflow's blocking tests, then verify closure with rerunnable evidence before release or expansion.

A minimal, cinematic desktop featuring three orange tokens or markers sliding from a labeled 'threat' area through to a well-defined 'fix' zone. Each marker rests in a visible path or tray bridging the gap, with soft orange light illuminating their journey. A few remaining tokens wait at the start, showing there’s always more to do. No text, screens, labels, or hands. Editorial, tangible, and cleanly structured.
Real progress looks like public, focused fixes—each issue owned, tracked, and measured where your AI needs it most.

The goal is to remove the blocking conditions for the target workflow, not to clean every source system. Choose the smallest coherent set of fixes that can satisfy the failed tests and make the next workflow decision possible.

A fix can change collection, identifiers, timestamps, units, labels, access, transforms, controls, evaluation design, or workflow scope. Sometimes the right action is to narrow or stop the AI use case because the required data cannot be obtained lawfully, reliably, or economically.

Define done as a rerunnable test result. A completed ticket, new pipeline, or revised policy is an implementation step; closure requires evidence that the workflow requirement now passes or that an authorized residual risk is recorded.

The Blocking Data Fix Plan names the failure mode, selected intervention, dependency, owner, cost and effort boundary, rollback, acceptance test, proof location, and release decision.

Worked example

Illustrative industrial fix plan: standardize asset identity before tuning a model; normalize timestamp and unit handling before rebuilding features; restore lineage for failure labels before evaluating performance. Each fix closes only when the relevant workflow test passes on the required sites and operating states.

Quality checklist

Every fix maps to a failure mode and workflow decision

Dependencies are sequenced before downstream work

Permission and policy changes are included where needed

Acceptance tests reuse defined fitness thresholds

Rollback or containment is documented

Proceed, hold, narrow, or stop authority is clear

Common mistakes

Launching a broad cleanup program without a workflow dependency

Fixing downstream symptoms before identity, time, or lineage

Calling implementation complete before the acceptance test passes

Leaving permission or policy changes until release

Assigning a team instead of an accountable owner

Forcing the original scope when narrowing or stopping is safer

Checkpoint

Does every selected fix close a named workflow blocker through a rerunnable acceptance test?

Exercise

Select and Verify the Blocking Fixes

Take the highest-priority failure register items and compare possible interventions.

For each selected fix, record:

  • Failure mode and affected workflow decision
  • Intervention and rejected alternatives
  • Dependency and permission required
  • Accountable owner
  • Cost and effort boundary
  • Rollback or containment
  • Acceptance test and threshold
  • Proof location
  • Release decision: proceed, hold, narrow, or stop

Sequence fixes by dependency. Rerun the exact failed test before changing the failure register status.

Output to complete

Blocking Data Fix Plan

Copyable template

Failure mode and workflow decision:

Intervention:

Rejected alternatives:

Dependencies and permissions:

Accountable owner:

Cost and effort boundary:

Rollback or containment:

Acceptance test and threshold:

Proof location:

Release decision: proceed/hold/narrow/stop

Use this at work tomorrow

Choose the one blocker that prevents the next workflow test, assign its owner, and write the acceptance test before implementation starts.

Core idea

Fix the smallest coherent set of blockers, rerun the failed tests, and let the evidence decide whether to proceed, hold, narrow, or stop.

05

Assign Ownership and Monitor Drift

Keep the workflow's data fit through named ownership, threshold-based monitoring, event triggers, escalation, revalidation, and retirement rules.

A modern desk scene with a single, well-crafted analog clock and a recurring sequence of small, bright orange markers set at regular intervals on a circular white tray—representing review cadence. An empty, reserved-looking chair stands at a distance, suggesting invisible relentless ownership. Warm, editorial lighting with orange highlights. No text, numbers, digital UI, or hands. Minimal, disciplined, and loaded with intent.
A recurring review keeps your AI data healthy. The cycle is public, rhythmic, and clearly owned—proof that data care is becoming a living process.

AI-ready data can stop being fit when collection changes, source systems migrate, schemas drift, permissions expire, populations shift, operating conditions change, or labels arrive differently. Monitoring must cover the data and the workflow outcome.

Assign separate responsibilities for source data, pipeline or retrieval, workflow outcome, access policy, and release decisions. One person may hold several roles, but an unnamed team cannot accept a failed test or close a blocker.

Use a cadence proportionate to workflow risk and rate of change, plus event triggers for source, schema, model, vendor, permission, population, or policy changes. Monitor the same segments and thresholds used in the fitness scorecard so drift has an operational meaning.

The Data Readiness Monitoring Plan records metric, population, threshold, owner, evidence location, review cadence, event triggers, escalation, containment, retraining or revalidation rule, and retirement condition.

Worked example

Illustrative industrial monitoring plan: watch asset-key match, timestamp delay, unit distribution, missing operating states, label arrival, retrieval failures, and workflow override rate by site. A source or firmware change triggers revalidation before wider release.

Quality checklist

Metrics reuse workflow-specific fitness thresholds

Critical segments are monitored separately from global averages

Scheduled and event-triggered reviews are both defined

Named owners cover detection, decision, and response

Containment and revalidation rules can be executed

Retirement conditions prevent indefinite operation

Common mistakes

Monitoring a global average that hides weak segments

Scheduling reviews without event triggers

Naming a team instead of decision and response owners

Alerting without containment or escalation rules

Retraining automatically without revalidation

Keeping a workflow live after its data or purpose no longer matches the business need

Checkpoint

When a source, permission, schema, or population changes, can the team show who detects it, who decides, and what is contained?

Exercise

Define Monitoring, Triggers, and Ownership

Use the Workflow Data Map, Fitness Scorecard, and Failure Register for one workflow.

For each monitored condition, record:

  • Data or workflow metric
  • Population and segment
  • Threshold and evidence location
  • Source, pipeline, workflow, and decision owners
  • Scheduled review cadence
  • Event triggers
  • Escalation and containment
  • Revalidation or retraining rule
  • Change record and communication path
  • Retirement condition

Test the plan with one scenario: a schema, permission, vendor, or population change. Confirm who notices, who decides, and what stops automatically.

Output to complete

Data Readiness Monitoring Plan

Copyable template

Data or workflow metric:

Population and segment:

Threshold and evidence location:

Source, pipeline, workflow, and decision owners:

Scheduled review cadence:

Event triggers:

Escalation and containment:

Revalidation or retraining rule:

Change record and communication path:

Retirement condition:

Use this at work tomorrow

Name the detection and decision owners for one blocking metric, then define what happens when its threshold fails.

Core idea

AI-ready data stays ready through owned thresholds, change triggers, containment, revalidation, and a clear retirement condition.

30-day path

Week 1: Map one AI workflow from data origin through transforms, use, and evaluation.

Week 2: Define and run the critical fitness, permission, and access tests.

Week 3: Rank blocking failure modes and implement the smallest coherent fix set.

Week 4: Rerun acceptance tests and make the proceed, hold, narrow, or stop decision.

Ongoing: Monitor thresholds and event triggers, revalidate after material change, and retire the workflow when its conditions no longer hold.

Success signals

Material workflow inputs have confirmed origin, transforms, permissions, context, and owners

Critical fitness requirements have pre-agreed thresholds and reproducible evidence

Blocking failure modes have an authorized status and required proof of closure

Selected fixes pass their acceptance tests before release or expansion

Scheduled and event-triggered monitoring has named detection, decision, and response owners

Reflection prompts

Which source, transform, or manual step is least understood in the target workflow?

Which fitness failure would invalidate the decision even if average model performance looked acceptable?

What change should trigger revalidation or retirement?

Manager checklist

Require a named workflow and decision before accepting an AI-ready claim.

Confirm the map with business and technical owners.

Approve fitness thresholds before results are interpreted.

Do not release through an unresolved blocker without authorized acceptance.

Require monitoring, containment, and retirement ownership before scale.

In this library

Related RisePlans

Want this shaped around your company?

Risey can research your company foundation first, then build a version of this path around your real workflows, customers, and culture.

Start with your company