Published by Roast & Rise
AI-Ready Data Foundation Sprint
Make one AI workflow's data fit for purpose, accessible, owned, and monitored.
Map the data one AI workflow uses, test its fitness and access, fix the blocking gaps, and assign ownership for ongoing review.

Course thesis
Data becomes AI-ready in context. Map one workflow, test the data against its real requirements, expose blocking failure modes, fix the smallest coherent set, and monitor the conditions that could make the data unfit again.
What you leave with
You will leave with a workflow-specific data map, fitness tests, a ranked blocker register, a focused fix plan, and named monitoring ownership.
For
Founders, operations and IT leaders, data owners, product teams, and sponsors preparing or reviewing an AI workflow.
Workflow
Map one workflow's data, test fitness and access, rank blocking failure modes, close the smallest set of gaps, and monitor drift and change.
Change
Move from broad data-readiness claims and cleanup backlogs to workflow-specific tests, evidence-backed blockers, focused fixes, and owned monitoring.
What you can do
Use these as checks while you move through the plan.
Define AI-ready data for a specific workflow and decision
Trace exact sources, transforms, manual steps, permissions, and evaluation data
Test quality, representativeness, freshness, provenance, access, and leakage risk
Connect blocking failure modes to workflow consequences and controls
Verify focused fixes through acceptance tests
Assign monitoring, escalation, revalidation, and retirement ownership
Chapters
01
Map the Data for One AI Workflow
Trace the data used by one AI workflow from origin through transforms and manual workarounds to the decision, output, and evaluation record.

AI-ready data is data fit for a specific AI workflow, with known origin, permissions, quality, representativeness, freshness, access path, owner, limitations, and monitoring. A generic claim that the organization's data is clean does not establish readiness.
Map the workflow before the platform. Name the decision or task, the people affected, the inputs used at each step, any labels or outcomes used for evaluation, and the systems that create, transform, join, export, or manually correct the data.
For industrial AI, the map may cross sensors, a historian, MES and ERP records, equipment identifiers, timestamps, units, maintenance logs, operator notes, and local spreadsheets. Asset identity, time alignment, operating state, and units belong in the map because a plausible join can still describe the wrong machine or moment.
NIST's AI Risk Management Framework asks teams to document intended use, context, data, dependencies, assumptions, limitations, and affected parties. Source: NIST, AI Risk Management Framework 1.0. The Workflow Data Map turns that guidance into a source-to-use inventory.
Worked example
Illustrative industrial map: a maintenance workflow joins sensor readings with equipment identity, operating state, work orders, and failure outcomes. The map requires the asset key, timezone, sampling interval, unit conversion, transform owner, and the manual spreadsheet used to correct work-order codes.
Quality checklist
The map covers one named workflow and decision
Exact records, transforms, joins, and manual steps are visible
Identity, time, units, and operating context are documented where material
Permissions and accountable owners are named
Evaluation outcomes or labels are included
Business and technical owners confirm the map
Common mistakes
Mapping systems without the exact records used
Leaving manual corrections and local extracts out of the flow
Joining data without checking identity, time, unit, or operating context
Ignoring the outcome or label needed to evaluate the workflow
Naming a technical custodian but no workflow owner
Turning unknowns into assumptions instead of marking them
Checkpoint
Can the workflow owner trace every material input from origin to use and explain how the output will be evaluated?
Exercise
Trace One Workflow from Source to Decision
Choose one live or proposed AI workflow and walk it with a business owner and a technical owner.
For each input, record:
- Workflow step and decision supported
- Record or signal used
- Source system and exact object, table, stream, file, or field
- Origin and collection method
- Transformations and joins
- Identifier, timestamp, unit, and operating context where relevant
- Manual workaround or shadow copy
- Permission and access path
- Data owner and workflow owner
- Evaluation label or outcome record
- Known limitation or unknown
Output to complete
Workflow Data Map
Copyable template
AI workflow and decision:
Workflow step:
Record or signal:
Source system and exact object:
Origin and collection method:
Transformations and joins:
Identifier, timestamp, unit, and context:
Manual workaround or shadow copy:
Permission and access path:
Data owner and workflow owner:
Evaluation label or outcome:
Known limitation or unknown:
Use this at work tomorrow
Walk one AI workflow with its operator and data owner, then add the manual step or shadow source missing from the architecture diagram.
Core idea
AI-ready data starts with one workflow map that exposes origin, transforms, permissions, owners, and evaluation data.
02
Test Fitness, Quality, and Access
Translate workflow requirements into evidence-based tests for quality, representativeness, freshness, provenance, permissions, and reliable access.

Data is ready only when it is suitable for the intended workflow and evaluation. Test the dimensions that can change the decision: correctness, completeness, consistency, freshness, representativeness, provenance, label quality, permission, retrieval reliability, and leakage risk.
Define each test from the workflow requirement. Freshness means something different for live equipment alerts, quarterly forecasting, and policy retrieval. A high average score can hide one blocking field, class, site, or access rule.
NIST's AI RMF Playbook asks teams to examine data suitability, representativeness, quality, provenance, assumptions, limitations, and ongoing measurement. Source: NIST, AI RMF Playbook.
The Workflow Data Fitness Scorecard uses pass, watch, or block for each requirement and attaches the test method, evidence, threshold, affected segment, owner, and action. A block stops the dependent test or release until resolved or explicitly accepted.
Worked example
Illustrative industrial test: for a predictive-maintenance input, define asset-ID match rate, timestamp alignment, unit consistency, operating-state coverage, failure-label lineage, access reliability, and leakage checks. Enter actual results only after running each test on the relevant equipment and period.
Quality checklist
Tests are tied to the intended workflow and decision
Thresholds are set before results are interpreted
Population, period, and weak segments are visible
Provenance, permissions, access, and leakage are included where relevant
Every watch or block has an owner and action
Business and technical owners can challenge the evidence
Common mistakes
Using a generic maturity score with no workflow threshold
Testing only averages and missing weak sites, classes, or operating states
Calling data representative without naming the target population
Checking availability but not permission or reliable retrieval
Using outcome information that would not exist at prediction time
Changing the pass threshold after seeing the result
Checkpoint
Can the workflow owner explain why each threshold is sufficient for the decision and which failed test blocks progress?
Exercise
Test One Critical Input
Select the input whose failure would most affect the workflow. Define tests before inspecting results.
For each requirement, record:
- Requirement and why it matters
- Dimension: correctness, completeness, consistency, freshness, representativeness, provenance, label quality, permission, retrieval, or leakage
- Population and segment tested
- Test method and source evidence
- Pass threshold
- Result: pass, watch, or block
- Limitation or uncertainty
- Owner and action
Have the workflow owner confirm that the threshold reflects operational risk, not only technical convenience.
Output to complete
Workflow Data Fitness Scorecard
Copyable template
Critical input:
Workflow requirement:
Fitness dimension:
Population and segment:
Test method and source evidence:
Pass threshold:
Result: pass/watch/block
Limitation or uncertainty:
Owner and action:
Workflow-owner confirmation:
Use this at work tomorrow
Define and run one blocking fitness test for the most important input in the target AI workflow.
Core idea
Data fitness is a set of workflow-specific tests with evidence and thresholds, not a general maturity label.
03
Find the Blocking Data Failure Modes
Turn failed fitness tests and map unknowns into a short register of the data conditions that can block safety, usefulness, evaluation, or value.

A blocking failure mode is a data condition that makes the intended workflow unsafe, unusable, unevaluable, or economically unjustified. Rank failure modes by their effect on the workflow, not by the number of fields affected.
Common blockers include unknown origin, incompatible identifiers, misaligned timestamps or units, stale extracts, missing outcome labels, target leakage, permission mismatch, unreliable retrieval, unrepresentative samples, undocumented manual corrections, schema drift, and no accountable owner.
The U.S. Government Accountability Office's AI Accountability Framework calls for attention to data origin, reliability, processing, intended use, performance, and ongoing monitoring. Source: U.S. GAO, AI Accountability Framework.
The Blocking Data Failure Register connects each failure mode to the affected workflow step, evidence, consequence, current control, detectability, decision status, owner, and required proof of closure.
Worked example
Illustrative industrial failure modes: asset identifiers do not match across historian and maintenance records; sensor timestamps use inconsistent timezones; units change after a firmware update; failure outcomes are recorded only for one site; an analyst corrects labels in an untracked spreadsheet. Each condition needs evidence and a workflow consequence before it enters the blocking queue.
Quality checklist
Each failure mode names an observable condition
Evidence links back to the map or fitness test
Workflow consequence and affected segment are explicit
Current control and detectability are recorded
Block, mitigate, accept, or investigate status has an authorized owner
Closure requires a rerun or other defined evidence
Common mistakes
Calling every quality issue a blocker
Writing vague failure modes such as bad data
Ignoring conditions that affect only a small but critical segment
Listing a risk without its current control or detectability
Accepting a blocker without an authorized decision owner
Closing a failure mode without rerunning the relevant test
Checkpoint
Can the sponsor explain why each item blocks or constrains the workflow and what evidence would close it?
Exercise
Convert Failed Tests into Failure Modes
Review the Workflow Data Map and every watch or block in the fitness scorecard.
For each failure mode, record:
- Failure condition
- Affected workflow step and decision
- Evidence and source
- Consequence for safety, usefulness, evaluation, compliance, or value
- Population or operating condition affected
- Existing control and detectability
- Status: block, mitigate, accept, or investigate
- Decision owner
- Required proof of closure
Rank the register by workflow consequence and dependency. Keep lower-impact hygiene work visible but outside the blocking queue.
Output to complete
Blocking Data Failure Register
Copyable template
Failure condition:
Affected workflow step and decision:
Evidence and source:
Consequence:
Affected population or condition:
Existing control and detectability:
Status: block/mitigate/accept/investigate
Decision owner:
Required proof of closure:
Use this at work tomorrow
Write the one data failure condition that could invalidate the target workflow, attach its evidence, and ask the sponsor to confirm its decision status.
Core idea
A blocking data failure mode names the condition, affected decision, evidence, consequence, control, owner, and proof required for closure.
04
Fix the Smallest Set of Blocking Gaps
Choose focused interventions that clear the workflow's blocking tests, then verify closure with rerunnable evidence before release or expansion.

The goal is to remove the blocking conditions for the target workflow, not to clean every source system. Choose the smallest coherent set of fixes that can satisfy the failed tests and make the next workflow decision possible.
A fix can change collection, identifiers, timestamps, units, labels, access, transforms, controls, evaluation design, or workflow scope. Sometimes the right action is to narrow or stop the AI use case because the required data cannot be obtained lawfully, reliably, or economically.
Define done as a rerunnable test result. A completed ticket, new pipeline, or revised policy is an implementation step; closure requires evidence that the workflow requirement now passes or that an authorized residual risk is recorded.
The Blocking Data Fix Plan names the failure mode, selected intervention, dependency, owner, cost and effort boundary, rollback, acceptance test, proof location, and release decision.
Worked example
Illustrative industrial fix plan: standardize asset identity before tuning a model; normalize timestamp and unit handling before rebuilding features; restore lineage for failure labels before evaluating performance. Each fix closes only when the relevant workflow test passes on the required sites and operating states.
Quality checklist
Every fix maps to a failure mode and workflow decision
Dependencies are sequenced before downstream work
Permission and policy changes are included where needed
Acceptance tests reuse defined fitness thresholds
Rollback or containment is documented
Proceed, hold, narrow, or stop authority is clear
Common mistakes
Launching a broad cleanup program without a workflow dependency
Fixing downstream symptoms before identity, time, or lineage
Calling implementation complete before the acceptance test passes
Leaving permission or policy changes until release
Assigning a team instead of an accountable owner
Forcing the original scope when narrowing or stopping is safer
Checkpoint
Does every selected fix close a named workflow blocker through a rerunnable acceptance test?
Exercise
Select and Verify the Blocking Fixes
Take the highest-priority failure register items and compare possible interventions.
For each selected fix, record:
- Failure mode and affected workflow decision
- Intervention and rejected alternatives
- Dependency and permission required
- Accountable owner
- Cost and effort boundary
- Rollback or containment
- Acceptance test and threshold
- Proof location
- Release decision: proceed, hold, narrow, or stop
Sequence fixes by dependency. Rerun the exact failed test before changing the failure register status.
Output to complete
Blocking Data Fix Plan
Copyable template
Failure mode and workflow decision:
Intervention:
Rejected alternatives:
Dependencies and permissions:
Accountable owner:
Cost and effort boundary:
Rollback or containment:
Acceptance test and threshold:
Proof location:
Release decision: proceed/hold/narrow/stop
Use this at work tomorrow
Choose the one blocker that prevents the next workflow test, assign its owner, and write the acceptance test before implementation starts.
Core idea
Fix the smallest coherent set of blockers, rerun the failed tests, and let the evidence decide whether to proceed, hold, narrow, or stop.
05
Assign Ownership and Monitor Drift
Keep the workflow's data fit through named ownership, threshold-based monitoring, event triggers, escalation, revalidation, and retirement rules.

AI-ready data can stop being fit when collection changes, source systems migrate, schemas drift, permissions expire, populations shift, operating conditions change, or labels arrive differently. Monitoring must cover the data and the workflow outcome.
Assign separate responsibilities for source data, pipeline or retrieval, workflow outcome, access policy, and release decisions. One person may hold several roles, but an unnamed team cannot accept a failed test or close a blocker.
Use a cadence proportionate to workflow risk and rate of change, plus event triggers for source, schema, model, vendor, permission, population, or policy changes. Monitor the same segments and thresholds used in the fitness scorecard so drift has an operational meaning.
The Data Readiness Monitoring Plan records metric, population, threshold, owner, evidence location, review cadence, event triggers, escalation, containment, retraining or revalidation rule, and retirement condition.
Worked example
Illustrative industrial monitoring plan: watch asset-key match, timestamp delay, unit distribution, missing operating states, label arrival, retrieval failures, and workflow override rate by site. A source or firmware change triggers revalidation before wider release.
Quality checklist
Metrics reuse workflow-specific fitness thresholds
Critical segments are monitored separately from global averages
Scheduled and event-triggered reviews are both defined
Named owners cover detection, decision, and response
Containment and revalidation rules can be executed
Retirement conditions prevent indefinite operation
Common mistakes
Monitoring a global average that hides weak segments
Scheduling reviews without event triggers
Naming a team instead of decision and response owners
Alerting without containment or escalation rules
Retraining automatically without revalidation
Keeping a workflow live after its data or purpose no longer matches the business need
Checkpoint
When a source, permission, schema, or population changes, can the team show who detects it, who decides, and what is contained?
Exercise
Define Monitoring, Triggers, and Ownership
Use the Workflow Data Map, Fitness Scorecard, and Failure Register for one workflow.
For each monitored condition, record:
- Data or workflow metric
- Population and segment
- Threshold and evidence location
- Source, pipeline, workflow, and decision owners
- Scheduled review cadence
- Event triggers
- Escalation and containment
- Revalidation or retraining rule
- Change record and communication path
- Retirement condition
Test the plan with one scenario: a schema, permission, vendor, or population change. Confirm who notices, who decides, and what stops automatically.
Output to complete
Data Readiness Monitoring Plan
Copyable template
Data or workflow metric:
Population and segment:
Threshold and evidence location:
Source, pipeline, workflow, and decision owners:
Scheduled review cadence:
Event triggers:
Escalation and containment:
Revalidation or retraining rule:
Change record and communication path:
Retirement condition:
Use this at work tomorrow
Name the detection and decision owners for one blocking metric, then define what happens when its threshold fails.
Core idea
AI-ready data stays ready through owned thresholds, change triggers, containment, revalidation, and a clear retirement condition.
30-day path
Week 1: Map one AI workflow from data origin through transforms, use, and evaluation.
Week 2: Define and run the critical fitness, permission, and access tests.
Week 3: Rank blocking failure modes and implement the smallest coherent fix set.
Week 4: Rerun acceptance tests and make the proceed, hold, narrow, or stop decision.
Ongoing: Monitor thresholds and event triggers, revalidate after material change, and retire the workflow when its conditions no longer hold.
Success signals
Material workflow inputs have confirmed origin, transforms, permissions, context, and owners
Critical fitness requirements have pre-agreed thresholds and reproducible evidence
Blocking failure modes have an authorized status and required proof of closure
Selected fixes pass their acceptance tests before release or expansion
Scheduled and event-triggered monitoring has named detection, decision, and response owners
Reflection prompts
Which source, transform, or manual step is least understood in the target workflow?
Which fitness failure would invalidate the decision even if average model performance looked acceptable?
What change should trigger revalidation or retirement?
Manager checklist
Require a named workflow and decision before accepting an AI-ready claim.
Confirm the map with business and technical owners.
Approve fitness thresholds before results are interpreted.
Do not release through an unresolved blocker without authorized acceptance.
Require monitoring, containment, and retirement ownership before scale.
In this library
Related RisePlans
AI Sprawl Cleanup Sprint
Bring order to fragmented AI use. Map every tool, prompt, and cleanup hour. Diagnose waste and workslop. Set the rules and rhythms that make team experiments compound instead of costing trust, time, and money.
Company Knowledge System
Turn scattered documents, decisions, examples, and team know-how into a maintained company memory people can trust and use in daily work.
AI Governance and Regulation Readiness: Your Move Before the EU AI Act Deadline
Most small and mid-size companies believe the EU AI Act targets only large enterprises. That is a myth. This RisePlan cuts through confusion: map your company’s AI risk, close your compliance gaps, and build a routine that fits small teams and tight timelines—without a legal department.
Want this shaped around your company?
Risey can research your company foundation first, then build a version of this path around your real workflows, customers, and culture.
Start with your company