Questions answered by this guide
- What's a good process for reviewing an eLearning course before it launches?
- Who should review a course before it publishes, and in what order?
- What's the difference between this and the Before You Publish Checklist?
- How do I catch problems before they're expensive to fix?
- Should the SME review before or after the accessibility review?
What you'll learn
- Four stages: self-review, SME review, accessibility/quality/engagement review, final sign-off
- Each stage has a different reviewer and a different job, reviewing everything at once at the end catches problems too late to fix cheaply
- Complements, not replaces, Before You Publish Checklist, that's the final stage's fast pass
What's inside
Instructional designers, SMEs, QA reviewers, and L&D managers coordinating a multi-person course review
- 01Stage 1: Self-review (author)
- 02Stage 2: SME review
- 03Stage 3: Accessibility, quality, and engagement review
- 04Stage 4: Final sign-off
Why it matters
A course reviewed only once, right before publishing, by one person, tends to catch surface problems and miss structural ones. A broken link is easy to catch late. A learning objective that doesn't match the actual content, or a course built around an interaction pattern that turns out not to be accessible, is expensive to catch late, it means rebuilding, not just fixing. Staging review by role means each kind of problem gets caught by the person actually equipped to catch it, at the point where fixing it is still cheap.
When you'll encounter this
- More than one person touches a course before it launches, an author, a subject matter expert, and a reviewer, not just one person building and publishing solo.
- A course has failed review late before, after most of the build work was already done.
- You're setting up a repeatable process for a team, not reviewing a single one-off course.
Example
Catching a structural problem at the right stage
✕ Incorrect
A course is built entirely, then reviewed once at the very end. The SME flags that a key compliance scenario is missing, which means rebuilding two lessons that were already polished, captioned, and accessibility-checked.
The SME's job, confirming the content itself is correct and complete, happened after the accessibility and polish work, not before it. Everything built on top of the missing content had to be redone.
✓ Correct
The SME reviews a content outline and draft script before any slide is built. The missing scenario is caught and added at the outline stage, before any polish or accessibility work exists yet to redo.
Content accuracy is checked before content-dependent work, accessibility, styling, captions, is built on top of it, so a content problem never forces rework of finished, unrelated work.
Best practices
- Stage 1, self-review: the author reviews their own work against Before You Publish Checklist before sending it anywhere, catching the obvious things themselves costs the team nothing.
- Stage 2, SME review: a subject matter expert reviews for content accuracy, completeness, and whether the course actually teaches what it claims to, before any further polish work happens on top of it.
- Stage 3, accessibility/quality/engagement review: run once content is stable, not before, since content changes after this stage often mean re-checking. This is where a real A11yCheck scan belongs in the process, alongside a manual pass.
- Stage 4, final sign-off: a second person confirms every prior stage's issues were actually resolved, not just identified, before the course is marked ready to publish.
- Document who signed off at each stage and when, even informally, so a problem discovered later can be traced to which stage should have caught it.
Common mistakes
- Running every kind of review at the very end, in one pass, which means every kind of problem is equally expensive to fix by the time it's found.
- Skipping SME review because the person who built the course is confident in the content, confidence isn't the same as a second set of eyes.
- Treating sign-off as a formality instead of an actual re-check that prior issues were resolved.
Practical checklist
- The author has run Before You Publish Checklist against their own work first.
- A subject matter expert has reviewed content accuracy and completeness before further build work continues.
- Accessibility, course quality, and course engagement have each been reviewed, with both an automated scan and a manual pass.
- Every issue found in Stage 3 has a resolution, fixed, or a documented decision not to fix, not just a list of open items.
- A different person than the original author performs final sign-off.
- The sign-off decision and date are recorded somewhere the team can find later.
How A11yCheck reviews this
A11yCheck's scan is built for Stage 3, run it once content is stable for a fast, consistent pass across all three pillars. It doesn't replace Stage 2's SME content review, it can't judge whether the content itself is accurate or complete.
Frequently asked questions
How is this different from the Before You Publish Checklist?
Before You Publish Checklist is Stage 4's fast pass, one person, right before publishing. This page is the whole process a course goes through to get there, across multiple people and multiple stages. Use both together, this page for the process, that one for the final pass.
Do I need all four stages for every course?
A small, low-stakes course might collapse Stage 1 and 2 into one person. A compliance-critical or high-visibility course benefits from keeping every stage distinct. Match the process to what's actually at stake if something's wrong.
What if there's no dedicated SME?
Someone still needs to check content accuracy, even if it's a manager or a peer instructional designer rather than a formal subject matter expert. Skipping the check entirely is the actual risk, not who specifically does it.
Related Guides
Before You Publish Checklist→
A short checklist to run through before you publish any Storyline or Rise course. It covers accessibility, course quality, and course engagement in one pass.
Accessibility Testing SOP: A Standard Process for eLearning Teams→
A repeatable process, not a one-time checklist, for how a team tests accessibility: who's responsible, what tools and methods to use together, how often to test, and how to document that testing happened.
Course Quality Checklist→
A focused checklist for the polish-and-consistency issues that make a course feel unfinished, broken links, mismatched styling, duplicate content, separate from accessibility.
Course Engagement Checklist→
A focused checklist for whether a course is actually easy to learn from, content density, reading level, and whether interactions serve a real purpose, separate from accessibility and course quality.
A11yCheck's Review Methodology→
A11yCheck reviews a real, rendered Storyline or Rise course, not its source file, using a headless browser to open the published output the way a learner actually would, then runs three separate passes: Accessibility (deterministic, WCAG-grounded), Course Quality (deterministic, structural), and Course Engagement (advisory, AI-assisted). Here's exactly how each one works, and where the line between automated and human review actually sits.
See a Sample A11yCheck Scan Report→
This is a walkthrough of an illustrative sample course, not a real customer's course, built to show exactly what a real A11yCheck report contains: how findings are grouped by pillar, what a finding actually looks like, and what the report explicitly does not claim. Run a free scan on your own course to see a real one.
Instructional Design QA: A Practical Framework for Reviewing a Course Before Publishing→
Most instructional design frameworks (ADDIE, backward design, and similar) focus on how a course gets built. This page is about the moment after it's built, and before it's someone else's problem: how an ID reviews their own work with real distance, across five real dimensions, before handing it off.
Summary
A course reviewed once, at the end, by one person, catches surface problems and misses structural ones. Staging review across four roles, self, SME, accessibility/quality/engagement, sign-off, catches each kind of problem at the point where it's still cheap to fix.
Review your course before you publish it.
A11yCheck reviews Storyline and Rise courses for:
- Accessibility
- Course Quality
- Course Engagement
www.a11ycheck-dev.com