qa-execution
Executes real-user QA sessions through public interfaces using personas, journeys, exploratory charters, test tours, edge-case probes, CFR checks, and browser evidence. Reads qa-report artifacts from <qa-output-path>/qa/ when present, captures issues/screenshots/reports under the same output tree, and classifies bugs by user impact. Use when validating a release candidate, migration, refactor, or user-facing change against production-like behavior. Do not use for AI implementation audits, task-status reconciliation, CI gate runs, integration/security/performance templates, or flaky-test triage; use agent-output-audit for those.
What this skill does
# Real-User QA Execution QA the way a real person would experience the product: assigned a persona, walking a journey, exercising charters bound to specific tours, probing the edges users actually hit, and validating CFRs that no single feature owns. ## Required Reading Router Match your task to the row. Read the listed files **in full before** producing output. They are not appendices — they are load-bearing. Inline content in this SKILL.md is a pointer, not a substitute. | Task | MUST read | | -------------------------------------------------------------------- | ------------------------------------------------------------------------------------------ | | Assigning personas to sessions (Step 2) | `references/user-personas.md` | | Selecting high-value journeys (Step 2) | `references/journey-maps.md` | | Writing exploratory charters and picking tours (Step 3) | `references/exploratory-charters.md` + `references/test-tours.md` | | Executing browser flows (Step 4) | `references/web-ui-qa.md` | | Probing off-script user edge cases (Step 5) | `references/test-tours.md` + `references/user-edge-cases.md` | | Running the Cross-Functional Requirement pass (Step 6) | `references/cfr-checks.md` | | Classifying bug severity by user impact (Step 7) | `references/bug-severity-by-user-impact.md` | | Building the QA scope checklist | `references/checklist.md` | ## Reference Index - `references/user-personas.md` — Canonical persona set (New User / Power User / Casual User / Mobile User / Accessibility-Reliant / Recovering User), attributes, and assignment rules. - `references/journey-maps.md` — Journey anatomy (entry → actions → goal → exit + abandonment), high-value journey selection, mapping template. - `references/exploratory-charters.md` — Charter format (mission + persona + surface + tour + time-box), charter modes (freestyle / strategy-based / scenario-based / collaborative / charter-with-tour), worked examples, debrief format. - `references/test-tours.md` — Canonical tour catalog: Feature, Money, Garbage, Back-Button, Multi-Tab, Network, Locale, Paste, Autofill, Interrupt. One tour per charter. - `references/user-edge-cases.md` — Catalog of non-technical edge cases real users hit (navigation, form, session, network, device, locale, accessibility, interrupt, trust/recovery). - `references/cfr-checks.md` — 45-minute CFR pass: usability (Nielsen short list), accessibility (WCAG AA quick check), perceived performance, compatibility, error recoverability, production parity. - `references/bug-severity-by-user-impact.md` — User-impact rubric (Blocks-Completion / Data-Loss / Trust-Damage / Friction / Cosmetic) with mapping to legacy severity/priority. - `references/web-ui-qa.md` — `agent-browser` command set, snapshot/interact/verify loop, auth flows, viewport testing, anti-smoke guardrails. - `references/checklist.md` — Real-user QA checklist by category: persona coverage, journey coverage, charter coverage, off-script & edge case coverage, CFR coverage, bug filing, browser evidence, final report. ## Required Inputs - **qa-output-path** (optional): Directory where QA artifacts (issues, screenshots, verification reports) are stored. When provided, create the directory if it does not exist and use it for all QA outputs. When omitted, fall back to repository conventions or `/tmp/qa-execution-<slug>`. ## Procedures **Step 1: Resolve Output Directory and Read qa-report Artifacts** 1. Resolve the QA artifact directory. If the user provided a `qa-output-path` argument, use it. Otherwise use repository conventions, falling back to `/tmp/qa-execution-<slug>`. Create the `qa/` subdirectory and `qa/screenshots/`, `qa/issues/` under it. 2. Check whether `<qa-output-path>/qa/test-plans/`, `<qa-output-path>/qa/test-cases/`, and any persona/journey/charter artifacts exist from a prior `qa-report` run. If they do, read them to seed Steps 2-3: persona assignments, journey maps, charter missions, and TC-* test cases prioritized by qa-report. 3. Confirm the dev server URL or the runtime entry point is reachable in a production-parity build before any test runs. **Do not run QA on a build that hasn't passed CI** — that's `agent-output-audit`'s job, not this skill's. If CI hasn't been confirmed green, surface the gap and stop. **Step 2: Assign Personas and Select Journeys** 1. **STOP. Read `references/user-personas.md` in full before picking personas.** The six canonical personas (New User / Power User / Casual User / Mobile User / Accessibility-Reliant / Recovering User) and their attribute schema live there. The persona-of-convenience anti-pattern is the most common QA failure mode. 2. Pick **at least 3 personas** for this release-candidate QA pass, covering the product's actual audience. Include at least one Mobile User when a mobile surface exists; include at least one Accessibility-Reliant persona unless explicitly out of scope (record the skip reasoning). 3. **STOP. Read `references/journey-maps.md` in full before selecting journeys.** Journey anatomy (entry → actions → goal → exit + abandonment paths), high-value journey selection criteria, and the journey-map template live there. 4. Pick **3-7 high-value journeys** for this pass. Use these prompts: what generates revenue, what handles sensitive data, what's used most frequently, what's the first impression, what's the recovery path. Include at least one cross-feature journey when the product has them. 5. For each journey, document at least one **abandonment path** — the realistic way a real user gives up partway through. Abandonment paths surface the highest-impact bugs. 6. Record persona × journey assignments in working notes. Each journey gets at least one persona; each persona gets at least one journey. **Step 3: Plan Exploratory Charters** 1. **STOP. Read `references/exploratory-charters.md` in full before writing any charter.** Charter anatomy (mission + persona + surface + tour + time-box), charter modes, time-box guidance, debrief format. Charters are the single biggest predictor of whether the session finds real bugs. 2. **STOP. Read `references/test-tours.md` in full before picking tours.** The 10-tour catalog (Feature / Money / Garbage / Back-Button / Multi-Tab / Network / Locale / Paste / Autofill / Interrupt) and the surface-to-tour matrix live there. 3. For each persona × journey × surface, write a charter with: a one-sentence mission, the persona, the entry URL, **exactly one tour**, and a time-box (30 / 60 / 90 minutes). Save charter drafts to `<qa-output-path>/qa/test-plans/charters/` when applicable. 4. Mix charter modes deliberately: at least one charter-with-tour for each P0 journey, at least one freestyle for new surfaces, at least one scenario-based for cross-feature journeys. 5. Order the session list by risk: highest-impact journey × highest-blast-radius tour first. Run the most fragile combinations while tester attention is fresh. **Step 4: Execute Journey Sessions (Web UI primary)** Skip this step's Web UI portion if the project has no Web UI surface — but still run CLI/HTTP journeys against the same persona × journey × charter plan. 1. **STOP. Read `references/web-ui-qa.md` in full before opening a browser.** That file owns the c
Related in Cloud & DevOps
appbuilder-action-scaffolder
IncludedCreate, implement, deploy, and debug Adobe Runtime actions with consistent layout, validation, and error handling. Use this skill whenever the user needs to add actions to an App Builder project, understand action structure (params, response format, web/raw actions), configure actions in the manifest, use App Builder SDKs (State, Files, Events, database), deploy and invoke actions via CLI, debug action issues, or implement patterns such as webhook receivers, custom event providers, journaling consumers, large payload redirects, action sequence pipelines, and Asset Compute workers. Also trigger when users mention serverless functions in Adobe context, action logging, IMS authentication for actions, or cron-style scheduled actions.
orchestrating-datacloud
IncludedSalesforce Data Cloud product orchestrator for connect→prepare→harmonize→segment→act workflows. Use this skill when the user needs a multi-step Data Cloud pipeline, cross-phase troubleshooting, or data space and data kit management. TRIGGER when: user needs a multi-step Data Cloud pipeline, asks to set up or troubleshoot Data Cloud across phases, manages data spaces or data kits, or wants a cross-phase sf data360 workflow. DO NOT TRIGGER when: work is isolated to a single phase (use the matching phase-specific skill), the task is STDM/session tracing/parquet telemetry (use observing-agentforce), standard CRM SOQL (use querying-soql), or Apex implementation (use generating-apex).
github-project-automation
IncludedAutomate GitHub repository setup with CI/CD workflows, issue templates, Dependabot, and CodeQL security scanning. Includes 12 production-tested workflows and prevents 18 errors: YAML syntax, action pinning, and configuration. Use when: setting up GitHub Actions CI/CD, creating issue/PR templates, enabling Dependabot or CodeQL scanning, deploying to Cloudflare Workers, implementing matrix testing, or troubleshooting YAML indentation, action version pinning, secrets syntax, runner versions, or CodeQL configuration. Keywords: github actions, github workflow, ci/cd, issue templates, pull request templates, dependabot, codeql, security scanning, yaml syntax, github automation, repository setup, workflow templates, github actions matrix, secrets management, branch protection, codeowners, github projects, continuous integration, continuous deployment, workflow syntax error, action version pinning, runner version, github context, yaml indentation error
sf-datacloud
IncludedSalesforce Data Cloud product orchestrator for connect→prepare→harmonize→segment→act workflows. TRIGGER when: user needs a multi-step Data Cloud pipeline, asks to set up or troubleshoot Data Cloud across phases, manages data spaces or data kits, or wants a cross-phase `sf data360` workflow. DO NOT TRIGGER when: work is isolated to a single phase (use the matching sf-datacloud-* skill), the task is STDM/session tracing/parquet telemetry (use sf-ai-agentforce-observability), standard CRM SOQL (use sf-soql), or Apex implementation (use sf-apex).
fabric-cli
IncludedUse this skill for Fabric.so CLI workflows with the `fabric` terminal command: diagnose/install/login, search or browse a Fabric library, save notes/links/files, create folders, ask the Fabric AI assistant, manage tasks/workspaces, generate shell completion, check subscription usage, produce JSON output, and use Fabric as persistent agent memory. Do not use for Microsoft Fabric/Azure/Power BI `fab`, Daniel Miessler's Fabric framework, Python Fabric SSH, Fabric.js, or textile/fashion fabric.
lark
IncludedLark/Feishu CLI skills: lark-cli operations for docs, markdown, sheets, base, calendar, im, mail, task, okr, drive, wiki, slides, whiteboard, apps, approval, attendance, contact, vc, minutes, event. Use when the user needs to operate Lark/Feishu resources via lark-cli, send messages, manage documents, spreadsheets, calendars, tasks, OKRs, deploy web pages, or any Feishu/Lark workspace operations.