Skip to main content
AI/MLjmagly

quality-assess

Perform GRADE quality assessment on a research source

Stars
141
Source
jmagly/aiwg
Updated
2026-05-31
Slug
jmagly--aiwg--quality-assess
View on GitHubRaw SKILL.md

// install — copy + paste into any project

mkdir -p .claude/skills && curl -fsSL https://raw.githubusercontent.com/jmagly/aiwg/HEAD/agentic/code/frameworks/sdlc-complete/skills/quality-assess/SKILL.md -o .claude/skills/quality-assess.md

Drops the SKILL.md into .claude/skills/quality-assess.md. Works with Claude Code, Cursor, and any agent that loads SKILL.md files from .claude/skills/.

Quality Assess Command

Perform a GRADE evidence quality assessment on a research source or finding.

Instructions

When invoked, perform systematic GRADE assessment:

  1. Load Source

    • Accept REF-XXX identifier or file path
    • Load frontmatter metadata
    • Determine source type and baseline quality

  2. Apply GRADE Framework

    • Evaluate 5 downgrade factors (bias, inconsistency, indirectness, imprecision, publication bias)
    • Evaluate 3 upgrade factors (large effect, dose-response, confounding)
    • Calculate final GRADE level

  3. Generate Assessment

    • Fill assessment template per @.aiwg/research/docs/grade-assessment-guide.md
    • Include hedging language recommendations
    • Include applicability notes for AIWG context

  4. Save Assessment

    • Save to .aiwg/research/quality-assessments/{ref-id}-assessment.yaml
    • Update frontmatter in source document if --update-frontmatter

  5. Report

    • Display GRADE level with confidence statement
    • Show allowed vs forbidden hedging language
    • Flag any existing citations that violate the assessed quality level

Arguments

  • [ref-id or file-path] - Source to assess (required)
  • --output [yaml|markdown] - Output format (default: yaml)
  • --update-frontmatter - Update source document frontmatter with assessment
  • --check-citations - Also check existing citations of this source for GRADE compliance

References

  • @.aiwg/research/docs/grade-assessment-guide.md - GRADE methodology
  • @$AIWG_ROOT/agentic/code/frameworks/sdlc-complete/agents/quality-assessor.md - Quality Assessor agent
  • @$AIWG_ROOT/agentic/code/frameworks/sdlc-complete/schemas/research/quality-dimensions.yaml - Quality schema
  • @$AIWG_ROOT/agentic/code/frameworks/sdlc-complete/rules/citation-policy.md - Hedging language rules