Accessibility Reporting Best Practices

From MemberWiki

Jump to: navigation, search

Accessibility Home | Issue Tracker | WCAG 2.0 Rules | Rules Format 1.0 | Cache | Proposed WCAG 2.0 Techniques | Rule Review | Testsuite | Evaluation Results | Reporting Practices


Contents

Goals

  • Provide detailed reports for persons in different roles of the software life cycle
  • Define when to trigger validations or "snapshots" of compliance
    • Static - one-time process of each page during a crawl
    • Manual - developer or tester manually defines snapshot
    • Automatic - reporting in response to focus change, aria-activedescendant change, mutation events of children of content of live regions (Configurable what will test)
      • Note: IE fires the focus events before and Firefox send focus events after
  • Reproduce Violation

Test Scenarios

How tests are triggered and annotated is important to each of these tests. Also, what tests are triggered needs to be specified due to performance limitations

  • Web Crawling Snapshots
  • IDE Debug and Feedback
  • Functional Verification Tests

Proposed Report System for a Requirement

Score Abbreviation Violation Recommendation Potential Violation Potential Recommendation
Manual Check M no rules no rules One or more rules Fail One or more rules Fail
Complete (All Best Practices) + Manual Check C + R + M 100% Pass 100% Pass One or more rules Fail One or more rules Fail
Complete (All Best Practices) C + R 100% Pass 100% Pass 100% Pass 100% Pass
Complete (At least one BP) + Manual Check C + r + M 100% Pass At least one Pass One or more rules Fail One or more rules Fail
Complete (At leaset one BP) C + r 100% Pass At least one Pass 100% Pass 100% Pass
Complete (Minimum) + Manual Check C + nr + M 100% Pass 100% Fail One or more rules Fail n/a
Complete (Minimum) C + nr 100% Pass 100% Fail 100% Pass n/a
Complete (Minimum) + Manual Check C + M 100% Pass no rules One or more rules Fail n/a
Complete (Minimum) C 100% Pass no rules 100% Pass n/a
Almost Complete + Manual Check AC + M 100% > Pass >= %80 n/a One or more rules Fail n/a
Almost Complete AC 100% > Pass >= %80 n/a 100% Pass n/a
Partial Implementation + Manual Check PI + M 80% > Pass >= %50 n/a n/a n/a
Partial Implementation PI 80% > Pass >= %50 n/a n/a n/a
Not Implemented NI < 50% Pass n/a n/a n/a

Proposed Report Grading System for a Requirement

Grade Violation Recommendation Potential Violation Potential Recommendation
M no rules no rules One or more rules Fail One or more rules Fail
A + M 100% Pass 100% Pass One or more rules Fail One or more rules Fail
A 100% Pass 100% Pass 100% Pass 100% Pass
B + M 100% Pass One or more rules Fail One or more rules Fail n/a
B 100% Pass One or more rules Fail 100% Pass n/a
C + M 100% > Pass >= %80 n/a One or more rules Fail n/a
C 100% > Pass >= %80 n/a 100% Pass n/a
D 80% > Pass >= %50 n/a n/a n/a
F < 50% Pass n/a n/a n/a
Personal tools