[CATO] Examsoft VPAT, YIKES!

[Vicki Walton]

Zach,

I had tested ExamSoft a few times while at CBC and remember the battle.  I don't have any of those record now.  I feel your frustration.


[Title: SBCTC logo - Description: Compass]Vicki Walton
Pronouns: they/them
Web Accessibility Specialist/IT Quality Assurance Tester
Washington State Board for Community and Technical Colleges
vwalton at sbctc.edu* office: 360-704-4343* website: www.sbctc.edu<https://www.sbctc.edu/default.aspx>




The power of the Web is in its universality.
Access by everyone regardless of disability is an essential aspect.
Tim Berners-Lee, W3C Director and inventor of the World Wide Web

From: CATO <cato-bounces at lists.ctc.edu> On Behalf Of Lattin, Zachary via CATO
Sent: Tuesday, February 7, 2023 11:45 AM
To: cato at lists.ctc.edu
Cc: Lattin, Zachary <ZLattin at clark.edu>
Subject: [CATO] Examsoft VPAT, YIKES!

Greetings CATO,

I just tested assessment software Examplify for our institution and it was a particularly egregious accessibility failure, so I figured I would share some of my findings.  Attached is the first red flag ... I mean VPAT, which is a completely inaccessible and untagged pdf.  After I OCRed it with ABBYY Finereader I found the following concerns in the "Partially Supports" and "Does not support" columns, which I then verified in subsequent testing of the windows and IOS Apps:

  *   Hotspot questions using images cannot be used with VoiceOver.
  *   Some controls have accessible labels. Some form fields such as edit fields do not have accessible names.
  *   Some functions are keyboard operable. The Spreadsheet tool is not keyboard operable and the text editor used in Essay questions does not support keyboard shortcuts for formatting functions when using a physical keyboard.
  *   iOS devices are intended for touchscreen use. The home menu and PDF attachments traps VoiceOver focus when focus is moved to the menu.
  *   Programmatic focus that VoiceOver follows does not follow reading order on exam question pages or when opening a PDF pop out.
  *   Some user interface components with labels contain the text that is presented visually. Some "Next" buttons do not have an accessible name that matches the visible text.
  *   Some components (e.g., input fields) do not provide some required information (e.g., names).
  *   Application restricts content to landscape orientation.
  *   Minimum contrast ratios are used with some exceptions.
  *   Operating system functions for changing text size are not supported. Functions to bold text are supported.
  *   Visual focus is shown where there is keyboard functionality.

The first deal-breaker for me was the completely inaccessible text editor for composing essay questions.  I will point out that inaccessible text editors in products like this stem from a particularly ablest assumption that AT users don't need to create content, they just need to consume it.  if you're testing a product, please remember to test its ability to create content inside itself!

I could go on and on about these issues but I think you get the gist.  Clark will need to work on finding an alternative to using Examsoft.
--Zach

Campus IT Accessibility Coordinator and Assistive Technology Specialist
IT Services
Phone (call or text): (360) 992-2016
Email: zlattin at clark.edu<mailto:zlattin at clark.edu>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ctc.edu/pipermail/cato_lists.ctc.edu/attachments/20230208/8fe6a4b4/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 18063 bytes
Desc: image001.png
URL: <http://lists.ctc.edu/pipermail/cato_lists.ctc.edu/attachments/20230208/8fe6a4b4/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.gif
Type: image/gif
Size: 803 bytes
Desc: image003.gif
URL: <http://lists.ctc.edu/pipermail/cato_lists.ctc.edu/attachments/20230208/8fe6a4b4/attachment-0001.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.png
Type: image/png
Size: 8117 bytes
Desc: image004.png
URL: <http://lists.ctc.edu/pipermail/cato_lists.ctc.edu/attachments/20230208/8fe6a4b4/attachment-0003.png>