ALADDIN
CENTER Carnegie Mellon UniversityCarnegie Mellon Computer Science DepartmentSchool of Computer Science
REU

Using Games to Solve Problems that Computers Cannot Yet Solve:

Aladdin
About
Calendar
People
PROBEs
Workshops
Papers
Education
Related Activities
Corporate
Contact
 
Captcha
Outreach Roadshow

       Improving Accessibility of the Web

REU
Student

Graduate
Mentor

Faculty
Advisor

Shiry Ginosar
Visually impaired individuals surf the Web using screen readers (programs that read the contents of the screen out loud). Since today's screen readers can only read text from Web pages, the Web still presents a major accessibility problem because there are millions of images on the Web, most of which have no appropriate captions and therefore are completely obscured for those who rely on screen readers. One possible solution to this problem is the ESP Game. If all images on the Web are labeled by the game, screen readers could read the labels out loud. This, however, can be improved. The ESP Game produces labels, not explanatory sentences. While keyword labels are perfect for certain applications such as image search, accessibility would benefit more from explanatory sentences. The REU will build a new game whose output is explanatory sentences of images. Using the output of the game, we propose to build a prototype of a system that can improve the accessibility of the Web for visually impaired individuals.

Preliminary Presentation (ppt)
Final Presentation (ppt)

 

This material is based upon work supported by National Science Foundation under Grant No. 0122581.
Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the
National Science Foundation