Gadgets

New voice assistant makes web browsing easier for visually impaired

ANI | August 19, 2019 02:08 PM
Representative image

Washington D.C. [USA], Aug 19 (ANI): Researchers have developed a new voice assistant that allows people with visual impairments to get web content as quickly and as effortlessly as possible from smart speakers and similar devices.

A new study, led by University of Waterloo Faculty of Mathematics student Alexandra Vtyurina, who collaborated with Microsoft researchers and the University of Washington's Assistant Professor, Leah Findlater, found a way to merge the best elements of voice assistants with screen readers to create a tool that makes free-form web searches easier.

As reported by the study presented at the meeting 1st International ACM SIGACCESS Conference on Computers and Accessibility, the tool is called Voice Exploration, Retrieval, and Search (VERSE).

"People with visual impairments often rely on screen readers, and increasingly voice-based virtual assistants, when interacting with computer systems. Virtual assistants are convenient and accessible but lack the ability to deeply engage with content, such as read beyond the first few sentences of an article, list alternative search results, and suggestions," said Vtyurina, a PhD candidate in Waterloo's David R. Cheriton School of Computer Science, who undertook the study during her internship at Microsoft Research.

"In contrast, screen readers allow for deep engagement with accessible content, and provide fine-grained navigation and control, but at the cost of reduced walk-up-and-use convenience," Vtyurina added.

Our prototype, VERSE, adds screen reader-like capabilities to virtual assistants and allows other devices, such as smartwatches to serve as input accelerators to smart speakers.

The primary input method for VERSE is voice; so, users can say "next", "previous", "go back" or "go forward". VERSE can also be paired with an app, which runs on a smartphone or a smartwatch. These devices can serve as input accelerators, similar to keyboard shortcuts. For example, rotating the crown on a smartwatch advances VERSE to the next search result, section, or paragraph, depending on the navigation mode.

In the study, 53 visually impaired web searchers were surveyed. More than half of the respondents reported using voice assistants multiple times a day, and a vast range of devices, such as, smart speakers, phones, and smart TVs.

The data collected from the survey was used to inform the design of a prototype of VERSE after which a user study was conducted to gather feedback.

At the outset, VERSE resembles other virtual assistants, as the tool allows people to ask a question and have it answered verbally with a word, phrase or passage, said Vtyurina.

VERSE is differentiated by what happens next. If people need more information, they can use VERSE to access other search verticals, for example, news, facts, and related searches, and can visit any article that appears as a search result.

For articles, VERSE showcases its screen reader superpowers by allowing people to navigate along with words, sentences, paragraphs, or sections. (ANI)

Have something to say? Post your comment
Must Read
Melania Trump to visit Delhi govt school during India visit: Sources
Melania Trump to visit Delhi govt school during India visit: Sources
Two Nigerians arrested for staying without valid documents in Delhi
Two Nigerians arrested for staying without valid documents in Delhi
Muktsar fines 132 school vehicles, impounds 24 in two days, while Faridkot only fined 17, impounded 4 on Monday, influential being spared
Muktsar fines 132 school vehicles, impounds 24 in two days, while Faridkot only fined 17, impounded 4 on Monday, influential being spared
SAD urges Punjab govt to declare there will be no tampering with reservation policy
SAD urges Punjab govt to declare there will be no tampering with reservation policy
Punjab to honour cops under 'Appreciate and Commend' scheme
Punjab to honour cops under 'Appreciate and Commend' scheme
Four family members shot dead by cop by visiting in-laws house
Four family members shot dead by cop by visiting in-laws house
School buses run at full speed ignoring the Apex court guidelines, authorities sleep until precious lives lost
School buses run at full speed ignoring the Apex court guidelines, authorities sleep until precious lives lost
Punjab CM asks DCs to prioritise core sectors of education, health, water & power for development
Punjab CM asks DCs to prioritise core sectors of education, health, water & power for development
A theft in the commission agents’ shop in Jaitu, town, residents allege police inaction, claim the frequent thefts are happening
A theft in the commission agents’ shop in Jaitu, town, residents allege police inaction, claim the frequent thefts are happening
Muktsar police hold an awareness seminar against drugs in village Kotli Ablu, 18 cases of having the property of drug peddlers attached forwarded to Delhi
Muktsar police hold an awareness seminar against drugs in village Kotli Ablu, 18 cases of having the property of drug peddlers attached forwarded to Delhi
Babu Singh Panjawa isn’t SC commission member, people shouldn’t be misled: Chairperson Tejinder Kaur
Babu Singh Panjawa isn’t SC commission member, people shouldn’t be misled: Chairperson Tejinder Kaur
Commissionerate Police issue various ban orders
Commissionerate Police issue various ban orders