Gadgets

New tool to make Internet memes convenient for visually impaired people

ANI | December 01, 2019 05:36 PM
Researchers at Carnegie Mellon University have developed a tool to automatically identify memes.

Washington D.C. [USA], Dec 1 (ANI): In a new study researchers have developed a tool that will enable visually impaired people who find it difficult to understand memes, to enjoy them.

Researchers at Carnegie Mellon University have developed a tool to automatically identify memes and apply prewritten templates to add descriptive alt text, making them intelligible via existing assistive technologies.

"Memes are images that are copied and then overlaid with slight variations of text. They are often humorous and convey a shared experience, but if you're blind, you miss that part of the conversation," said Cole Gleason, a PhD student at CMU's Human-Computer Interaction Institute (HCII).

"Memes may not seem like the most important problem, but a vital part of accessibility is not choosing for people what deserves their attention," said Jeff Bigham, associate professor at the HCII. "Many people use memes, and so they should be made accessible."

Memes largely live within social media platforms that have barriers to adding alt text.Twitter, for example, allows people to add alt text to their images, but that feature isn't always easy to find. Of 9 million tweets the CMU researchers examined, one million included images and, of those, just 0.1 per cent included alt text.

Gleason said basic computer vision techniques make it possible to describe the images underlying each meme, whether it be a celebrity, a crying baby, a cartoon character or a scene such as a bus upended in a sinkhole.

Optical character recognition techniques are used to decipher the overlaid text, which can change with each iteration of the meme, reported the study published in - Access.

For each meme type, it's only necessary to make one template describing the image, and the overlaid text can be added for each iteration of that meme. But writing out what the meme is intended to convey proved difficult.

"It depends on the meme if the humour translated. Some of the visuals are more nuanced," Gleason said. "And sometimes it's explicit and you can just describe it."

"For example, the complete alt text for the so-called 'success kid' meme states "Toddler clenching fist in front of the smug face. Overlaid text on top: Was a bad boy all year. Overlaid text on bottom: Still got awesome presents from Santa."

The team also created a platform to translate memes into sound rather than text. Users search through a sound library and drag and drop elements into a template. This system was made to translate existing memes and convey the sentiment through music and sound effects. (ANI)

Have something to say? Post your comment
Must Read
People getting killed to protect constitution while Sukhbir playing dirty politics on CAB, says Capt Amarinder
People getting killed to protect constitution while Sukhbir playing dirty politics on CAB, says Capt Amarinder
Panel Discussion on 'Ek Aur Satyagraha Bharat Ki Aatma Ke Liye....' Ravish Kumar
Panel Discussion on 'Ek Aur Satyagraha Bharat Ki Aatma Ke Liye....' Ravish Kumar
Military Literature Festival 2019:  Lessons of Burma Campaign are still relevant, panelists echo during discussion on second day of MLF
Military Literature Festival 2019: Lessons of Burma Campaign are still relevant, panelists echo during discussion on second day of MLF
On CM’s directive Finance Department releases Rs. 566 cr for Rural Development, Cooperation, Tourism and PIDB
On CM’s directive Finance Department releases Rs. 566 cr for Rural Development, Cooperation, Tourism and PIDB
Police recovered the dead body of notorious gangster Rajvinder Singh Ghali in Kotkapura
Police recovered the dead body of notorious gangster Rajvinder Singh Ghali in Kotkapura
Kisan Union and government representatives still holding the meeting, not clue about the outcome so far Meeting is on since 2.30 Pm till 8.30
Kisan Union and government representatives still holding the meeting, not clue about the outcome so far Meeting is on since 2.30 Pm till 8.30
Punjab Cabinet okays revision of river/canal water charges for non-agriculture purposes
Punjab Cabinet okays revision of river/canal water charges for non-agriculture purposes
Water supply and sanitation dept honoures 200 officials and employees for great services during Gurpurab celebrations
Water supply and sanitation dept honoures 200 officials and employees for great services during Gurpurab celebrations
Clean environment and sports are our priority: MP Chaudhary
Clean environment and sports are our priority: MP Chaudhary
 Playing D/N Test in India, a victory for world cricket: Rajeev Shukla
Playing D/N Test in India, a victory for world cricket: Rajeev Shukla
INX Media case: Court allows ED to quiz Chidambram on Nov 22-23
INX Media case: Court allows ED to quiz Chidambram on Nov 22-23
Time line to pay outstanding house tax or property tax extended by three months: Brham Mohindra
Time line to pay outstanding house tax or property tax extended by three months: Brham Mohindra