Yahoo! Accessibility

Research

Busy signal or engaged tone? Captions, language variety, and localized accessibility

Monday, September 19th, 2011

Screen shot from The Adjustment Bureau featuring a NYC taxi
How would you caption this phone sound? If it can be captioned in more than one way, how do you choose the way that is best? What if the option you prefer depends on the variety of English you speak?

Differences between American and British English can pose problems for some users of closed captions. Quite a few British words are not commonly used in the United States, or have different meanings for American viewers. (Follow these links for entries on the British “engaged tone” vs. the American “busy signal.”) While speech sounds should always be captioned verbatim, non-speech sounds offer greater freedom and present new challenges for the captioner. At times, non-speech sounds need to be considered from the perspective of the language variety typically spoken or signed in the DVD region in question. While it may not be feasible to localize English captions for both British and American caption users, captioners should remember that less common British terms may cause confusion for some American DVD caption users (and vice versa). Continue reading Busy signal or engaged tone? Captions, language variety, and localized accessibility

Captioned silence?

Monday, August 8th, 2011

A screenshot from Jon Benjamin Has a Van featuring a

It will almost certainly seem counter-intuitive to talk about captioning silences. That’s because nearly every definition of closed captioning begins and ends with measurable, acoustically quantifiable sounds. For example, Wikipedia describes closed captioning as a “transcription of the audio portion of a program as it occurs (either verbatim or in edited form), sometimes including non-speech elements.” The FCC defines closed captioning as “A service for persons with hearing disabilities that translates television program dialog into written words on the television screen.” Whereas the Wikipedia entry seems to leave room for the possibility that the entire audio track (i.e. all sounds) might be captioned, the FCC focuses narrowly on “dialog” or speech. Nevertheless, both definitions are concerned exclusively (and not surprisingly) with sound.

Yet captioning is complex, perhaps more complex than we’ve ever previously considered. In some well-defined situations, silence must be captioned. We need at times to make room on the caption track for sudden quiet, the illusion of speech (i.e. mouthed words), intentional loss of audio, and the cessation of sustained sounds. While a lack of sound would seem, at first blush, to fall outside the captioner’s purview, it becomes significant for the captioner when it is tied to our visual expectations about how sound works.

Let me share a few examples, organized into three categories. The categories are not exhaustive. All of the examples below are pulled from the official versions shown on TV or DVD. Continue reading Captioned silence?

Logocentrism: The tendency to privilege speech over non-speech in closed captioning

Thursday, July 28th, 2011

Photo of Cameron Diaz checking out Tom Cruise in movie, Knight and Day.
The opening to Knight and Day (2010) provides a dramatic example of how closed captions can mistakenly privilege speech over non-speech, even when the speech sounds are barely audible and/or insignificant. I call this audacious appetite for speech “logocentrism” and discuss its implications below.

First, consider the uncaptioned version, which I pulled from the official DVD. If you are a hearing viewer, think about how you would caption it. Which sounds are significant? Every sound cannot be captioned, so which ones are most important here? And how would you convert those sounds into words? If you are a deaf or hard-of-hearing viewer, think about how this scene visually establishes a context or mood without relying on speech from either of the main characters (Tom Cruise and Cameron Diaz). Continue reading Logocentrism: The tendency to privilege speech over non-speech in closed captioning

Captioning the faintest sounds when they’re part of a repetitive series

Monday, May 9th, 2011

At the very end of 2010′s The Social Network (spoiler alert), Mark Zuckerberg (played by Jesse Eisenberg) sits alone at his computer, repeatedly refreshing his Facebook page after sending a friend request to an old girlfriend. In the official screenplay, he refreshes his browser twice, but in the film he refreshes seven times.

A moment after Zuckerberg sends his friend request, a snappy tune begins to play in the background. The beat of the music — a light clapping sound — is remarkably similar to the sound of the refresh keystroke. The keystroke sound is not very loud to begin with and when the timing of the music matches the timing of the keystroke, the keystroke is nearly inaudible.

A sound’s function is always more important than its volume level or clarity. Quiet, masked, buried, and canceled out sounds need to be captioned if they are significant. The seven browser refresh keystrokes are significant, despite being difficult at times for hearing viewers to hear.The question is whether every single browser refresh sound needs to be captioned. When repetitive sounds are signaled by visual cues such as hands descending onto a keyboard or a computer screen flashing its refresh state, every instance of a repetitive sound may not require a caption.

Only three captions are used in the DVD clip below: one music song title (BABY, YOU’RE A RICH MAN PLAYING) and two browser refresh captions: (REFRESHING PAGE) and (CONTINUES REFRESHING). Is this sufficient?

 

Continue reading Captioning the faintest sounds when they’re part of a repetitive series