Flexiflyer with wheels (used with permission)

Long-promised video here!

Here’s an historical post. The key part is the video below which was created in 1972.

The video has been promised to accompany my chapter in the Festschrift for Ursula Bellugi and Ed Klima published in 2000. In that chapter I analyzed Lou Fant’s live interpretation of a spoken reminiscence.  I was the (English) speaker; Lou used American Sign Language (ASL). My story told about trying to ride a Flexiflyer down a steep U-shaped driveway and back up.

Spoiler alert:  I crashed.

Key Findings:  Fant managed to get the description of the relationship of the house, the driveway and the sled’s riders correct, if mirror-image of the actual space, without having seen the place, without any gestures from me (the speaker), and with the English input message being pretty sketchy. And the cool part? He continues still interpreting for at least a full minute, before he commits himself to those spatial relationships.

It takes a village…

Support from the National Institutes of Health and National Science Foundation over the past 40 years fueled the research of Klima and Bellugi, and many of their students and colleagues. I was privileged to be a member of the laboratory research staff from Fall 1970 through Spring 1973, and an irregular visitor thereafter. This video was created in 1972 at the Salk Institute. It was preserved during the early 1980s (on VHS cassette). It was digitized in 2000 with help from Stanford’s Academic Technology Laboratory (a support facility for faculty), and from Treehouse Video. I’m thrilled to report that the .mov (Quicktime format) video still plays, and has now been uploaded to YouTube, and is presented for your viewing pleasure, with gratitude to all those who helped along the way.

Pack rat unveiled

I saved that bit of video from Fant’s first (or perhaps second) visit to Salk Institute on one of my irregular visits back to La Jolla. When copying from helical scan 1/2″ videotape to VHS cassette, I remembered that I had consciously chosen to tell about an event that no one in the room had heard before, one from my childhood, so that it would be a genuine listening and viewing experience for both the hearing and deaf people present (not a retelling of a familiar story). Of course the interpreter hadn’t heard this story before, and he didn’t have much context about me either. I thought I had been quite clear about the physical space – I could picture it even many years after the event – how the house was situated, where the driveway started, turned, and ended at the street again, and what it was like to ride the wheeled sled. On listening again, I realize that the physical space is difficult to imagine if you were depending on the spoken message only.

Interpreter stays vague for a full minute

Our visitor, the exemplary interpreter and sign language educator, Lou Fant agreed to contrast “transliteration” and “interpreting.” I’ll offer a brief definition of these terms, knowing full well that other experts out there can elaborate in greater depth. Transliteration is a more English-influenced rendering into signs; interpreting is provides simultaneous translation into ASL, a different language, with English influence kept to a minimum. The excerpt shown here was the first part of the illustration of “interpreting.” The key surprise for me in reviewing the video was that Fant managed to keep the message vague as he worked out how all the different parts of the space described fit together. The ability to be vague had never been catalogued as a characteristic of the competent interpreter before. When I told him I was planning to look at this bit of video at long last and asked whether he’d like to see what I was finding and writing about him, he gave his blessing to my work without his review. I’m delighted to be able to present his spontaneous interpretation now almost 40 years after it was first produced.

And thanks to an interpreting instructor who uses the chapter from the Festschrift for asking where that video is.  Rachel, it’s here now.

Tuesday, March 9, we got the next update on YouTube’s automated captioning efforts. I heard it on NPR’s “All Things Considered” afternoon program, in which Robert Siegel interviewed Ken Harrenstien of Google with a (female) interpreter providing voice for the Google engineer.

Audio and transcript are available at http://www.npr.org/templates/story/story.php?storyId=124501330.

Harrenstien acknowledges that automated captioning today stumbles on proper names, including trademarks and product names:  ”YouTube” that comes out “You, too!” And automated captioning has difficulty with videos that have music or other sounds in the background. But, he characterizes himself as a technology-optimist, anticipating that in 10 years things will be much improved.

Benefits of captioning

Like “curb cuts” which have become the symbol indicating that solutions for disabled people (here, those in wheelchairs) resolve needs for others (strollers, roll-aboard luggage, shopping carts), captions have benefits that extend beyond hearing impairment.

• Deaf and hearing impaired people can enjoy the huge inventory of videos on YouTube. (The still frame that opens this post is from an announcement by President Obama in response to the Chilean earthquake. Making emergency and other time-sensitive news available to those who cannot hear meets the requirements of laws and regulations in the US. And more importantly, it meets the moral or ethical standards we expect from a civilized society where we include everyone in the polity.)
• If you’re in a noisy environment or located close to others who will be bothered by the audio, you can figure out what the video is saying even without benefit of headphones
• Small companies can afford to provide captions on their webcasts, often the heart of learning about new products
• Non-native speakers of English have a much better chance of understanding speech at ordinary (rapid) rates with the assist of captions
• Captions provide input to machine translation services, so that there soon will be captions in other languages besides English as well; as automated speech-to-text technology improves, we’re going to see other input languages as well
• Captions provide much better input to (current) search technology than speech does, so there’s hope of finding segments of videos that might not appear in written form

Professional captioners need not despair

I read the YouTube blog post of March 4 and the comments following it, and recalled the announcement of the limited trial with selected partners last November.  James expresses concern in his comment about the recent YouTube announcement that people, like him, who earn their living as captioners for post-production houses will lose their jobs as a result of the automated captioning.  My response seconds HowCheap’s comment that professional captioners will continue to find work both as editors of the automated speech-to-text and for organizations prefer doing their own captioning. Organizations that produce professional quality video typically start from a written script, adjust for the few changes that happen in the spoken version, and then set the timing of the text with the video.

The huge number of videos on YouTube are uploaded by individuals or by small organizations who may not be aware of the benefits from captioning, and likely don’t know about the tools available.  According to YouTube’s fact sheet: “Every minute 20 hours of video is uploaded to YouTube.” That’s a volume that is beyond the capacity of professional captioners and the organizations that employ them.

A proposal for improving the quality of captions

How shall we improve the quality of automatically produced captions?

I’d like to see interpreter training programs (ITPs) make editing automated captions a course assignment, a program requirement, or a component of an internship. Engagement with spoken language, not one’s own, is a challenge.  People phrase things in ways you don’t; they use unfamiliar vocabulary and proper names (streets, towns, people, products) that I need to look up.  Both ITPs for training sign language interpreters and those for people learning to interpret between 2 spoken languages may allow entry to students whose skills in listening, writing or spelling may be lacking.  How many caption-editing assignments are enough? Shall we also coordinate quality checks by others in the same or a different program?  Such assignments will guide students toward greater appreciation for the challenges of speech in online settings, with a task that provides an authentic service.

VRS and VRI

In the case of ITPs for sign language interpreters, the improved listening to online speech is great preparation for work settings such as VRS and VRI.  Video Relay Service (VRS) in the US is regulated by the FCC: deaf signers who cannot use the telephone (because their speech is not intelligible and they cannot hear well enough to understand speech over the phone) make use of intermediaries (interpreters) to communicate with hearing non-signers. (Think of simple tasks such as calling the school to notify them that your child will be absent; scheduling a haircut; ordering a pizza for delivery, not to mention more complex transactions involving prescriptions, real estate contract negotiation, billing disputes.)  Video Remote Interpreting (where the deaf and hearing parties are physically together, with the interpreter remote from them) is a service with similar requirements for the interpreter (listening to speech over a phone or data line, and rendering accurate translations in real time).

Broad multi-disciplinary open source content quality

Programs training instructors in English as a Second Language (ESL) could also participate.  Students in speech therapy and audiology would benefit from both the direct engagement with spoken language “in the wild” and with future colleagues in other disciplines. There are advantages to engaging a variety of people who are studying for professions that emphasize expertise in spoken and written English.

Looks like an open source content development effort to me. Yes, it will require a little bit of coordination, but not terrific overhead. How about it, ITP program directors?

Photograph detail UPI © 1980

I met Ted Kennedy only once.

In an earlier part of my professional life, I worked as a sign language researcher and interpreter based in New York City.  Well aware that the Democratic National Convention was scheduled for New York’s Madison Square Garden in August, 1980, I started attending planning meetings as a volunteer about 8 months beforehand. My reminiscences about sitting on that committee will wait for another post.

Suffice it to say that when Convention week arrived, we had a sign language interpreting team ready to work on the podium and in the gallery portions of the hall, with appropriate security credentials for each area.

On Tuesday evening, August 12, we realized that Senator Kennedy would address the delegates. I knew this would be an important speech:  He had just withdrawn his name from nomination, and he still had a strong following among a large number of delegates. Working in close proximity with Ted Kennedy meant that once I committed to interpreting his address, I was under Secret Service scrutiny, for roughly 40 minutes before we took the stage on Tuesday night until I left the stage.

Rehearsal?

I asked to read through the prepared speech. Under other circumstances the interpreter’s request would be anticipated and even welcomed by a veteran international speaker or his staff:  The interpreter ought to be commended for preparing. In this situation, other concerns arose:  Would this breach of confidentiality result in a leak to the press before the senator had delivered the address? The staff allowed access, but under highly controlled conditions. I was sitting in a hallway in which his support staff and others managing the stage for the DNC were chattering and moving about. In my recollection, it was noisy, poorly lit for reading, and with every possible distraction. I know I didn’t spend enough time on the final few pages of the speech, which turn out to have been the most memorable. (And if I had spent a moment thinking about it, I would have realized that the ending had to be inspiring, as Kennedy was conceding his candidacy in public with a goal of unifying the party under a single candidate.)

A note about the technology

I recall that the pages of Kennedy’s speech were given to him in a ring binder. Each page was printed at least double-spaced in large type (probably 24 point or greater). Each page was contained in a sheet protector, making it easy to turn a single page at a time. Not only did he have the speech on the teleprompter (which is visible in the photo), but it was also at hand, in physical means, in case of a technology glitch.

The television cameras were placed in several spots around the hall. This was my first experience of the “pool feed,” where all the networks relied on the same original video and audio signal, which they could edit as they wished for broadcast.

Physical proximity, audio quality

When the senator was called to the stage, I followed him, ascending a narrow staircase. While it appears in the photo that I’m standing within an arm’s reach behind him, in fact I was standing more than 10 feet behind him. (The wonders of the telephoto lens.) Of course the text had been taken from me, which barely mattered because I had no place to rest a script within viewing range. The audio quality was less than ideal; I don’t recall now whether I had a monitor to listen to the sound or had to depend on the sound coming to the others on the dais.

(For the subsequent evenings, the organizers moved the interpreters off the speaker’s platform to the far end of the honored guests’ seating, perhaps 100 feet or more from the speaker. I definitely recall the difficult listening situation for Lou Ann Walker, who interpreted Jimmy Carter’s acceptance speech, and me, as I took on Walter Mondale’s acceptance speech, both on Thursday evening, August 14. I suspect the pool didn’t care for the position of the interpreter in the line of sight of several of the cameras. Most of the video recordings show Kennedy from the side, rather than straight on. Keep in mind that this occasion was early in the history of closed captioning, only available for scripted, not live, broadcast events, a decade before the ADA became law.)

And that photo?

Friends and family around the country send me copies of the newspaper photo in their local papers on Wednesday. I went to UPI’s offices on 42nd Street some weeks later and got my own copy of the original photograph.

Photograph UPI © 1980

The framed photo hangs on the wall at my home. I missed my chance to have Senator Kennedy autograph the image, but I’m okay with that; it wouldn’t change my memories of the experience. In recalling the events, I realize how primitive the paper credentials were, how limited the Secret Service scrutiny, and how fortunate I was to have been part of this historic occasion.

An exercise for the reader…

Here’s a link to the audio recording of the speech (and text transcribed from the audio) , which I offer as a training exercise to all interpreting students and working interpreters. Keep in mind that as the interpreter, your goal is to convince the audience that you are delivering the speech as Ted Kennedy would have done if he had been fluent in American Sign Language (or into whatever language is your specialty). It’s a great chance to spend time with a text that has layers of meaning and historical significance, and to practice a rhetorical style which few of us get to interpret live. The challenge is equal whether you agree with his point of view or disagree, whether you admire his life and career or not.

For extra credit, try it with less than 30 minutes of distracted rehearsal time, in a stadium of approximately 10,000 people who speak Kennedy’s language, where there is no obvious audience for your live translation, with an uncertain audio signal, and during live broadcast to a few million home viewers.

www.americanrhetoric.com/speeches/tedkennedy1980dnc.htm