VOICE APPLICATIONS IN CEDAR A VIDEOTAPE BY POLLE ZELLWEGER AND KEN PIER PROLOGUE SET UP /Cedar/Cedar6.0/Heads/TerminalFace.SetFieldRate[normalAlto, normalLF, lfBall60hz, lfPhillips60hz] Artwork ON adds ///Users/PolleZ.PA/Finch/ color: Etherphone logo with PARC picture. PreView /indigo/voice/pics/EtherphoneLogo.IP LF: icons: Edit tool, Clock, mailbox, Active msg. set, Finch, phone directory, SIL viewer on system diagram. SIL ///Users/PolleZ.pa/Video/EPBlockD2.sil PreView on ColorParc.ais. cpreview2 [pixel]parc right side icons: AudioTitle.tioga Viewers: right: Watch, CmdTool with Phone button, AudioTitle.tioga left: VideoTitle viewer. Open ///Users/PolleZ.pa/Video/VideoTitle.tioga MAKE A PHONE CALL TO PRIME ICONS. SPEAKTEXT TO PRIME SPEAKER MAKE FINCH VERY SHORT AT BOTTOM OF LEFT SIDE. CmdTool Look L, caret Look L. Maybe LOOK B also ?? ACTION CAMERA: Full screen shot of Etherphone logo/PARC picture on color display. 3 seconds. CAMERA: zoom in to workstation. 3 seconds. CAMERA: DISSOLVE TO REAL WORKSTATION. 2 seconds. CAMERA: ON TOP LEFT quarter of LF. FREEZE. Text there is title and credits. Title: Voice Applications in Cedar VOICE OVER from synthesizer select AudioTitle text & click SpeakText => spoken credits CUT: make logo viewer iconic. Close credits. Open PreViewer icon on ColorParc.AIS (color). Set up screen as described in SET UP, above. Open TiogaDoc in Upper Left LF. ACTION * CAMERA: ON color, full screen. PAN LEFT along top of LF. Show Watchtool running , Tioga viewer, ... PAN DOWN, then RIGHT along bottom of screen: Show Icons at bottom of screen. PAN BACK TO FULL LF SCREEN. FREEZE. * VOICE OVER (Dan): In the Computer Science Laboratory at the Xerox Palo Alto Research Center, we are developing an experimental voice management system. This system is implemented within an integrated programming environment called Cedar. Cedar runs on a collection of personal workstations and servers interconnected with Ethernet, a local area network. The voice management system is a foundation for research in using voice within personal information systems. We are primarily interested in workstation based applications built on the voice manager. We will demonstrate an advanced digital telephone system and voice within electronic mail and calendar systems. ** CAMERA: PAN LEFT to microphone, speaker, telephone. PAN DOWN TO Etherphone box. PAN back to show components again. ** VOICE OVER (Dan): Our experimental telephone application serves all of the telephone needs of nearly fifty laboratory members. Each office is equipped with a modified telephone instrument, a speaker, a microphone, and a custom microprocessor-based unit. Together, this equipment is called an Etherphone. CUT: Open and arrange SIL viewer with system block diagram on LF display. Destroy other viewers so as not to have too many icons (distracting). ACTION *** CAMERA: on SIL viewer. Cursor will be used during voice over to make points. *** VOICE OVER (Dan): System databases and connections are managed by a centralized switching server on the network. There is a second server, called the voice file server, used to store and access digitally recorded audio signals. An Etherphone digitizes voice, encrypts it, and transmits it over an Ethernet to other Etherphone users and voice services. It also receives, decrypts, and converts encoded signals to audible form. Each Etherphone is further connected to a commercial, direct-dial office telephone line. This line is used for calls to telephones outside the Etherphone system. CUT END PROLOGUE SCENE 0: IN POLLE'S OFFICE INCOMING CALL SET UP Finch/Phone icon and directory icon, closed. No other distractions. Delete nearby icons. CAMERA: ZOOMED IN TO PHONE ICON. ACTION incoming call from inside line: Maureen Polle uses SpeakerPhone. Polle: "Hello, Polle Zellweger here." Maureen: "Hi this is Maureen Stone. I'm busy now, but I'd like to see you later. Can you come by and show me how to put voice into an electronic message?" screen: show icon as conversation with Maureen Stone Polle: "Sure. How about around 3:30 or 4?" Maureen: "Fine. See you then." Polle: "Okay, bye." hang up with SpeakerPhone switch show icon becoming phone again CUT END SCENE 0 SCENE 1: IN POLLE'S OFFICE EMAIL AND OUTGOING CALL SET UP color: PreView on ColorParc.ais. LF: icons: Clock, mailbox, msg. set, Finch, phone directory, SIL viewer on system diagram, WatchTool closed. viewers: left: CmdTool with Phone button right: EditTool, Walnut, Active msgs. UNADJUST FINCH VIEWER and scroll to conversation log. Make iconic on LEFT side. ACTION CAMERA: Starts same position as end of Scene 0. PAN/ZOOM OUT TO Polle Polle: "Cedar provides many services that we use in our day-to-day business. Electronic mail is one of them, and the voice system plays a part in that as well. Let's see what's in my electronic mailbox." CAMERA: PAN AND ZOOM TO FULL LEFT LF POLLE: Opens Doug's message on right side. CAMERA: ZOOM IN TO electronic message from Doug Terry on LEFT SIDE: To: VoiceProject^.PA From: Terry.PA Subject: Demo today "I'll be ready to give a demonstration of the new telephone directory package at 2 PM" Polle: "Doug Terry is working on an improved directory package for us. Let's call him and let him know we're coming to his demo." CAMERA: ZOOM OUT slightly TO see message and Phone button in CommandTool. Polle: "I'll just select Doug's user name and click a convenient 'Phone' button. The system will do the rest." SIMULTANEOUS ACTION AS DESCRIBED. using speakerphone, can hear tune CAMERA: CUT TO POLLE. Polle: "That's Doug's special ring tune, which he is also hearing in his office. The switching server consults a database for phone numbers and ring tunes." Doug answers: "Hi Polle. How do you like my loony tune!" CAMERA: ZOOM OUT TO FULL LEFT SIDE (LF). Polle: SHIFT-MIDDLE open and show conversation log entry CAMERA: ZOOM IN TO CONVERSATION LOG ENTRY Polle: "Just ducky, Doug. 2 o'clock is fine for the demo" Doug: "Great. See you then." Polle: "OK, Bye." POSSIBLE FADE OUT HERE. CUT END SCENE 1 SCENE 2: IN POLLE'S OFFICE AUDIBLE REMINDER SET UP unchanged from end of Scene 1. Close Finch. ACTION CAMERA: on Polle Polle: "Cedar provides an on-line calendar service with visual and audio reminder messages. I'll have the system remind me to go to the demo." CAMERA: PAN/ZOOM OR CUT TO LEFT SIDE LF where Polle selects text from Doug's message "... a demonstration of the new directory at 2 PM" Polle selects text, pushes "REMIND" BUTTON. CAMERA: CUT TO Polle Polle: "I told the Calendar system to speak the reminder, in addition to flashing an icon, at 2 o'clock. The spoken reminder will use the same commercial speech synthesizer that you heard introducing this videotape. We have several synthesizers available as servers to any Etherphone user." CUT END SCENE 2 SCENE 3: IN POLLE'S OFFICE VOICE IN EMAIL SET UP unchanged from end of Scene 2. ACTION CAMERA: already on Polle Polle: "Let's go back to reading my mail. Here's an interesting message. Let's have a look." Polle: destroy or close Doug's message. Open new message by itself on LEFT LF. Polle: "It looks like it has color in it, so let's put it on the color display." Move to Color display. CAMERA: CLOSEUP of MESSAGE Polle: "This is a message describing some work one of our associates is doing." "In addition to the telephone management features we've seen so far, our voice system also supports voice annotation of documents, in this case an electronic message." electronic message from Dan re voice prints text explaining the voice prints voice ID 1: some sentence(s) voice print of above voice ID 2: music small color telephone with smiley face near signature [this requires some simulation: maybe use 2 mics or tape recorder] Polle: point to first voice ID with mouse "This text identifies a previously-recorded voice message that's stored on the voice file server." click Play in header for first message. Click Play in header for second message. Voice over music in second message: "Voice playback uses the same connection and voice transmission capabilities as Etherphone calls." CUT END SCENE 3 SCENE 4: IN POLLE'S OFFICE MORE VOICE IN EMAIL SET UP unchanged from Scene 3. ACTION Polle: "Let's send Dan a response." Click Answer in message header to send electronic response, also with voice message. Text of message: Wow! Click Record. Polle: (as voice recording) "Pretty snazzy, Dan: integrated text, voice, and graphics!" Polle: "Let's check the message before we send it." Play back message. Polle: "Sounds fine." Send message. CUT END SCENE 4 SCENE 5: IN POLLE'S OFFICE PRIVATE DIRECTORIES AND OUTSIDE CALLS SET UP Probably same as at end of 4. Be sure directory is scrolled correctly, then make it iconic. Run VideoCommands. ACTION CAMERA: on Polle. Polle: "I can also create a personal telephone directory as an unlimited set of speed dialing buttons. Let's open up my directory." CAMERA: PAN TO LEFT HALF LF. WATCH DIRECTORY ICON OPEN UP. CAMERA: ZOOM/ SLOW PAN along directory entries. FREEZE on "flower shop" Polle: "Each entry is actually a button. Entries contain a freely formatted name field, a work phone number field, a home phone number field, and comments. Let's make a call to a phone outside of the Etherphone system." Polle places call to "flower shop" by pushing directory entry. Use speakerphone. Rings once or twice. Shop (Ken): "Flora's flowers" Polle: "Hi. I'd like a dozen lavender roses for a Valentine's Day gift. Do you have any?" Shop: "Yes. We got some fresh today." Polle: "How late are you open tonight?" Shop: "until 6" Polle: "Great, thanks. Bye." CUT CUT END SCENE 5 SCENE 6: IN POLLE'S OFFICE, 2 PM CALLING DAN FROM COMMANDTOOL SET UP Probably same as at end of 4, or get rid of a few viewers. new command tool _ Process.Pause[Process.SecondsToTicks[10]] PretendIts 1400 close new command tool ACTION CAMERA: on Polle, reading SIGCHI Journal, away from the display. audio reminder happens. Small reaction from Polle; no big deal. Not a robot. CAMERA: PAN OR CUT to SCREEN REMINDER ICON. FREEZE, 3-4 seconds. CAMERA: PAN BACK TO POLLE. Polle: "Time for the demo. Let's call Dan Swinehart and see if he's going to be there." Polle calls Dan CAMERA: CUT TO CommandTool. Polle use command tool: phone Swinehart rings three times- no answer Polle: "oh well, I guess he'll have to see it another time" CAMERA: SEE Polle thru doorway. EXEUNT. FADE. CUT END SCENE 6 SCENE 7: IN DOUG'S OFFICE VISITING AND NEW DIRECTORY SYSTEM DEMO SET UP [simulate visiting: Polle is logged in @ Doug's machine, but it looks like Doug is...] N.B.: PolleZ's FINCH MUST DROP OUT. Then, Doug's machine may need a new Finch. Doug's machine. Browsers on left of screen. CommandTool on right. Few Icons. No WatchTool. Doug browsing when Polle enters. ACTION CAMERA: BROAD SHOT SHOWING OFFICE AND DOUG Polle enters. To Doug: "Hi Doug, I'm here to see your new telephone directory package. Since Dan might call, I'd like to tell the Etherphone system that I'm visiting your office." CAMERA: CUT TO RIGHT SIDE LF. ZOOM IN TO COMMAND TOOL screen: Visit PolleZ response: PolleZ is visiting Terry at 2:03pm. PolleZ's calls will now ring at Terry's office and PolleZ's office. CAMERA: CUT TO DOUG. Screen not important here. Doug: "Okay, Polle, I've built a database system for managing public and private telephone directories simultaneously. Unlike a simple text file, the database allows several different ways of accessing the data and supports large numbers of entries efficiently. The public directory contains names and office phone numbers of all Xerox employees in Palo Alto. My personal directory contains information about people I'm likely to call, including their name, office phone, home phone, and other remarks." Doug gets a call from someone [Mike Spreitzer, in Peter Kessler's office]. (Doug's tune) Doug: "Hi, this is Doug. I'm busy right now, can I call you back? Thanks. Bye" Polle IMMEDIATELY gets a call from Dan. (Polle's tune) CAMERA: ZOOM OUT TO BOTH Polle: "Excuse me, they're playing my song." Polle looks at screen to determine caller. Polle: Hi Dan. Dan: Hi Polle, My conversation log says that you called me. Polle: Yeah, I'm in Doug's office looking at a demo of his new directory package. Why don't you come join us? Dan: I'd like to, but I'm due at a meeting shortly. I'll come by and see it later. Polle: OK. Bye. ACTION CAMERA: on SCREEN to view whitepages browser on left. DEMO OF WHITEPAGE BROWSER Polle (to Doug): Okay Doug, let's see your demo. Doug: The new telephone directory browser has a query-browsing style of interaction. I can query the whitepages database using a variety of information about people and various pattern matching filters. I can then browse through the responses to find the person I want. Suppose I'm looking for someone whose first name is "Dan", but I don't know his last name; I can select "wildcard" pattern matching and type "*, Dan" into the name field. I could also have issued a more complicated query, such as show all Dans or Dougs. Doug runs the query"*, Dan". Doug: As you can see, the phone numbers and mail addresses of all of the "Dans" are being retrieved. Polle: Once you have a set of query responses, can you place calls using them the same way we do now? Doug: Sure, I can now call Dan Swinehart by clicking on his entry with the mouse button. Or I could send electronic mail to him. Doug: Each database entry also has a Soundex key. Soundex encoding is essentially a simplified phonetic spelling that was developed at the turn of the century. Names that sound similar usually have the same encoding. Soundex has been used in many different applications, such as airline reservation systems. Let's say I'm looking for the phone number of Sally Johnson, but I don't remember how she spells her last name. I can select "soundex" and type in "jonson". Run the query"jonson". Doug: When I click "browse", not only do all of the "johnsons" get retrieved, but so does "Frank Jansen", and "Betty Jensen", and look here, I even get "Norm Johansen". Polle: "That's great, Doug. I'm looking forward to using this soon." CAMERA: FADE CUT END SCENE 7 SCENE 8: IN POLLE'S OFFICE UNVISITING AND SWITCHING OFF WORKSTATION SET UP Out of IDLE. same as before ACTION CAMERA: FADE UP TO CLOCK showing sometime after demo. PAN TO CommandTool: visit PolleZ CUT TO Polle, seated, facing Camera Polle: "I've just told the system that I've returned to my office. If I had forgotten, my phone would ring both places, so I wouldn't miss calls. Since my calls would ring with my tune, Doug would know not to answer them. "Although having a workstation next to an Etherphone allows all of the screen-based interactions you've seen so far, the workstation isn't needed for the basic Etherphone functions of making and receiving calls. Remember, the Etherphone is not physically connected to the workstation; instead, part of the database in the centralized switching server associates Etherphones with adjacent workstations. To demonstrate this, I'll turn my workstation off and place a call. Incoming calls will still ring with my distinctive tune, and calls from my telephone will still be identified as being from me. machine to IDLE, pick up handset. "Since I use online directories all the time now, I don't remember anyone's phone number. Luckily, I don't need to, because directories are available from the telephone as well as from the workstation. I just type the person's last name using the letters printed on the keys. I think I'll call Maureen Stone back and see if she's ready to learn about voice messages now. CAMERA: PAN OR CUT to telephone. call * 0 S T O N E # Polle: "Hi Maureen, is now a good time for me to come by? All right, see you in a few minutes." CAMERA: FADE out in the middle of the above conversation. END SCENE 8 EPILOGUE VOICE OVER Polle interacting with her display. Dan: "You have seen many of the current applications of the Etherphone voice and telephone management system. These applications all use the Cedar voice management package, which makes the basic telephone and service features available to programs. Applications such as the new directory browser can be connected to the voice facilities quickly and with little effort. "The project is still in progress. We want to develop both the telephone system and the use of digital voice in powerful new ways. In the telephone arena, we are interested in convenient conference calling, call filtering, and automated phone answering services. We also want to add voice annotations to all kinds of dynamic documents, including everything from voice annotation of text documents for tutorials to complete animation with voice and pictures. We are planning to use the annotation system to collect voice input data for computer-human interaction studies, where we simultaneously capture both user actions and vocal explanations of his or her intentions. "The voice management package and its applications are representative of the kinds of experimental activities that the Cedar environment will support. We hope that this brief presentation has given you something of the flavor of both the Cedar environment and of the present state of the CSL voice project at PARC." FADE CUT END EPILOGUE END TAPE. What about credits, music, ... ?? Notes: tiny Etherphone logos on all hardware components? change tunes to singletons: Close Encounters, some other easily recognized (Ades?) Centrex forward all calls to somewhere else, Dealer/msg announce no calls during demo. change Finch to reverse video active conversations in log. change Finch to remove ".." for node breaks; "[+]" instead? how to deal with DECtalk fan hum? I think there's enough cable to roll it outside my office. want to show DECtalk, server?? hack breakpoint into Remember comment in 2 tells how to do this after rollback set up profile for fancier Remember icon Thrush change 1: don't cut off the conversation so quickly. Would help all t-t-s interactions. Can simulate or do in Finch. Thrush change 2: allow a dictionary response ("")? This may be hard. Summary: ways to place calls (could send this as electronic message) 1. select name/number & click `phone' 2. phone name/number in Command Tool 3. click directory entry (home/office) 4. type name/number into Finch called party field & click 5. if last person you called, click Finch called party field 6. if last person to call you, click Finch calling party field 7. dial name/number on keypad could look at FinchDoc online \PhoneScript.tioga Polle Zellweger (PTZ) February 17, 1986 3:57:29 pm PST Pier, February 13, 1986 7:35:33 pm PST Swinehart, February 13, 1986 12:26:52 pm PST N.B.: may really use off camera phonetic spelling to make it sound good: Seedar, Pollee, etc. Maureen's Etherphone is unreliable and currently off. N.B.: This scene modified to have Maureen calling from inside instead. Sexier icons. N.B.: let it ring twice, then Polle explains: N.B. Using BreakTool, set FinchSmarts.TextToSpeech[event.text, TRUE, NIL] at RememberImpl.EnterEventMinder (pos: 19745) -- may need to use actual rope, for ending No real scene change here!! (want to see receipt of this message? use speakerphone or handset?) Set up phony clock time. CAMERA: ZOOM IN ON CLOCK ICON _ VideoCommands.KickClock[] show clock advancing quickly to nearly 2 PM. FADE OUT. [can set clock: red=hr yel=min blu=sec shift=fwd non-shift=back ctrl=restore can write small program to call Clock.ChangeOffset to advance to near 2pm; Reminder can be triggered secretly using ItIsNow command. Maybe omit this view of keypad -- it was described above anyway. Κœ˜™Icode™6K™&K™,—J˜IcenteršΠbl˜L˜L˜L˜L˜default˜˜Jšœ#Οn œ2˜aJ˜ šœ˜J˜V˜J˜JJ˜HJšœ9˜9J˜"—˜˜9J˜G——Jšœ!˜!J˜J˜-J˜2——J˜˜J˜UJ˜*J˜0J˜LJ˜"˜J˜:J™]—J˜J˜§I pagebreak˜—˜˜ΨJ˜—JšœΟbŠ˜ž—˜˜uJ˜—JšœŸž˜³J˜J˜J˜—˜˜PJ˜—JšœŸ½˜ΤJ˜J˜—J˜ N˜—L˜˜ ˜J˜XJ˜ —J˜˜˜'J™5—J˜šŸ˜JšŸ˜—šŸ ˜ JšŸ“˜“—Jšœ4˜4šŸ˜JšŸ$˜$—šŸ˜JšŸ˜—šŸ˜JšŸ ˜ —J˜ J˜J˜J˜—˜ JšœT™T——N˜L˜˜˜J˜!˜J˜h˜J˜J˜%——J˜O—˜˜EšŸ˜JšŸΕ˜Ε——J˜$J˜*˜C˜J˜˜J˜V———šŸ˜JšŸz˜z—J˜IšŸ˜JšŸhœ#˜‹—Jšœ!˜!J˜Jšœ-™-šŸ˜JšŸ•˜•—šŸ ˜ JšŸ+˜+—J˜(J˜8J˜)šŸ˜JšŸ3˜3—šŸ˜JšŸ˜—šŸ˜JšŸ ˜ JšΟi˜—J˜—J˜ —N˜L˜˜˜J˜+Jšœ£™£—˜J˜šŸ˜JšŸ‡˜‡—J˜‡J˜+J˜šŸ˜JšŸ˜—J˜—J˜ —N˜L˜˜˜J˜—˜J˜šŸ˜JšŸW˜W—J˜OšŸ˜JšŸI˜I—Jšœ˜J˜šŸ˜JšŸH˜HJšŸ§˜§—˜+Jšœ ˜ J˜J˜J˜˜5J˜B——šŸ˜J˜"JšŸb˜bJ˜'J˜MJšŸb˜b—J˜—J˜ —J˜L˜˜˜J˜J™—˜šŸ˜JšŸ˜—J˜TJ˜J˜ šŸ˜JšŸ;˜;—šŸ˜JšŸ,˜,—J˜šŸ˜JšŸ˜—J˜ J™CJ˜—J˜ —N˜L˜˜%˜J˜[J˜—˜J˜šŸ˜JšŸ}˜}—J˜:J˜HšŸ˜JšŸΥ˜Υ—J˜PJ˜šŸ ˜ JšŸ˜—šŸ˜JšŸS˜S—šŸ˜JšŸ ˜ —šŸ˜JšŸ ˜ —šŸ˜JšŸ ˜ —šŸ˜JšŸ˜—˜J™J™J™J™6Jš L™LJš J™JJš 9™9—J˜—J˜ —N˜L˜ ˜˜J˜:J˜J˜Jšœ+˜+J˜J˜J˜—˜J˜@J˜LJ˜@J˜šŸ˜JšŸP˜P—J˜˜J˜'—J˜šŸ˜JšŸ4˜4—J˜.J˜—J˜ —N˜L˜˜&˜Jš V˜VJš N˜NJ˜|—˜J˜*šŸ˜JšŸ˜—J˜5J˜J˜rJ˜/šŸ˜JšŸτ˜τ—˜YšŸ˜JšŸH˜H——J˜9˜šŸ˜JšŸ%˜%——˜*JšŸ˜JšŸ;˜;JšŸn˜nJšŸS˜SJšŸ˜J˜——˜J˜5JšΠbs˜JšŸ1˜1šŸ˜JšŸN˜NJšŸΉ˜Ή—Jšœ˜šŸ˜JšŸ`˜`—šŸ˜JšŸ^˜^—šŸ˜JšŸ{˜{—šŸ˜JšŸΞ˜Ξ—Jšœ˜šŸ˜JšŸ’˜’—J˜šŸ˜JšŸ=˜=—J˜ J˜—J˜ —N˜L˜˜(˜J˜—˜J˜5J˜ J˜#šŸ˜JšŸΨ˜ΨJšŸΨ˜Ψ—˜!JšŸυ˜υ—˜ J™@—˜šŸ˜JšœŸWœ˜Y——J˜9—J˜ —N˜˜J˜˜.šŸ˜JšŸν˜νJ˜JšŸ‘˜‘J˜JšŸΌ˜ΌJ˜J˜——J˜ —˜˜,˜˜J˜1J˜RJ˜VJšΟy:˜:Jš’;˜;J˜}Jš’œ2˜OJš’(˜(J˜}J˜EJ˜J˜—˜˜J˜—J˜—————…—HΰTΨ