Voice Project Review December 18, 1986 CSL Voice Project · Background and rationale · Current goals · Who has done what · System overview (video), summary of overall architecture · Recent applications · Summary of overall architecture · Conversation control (switching) · Recorded voice support, databases · System issues · Directions Background, Rationale · Taming the telephone critical component in office user interface still crude not well integrated into other office tools · Voice as data recorded voice messages synthesized text-to-speech messages speech recognition (not yet) voice-annotated documents integration with other interactive applications · Earlier PARC attempts to incorporate voice fell short of critical mass Danray system in POLOS Alto voice boards . . . Overall Goal: A Voice Systems Architecture · User-programmable language-level interfaces simple things are simple complicated things make sense acceptable impact on reliability · Supports interoperability multiple workstations and environments multiple networks and protocols multiple telephone transmission and switching choices · Extensible admits new applications admits new services admits new workstations, networks, . . . Voice Architecture Layering Cast of Characters · Project management D. Swinehart, S. Ornstein · Hardware design and implementation, Etherphone software L. Stewart, D. Swinehart, S. Ornstein · Telephone control, switching, overall software architecture D. Swinehart, S. Owicki · Voice file server J. Ousterhout, S. Ades (Cambridge student) · Voice synthesizer integration P. Zellweger · Databases, recorded-voice support ("voice ropes"), telephone directories D. Terry, L. Adams (Stanford student, 1983) · Workstation Applications P. Zellweger, S. Ades, D. Swinehart, S. Owicki Voice Control Server · manages connections · monitors and controls state of each Etherphone · coordinates workstation user interfaces · stores voice objects · maintains databases Etherphone-workstation assignments directory assistance (white/yellow pages) ring tunes Conversation Management · one or more parties per conversation sources and sinks of voice non-voice participants, e.g. workstations · conversation establishment state machine (idle, notified, ringing, ringback, active, ...) parties act autonomously notifications of state changes · authenticated or presumed identities · active parties use Voice Transmission Protocol · broadcast reports during active conversation encryption key distribution recording started, playback finished, etc. Conversation Management -- Challenges · Novel conversation models background calls, lectures, "watercooler" simulators unsymmetric participation in (multiple) conversations under workstation program control · Workstation/telephone partnership workstation decisions override telephone decisions workstation tracks telephone-initiated activities default behavior when workstation fails or drops out · Reliability in the face of: simultaneous actions by all parties possibly-unreliable client code in workstation distributed control, failures real-time nature of the activity Directions · Left to do Intervoice for Etherphone system released to programmers Provocative telephone applications Receptionist's assistant Group background calls (SCL flavor) Locator Call filtering Publication, technology transfer · Current plans after 1-1-87, as time permits (some aspects become part of other projects, e. g. document frameworks) provocative telephone applications "unfunded" · Possible customers Corp. strategy -- Intervoice becoming feasible "ISD?" -- never had stable customer ISL -- myriad voice interests SCL -- related interests, but possibly disjoint approaches; low-level technical communications problems |Interpress Artwork: []<>Users>Terry.pa>Talks>IntervoiceLayers.IP!2 topMargin: 50.8mm, height: 152.4mm, width: 190.5mm �Ê.– PressFonts–"slides" style˜Iunleaded•Mark insideFooteršÑdis˜K– outsideFooterš�˜titlešÏxœ˜IraggedšÏb˜MšŸ˜MšŸ˜M˜MšŸ:˜:MšŸ˜MšŸ!˜!M˜MšŸ"˜"M˜MšŸ$˜$MšŸ˜M˜MšŸ ˜ —˜šŸ˜M˜M˜M˜+—šŸ˜M˜M˜#Mšœ˜M˜M˜/—šŸH˜HM˜M˜M˜——˜*šŸ˜M˜M˜M˜M˜ —šŸ˜M˜&M˜M˜5—šŸ ˜ M˜M˜M˜(——˜Idefault–[153.8111 mm topLeading 153.8111 mm topIndent 2.822222 mm bottomLeading 190.5 mm lineLength •Bounds(0.0 mm ymin 190.5 mm xmax 152.4 mm ymax •Artwork Interpress• Interpress¤Interpress/Xerox/3.0  f j k j¡¥“Äÿ�'Äþƒˆ ¢ ¨ r j¡¥“ÄWB ¤ ¨¡¡¨”””£¡ˆ¡¡ÅXeroxÅResearchÅ RGBLinear£¡¡¦ ç • ” ç­“Ä83ľKV™ÄTyV�Ä«z¡ŽÄ¾KV�Ä83Ž¡¡¡¡™ˆˆˆ£¡ ” ç­“Ä=`óÄÂÿV™ÄY-V�Ä´H¡ŽÄÂÿV�Ä=`óŽ¡¡¡¡™¤¯“   £¡ ” ç­“¢·“¢°“Ä=`óÄÂÿV™ÄY-V�Ä´H¡ŽÄÂÿV�Ä=`󎡸 r j¢·“¢°“¢¯“   £¡ ” ç­“Ä(ª¡ÄY-VÄ(ª¡ÄnWV¡¹¢¯“   £¡ ” ç­“Ä(ª¡ÄnWVÄ´H¡ÄnWV¡¹¢¯“   £¡ ” ç­“Ä´H¡ÄnWVÄ´H¡ÄY-V¡¹¢¯“   £¡ ” ç­“Ä´H¡ÄY-VÄ(ª¡ÄY-V¡¹ k é r j¢·“¢°“¢¯“   £¡ ” ç­“Ä(ª¡ÄnWVÄ(ª¡Äƒ�V¡¹¢¯“   £¡ ” ç­“Ä(ª¡Äƒ�VÄ´H¡Äƒ�V¡¹¢¯“   £¡ ” ç­“Ä´H¡Äƒ�VÄ´H¡ÄnWV¡¹¢¯“   £¡ ” ç­“Ä´H¡ÄnWVÄ(ª¡ÄnWV¡¹ k é r j¢·“¢°“¢¯“   £¡ ” ç­“Ä(ª¡Äƒ�VÄ(ª¡Ä˜«V¡¹¢¯“   £¡ ” ç­“Ä(ª¡Ä˜«VÄ´H¡Ä˜«V¡¹¢¯“   £¡ ” ç­“Ä´H¡Ä˜«VÄ´H¡Äƒ�V¡¹¢¯“   £¡ ” ç­“Ä´H¡Äƒ�VÄ(ª¡Äƒ�V¡¹ k é r j¢·“¢°“¢¯“   £¡ ” ç­“Ä(ª¡Ä˜«VÄ(ª¡Ä­ÕV¡¹¢¯“   £¡ ” ç­“Ä(ª¡Ä­ÕVÄ´H¡Ä­ÕV¡¹¢¯“   £¡ ” ç­“Ä´H¡Ä­ÕVÄ´H¡Ä˜«V¡¹¢¯“   £¡ ” ç­“Ä´H¡Ä˜«VÄ(ª¡Ä˜«V¡¹ k é r j¢·“¢°“¢¯“   £¡ ” ç­“Ä(ª¡Ä­ÕVÄ(ª¡ÄÂÿV¡¹¢¯“   £¡ ” ç­“Ä(ª¡ÄÂÿVÄ´H¡ÄÂÿV¡¹¢¯“   £¡ ” ç­“Ä´H¡ÄÂÿVÄ´H¡Ä­ÕV¡¹¢¯“   £¡ ” ç­“Ä´H¡Ä­ÕVÄ(ª¡Ä­ÕV¡¹ k é r j¢·“¢°“¢¯“   £¡ ” ç­“Ä=`óÄY-VÄ=`óÄY-V¡¹¢¯“   £¡ ” ç­“Ä=`óÄY-VÄóÄY-V¡¹¢¯“   £¡ ” ç­“ÄóÄY-VÄóÄY-V¡¹¢¯“   £¡ ” ç­“ÄóÄY-VÄ=`óÄY-V¡¹ k é r j¢·“¢°“¢¯“   £¡ ” ç­“ÄóÄY-VÄóÄÂÿV¡¹¢¯“   £¡ ” ç­“ÄóÄÂÿVÄóÄÂÿV¡¹¢¯“   £¡ ” ç­“ÄóÄÂÿVÄóÄY-V¡¹¢¯“   £¡ ” ç­“ÄóÄY-VÄóÄY-V¡¹ k é r jÄ@­¼ÄE¦! ¢ ¨ÅXeroxÅ PressFontsÅ Helvetica-brr£¡ “¸ ¤ ”¡•¡ —   £¡ ” ç­“  ŠÁ APPLICATION– k é r j¡¡¨¢·“¡¯“¡¡¨ k é r jÄ0fÄé } ¢ ¨ÅXeroxÅ PressFontsÅ Helvetica-brr£¡ “¸ ¤ ”¡•¡ —   £¡ ” ç­“  ŠÁSERVICE– k é r j¡¡¨¢·“¡¯“¡¡¨ k é r jÄ›ûùÄÊH} ¢ ¨ÅXeroxÅ PressFontsÅ Helvetica-brr£¡ “¸ ¤ ”¡•¡ —   £¡ ” ç­“  ŠÁ CONVERSATION– k é r j¡¡¨¢·“¡¯“¡¡¨ k é r jÄ ämÄŽ…h ¢ ¨ÅXeroxÅ PressFontsÅ Helvetica-brr£¡ “¸ ¤ ”¡•¡ —   £¡ ” ç­“  ŠÁ TRANSMISSION– k é r j¡¡¨¢·“¡¯“¡¡¨ k é r jÄ5E}ÄŒÂ} ¢ ¨ÅXeroxÅ PressFontsÅ Helvetica-brr£¡ “¸ ¤ ”¡•¡ —   £¡ ” ç­“  ŠÁPHYSICAL– k é r j¡¡¨¢·“¡¯“¡¡¨ k é r jßÁ ¢ ¨ÅXeroxÅ PressFontsÅ Helvetica-mrr£¡ “° ¤ ”¡•¡ —   £¡ ” ç­“  ŠÁ-- client applications– k é r j¡¡¨¢·“¡¯“¡¡¨ k é r jÄ‚ ¢ ¨ÅXeroxÅ PressFontsÅ Helvetica-mrr£¡ “° ¤ ”¡•¡ —   £¡ ” ç­“  ŠÁ-- telephony, recording, speech– k é r j¡¡¨¢·“¡¯“¡¡¨ k é r jßÄ# ¢ ¨ÅXeroxÅ PressFontsÅ Helvetica-mrr£¡ “° ¤ ”¡•¡ —   £¡ ” ç­“  ŠÁ-- establishment and management– k é r j¡¡¨¢·“¡¯“¡¡¨ k é r jßÄ)ࢠ¨ÅXeroxÅ PressFontsÅ Helvetica-mrr£¡ “° ¤ ”¡•¡ —   £¡ ” ç­“  ŠÁ#-- voice transmission protocol, RPC– k é r j¡¡¨¢·“¡¯“¡¡¨ k é r jßÄ8%1 ¢ ¨ÅXeroxÅ PressFontsÅ Helvetica-mrr£¡ “° ¤ ”¡•¡ —   £¡ ” ç­“  ŠÁ-- communication media– k é r j¡¡¨¢·“¡¯“¡¡¨ k é r jÄ'YÄN + ¢ ¨ÅXeroxÅ PressFontsÅ Helvetica-mrr£¡ “° ¤ ”¡•¡ —   £¡ ” ç­“  ŠÁsynthesis/understanding, etc.– k é r j¡¡¨¢·“¡¯“¡¡¨ k é r jÄ'/ÄN_2 ¢ ¨ÅXeroxÅ PressFontsÅ Helvetica-mrr£¡ “° ¤ ”¡•¡ —   £¡ ” ç­“  ŠÁof conversations– k é r j¡¡¨¢·“¡¯“¡¡¨ k é k é k gš Ïnœ1Ïo ÏfÐosœ¡¢£œ¡¢£™u—˜šŸ˜M˜—šŸ9˜9M˜%—šŸ=˜=M˜—šŸ˜M˜*—šŸ˜M˜ —šŸJ˜JM˜+—šŸ˜M˜.——˜MšŸ˜MšŸ0˜0MšŸ)˜)MšŸ˜šŸ˜M˜"M˜)M˜ ——˜šŸ&˜&M˜M˜)—šŸ˜M˜>M˜M˜—MšŸ&˜&MšŸ0˜0šŸ.˜.M˜M˜*——˜%šŸ˜M˜4M˜5M˜!—šŸ#˜#M˜2M˜1M˜4—šŸ˜M˜#M˜.M˜M˜ ——˜ šŸ ˜ M˜8˜"M˜M˜#M˜M˜—M˜ —šŸ˜M˜eM˜-I pagebreak˜—šŸ˜M˜.M˜#M˜M˜g—M˜——…—¬!V