VWGoA - Ex. 1001
`Volkswagen Group of America, Inc., Petitioner
`
`1
`
`

`
`US 8,706,504 B2
`Page 2
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`4,708,224 A
`4,749,062 A
`4,979,593 A
`4,995,479 A
`5,027,104 A
`5,042,620 A
`5,056,629 A
`5,086,450 A
`5,159,163 A
`5,200,583 A
`5,255,341 A
`5,283,731 A
`5287266 A
`5,295,064 A
`5,357,596 A
`5,448,625 A
`5,463,209 A
`5,485,897 A
`5551532 A
`5606154 A
`5,638,425 A
`5,689,094 A
`5748841 A
`5,749,443 A
`5,819,201 A
`5819284 A
`5,844,181 A
`5,852,775 A
`5,887,139 A
`5,918,222 A
`5,932,853 A
`5,955,710 A
`5,979,757 A
`5,984,051 A
`5,987,381 A
`6,011,839 A
`5,057,297 A
`6,073,727 A
`6,078,928 A
`6,082,500 A
`6,085,112 A
`6,157,705 A
`6,163,749 A
`5,202,008 B1
`
`6:223:160 B1
`6,230,132 B1
`6,236,968 B1
`6,332,127 B1
`6,341,668 B1
`6,349,797 B1
`6,360,167 B1
`
`...... .. 704/275
`
`11/1987 Schrooder
`6/1988 Tsuji et al.
`12/1990 Watanabe et al.
`2/1991 Fujiwara et a1.
`6/1991 Reid
`8/1991 Yoneda et a1.
`10/1991 Tsuji et a1.
`2/1992 Kitagawa et al.
`10/1992 Bah]-316131.
`4/1993 Kupersnlith et 31.
`10/1993 Nakajima
`2/1994 Lalonde et a1.
`2/1994 M3160 e131.
`3/1994 M3166 et a1.
`10/1994 Takebayashi et al.
`9/1995 Lederman
`10/1995 Figh et a1.
`1/1996 Matsumoto et al.
`9/1996 Kupersmith
`2/1997 Doigan e131.
`6/1997 Meador et a1.
`11/1997 Friedli et a1.
`5/1998 Morin e131.
`5/1998 Romao
`10/1998 DeGmaf
`10/1998 Farber e131.
`12/1998 Amo et a1.
`12/1998 Hidmy
`3/1999 Madison e131.
`6/1999 Fukui et al.
`......................... .. 1/1
`8/1999 Friedli et a1.
`9/1999 DiFranza
`11/1999 Tracy et al.
`11/1999 Morgan et al.
`11/1999 Oshizawa
`1/2000 Friedli et al.
`5/2000 Beach
`6/2000 DiFranza et al.
`6/2000 Schnase et al.
`7/2000 Amo et al.
`7/2000 Kleinschmidt et al.
`12/2000 Perrone
`12/2000 McDonough et al.
`3/2001 Beckefi et 31~
`amp h
`4/2001 Kfsagmagtlal.
`5/2001 Class et 31.
`5/2001 Kanevsky et 31.
`12/2001 Bandem et 31.
`1/2002 Fayette et al.
`2/2002 Newville et al.
`3/2002 Millington et a1.
`
`6,397,976 B1
`6,421,305 B1
`5,450,035 B1
`6,466,232 B1
`6,504,571 B1
`6,526,506 B1
`5,571,279 B1
`6,587,835 B1
`6,594,580 B1
`5,505,544 B1
`6,615,175 B1
`6,651,045 B1
`6,799,327 B1
`6,801,792 B1
`6,944,533 B2
`6,990,312 B1
`7,136,853 B1
`7,305,345 B2
`7,577,244 B2
`7,702,798 B2
`7,765,558 B2
`7,783,975 B2
`8,234,119 B2
`2003/0115289 A1
`2003/0195833 A1
`2004/0104842 A1
`2005/0144073 A1
`2005/0239402 A1
`2006/0069749 A1
`2007/0174258 A1
`2007/0255838 A1
`2008/0187121 A1
`2008/0319733 A1
`2009/0077100 A1
`2010/0023392 A1
`
`6/2002 Hale et al.
`7/2002 Gioscia et al.
`10/2002 HGTZ
`10/2002 Newell et al.
`1/2003 Narayanaswami et al.
`2/2003 Lewis
`5/2003 Herz 65 31,
`7/2003 Treyz et a1,
`7/2003 Tada et al.
`8/2003 Ford GU11;
`9/2003 Gazdz1nsk1
`11/2003 Macaulay
`9/2004 Reynolds et al.
`10/2004 Schuster et al.
`9/2005 Kozak_ et al.
`1/2006 G1osc1a et al.
`11/2006 Kohda et al.
`12/2007 Bares et al.
`8/2009 Taschereala
`4/2010 Apreutesei et al.
`7/2010 Sahota et al.
`8/2010 Andrews et al,
`7/2012 Dhawan et al.
`6/2003 Ch1nn et al._
`10/2003 Baranowski
`6/2004 Drury et al.
`6/2005 l\/l_orr1_sroe et al.
`10/2005 G1osc1a et al.
`3/2006 Herz et al.
`7/2007 Jones et al.
`11/2007 Hassan et al.
`8/2008 Agarwal et al.
`12/2008 Pulz et al.
`3/2009 Han°_°°1<<°~t 31,
`1/2010 Merr1man et al.
`
`JP
`JP
`JP
`JP
`JP
`
`FOREIGN PATENT DOCUMENTS
`
`01225581 A
`03272977 A
`05017083 A
`05058554 A
`05201524 A
`
`9/1989
`12/1991
`1/1993
`3/1993
`8/1993
`
`OTHER PUBLICATIONS
`
`Karen Jacobs (Dec. 7, 1999) “Elevator Maker to Add Commercial
`Touch,” The Wall Street Journal, pp. 1-2.
`Lewis Perdue (Jul. 20, 1999) “Forget Elevator Music, Here Comes
`Elevator Internet,” Internet VC Watch, pp. 1-2.-
`Stevens Institute ofTechnology, Spring 1999 Final Report, pp. 1-12.
`Ken11Yoneda, et al. (Dec._1997) _lV_lult1-Objective Elevator Supervi:
`sory-Control System with Ind1v1dual Floor-S1tuat1on Control,
`H1tach1Rev1ew, p~ 1,
`
`* cited by examiner
`
`2
`
`

`
`U.S. Patent
`
`
`
`.WsoSE28AT 2.
`ozzmoza955
`
`M022,
`
`1w
`
`«U5295
`
`m8<>m:m
`
`SE28
`
`2:2:
`_%omE>
`
`35........................................-.4%>%m.%n,_§,25o2939
`
`US 8,706,504 B2
`
`moéoa
`
`BBB
`
`Hmmmfizwm
`
`5502
`
`56%
`
`2
`
`3
`
`
`
`
`

`
`U.S. Patent
`
`US 8,706,504 B2
`
`4
`
`

`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 3 of 24
`
`US 8,706,504 B2
`
`m9EE,z_Hmmmsmmé
`
`_,2,5,7::
`.Hmz<.EZ
`
`mm,/mmm
`
`mGE
`
`5
`
`
`
`
`

`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 4 of 24
`
`US 8,706,504 B2
`
`
`
` USER SELECT
`“BUILDING DIRECTORY"
`
`FUNCTION EY
`
`
`
`
`
`
`SYSTEM
`J)
`,
`
`”};C())C,:P:{%f)IYIg‘D
`
`OR VISUAL
`PROMPT
`
`RETRIEVE BUILDING
`
`IIcTI<YIL,E %
`?
`~
`
`VIEUAL W
`
`
`
`
`
`DISPIAV DIRECTORY
`EILE ON DISPLAY
`
`7 DEV
`
`
`
`AUDIO
`
`I
` RETRIEE CELP FILE A
` SYNTIIISSIZII.
`VOICE PROMPT
`("NAME")
`
`
`
`
`
`AUDIO
`
`USER3
`‘NI
`
`INPUT DEVICE
`
`
`
`
`LOCATE & RETRIEVE
`
`GRAPHIC PILE
`
`POR SELECTED FNTRY
`‘
`’
`I
`I
`‘
`YES DISPLAY GRAPHIC EILE
`
`
`FLOOR
`SELECTED NO
`3;
`
`
`
`SAMPLE VOICE
`AN DIGITIZE é
`
`RETRIEVE BLDG.
`DIECTY “U5
`
`COMPARE SAIQTPLED
`I
`.
`VOICE WITH DIRECTORY
`FILE
`V
`
`CALCULATE
`CONT RATING
`I
`I
`
`.
`
`
`ENABLED . »
`Q
`
`CONT.
`RATING
`
`
`
`GENERATI-.l SEQUENCE
`b LIST OF I\CES
`
`
`
`SIISIZEPOMPT
`
`
`
`
`
`
`SYNTHESIZE NEXT PROIVIPT ‘
`BASED ON MATCHS
`
`
`US INPUT
`
`YES
`
`FIG. 4
`
`6
`
`

`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 5 of 24
`
`US 8,706,504 B2
`
`>2/$2.0mom?
`
`32mtpm
`
`m65
`
`NCA
`
`>Z<&2©u
`
`K
`
`SEE>><q
`
`7
`
`

`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 6 of 24
`
`US 8,706,504 B2
`
`,7rDDDDD
`
` lDUmD
`
`8AVE
`
`
`
`
`
`moo..MJNEE,$maE,zMmzo:5.,MZ<ZEmoSE2fix,.
`
`8
`
`
`
`

`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 7 of 24
`
`US 8,706,504 B2
`
`06$3
`
`9
`
`

`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 8 of 24
`
`US 8,706,504 B2
`
`m:
`
`
`
`%E<m§aéfiouQUE:Z<m
`
`Smza35Nmzd
`
`2W22295..
`
`anam2.omQ.m
`
`EO].E04E04
`
`3&2<mDEzmfimm
`
`09zxfima
`
`«E2E23
`
`mmfifiaQ24:7:
`
`E
`
`10
`
`10
`
`
`
`
`

`
`U.S. Patent
`
`PA
`
`m2:2r._
`
`42f09whS
`
`US 8,706,504 B2
`
`
`
`:.§<.mmmimaMm<S§6oQ<Ou:,S/OQ
`
`D<©4Z.;>©Q
`
`wk/mZ
`
`.\.CE
`
`11
`
`
`

`
`12
`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 10 of 24
`
`US 8,706,504 B2
`
`3.7
`C\1
`O’:
`
`/
`
`Q(
`
`G
`0-0
`
`DOORSENSOR
`
`
`
`
`
`
`
`[\V-4
`(>0
`
`
`
`»PROCESSOR
`
`814
`
`I)
`
`FIG.8
`
`
`
`
`12
`
`

`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 11 of 24
`
`US 8,706,504 B2
`
`./00U0
`
`804
`
`FIG. 9
`
`13
`
`13
`
`

`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 12 of 24
`
`US 8,706,504 B2
`
`SAR M
`
`
`
`OBTAIN SIGNAL
`FROM EACH SENSOR
`
`
`
`COUNT# OT
`
`New OUTPUTS
`OMAXU »
`
`
`
`
`
`A
`I
`I%?X‘é’§‘§%%I*i§?£s
`‘
`
`
`ANY
`
`N
`
`Y
`
`MA
`
`SUM ALL NON—ZERO
`
`OUTPUT M
`
`I
`
`INTEGRATE OVER I S
`
`
`
`
`
`PAIR MEMBER
`<THRESHOLD .
`?
`M
`M
`*
`
`SCALE TO OBTA1N OE S
`
`OE
`
`OBTAIN # OF FLOORS
`SELECTED IN CAR M
`OMNP
`
`M
`
`COMPUTE
`CORECTION
`
`
`
`
`APPLY
`CORRECTION
`T0 OMAXU
`
`
`
`OMINS
`
`
`COMPARE OE, OMINP,
`QMINS= & OMAXC
`
`D COOSF. AE
`_ A‘
`
`
`
`
`OENERATE
`BYPASS CONTROL
`
`
`
`
`STGA,
`
`
`FIG. 10
`
`
`
`
`
` NEXT
`FLOOR
`REACHED I
`9
`. ’
`
`TIME S
`
`DLAY
`
`14
`
`14
`
`

`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 13 of 24
`
`US 8,706,504 B2
`
`Omar»
`
`ME/mum
`
`mobamfim
`
`~_<u
`
`9;_SMZ282
`3,Z.»,:%umm
`
`15
`
`15
`
`
`
`
`
`

`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 14 of 24
`
`US 8,706,504 B2
`
`2d3
`
`2%
`
`16
`
`16
`
`
`

`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 15 of 24
`
`US 8,706,504 B2
`
`17
`
`MG.143.
`
`0 b 0
`
`(V)
`
`(\l
`
`in?!
`
`
`
`FLOORNUMBER
`
`17
`
`

`
`U.S. Patent
`
`WA
`
`eehS
`
`M
`
`US 8,706,504 B2
`
`52$:7:_,>m:.cmeabo..s.§:
`
`
`
`
`./5mzom$53v_o§/Ha
`
`
`gm:sq:
`
`
`
`
`
`39%:M:3%,”:853%ambmzmmzo
`
`6E23:H35>
`.mm<m§<
`
`ZQEEE:M92,mzoEE5.,__nE5%
`aflumdmzoSEEAMmzow383%&SmdmE\Jgm:0D‘V-WP/SmREEM;,52E:H5.2928
`
`39,5
`
`33GE
`
`18
`
`18
`
`
`

`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 17 of 24
`
`US 8,706,504 B2
`
`82
`
`SJNmm<m<r~<QV/2mmm8<
`
`:5
`
`fibmm
`
`19
`
`19
`
`
`
`

`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 18 of 24
`
`US 8,706,504 B2
`
`USER ENTER
`EEATOR CA
`
`
`READER
`
`
`I ATV/* .
`Ir
`
`
`
`READER
`
`PASSWORD
`
`ACCESS
`
`
`
`FILE
`
`
`O DAAS
`
`READER INTERROGATE
`
`
`
` REID TAG
`
`
`
`
`
`H READER EIIION
`
`RFID TAG DECRYPT
`
`
`
`
`
`GENERAT E
`CONTROL
`
`
`
`, LREMO ING
`“
`READER
`S[°§f‘OCK FREE;
`AUTIIENTICATED
`
`
`
`I
`AUTORIZEDFLORS
`1’
`V
`
`TAG XMIT
`"NOT
`
`RECOGNIZED" . IN .
`
`DEACTIVATE
`READER
`
`LOG DATA
`I ATABASE
`
`
`
`DISPLAY
`"NOT
`" AUTHORIZED"
`b ARNTNO
`
`
`
`
`
`
`20
`
`
`
`
`
`ENABLE UTILITY
`
`UNCTION ms
`
`L
`
`Y
`
`A
`
`I“3SIf§}IjI\5FI“
`
`USER SELECT
`DESIRED FUNCTIONS
`
`READER DECRYPT
`EID EISSION I
`
`
`
`DISPLAY
`"INCORRECT
`
`
`PASSWORD"
`
`
`WARNING
`
`READER ACCESS
`DATABASE _
`
`ACCESS
`
`Z
`
`AUTHORIZED ~
`A
`h
`I
`
`READER ENABLE
`PUT DEVICE
`
`USER ENTER PASWORD
`
`FIG. 16
`
`20
`
`

`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 19 of 24
`
`US 8,706,504 B2
`
`:avg
`
`u<>m
`
`.u<>m
`
`55%
`
`,550,6
`
`uzmmos
`
`_Humgmm
`
`02:5:
`
`we:
`
`852
`
`M
`
`/8:
`
`21
`
`

`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 20 of 24
`
`US 8,706,504 B2
`
`
`
`PARSE IMAGE A
`DATA ADDRESS
`FROM ALL
`
`RETRIEVE ALL
`IIAGE AT T
`
`
`ALLOCATE ONE
`FILE TO EACH DISPL.
`IMAGE DATA
`
`SET
`
`,MBIGUIT‘I FLA
`
`
`
`. <..____......_._.___
`
`SAMPLE SPEECH
`OF OCCUPANTS
`
`
` CONVERT
`SAMPLED
`
`
`SPEECH TO
`DIGITAL FORMAT
`
`
`
`
`COMPARE
`SAMPLED
`SPEECH TO
`LIBRARY
`
`
`
`
`MATCII
`ANY LIBRARY A
`
`WORD .
`I
`
`‘7
`
`IDENTIFY
`\> SEMI) VV
`
`
`
`SUB FILE
`MATCH
`PREVIOUS
`SUB-FH..E(S)
`:7
`
`,
`
`I
`
`V
`N
`
`
`
`
`
`
`IMAGE
`ORAUDIO
`DATA
`CURRENTLY I
`IN USE
`-I
`
`
`
`
`
`PARSE I\IAGE/
`AUDIO IILL‘
`AI)DRESS(_ES)
`
`I
`
`I
`
`\,
`‘
`
`V
`,
`m——
`RETRILVL
`IMAGE/AUDIO
`FILES
`
`
`
`
`
`
`
`
`
`,
`DISPLAY/PLAY
`RETRIEVFD
`
`DATA ON
`
`ALL DISPLAYS
`
`FOR PREDETER.MII\’ED
`PERIOD
`
`---=- FIG. I821
`
`Y
`
`22
`
`22
`
`

`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 21 of 24
`
`US 8,706,504 B2
`
`qwwmVfiwfl
`
`mmfiafiEa
`
`
`
`mo<E<55Efimsm
`
`mmsfimsmE
`
`EE
`
`32CE
`
`ovmfi
`
`23
`
`23
`
`
`
`

`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 22 of 24
`
`US 8,706,504 B2
`
`
`
`NEW CALL
`
`
`
`
`
`SIGNAL REC’
`9
`. *
`
`
`
`OTHER
`CALL SIGNALS
`
`PRESENT V
`T’
`*
`
`SELECTED
`BY OCCUPANTS
`or CAR
`‘P
`
`
`
`
`Y
`
`SELE TFD
`BYc‘AR%c“gUp
`’
`’)
`‘
`
`I
`
`’
`
`
`
`Dl;"l‘J;‘RMINE
`DIRECTION
`
`OTHER
`CALLSIGNAL
`PRESENT
`? v
`
`
`
`.
`
`
`DETERMINE DIRECTION
`OF TVEL
`
`
`"Ag*§}3,§D
`
`
`
`
`—
`
`~
`
`.
`
`STEESSNIEERESTILSR
`
`
`
`
`
`
`
`
`
`ORDER
`
`SELECT
`NEXT FOOR
`
`CALLSIGA
`
`
`SELECT NEXT
`FLOR I
`
`DAI:
`
`
`
`
`
`
`TIME 3
`EREsI;'I' VALUE —
`‘.7
`
`
`_
`
`
`W X;
`
`
`
`ACCESS BLDG. DIRECTORY
`FOR NEXT FLOOR
`
`
`RIIN TI3NAN’I‘
`
`SELECTION
`RIIINE
`
` MULTIPLE
`TENANT S ON
`N
`FLOOR
`0
`
`REACHED
`")
`.
`1
`
`
`
`
`
`’
`
`
`
`
`FIG. 180
`
`FLOOR
`
`
`
`
`
`RETRSIEVE
`IMAGE/AUDIO
`ATA FOR I
`
`
`
`
`
`
`
`ESTIMATE TIME TO NEXT
`FLOOR C OUNERE
`
`
`
`SELECT NEXT FLOOR
`TO BE ENCOUNRF.
`
`
`
`
`
`
`DISPLAY/PLAY
`
`
`RETRIEVED
`
`
`24
`
`

`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 23 of 24
`
`US 8,706,504 B2
`
`
`
`
`
`RETRIEVE
`STATISTIC
`FILES FOR
`ALL K SUB-FILES
`«Gm-——-—-—-—-—-
`
`
`
`
`
`RETRIEVE
`HISTORICAL
`DISPLAY FILES FOR
`ALL K SUB-FILES
`
`
`
`
`
`
`
`COMPARE
`IIISTORICAL
`DISPLAY FILE
`DISTRIBUTION TO
`STATISTICAL FILES
`DISTRIB.
`
`
`
` SELECT
`SUB-FILE WITH
`—
`
`LRGEST D
`
`
`
`
`
`I RETRIEVE DATA
`FI1.I'~‘,I’OR SUB—FILE
`WITH LARGEST D
`
`
`
`
`
`CONVERT
`TO DIIAL
`
`COMPARE
`T LIBRARY
`
`
`
`
`
`RETRIEVE ‘
`SUB~FILIE
`V S'ATIS'IC FIL T
`
`
`
`
`_
`
`INCREMENT
`STATISTIC
`FIL BY E >
`
`DISPLAY DATA
`TILE
`
`>
`
`A
`
`UPDATE HISTORICAL
`DISPLAY FILE F OR,
`Fl I. E DISPLAYED
`
`
`
`
`
`
`
`WAIT PREDET,
`PERID
`
`A
`
`
`
` [NCREMENT
`?
`
`COMPARISON
`
`SINCE LAST
`
`25
`
`STORE
`STATISTIC
`FILE
`
`I
`
`A
`
`WAIT PRESET I
`H PEIOD V
`
`
`
`FIG. 18d
`
`25
`
`

`
`U.S. Patent
`
`Apr. 22, 2014
`
`Sheet 24 of 24
`
`US 8,706,504 B2
`
`
`
`USER SELECT DEDICATED
`FUNCTION KEY OR TOUCH
`CREN FCTION KEY
`
`
`
`
`
`
`PROCESSOR GENERATE
`ID CODE FOR
`_ SELECIED EDNCIION
`
`
`
`
`PROCESSOR RETRIEVE
`
`STORED "TAG" FILE FOR
`ADVRTISIG SUB—I7ILES
`
`
`
`
`
`COMPARE GENERATED
`ID CODE TO TAG
`ASSOCIATED WITH ONE
`
`(OR MORE) SUB-FILES
`
`
`
`
`
`PROCESSOR SF.QUE.N(_‘.E
`V TAGS
`
` PROCESSOR RETRIEVE
`
`DATA FILE FOR IITH
`SUB-FILE IN SEQUENCE
`
`
`
`
`
`
`
`DISPLAY nTH
`> SB~FLE .A FILE
`
`
`
`
`WAIT RRE.DI=.TER MIN ED
`é PERIOD V
`
`
`
`
`
`LAST
`TAG FILE
`
`DISPLAYED
`Q
`.
`
`
`
`26
`
`FIG. 19
`
`
`
`INCREMENT H:
`n=n+1
`H
`
`26
`
`

`
`US 8,706,504 B2
`
`1
`COMPUTERIZED INFORMATION AND
`DISPLAY APPARATUS
`
`This application is a continuation of and claims priority to
`co-owned and co-pending U.S. patent application Ser. No.
`13/369,850 filed Feb. 9, 2012 and entitled “COMPUTER-
`IZED INFORMATION PRESENTATION APPARATUS”,
`which is a continuation of and claims priority to co-owned
`and U.S. patent application Ser. No. 12/711,692 filed Feb. 24,
`2010 and entitled “ADAPTIVE INFORMATION PRESEN-
`TATION APPARATUS AND METHODS”, now U.S. Pat.
`No. 8,1 17,037, which is a continuation of and claims priority
`to co-owned and U.S. patent application Ser. No. 11/506,975
`filed Aug. 17, 2006 and entitled “SMART ELEVATOR SYS-
`TEM AND METHOD”, now U.S. Pat. No. 7,711,565, which
`is a divisional of and claims priority to co-owned U.S. patent
`application Ser. No. 10/935,957 filed Sep. 7, 2004 and
`entitled “ELEVATOR ACCESS CONTROL SYSTEM AND
`METHOD”, now U.S. Pat. No. 7,093,693, which is a divi-
`sional of co-owned U.S. patent application Ser. No. 10/651,
`451 filed Aug. 29, 2003 and entitled “SMART ELEVATOR
`SYSTEM AND METHOD”, now U.S. Pat. No. 6,988,071,
`which is a continuation of co-owned U.S. patent application
`Ser. No. 09/330,101 filed Jun. 10, 1999 and entitled“SMART
`ELEVATOR SYSTEM AND METHOD”, now U.S. Pat. No.
`6,615,175, each ofthe foregoing incorporated into the present
`application by reference in its entirety. This application is also
`related to U.S. patent application Ser. No. 12/703,666 filed
`Feb. 10, 2010 entitled “Adaptive Advertising Apparatus and
`Methods”, now U.S. Pat. No. 8,065,155, U.S. patent applica-
`tion Ser. No. 12/704,431 filed Feb. 11, 2010 entitled “ADAP-
`TIVE ADVERTISING APPARATUS AND METHODS”,
`now U.S. Pat. No. 8,078,473, Ser. No. 12/711,692 filed on
`Feb. 24, 2010 entitled “ADAPTIVE INFORMATION PRE-
`SENTATION APPARATUS AND METHODS”, now U.S.
`Pat. No. 8,117,037, Ser. No. 12/711,857 filed Feb. 24,2010
`and entitled “ADAPTIVE INFORMATION PRESENTA-
`TION APPARATUS AND METHODS”, now U.S. Pat. No.
`8,065,156, Ser. No. 13/364,194 filed Feb. 1, 2012 and entitled
`“COMPUTERIZED INFORMATION PRESENTATION
`APPARATUS”, now U.S. Pat. No. 8,285,553, Ser. No.
`13/362,902 filed Jan. 31, 2012 and entitled “ADAPTIVE
`INFORMATION PRESENTATION APPARATUS”, now
`U.S. Pat. No. 8,370,158, and Ser. No. 13/357,487 filed Jan.
`24, 2012 and entitled “ELECTRONIC INFORMATION
`ACCESS SYSTEM AND METHODS”, now U.S. Pat. No.
`8,301,456, Ser. No. 13/369,850 filed Feb. 9,2012 and entitled
`“COMPUTERIZED INFORMATION PRESENTATION
`APPARATUS”, now U.S. Pat. No. 8,447,612, Ser. No.
`13/404,606 entitled “COMPUTERIZED INFORMATION
`PRESENTATION APPARATUS”, now U.S. Pat. No. 8,290,
`781, Ser. No. 13/404,980 entitled “COMPUTERIZED
`INFORMATION PRESENTATION APPARATUS”, now
`U.S. Pat. No. 8,296,146, Ser. No. 13/404,853 entitled“COM-
`PUTERIZED INFORMATION PRESENTATION APPA-
`RATUS”, now U.S. Pat. No. 8,290,778, and Ser. No. 13/405,
`046
`entitled
`“COMPUTERIZED
`INFORMATION
`PRESENTATION METHODS” now U.S. Pat. No. 8,296,
`153, each filed on Feb. 24, 2012, Ser. No. 13/406,408 entitled
`“COMPUTERIZED INFORMATION SELECTION AND
`DOWNLOAD APPARATUS AND METHODS” filed on
`Feb. 27, 2012, now U.S. Pat. No. 8,311,834, and Ser. No.
`13/410,080 entitled “NETWORK APPARATUS AND
`METHODS FOR USER INFORMATION DELIVERY”
`filed Mar. 1, 2012, now U.S. Pat. No. 8,285,551, each of
`which is incorporated herein by reference in its entirety. This
`application is also related to co-owned and co-pending U.S.
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`
`patent application Ser. Nos. 13/728,512 filed Dec. 27, 2012
`and entitled “SMART INFORMATION AND DISPLAY
`
`APPARATUS”, Ser. No. 13/728,715 filed Dec. 27, 2012 and
`entitled “COMPUTERIZED INFORMATION AND DIS-
`PLAYAPPARATUS”, Ser. No. 13/733,098 filed Jan. 2, 2013
`and entitled “COMPUTERIZED INFORMATION AND
`
`DISPLAY APPARATUS”, Ser. No. 13/737,853 filed Jan. 9,
`2013 and entitled “TRANSPORT APPARATUS WITH
`COMPUTERIZED INFORMATION AND DISPLAY
`
`APPARATUS”, Ser. No. 13/746,266 filed Jan. 21, 2013 and
`entitled “COMPUTERIZED INFORMATION AND DIS-
`
`PLAY APPARATUS”, Ser. No. 13/750,583 filed Jan. 25,
`2013 and entitled “COMPUTERIZED INFORMATION
`AND DISPLAY APPARATUS”, Ser. No. 13/752,222 filed
`Jan. 28, 2013 and entitled “COMPUTERIZED INFORMA-
`TION AND DISPLAY APPARATUS”, Ser. No. 13/753,407
`filed Jan. 29, 2013 and entitled “COMPUTERIZED INFOR-
`MATION AND DISPLAY APPARATUS”, Ser. No. 13/755,
`682 filed Jan. 31, 2013 and entitled “INTELLIGENT
`ADVERTISING METHODS”, and Ser. No. 13/758,898 filed
`Feb. 4, 2013 and entitled “INTELLIGENT ADVERTISING
`APPARATUS”, each incorporated herein by reference in its
`entirety.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`
`The present invention relates to the field ofpersonnel trans-
`port apparatus, and specifically to elevators and similar
`devices for transporting people from one location to another
`which incorporate various information technologies.
`2. Description of Related Technology
`Elevators and similar personnel transport devices (such as
`moving walkways or shuttles) are important aspects of mod-
`em urban life. Commonly used in office buildings, airports,
`shopping malls, and other large structures, these devices
`transport large numbers of people and equipment between
`two locations on a routine basis. Elevators in particular are
`widely used throughout the world.
`Depending on loading, a person may spend up to several
`minutes on an elevator during travel between floors. Signifi-
`cant amounts of time may also be spent waiting for the eleva-
`tor to arrive when called. This time is usually “dead” from the
`standpoint that very little can be accomplished or very few
`tasks undertaken during these few minutes. However, often
`times an individual may require information which will be of
`use after leaving the elevator. For example, the person may
`wish to obtain travel information such as directions to the
`
`nearest airport or public transportation node, or the location
`of a nearby restaurant. Weather-related information or trafiic
`reports may also be useful. A plethora of different types of
`information, including financial data, breaking news head-
`lines, sports scores and the like may also be of interest to one
`waiting for or riding on an elevator or other transport device.
`An associated problem relates to determining the location
`of a person, firm, or store within a building when unfamiliar.
`Building directories are often posted in the lobby ofthe build-
`ing, yet these require the user to manually or visually locate
`the name of the person, firm, or store which they are looking
`for, and remember the location information associated there-
`with. Additionally, such directories often do not provide pre-
`cise location information, but rather merely a floor number
`and/or suite number. The user often times does not have a
`
`graphical representation of the desired location in relation to
`the elevators, thereby resulting in additional wasted time in
`finding the location once off of the elevator. Even if a graphi-
`
`27
`
`27
`
`

`
`US 8,706,504 B2
`
`3
`cal display is provided, it often requires the user to spatially
`orient themselves to determine relative location.
`
`Security is also a concern when riding elevators late at
`night or to remote locations. Many elevator systems are used
`partly or entirely within parking garages, which often may be
`sparsely populated at off hours. People are all too frequently
`assaulted or robbed when departing from elevators under
`such conditions. Unfortunately, existing elevator systems do
`not have the facility to provide the occupant(s) with the ability
`to selectively observe the area immediately surrounding the
`elevator doors on one or more destination floors, or otherwise
`take precautions to enhance their security.
`Another problem associated with existing elevator systems
`relates to their loading capacity. Often, especially at peak use
`hours such as during the noon hour, the call buttons for several
`different floors within a building will be activated, and eleva-
`tor cars which are at or near their loading capacity will
`respond. With no additional room available in the elevator, the
`person depressing the call button on a given floor is left to wait
`for the elevator doors to close, depress the call button again,
`and wait for another (hopefully partially vacant) car to arrive.
`This process not only delays the person waiting for the car, but
`also those on the elevator car(s), and those waiting on other
`floors.
`
`In addition to the foregoing, many elevators must have a
`means of restricting access to certain floors during certain
`time periods while not interfering with other operations.
`These elevators generally also include means by which cer-
`tain users may gain access to the restricted floors, such as a
`magnetic striped card which is inserted into a card reader on
`the elevator. However, such card readers are prone to wear and
`having to re-swipe the card several times in order to obtain
`access. Furthermore, as the card wears due to repeated swip-
`ing or bending (such as when left in the pocket of the indi-
`vidual carrying the card), the card will be more prone to
`failure and will eventually require replacement. Also, such
`cards are prone to unauthorized use. Someone stealing or
`finding the lost card can simply insert it into the card reader of
`the elevator and gain access to the restricted floor(s). It is also
`noted that since access is restricted to certain floors typically
`during late-night or weekend hours, HVAC and lighting sys-
`tems are typically turned off or dormant in order to conserve
`energy. Hence, when the user arrives at one ofthese restricted
`access floors, several minutes are typically spent turning on
`the HVAC, lights, and any other number of electrical devices.
`Some systems require the user to insert their magnetic strip
`card in a separate reader, such as in the control room for the
`HVAC (which is typically located on a different floor), in
`order to initiate equipment operation. This is obviously time
`consuming and cumbersome.
`Lastly, there is often an element of discomfort associated
`with riding an elevator car, especially when several individu-
`als are present in the car. Due in part to minimal space within
`the car and nothing to occupy the occupants attention visu-
`ally, there is a natural tendency for one to stare up, down, or
`forward at the door of the elevator, or at the visual floor
`indicators so as to avoid prolonged eye contact with the other
`occupants.
`Heretofore, many of the technologies necessary to address
`the aforementioned issues have not been available or, alter-
`natively, have been cost or space prohibitive to implement.
`However, recent advances in data networking, thin or flat
`panel display technology, personal electronics, and speech
`recognition and compression algorithms and processing have
`enhanced the viability of such features from both technologi-
`cal and commercial perspectives.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`
`Based on the foregoing, there is a need for an improved
`elevator system and method of operation which will reduce
`the time spent waiting for and travelling on the elevator car,
`reduce the frustration associated with repeated stops at dif-
`ferent floors, and allow the occupants of the elevator (as well
`as those waiting for the car) to use their time more efficiently
`and obtain needed information. Additionally, such an elevator
`system would enhance the security of the occupants upon
`egress, and allow for automatic recognition ofan individual in
`order to provide access to certain restricted locations and
`initiation of certain functions such as lighting and HVAC.
`
`SUMMARY OF THE INVENTION
`
`In one aspect, a computerized information and display
`apparatus is disclosed. In one embodiment, the apparatus
`includes: a network interface; processing apparatus in data
`communication with the network interface; a display device;
`and a storage apparatus comprising at least one computer
`program. In one variant, the at least one program is configured
`to, when executed: obtain digitized speech generated based
`on speech received from a user, the digitized speech relating
`to a query for desired information which the user wishes to
`find; and cause, based at least in part on the digitized speech,
`access of a remote network entity to cause retrieval of the
`desired information. In another variant, the apparatus is fur-
`ther configured to display advertising content on the display
`device, the content received via the network interface and
`selected based at least in part on the digitized speech.
`In another embodiment, the computerized information and
`display apparatus includes: a wireless network interface; pro-
`cessing apparatus in data communication with the network
`interface; a microphone; a display device; and a storage appa-
`ratus comprising at least one computer program, the at least
`one program being configured to, when executed: obtain digi-
`tized speech generated based on speech received from a user
`via the microphone, the digitized speech relating to a desired
`information which the user wishes to find via a network
`
`search, the desired information relating to at least one of a
`plurality ofpredetermined topics of interest; and cause, based
`at least in part on the digitized speech, search of a remote
`network entity to cause retrieval of the desired information.
`In another embodiment, the information and display appa-
`ratus is for use in a land-mobile apparatus, and includes: a
`wireless network interface; processing apparatus in data com-
`munication with the network interface; a display device con-
`figured to be viewable by an occupant of the land-mobile
`apparatus during use; and a storage apparatus comprising at
`least one computer program, the at least one program being
`configured to, when executed: obtain digitized speech gener-
`ated based on speech received from the occupant, the digi-
`tized speech relating to a desired information which the occu-
`pant wishes to obtain; cause, based at least in part on the
`digitized speech, access of a remote network entity to cause
`retrieval of the desired information; and receive the desired
`information via the network interface. In one variant, the
`apparatus is further configured to display advertising content
`and at least a portion ofthe desired information on the display
`device, the content received via the network interface and
`selected based at least in part on the digitized speech.
`In another embodiment, the at least one computer program
`is configured to, when executed: obtain digitized speech gen-
`erated based on speech received from the occupant, the digi-
`tized speech relating to a desired information which the occu-
`pant wishes to obtain; cause, based at least in part on the
`digitized speech, access of a remote network entity to cause
`retrieval of the desired information; and receive the desired
`
`28
`
`28
`
`

`
`US 8,706,504 B2
`
`5
`information via the network interface; the apparatus is further
`configured to display at least a portion of the desired infor-
`mation on the display device, the at least portion received via
`the network interface and selected based at least in part on the
`digitized speech.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a block diagram of one embodiment of the infor-
`mation and control system of the invention, showing those
`components local to each elevator car.
`FIG. 2 is a plan view of a first embodiment of the interface
`panel ofthe information and control system of FIG. 1, includ-
`ing the touch keypad and the display device.
`FIG. 3 is a block diagram of one embodiment of the infor-
`mation and control system network architecture.
`FIG. 4 is a logic diagram illustrating the operation of one
`embodiment of the building directory sub-system of the
`invention.
`
`FIG. 5 is a plan view of one embodiment of a building
`directory sub-system graphic location file, as shown on the
`display device of the information and control system.
`FIG. 6a is a plan view of one embodiment of a network
`input device having dedicated function keys thereon.
`FIGS. 6b and 6c illustrate one embodiment of an exem-
`
`plary coordinated graphic weather display according to the
`present invention.
`FIG. 7 is a plan view of one embodiment of the PED data
`download terminal of the invention.
`
`FIG. 8 is a block diagram of one embodiment of the capac-
`ity sensing sub-system according to the present invention.
`FIG. 9 is a plan view of one embodiment of the elevator
`floor sensor array used in conjunction with the capacity sens-
`ing sub-system of FIG. 8.
`FIG. 10 is a logic diagram illustrating the method of opera-
`tion of the capacity sensing sub-system of FIG. 8.
`FIG. 11 is a block diagram illustrating one embodiment of
`the monitoring and security sub-system of the present inven-
`tion.
`FIG. 12 illustrates one embodiment of the elevator car
`
`touch panel used in conjunction with the monitoring and
`security sub-system of FIG. 11.
`FIG. 13 is a block diagram of a second embodiment of the
`monitoring and security sub-system of the present invention.
`FIGS. 14a and 14b are plan views of one embodiment of
`the parking and video monitoring displays, respectively, of
`the monitoring and security sub-system of FIG. 11.
`FIG. 15 is a block diagram illustrating one embodiment of
`the identification and access sub-system ofthe present inven-
`tion.
`
`FIG. 16 is a logic diagram illustrating the operation of the
`identification and access sub-system of FIG. 15.
`FIG. 17 is a plan view of one embodiment of a utility
`services selection display associated with the identification
`and access sub-system of FIG. 15.
`FIG. 18a is a logic diagram illustrating the operation of a
`first embodiment of the prompt mode of the adaptive adver-
`tising sub-system of the invention.
`FIG. 18b illustrates the library data file structure used in
`conjunction with the advertising sub-system of the invention.
`FIG. 18c is a logic diagram illustrating the operation of a
`second embodiment of the advertising sub-system of the
`invention.
`
`FIG. 18d is a logic diagram illustrating the operation of a
`third embodiment of the adaptive advertising sub-system of
`the invention.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`FIG. 19 is a logic diagram illustrating the operation of a
`fourth embodiment of the adaptive advertising sub-system of
`the invention.
`
`DESCRIPTION OF THE INVENTION
`
`Reference is now made to the drawings listed above,
`wherein like numerals refer to like parts throughout.
`It is noted that while the system and methods of the inven-
`tion disclosed herein are described primarily with respect to
`an elevator car, certain aspects of the invention may be useful
`in other applications,
`including, without limitation, other
`types of personnel transport devices such as trams or shuttles
`or moving walkways, or stationary devices such as kiosks
`within the lobby or elevator waiting areas of a building. As
`used herein, the term “building” is meant to encompass any
`structure, whether above ground or underground, permanent
`or temporary, used for any function.
`General Description
`Referring now to FIGS. 1 and 2, one embodiment of an
`improved elevator information system is generally described.
`As shown in FIG. 1, the system 100 includes an input device
`102, speech recognition (SR) module 104, central processor
`106 with associated motherboard 121, video RAM 107, non-
`volatile storage device 108 containing a database (not
`shown), graphics co-processor 109, volatile or dynamic stor-
`age device 110 with associated DMA module 139, audio
`amplifier and speaker module 111, speech synthesis module
`112, micro-controller 123, PCI slots 147, and display device
`113. The system also includes a serial bus with universal
`asynchronous receiver transmitter (UART) 117 or altema-
`tively universal serial bus (USB), as described in greater
`detail below with respect to FIG. 7. As shown in FIG. 2, the
`input device 102 of the present embodiment is a touch-sen-
`sitive keypad and/or display screen of the type well known in
`the electrical arts. The input device 102 includes a variety of
`different functional keys 114 on a keypad 116 (and/or on a
`touch-sensitive display screen 113, as described below)
`which allow the user to initiate a query of the database either
`manually via the keypad 116, display device 113, or audibly
`through the speech recognition module 104.
`As shown in FIG. 1, the speech recognition module 104 of
`the present invention includes a high quality, high SNR audio
`microphone 118, analog-to-digital converter (ADC) 141, and
`linear predictive coding (LPC)-based spectral analysis algo-
`rithm run on a digital signal processor 125 having associated
`SR module RAM 127. It will be recognized that other forms
`of spectral analysis, such as MFCC (Mel Frequency Cepstral
`Coefficients) or cochlea modeling, may be used. Phoneme/
`word recognition in the present embodiment is based on
`HMM (hidden Markov modeling), although other processes
`such as, without limitation, DTW (Dynamic Time Warping)
`or NNs (Neural Networks) may be used. Myriad speech rec-
`ognition systems and algorithms are available, all considered
`within the scope of the invention disclosed herein.
`In the present embodiment, CELP-based voice data com-
`pression is also utilized for transmission and storage of voice
`data. CELP algorithms in general are useful for converting
`analog speech to a compressed digital format which is more
`rapidly and easily manipulated and stored within a digital
`system using less bandwidth and memory. CELP algorithms
`and low bit rate vocoder technology are well known in the
`si