`Volkswagen Group of America, Inc., Petitioner
`
`1
`
`
`
`US 8,296,146 B2
`Page 2
`
`U.S. PATENT DOCUMENTS
`5,287,266 A
`2/1994 Maleceral.
`572957054 A
`3/1994 M*‘1e° 6131‘
`574637209 A
`10/1995 F181‘ 6‘ 31‘
`5,485,897 A
`1/1996 Matsumoto et al.
`575517532 A
`9/1995 Kupersmifl‘
`576067154 A
`2/1997 D018“ 6””
`576897094 A
`11/ 1997 F0ed“‘°*”‘1~
`5,749,443 A
`5/1998 Roma‘)
`578447181 A
`12/1998 Am° 6””
`578877139 A
`3/1999 M30150“ 6””
`5,918,222 A
`6/1999 Fukuietal.
`5,932,853 A
`8/1999 Friedhetalp
`5,955,710 A
`9/1999 DiFranza
`5,979,757 A
`11/1999 Tracy etal.
`5,984,051 A
`11/1999 Morgan etal.
`6,011,839 A
`1/2000 Friedlietal.
`6,073,727 A
`6/2000 DiFranza etal.
`6,078,928 A
`6/2000 Schnase etal.
`6,082,500 A
`7/2000 Amo etal.
`6,202,008 B1
`3/2001 Beckert etal.
`6,202,799 B1
`3/2001 Drop
`6,206,142 B1
`3/2001 Meacham
`6,223,160 B1
`4/2001 Kostkaetal.
`6,236,968 B1
`5/2001 Kanevsky et al.
`5,332,127 B1
`12/2001 Bfindefa 91 31
`6,349,797 B1
`2/2002 Newville etal.
`B1
`6,421,305 B1
`6,460,036 B1
`6,466,232 B1
`6,504,571 B1
`6,571,279 B1
`6,587,835 B1
`6,606,644 B1
`
`7/2002 Giosciaetal.
`10/2002 Herz
`10/2002 Newell et 31,
`1/2003 Narayanaswamiet al.
`5/2003 Herz et al.
`7/2003 Treyz et al.
`8/2003 Ford et al.
`
`9/2003 Gazdzinski
`6,615,175 B1
`113883, 1£*;°:.t1§§e,ar
`25383:‘? 31
`10/2004 Schusteretal,
`6,801,792 B1
`1/2006 Gioscia etal,
`6,990,312 B1
`11/2006 Kohda et al
`,
`7’136’85-3 B1
`12/2007 Bares et al,
`7,305,345 B2
`4/2010 Apreuteseietal
`7,702,798 B2
`,
`6/2004 Druryetal
`2004/0104,842 A1*
`10/2005 Giosciaetéll ,,,,,,,,,,,, ,,
`2005/0239402 A1
`3/2006 Herz etal
`,
`2006/0069749 A1
`3/2009 Hancocketal
`2009/0077100 A1
`'
`-
`1/2010 Merrimanetal.
`2010/0023392 A1
`FOREIGN PATENT DOCUMENTS
`
`JP
`JP
`JP
`JP
`JP
`JP
`
`52039237 A
`01225581 A
`03272977 A
`05017083 A
`05058554 A
`05201524 A
`
`3/1977
`9/1989
`12/1991
`1/1993
`3/1993
`8/1993
`
`OTHER PUBLICATIONS
`
`342/35713
`,
`
`Karen Jacobs (Dec. 7, 1999) “Elevator Maker to Add Commercial
`Touch,” The Wall Street Journal, pp. 1-2.
`-
`..
`
`-
`
`3
`,’PP'
`’
`,
`Stevens Inst1tute ofTechnology,Spr1ng 1999 Final Report, pp. 1-12.
`KenjiYoneda, et al. (Dec. 1997) “Multi-Objective Elevator Supervi-
`sory-Control System Wit11
`Individual Floor-Situation Control,”
`Hitachi Review, p. 1.
`.
`.
`* c1ted by examiner
`
`2
`
`
`
`U.S. Patent
`
`009
`
`2B
`
`%.MHGEEN:
`
`S.Esme:Umomma
`mmmE.E.mEmméoa
`
`momma
`
`mi
`
`mHEmmmoofiH......-1mH
`§_fi_%1\Ito.I..l1\ma.own;Egf..\
`
`me.<>m.EW
`
`226Man:mE.ge:83HT0:mmgofizooE_EK42
`
`4m...................am................-.
`
`m:
`
`IIIIlIIIIlIIIIIIIIIIIII
`
`u-nu-manna---u--ac-—_-n--anew»-w —n
`
`H:
`
`3
`
`
`
`
`
`U.S. Patent
`
`US 8,296,146 B2
`
`4
`
`
`
`U.S. Patent
`
`m
`
`.m
`
`2
`
`U
`
`410/6
`
`2
`
`E
`
`asnozmamoz
`
`éurzoH:2
`
`Mmmémmm.MQRE
`
`cm.ao2mé_mo2Sea
`
`n_..........--..
`
`t.MgHmEH.W
`
`
`
`2:HM
`
`mofimwgzmem
`
`.__M8mmaémzzg
`
`.,Ezmfiz_
`Ez<..~:.z_
`2%,zfi
`
`B.6mCH
`
`fl02ME
`
`5
`
`
`
`
`
`
`
`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 4 of 24
`
`US 8,296,146 B2
`
`
`
`USER SELECT
`
`
`"BUILDING DIRECTOR "-
`
`FUNCTION KEY
`
`
`
`
`
`
`SYSTEM
`PROGRAMMED
` VISUAL
`FOR AUDIO
`OR VISUAL
` RETRIEVE BUILDING
`PROIIEPT
`
`
`
`DIRECTORY FILE
`
`
`RBTRIEVE CELP FILE
`
`
`
`SYNTHESIZE
`
`VOICE PROMPT
`DISPLAY DIRECTORY
`
`("NAME")
`FILE ON DISPLAY
`
`DEVICE
`
` INPUT DEVICE
`
`
`
`
`
`SAMPLE VOICE
`ANDDIGITIZE
`
`
`RETRIEVE BLDG.
`DIRECTORY FILES
`
`
`
`
`LOCA'IE&RETRIEVE
`GRAPHIC FILE
`FOR SELECTED ENTRY
`
`DISPLAY GRAPHIC FILE
`
`
`
`
`
`COMPARE SAMPLED
`VOICE WITH DIRECTORY
`
`FILE
`
`5§LL,%‘§D N0
`-;
`
`
`
`
`CONT-
`EIIEIEO
`,, ~
`0
`
`SAMPLE
`WCH
`FILE
`1?
`
`
`
`GENERATE SEQUENCE
`LIST OF MATCHES
`
`._ SYNTI-IESIZE NEXT PROMPT
`BASED ON MATCHES
`
`USER INPUT
`
`SYNTHESIZE PROMPT
`
`
`
`
`
`SYNTHESIZF. PROMPT
`
` SEARCH
`APP?END
`I YES
`
`FIG. 4
`
`6
`
`
`
`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 5 of 24
`
`US 8,296,146 B2
`
`///,:\\\w.§..mm.a
`\.maIIo.uI.:_zumQ\2_2,,/
`
`u---—----w —
`
`—-_._._—.._—..y._
`
`m O
`
`E
`
`u-n——uno-~up—u—~—
`
`d_nuhQuu—um—
`
`Nam
`
`Nzézou
`
`7
`
`
`
`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 6 of 24
`
`US 8,296,146 B2
`
`6?¢DDDDD
`
`
`
`N8E8242Emamzomue
`
`mmmoom
`
`8
`
`
`
`
`
`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 7 of 24
`
`US 8,296,146 B2
`
`9
`
`
`
`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 8 of 24
`
`US 8,296,146 B2
`
`
`
`
`
`mmmaéa.:E<ouooma2%
`
`m:{.i..
`
`u
`
`.........u.su»....u._...Vn
`
`:mza35.:mag
`
`OHzmamm
`
`.32mbmm
`
`10
`
`10
`
`
`
`
`U.S. Patent
`
`2nm0
`
`Sheet 9 of 24
`
`US 8,296,146 B2
`
`m:
`
`
`
`\\\\\
`
`v:v:
`
`
`
`
`
`
`
`mamzmm<o.Eaomm<o._z:5nEoeépooe..oa.Soa
`
`2:NE.
`
`-I-\‘_,
`
`S.N.6E
`
`11
`
`zomuzaa
`
`
`
`,3an.813mmfifia
`
`11
`
`
`
`
`
`
`
`U.S. Patent
`
`.0.
`
`H
`
`no1minCu
`
`U
`
`2.)
`
`2B
`
`E
`
`Mac:
`8%
`ma
`
`OasAOMFZOO
`
`.>Bmmam‘
`
`mA£.55wow
`
`MasMEm
`
`8T,S.
`mwGE%,5QA
`
`_---_--------u---u-----------__-_-----_--_-------_-_----4
`
`12
`
`12
`
`
`
`
`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 11 of 24
`
`US 8,296,146 B2
`
`Il2IIIllllliltllllllllll
`
`-_-----u----_-_J.-------_----——
`
`~.aa._..w._.fi.
`
`.
`
`----~-----u.J._-.---.----—
`
`Ililllla
`IIIIIJIIIF
`
`804
`
`FIG. 9
`
`13
`
`13
`
`
`
`
`
`
`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 12 of 24
`
`US 8,296,146 B2
`
`
` OBTAIN SIGNAL
` COMPARE # OF
`NON-ZERO OUTPUTS
`
`
`
`ADJACENT PAIRS
`
`FROM EACH SENSOR
`
`COUNT # OF
`
`SELECTED IN CAR CORRECTION
`
`
`OBTAIN # OF FLOORS
`
`T0 OMAXU
`
`
`
`COMPARE OE, OMINP,
`OMINS. & OMAXC
`AND CHOOSE LARGEST
`
`
`
`BYPASS CONTROL
`SIGNAL
`
`FIG. 10
`
`14
`
`14
`
`
`
`U.S. Patent
`
`H023,2
`
`US 8,296,146 B2
`
`.mS2:
`
`.h_
`
`BEE
`
`muszma
`
`¢¢__
`
`cud
`
`3:3:
`
`_
`
`
`E_.
`
`89>in
`
`Mxuhyqmwgm
`
`
`
`
`
`mmAwmmHr¢_—nmE-_gmny—@m&nm:_>.
`
`E
`
`1gM\2:..
`zmmmII.we
`
`mac:
`
`a:
`
`mmH_
`
`yhama
`
`NHGE
`
`DN__
`
`15
`
`15
`
`
`
`
`
`
`
`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 14 of 24
`
`US 8,296,146 B2
`
`
`
` “Hg:V,5gas_gm3::222gma5
`
`
`
` '323EVggEEEE3.2gzam:2an
`
`22
`
`2.05
`
`Q2mmammof
`
` 56
`
`16
`
`16
`
`
`
`
`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 15 of 24
`
`US 8,296,146 B2
`
`
`NUMBER coo
`FLOOR
`
`
`FIG.14a
`
`17
`
`17
`
`
`
`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 16 Of 24
`
`US 8,296,146 B2
`
`EzfimEii
`
`zomzow
`
`SEEmmbfimm
`
`M5950ES
`
`$58M_E<>m:m
`
`amfimdmZ0
`
`38,5
`
`68:
`
`)
`
`mzeE52
`65zocmom
`
`
`
`mzomameumamm
`
`
`
`385,3afluwsmmzo
`
`7:Ewe:
`
`
`
`20M155;$50226.
`
`mzommflomfim65
`
`mmeufimmZ0
`
`3.65%
`
`ENE
`
`L3
`
`A
`
`CE
`
`18
`
`18
`
`
`
`
`
`
`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 17 of 24
`
`US 8,296,146 B2
`
`19
`
`19
`
`
`
`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 13 of 24
`
`US 8,296,146 B2
`
`USER ENTER
`ELEVATOR CAR
`
`READER
`ACTIVATE
`
`
`
`
`
`-
`
`READER
`ACCESS
`
`PASSWORD
`FILE
`OF DATABASE
`
`
`
`
`
`GENERATE
`CONTROL
`SIGNAL REMOVING
`BLOCK FROM
`
`
`AUTHORIZED FLOORS
`
`
`
`
`' READER INTBRROGATE
`RFID TAG
`
`REE") TAG DECRYPT
`READER EMISSION
`
`
`
`TAG XMIT
`"NOT
`RECOGNIZED"
`
`WARNING
`
`
`-TAGS‘?§N“A‘EH”
`
`D§{\E‘ff§‘£§TE
`
`READER DECRYPT
`RFID EMISSION
`
`READBRACCESS
`DATABASE
`
`LOG DATA
`IN DATABASE
`
`
`
`
`
`
`ACCESS
`
`DISPLAY
`AUTH“(',‘§§zE ..
`AUTHORIZED
`
`
`WARNING
`5’
`
`
`
`ENABLE U'I‘ILITY
`
`FUNCTION KEYS
`
`USER SELECT
`DESIRED FUNCTIONS
`
`
`
`DISPLAY
`"INCORRECT
`PASSWORD"
`WARNING
`
`~
`
`
`
`.
`
`Y
`
`INPUT DEVICE
`
`I F
`
`IG. 16
`
`20
`
`
`
`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 19 of 24
`
`US 8,296,146 B2
`
`m:
`
`32
`
`C.05
`
`mzfimmfi
`
`image
`
`...53mm
`
`No.2
`
`.33
`
`#1
`2.M
`
`21
`
`
`
`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 20 of 24
`
`US 8,296,146 B2
`
`
`
`
`
`SAMPLE SPEECH
`.
`OF OCCUPANTS
`
`§2§§‘p’E§‘§
`SPEECH T0
`DIGITAL FORMAT
`
`
`
`
`
`COMPARE
`SAMPLED
`SPEECH T0
`LIBRARY
`
`
`
`£’ARSE IMAGE
`DATA ADDRESS
`FROM ALL
`
`RETRIBVEALL
`IMAGE DATA
`
`V
`
`ALLOCATE ONE
`IMAGE DATA
`FELE TO EACH DISPL.
`
`
`
`SET
`AMBIGUTTY FLAG
`
`
`
`
`-..__.....-....___<-.—-_...._-.._..,.-,_____
`
`. _ _ — . _ _ _ _ . _ _ . _ _ -1
`
`
`
`
`SUB FILE
`MATCH
`PREVIOUS
`
`SUB-F;ILE(S)
`
`
`
`
`
`AUDIO FILE
`ADDRESSES)
`
`Y
`
`
`
`
`
`
`IMAGE
`ORAUDIO
`
`DATA
`CURRENTLY
`RETRIEVE
`1N USE
`IMAGEIAUDID
`?
`
`FILES
`DISPLAYIPLAY
`
`
`RETRTEVED
`
`DATA ON
`ALL DISPLAYS
`
`FOR PREDETERMINED
` FIG. 183.
`PERIOD
`
`22
`
`
`
`22
`
`
`
`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 21 of 24
`
`US 8,296,146 B2
`
`£2U5
`
`3~
`
`A203Emm.E.m:mE
`
`Eéma
`
`23
`
`23
`
`
`
`
`
`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 22 of 24
`
`US 8,296,146 B2
`
` NEW CALL
`
`SIGNAI3. REC'D
`
`WAIT
`
`
`
`CALI. SIGNALS
`
`
`
`SELECTED
`BY OCCUPANTS
`OF CAR
`
`?
`
`
`
`
`SELECTED
`BY CAR?OCCUP.
`
`
`
`
`OTHER
`CALL SIGNAL
`PRE§ENT
`
`DETERMINE DIRECTION
`OF TRAVEL
`
`ORDER CALL SIGNALS
`BASED ON DIRECTION
`
`
`DAT
` PARS
`
`
`
`SELECT NEXT FLOOR
`TO BE ENCGISNTERED
`
` RE-FRIEVE
`IMAGE/AUDIO
` DATA FOR ID
`
`ESTIMATE TIME TO NEXT
`FLOOR ENCOUNTERED
` DISPLAY/PLAY
`
`RETRIEVED
`
`
`
`TIME 3
`PRESEIPVALUE
`
`
`
`ACCESS BLDG. DIRECTORY
`FOR NEXT FLOOR
`
`RUN TENANT
`SELECTION
`ROUTINE
`
`MULTIPLE
`TENANTS ON
`FLQGR
`
`FIG. 18c
`
`Y
`
`
`
`LOOR
`REACHEI)
`'9
`
`
`
`
`
`
`24
`
`
`
`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 23 of 24
`
`US 8,296,146 B2
`
`
`
`SAMPLE
`SPEECH
`
`CONVERT
`T0 DIGITAL
`
`
` RETRIEVE
`STATISTIC
`FILES FOR
`ALL K SU'B—FILES
`
`
`
`
`
`
`
`
`
`
`RETRIEVE
`HISTORICAL
`
`DISPLAY FILES FOR
`
`ALL K SUB-FILES
`
`
`
`COMPARE
`HISTORICAL
`DISPLAY FILE
`
`
`
`
`
`
`SELECT
`SUB-FILE WITH
`
`
`LARGEST D
`
`‘ RETRIEVE DATA
`FILE FOR SUB-FILE
`WITH LARGEST D
`
`DISPLAY DATA
`
`
`
`
`
`RETRIEVE
`SUB-FILE
`STATISTIC FILE
`
`INCREMENT
`STATISTIC
`FILE BY ONE
`
`STATISTIC
`FILE
`
`PARE
`“RY
`
`MATCH
`WORD
`A
`
`
`
`§%§%%%EI*€§iEE%
`msfisus-PALE
`
` 19 DISTRIB.
`
`
`FILE STORE
`”B?s€9£.E.5;”§E,°§%‘3%L
`
`
`FILE DISPLAYED
` WAIT PREDET.
`
`
`
`
`INCREMENT
`SINCE LAST
`COMPA)RISON
`
`
`
`PERIOD
`
`WAAEIIIOD ET
`
`FIG. 18d
`
`25
`
`
`
`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 24 of 24
`
`US 8,296,146 B2
`
`
`
`USER SELECT DEDICATED
`FUNCTION KEY OR TOUCH
`SCREEN FUNCTION KEY
`
`
`
`
`
`
`
` PROCESSOR GENERATE
`
`ID CODE FOR
`SELEC'i‘ED FUNCTION
`
`
`
`
`PROCESSOR RETRIEVE
`
`STORED "TAG" FILE FOR
`
`ADVERTISENG SUB-FILES
`
`
`
`
` COMPARE GENERATED
`ID CODE TO TAG
`ASSOCIATED WITH ONE
`
`(on MORE) SUB-FILES
`
`
`
`" PROCESSOR SEQUENCE
`TAGS
`
`
`
`
`
`
`
`TAG FILE
`DISPI6AYED
`N
`
`INCREMENT 11:
`n=n+l
`
`FIG. 19
`
`
`
`26
`
`PROCESSOR RETRIEVE
`DATA FILE I-‘OR nTH
`SUB-FILE iN SEQUENCE
`
`DISPLAY nTH
`SUB-FILE DATA HLE
`
`WAIT PREDETERMINED
`?ER1OD
`
`
`
`26
`
`
`
`1
`COMPUTERIZED INFORMATION
`PRESENTATION APPARATUS
`
`US 8,296,146 B2
`
`2
`
`PRIORITY AND RELATED APPLICATIONS
`
`This application is a continuation of and claims priority to
`co-owned and co-pending U.S. patent application Ser. No.
`13/357,487 filed Jan. 24, 2012 and entitled “ELECTRONIC
`INFORMATION ACCESS SYSTEM AND METHODS”,
`which is a continuation of and claims priority to co-owned
`and U.S. patent application Ser. No. 12/711,692 filed Feb. 24,
`2010 and entitled “ADAPTIVE INFORMATION PRESEN-
`TATION APPARATUS AND METHODS”, now U.S. Pat.
`No. 8,1 17,037, which is a continuation of and claims priority
`to co-owned and U.S. patent application Ser. No. 11/506,975
`filed Aug. 17, 2006 and entitled “SMART ELEVATOR SYS-
`TEM AND METHOD”, now U.S. Pat. No. 7,711,565, which
`is a divisional of and claims priority to co-owned U.S. patent
`application Ser. No. 10/935,957 filed Sep. 7, 2004 and
`entitled “ELEVATOR ACCESS CONTROL SYSTEM AND
`METHOD”, now U.S. Pat. No. 7,093,693, which is a divi-
`sional of co-owned U.S. patent application Ser. No. 10/651,
`451 filed Aug. 29, 2003 and entitled “SMART ELEVATOR
`SYSTEM AND METHOD”, now U.S. Pat. No. 6,988,071,
`which is a continuation of co-owned U.S. patent application
`Ser. No. 09/330,101 filed Jun. 10, 1999 and entitled“SMART
`ELEVATOR SYSTEM AND METHOD”, now U.S. Pat. No.
`6,615,175, each ofthe foregoing incorporated into the present
`application by reference in its entirety. This application is also
`related to U.S. patent application Ser. Nos. 12/703,666 filed
`Feb. 10, 2010 entitled “ADAPTIVE ADVERTISING APPA-
`RATUS AND METHODS”, now U.S. Pat. No. 8,065,155,
`12/704,431 filed Feb.
`11, 2010 entitled “ADAPTIVE
`ADVERTISING APPARATUS AND METHODS”, now
`U.S. Pat. No. 8,078,473, 12/711,857 filed on Feb. 24, 2010
`entitled “ADAPTIVE INFORMATION PRESENTATION
`APPARATUS AND METHODS”, now U.S. Pat. No. 8,065,
`156, 13/357,487 filed Jan. 24, 2012 and entitled “ELEC-
`TRONIC INFORMATION ACCESS SYSTEM AND
`METHODS”, 13/362,902 filed Jan. 31, 2012 and entitled
`“ADAPTIVE INFORMATION PRESENTATION APPA-
`RATUS”, 13/364,194 filed Feb. 1, 2012 and entitled “COM-
`PUTERIZED INFORMATION PRESENTATION APPA-
`RATUS”, and 13/369,850 filed Feb. 9, 2012 and entitled
`“COMPUTERIZED INFORMATION PRESENTATION
`
`APPARATUS”, each incorporated herein by reference in its
`entirety. This application is also related to U.S. patent appli-
`cation Ser. Nos. 13/404,606 entitled “COMPUTERIZED
`INFORMATION PRESENTATION APPARATUS”, 13/405,
`046 entitled “COMPUTERIZED INFORMATION PRE-
`SENTATION METHODS”, and 13/404,853 entitled “COM-
`PUTERIZED
`INFORMATION
`PRESENTATION
`
`APPARATUS”, each filed contemporaneously herewith on
`Feb. 24, 2012 and incorporated herein by reference in its
`entirety.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`
`The present invention relates to the field ofpersonnel trans-
`port apparatus, and specifically to elevators and similar
`devices for transporting people from one location to another
`which incorporate various information technologies.
`2. Description of Related Technology
`Elevators and similar personnel transport devices (such as
`moving walkways or shuttles) are important aspects of mod-
`em urban life. Commonly used in office buildings, airports,
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`shopping malls, and other large structures, these devices
`transport large numbers of people and equipment between
`two locations on a routine basis. Elevators in particular are
`widely used throughout the world.
`Depending on loading, a person may spend up to several
`minutes on an elevator during travel between floors. Signifi-
`cant amounts of time may also be spent waiting for the eleva-
`tor to arrive when called. This time is usually “dead” from the
`standpoint that very little can be accomplished or very few
`tasks undertaken during these few minutes. However, often
`times an individual may require information which will be of
`use after leaving the elevator. For example, the person may
`wish to obtain travel information such as directions to the
`
`nearest airport or public transportation node, or the location
`of a nearby restaurant. Weather-related information or trafiic
`reports may also be useful. A plethora of different types of
`information, including financial data, breaking news head-
`lines, sports scores and the like may also be of interest to one
`waiting for or riding on an elevator or other transport device.
`An associated problem relates to determining the location
`of a person, firm, or store within a building when unfamiliar.
`Building directories are often posted in the lobby ofthe build-
`ing, yet these require the user to manually or visually locate
`the name of the person, firm, or store which they are looking
`for, and remember the location information associated there-
`with. Additionally, such directories often do not provide pre-
`cise location information, but rather merely a floor number
`and/or suite number. The user often times does not have a
`
`graphical representation of the desired location in relation to
`the elevators, thereby resulting in additional wasted time in
`finding the location once off of the elevator. Even if a graphi-
`cal display is provided, it often requires the user to spatially
`orient themselves to determine relative location.
`
`Security is also a concern when riding elevators late at
`night or to remote locations. Many elevator systems are used
`partly or entirely within parking garages, which often may be
`sparsely populated at off hours. People are all too frequently
`assaulted or robbed when departing from elevators under
`such conditions. Unfortunately, existing elevator systems do
`not have the facility to provide the occupant(s) with the ability
`to selectively observe the area immediately surrounding the
`elevator doors on one or more destination floors, or otherwise
`take precautions to enhance their security.
`Another problem associated with existing elevator systems
`relates to their loading capacity. Often, especially at peak use
`hours such as during the noon hour, the call buttons for several
`different floors within a building will be activated, and eleva-
`tor cars which are at or near their loading capacity will
`respond. With no additional room available in the elevator, the
`person depressing the call button on a given floor is left to wait
`for the elevator doors to close, depress the call button again,
`and wait for another (hopefully partially vacant) car to arrive.
`This process not only delays the person waiting for the car, but
`also those on the elevator car(s), and those waiting on other
`floors.
`
`In addition to the foregoing, many elevators must have a
`means of restricting access to certain floors during certain
`time periods while not interfering with other operations.
`These elevators generally also include means by which cer-
`tain users may gain access to the restricted floors, such as a
`magnetic striped card which is inserted into a card reader on
`the elevator. However, such card readers are prone to wear and
`having to re-swipe the card several times in order to obtain
`access. Furthermore, as the card wears due to repeated swip-
`ing or bending (such as when left in the pocket of the indi-
`vidual carrying the card), the card will be more prone to
`failure and will eventually require replacement. Also, such
`
`27
`
`27
`
`
`
`US 8,296,146 B2
`
`3
`cards are prone to unauthorized use. Someone stealing or
`finding the lost card can simply insert it into the card reader of
`the elevator and gain access to the restricted floor(s). It is also
`noted that since access is restricted to certain floors typically
`during late-night or weekend hours, HVAC and lighting sys-
`tems are typically turned off or dormant in order to conserve
`energy. Hence, when the user arrives at one ofthese restricted
`access floors, several minutes are typically spent turning on
`the HVAC, lights, and any other number of electrical devices.
`Some systems require the user to insert their magnetic strip
`card in a separate reader, such as in the control room for the
`HVAC (which is typically located on a different floor), in
`order to initiate equipment operation. This is obviously time
`consuming and cumbersome.
`Lastly, there is often an element of discomfort associated
`with riding an elevator car, especially when several individu-
`als are present in the car. Due in part to minimal space within
`the car and nothing to occupy the occupants attention visu-
`ally, there is a natural tendency for one to stare up, down, or
`forward at the door of the elevator, or at the visual floor
`indicators so as to avoid prolonged eye contact with the other
`occupants.
`Heretofore, many of the technologies necessary to address
`the aforementioned issues have not been available or, alter-
`natively, have been cost or space prohibitive to implement.
`However, recent advances in data networking, thin or flat
`panel display technology, personal electronics, and speech
`recognition and compression algorithms and processing have
`enhanced the viability of such features from both technologi-
`cal and commercial perspectives.
`Based on the foregoing, there is a need for an improved
`elevator system and method of operation which will reduce
`the time spent waiting for and travelling on the elevator car,
`reduce the frustration associated with repeated stops at dif-
`ferent floors, and allow the occupants of the elevator (as well
`as those waiting for the car) to use their time more efficiently
`and obtain needed information. Additionally, such an elevator
`system would enhance the security of the occupants upon
`egress, and allow for automatic recognition of an individual in
`order to provide access to certain restricted locations and
`initiation of certain functions such as lighting and HVAC.
`
`SUMMARY OF THE INVENTION
`
`In a first aspect of the invention, computer readable appa-
`ratus is disclosed. In one embodiment, the apparatus com-
`prises a storage medium having at least one computer pro-
`gram with a plurality of instructions, the computer readable
`apparatus being part of a computerized information system
`disposed on or within a transport apparatus configured to
`transport at least one person from one location to another. In
`one variant, the computerized information system is config-
`ured to adaptively provide a user with desired information
`relating to a plurality of topical areas, and the at least one
`program is configured to: receive a digitized representation of
`a speech input of the user of the transport apparatus via a
`speech recognition apparatus in communication with the
`computerized information system, the speech input relating
`to a desired function to be performed by the computerized
`information system, the desired function relating to at least
`one of the topical areas;
`cause wireless access ofa remote server to access information
`
`necessary to perform the desired function; receive accessed
`information obtained from the remote server via the wireless
`
`interface; and implement the desired function on the comput-
`erized information system using at least a portion of the
`received information and at least one of: (i) a touch-screen
`
`4
`
`display and input device of the computerized information
`system; and/or (ii) a speech synthesis apparatus of the com-
`puterized information system.
`In a second embodiment, the computer readable apparatus
`comprises a storage apparatus, the storage apparatus having
`computerized logic configured to: receive, via a speech rec-
`ognition apparatus of the computerized information system,
`an input from the user, the input relating to a user’s desire to
`obtain directions to a business or entity from the computer-
`ized information system; cause utilization of a wireless inter-
`face and a network to access information disposed on a
`remote server, the information relating to the directions to the
`business or entity; receive the accessed information received
`via the wireless interface; and provide the user with at least a
`portion of the accessed information relating to the directions
`to the business or entity via at least one of (i) a touch screen
`input and display device of the computerized system; and/or
`(ii) a speech synthesis apparatus. In one variant, the comput-
`erized information system is disposed on or within a transport
`apparatus, the transport apparatus configured to transport at
`least one person from one location to another.
`In yet another embodiment, the computer readable appa-
`ratus comprises a storage medium, the storage medium com-
`prising at least one computer program with a plurality of
`instructions, the computer readable apparatus being part of a
`computerized information system disposed on or within a
`transport apparatus configured to transport at least one person
`from one location to another, the computerized information
`system being configured to adaptively provide a user with
`desired information relating to a plurality of topical areas. In
`one variant, the at least one program is configured to: receive
`a digitized representation of a speech input of the user of the
`transport apparatus via a speech recognition apparatus in
`communication with the computerized information system,
`the speech input relating to a desired function to be performed
`by the computerized information system; cause wireless
`access of a network in order to access information stored on a
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`remote server and necessary to perform the desired function;
`receive accessed information obtained from the remote server
`
`via the wireless interface; and implement the desired function
`on the computerized information system using at least a por-
`tion of the received information and at least one of: (i) a
`touch-screen display and input device of the computerized
`information system; and/or (ii) a speech synthesis apparatus
`of the computerized information system.
`In another variant: the input relating to a desired function
`comprises an input to obtain information relating to a particu-
`lar destination or entity; the computerized information sys-
`tem is further configured to generate a synthesized speech
`output via the speech synthesis apparatus, and iteratively
`receive digitized representations of subsequent user speech
`inputs via the speech recognition apparatus, the subsequent
`inputs being used to traverse a menu structure comprising a
`plurality of possible matching entries;
`the computerized
`information system is fixedly mounted within the transport
`apparatus such that at least a portion ofthe touch-screen input
`and display device is substantially flush with at least one
`surface of the transport apparatus and viewable by the user
`while operating the transport apparatus; and the provision of
`at least a portion of the accessed information relating to the
`directions to the business or entity via at least one of: (i) a
`touch screen input and display device of the computerized
`system; and/or (ii) a speech synthesis apparatus, comprises
`provision ofat least a map graphic showing the location ofthe
`destination or entity and other entities proximate thereto, the
`map graphic further comprising an arrow graphic differenti-
`
`45
`
`50
`
`55
`
`60
`
`65
`
`28
`
`28
`
`
`
`US 8,296,146 B2
`
`5
`ated at least in color from the map graphic so as to guide the
`user from a current location to the destination or entity.
`In yet another embodiment, the storage apparatus of the
`computerized apparatus includes a computerized means con-
`figured to: receive, via a speech recognition means of the
`computerized information system, an input from the user, the
`input relating to a user’s request to obtain directions to a
`business or entity from the computerized information system;
`cause utilization of a wireless interface and a means for net-
`
`working in order to access information disposed on a remote
`server or database, the information relating to the directions
`to the business or entity, the business or entity disposed at
`least partly within a building; receive the accessed informa-
`tion received via the wireless interface; and provide the user
`with at least a portion of the accessed information relating to
`the directions to the business or entity via at least one of (i) a
`touch screen input and display device of the computerized
`information system; and/or (ii) a means for speech synthesis.
`In one variant, the computerized information system is:
`fixedly mounted within a transport apparatus, the transport
`apparatus capable oftransport multiple persons including the
`user from one location to another, the fixed mounting such
`that the user can interface with each of the touch screen input
`and display device, the speech synthesis means, and the
`speech recognition means, while operating the transport
`apparatus; and configured to support an ad hoc communica-
`tion link with a portable electronic device of the user, the ad
`hoc link being used to transfer data between the computerized
`information system and the portable electronic device, the
`data relating at least in part to the user’s request to obtain
`directions.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a block diagram of one embodiment of the infor-
`mation and control system of the invention, showing those
`components local to each elevator car.
`FIG. 2 is a plan view of a first embodiment of the interface
`panel ofthe information and control system of FIG. 1, includ-
`ing the touch keypad and the display device.
`FIG. 3 is a block diagram of one embodiment of the infor-
`mation and control system network architecture.
`FIG. 4 is a logic diagram illustrating the operation of one
`embodiment of the building directory sub-system of the
`invention.
`
`FIG. 5 is a plan view of one embodiment of a building
`directory sub-system graphic location file, as shown on the
`display device of the information and control system.
`FIG. 6a is a plan view of one embodiment of a network
`input device having dedicated function keys thereon.
`FIGS. 6b and 6c illustrate one embodiment of an exem-
`
`plary coordinated graphic weather display according to the
`present invention.
`FIG. 7 is a plan view of one embodiment of the PED data
`download terminal of the invention.
`
`FIG. 8 is a block diagram of one embodiment of the capac-
`ity sensing sub-system according to the present invention.
`FIG. 9 is a plan view of one embodiment of the elevator
`floor sensor array used in conjunction with the capacity sens-
`ing sub-system of FIG. 8.
`FIG. 10 is a logic diagram illustrating the method of opera-
`tion of the capacity sensing sub-system of FIG. 8.
`FIG. 11 is a block diagram illustrating one embodiment of
`the monitoring and security sub-system of the present inven-
`tion.
`
`6
`FIG. 12 illustrates one embodiment of the elevator car
`
`touch panel used in conjunction with the monitoring and
`security sub-system of FIG. 11.
`FIG. 13 is a block diagram of a second embodiment of the
`monitoring and security sub-system of the present invention.
`FIGS. 14a and 14b are plan views of one embodiment of
`the parking and video monitoring displays, respectively, of
`the monitoring and security sub-system of FIG. 11.
`FIG. 15 is a block diagram illustrating one embodiment of
`the identification and access sub-system of the present inven-
`tion.
`
`FIG. 16 is a logic diagram illustrating the operation of the
`identification and access sub-system of FIG. 15.
`FIG. 17 is a plan view of one embodiment of a utility
`services selection display associated with the identification
`and access sub-system of FIG. 15.
`FIG. 18a is a logic diagram illustrating the operation of a
`first embodiment of the prompt mode of the adaptive adver-
`tising sub-system of the invention.
`FIG. 18b illustrates the library data file structure used in
`conjunction with the advertising sub-system of the invention.
`FIG. 18c is a logic diagram illustrating the operation of a
`second embodiment of the advertising sub-system of the
`invention.
`
`FIG. 18d is a logic diagram illustrating the operation of a
`third embodiment of the adaptive advertising sub-system of
`the invention.
`
`10
`
`15
`
`20
`
`25
`
`FIG. 19 is a logic diagram illustrating the operation of a
`fourth embodiment of the adaptive advertising sub-system of
`the invention.
`
`30
`
`DESCRIPTION OF THE INVENTION
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`Reference is now made to the drawings listed above,
`wherein like numerals refer to like parts throughout.
`It is noted that while the system and methods of the inven-
`tion disclosed herein are described primarily with respect to
`an elevator car, certain aspects of the invention may be useful
`in other applications,
`including, without limitation, other
`types of personnel transport devices such as trams or shuttles
`or moving walkways, or stationary devices such as kiosks
`within the lobby or elevator waiting areas of a building. As
`used herein, the term “building” is meant to encompass any
`structure, whether above ground or underground, permanent
`or temporary, used for any function.
`
`GENERAL DESCRIPTION
`
`Referring now to FIGS. 1 and 2, one embodiment of an
`improved elevator information system is generally described.
`As shown in FIG. 1, the system 100 includes an input device
`102, speech recognition (SR) module 104, central processor
`106 with associated motherboard 121, video RAM 107, non-
`volatile storage device 108 containing a database (not
`shown), graphics co-processor 109, volatile or dynamic stor-
`age device 110 with associated DMA module 139, audio
`amplifier and speaker module 111, speech synthesis module
`112, micro-controller 123, PCI slots 147, and display device
`113. The system also includes a serial bus with universal
`asynchronous receiver transmitter (DART) 117 or altema-
`tively universal serial bus (USB), as described in greater
`detail below with respect to FIG. 7. As shown in FIG. 2, the
`input device 102 of the present embodiment is a touch-sen-
`sitive keypad and/or display screen of the type well known in
`the electrical arts. The input device 102 includes a variety of
`different functional keys 114 on a keypad 116 (and/or on a
`touch-sensitive display screen 113, as described below)
`
`29
`
`
`
`US 8,296,146 B2
`
`7
`which allow the user to initiate a query of the database either
`manually via the keypad 116, display device 113, or audibly
`through the speech recognition module 104.
`As shown in FIG. 1, the speech recognition module 104 of
`the present invention includes a high quality, high SNR audio
`microphone 118, analog-to-digital converter (ADC) 141, and
`linear predictive coding (LPC)-based spectral analysis algo-
`rithm run on a digital signal processor 125 having associated
`SR module RAM 127. It will be recognized that other forms
`of spectral analysis, such as MFCC (Mel Frequency Cepstral
`Coefficients) or cochlea modeling, may be used. Phoneme/
`word recognition in the present embodiment is based on
`HMM (hidden Markov modeling), although other processes
`such as, without limitation, DTW (Dynamic Time Warping)
`or NNs (Neural Networks) may be used. Myriad speech rec-
`ognition systems and algorithms are available, all considered
`within the scope of the invention disclosed herein.
`In the present embodiment, CELP-based voice data com-
`pression is also utilized for transmission and storage of voice
`data. CELP algorithms in general are useful for converting
`analog speech to a compressed digital format which is more
`rapidly and easily manipulated and stored within a digital
`system using less bandwidth and memory. CELP algorithms
`and low bit rate vocoder t