`Volkswagen Group of America, Inc., Petitioner
`1
`
`
`
`US 8,290,778 B2
`Page 2
`
`U.S. PATENT DOCUMENTS
`5255541 A
`10/1955 Namima
`552575255 A
`271994 M5155 51515
`552955054 A
`3/ 1994 M5155 51515
`554535209 A
`10/1995 F1g1‘5151~
`5,485,897 A
`1/1996 M3t5u1T10t0et31~
`555515532 A
`9/ 1995 K“P515m111‘
`555055154 A
`2/ 1997 195185551515
`555595094 A
`1171997 F1155115151
`557495443 A
`5/ 1995 R°m5°
`555445151 A
`12/ 1995 A515 5151
`555575139 A
`371999 M55155“ 5151
`559155222 A
`571999 F“1“£5151~1
`5,932,853 A
`81999 Frie ieta.
`5,955,710 A
`9/1999 Dmmnza
`5,979,757 A
`11/ 1999 Tf30Y5131~
`5,984,051 A
`11/1999 Morgan etal.
`6,011,839 A
`1/2000 Friedlietal.
`6,073,727 A
`6/2000 DiFranza etal.
`6,078,928 A
`6/2000 Schnase etal.
`6,082,500 A
`7/2000 Arno etal.
`6,202,008 B1
`3/2001 Beckert etal.
`6,202,799 B1
`3/2001 Drop
`6,206,142 B1
`3/2001 Meacham
`6,223,160 B1
`4/2001 Kostka etal.
`6,236,968 B1
`5/2001 Kanevskyetal.
`6,332,127 B1
`12/2001 Bandem et 31.
`6,349,797 B1
`2/2002 Newville etal.
`6,397,976 B1
`6/2002 Hale et 31.
`5,421,305 B1
`7/2002 Gioscia et 31.
`6,460,036 B1
`10/2002 Herz
`6,466,232 B1
`10/2002 Newell et al.
`6,504,571 B1
`1/2003 Narayanaswamiet al.
`HCIZ Ct
`7/2003 Treyz et al.
`7/2003 Tada et al.
`
`6,587,835 B1
`6,594,580 B1*
`
`................... .. 701/532
`
`8/2003 Ford et al._
`6,606,644 B1
`11/3883 512113835‘
`285522 31
`9/2004 Reynolds et al
`6,799,327 B1
`10/2004 Schusteretali
`6,801,792 B1
`9/2005 Kozaketal
`1
`619441533 132*
`1/2006 Gioscia et all ................ N
`6,990,312 B1
`11/2006 Kohdaetali
`7,136,853 B1
`12/2007 Bares et al1
`7,305,345 B2
`4/2010 Apreuteseietal
`7,702,798 B2
`6/2004 Drury etal
`2004/0104842 A1
`10/2005 Giosciaetal
`2005/0239402 A1
`1
`3/2006 Herz etal
`2006/0069749 A1
`3/2009 Hancocketal
`2009/0077100 A1
`'
`.
`1/2010 Merrrmanetal.
`2010/0023392 A1
`FOREIGN PATENT DOCUMENTS
`
`1
`
`701/540
`
`JP
`JP
`JP
`JP
`JP
`JP
`
`52039237 A
`01225581 A
`03272977 A
`05017083 A
`05058554 A
`05201524 A
`
`3/1977
`9/1989
`12/1991
`1/1993
`3/1993
`8/1993
`
`OTHER PUBL1CAT1ONS
`«
`-
`garengacobs (Dec. 7, 1999) Elevator Maker to Add Commercial
`555115 1115 W511S115511°”mff15PP~ 1'2
`_
`Lewis Perdue (Jul. 20, 1999) Forget Elevator Music, Here Comes
`Elevator Internet,” InternetVC Watch, pp. 1-2.
`Stevens Institute of Technology, Spring 1999 Final Report, pp. 1-12.
`KenjiYoneda, et al. (Dec. 1997) “Multi-Objective Elevator Supervi-
`sory-Control System with Individual Floor-Situation Control,”
`Review,
`
`* cited by exarniner
`
`(cid:21)
`
`
`
`U.S. Patent
`
`Oct. 16, 2012
`
`Sheet 1 of 24
`
`US 8,290,778 B2
`
`nu.OmB>
`
`ozfimos
`
`soAOMHZOU
`
`3
`
`zomaoa
`
`#525
`
`mmémm
`
`38
`
`omw
`
`mE<>m:m
`
`AOMELZOU
`
`E3050
`
`E
`
`o:
`
`we
`
`mwéoem
`
`m§>mo
`
`H.05
`
`mommam
`
`mmmfiza
`
`m15DOE
`
`N:
`
`m:
`
`4
`
`(cid:22)
`
`
`
`
`
`
`
`U.S. Patent
`
`US 8,290,778 B2
`
`(cid:23)
`
`
`
`U.S. Patent
`
`m2mm0
`
`.m
`
`U
`
`2-)
`
`77,
`
`2
`
`3
`
`mmdozmedozM,2oEoO:
`
`2H:
`
`Mmm>,.mammafia
`
`q<uEo
`
`as.mo2me.mo252
`
`
`
`B.smGE
`
`%9:
`
`%2:
`
`mmzmmezfi
`,Ez<w:z_
`zsszfi
`
`(cid:24)
`
`
`
`
`
`
`U.S. Patent
`
`Oct. 16, 2012
`
`Sheet 4 of 24
`
`US 8,290,778 B2
`
`"BUILDING DIRECTORY"
`
`VISUAL
`
`
`
`AUDIO
`
` USER SELECT
`
`FUNCTION KEY
`
`
`RETRIEVE CELP FILE
`
`RETRIEVE BUILDING
`DIRECTORY FILE
`
` SYSTEM
`PROGRAMMED
`FOR AUDIO
`OR VISUAL
`PROMPT
`9
`
`
`
`
`
`
`SYNTHESIZE
`VOICE PROMPT
`DISPLAY DIRECTORY
`("NAME")
`FILE ON DISPLAY
`
`DEVICE
`
`
`
`
`
`
`
`9
`
`
`
`COMPARE SAMPLED
`FLOOR
`VOICE WITFHLIEIRECTORY
`SELECTED
`I
`
`
`
`
`
`
`ENAELED %
`
` CONT.
`
`RATING
`
`
`
`
`SYNTHESIZE PROMPT
`
`GENERATE SEQUENCE
`LIST OF MATCHES
`
`SYNTHESIZE NEXT PROMPT
`BASED ON MATCHES
`
`
`
`USER INPUT
`
`
`
`
`
`SYNTHESIZE PROMPT
`
` SEARCH
`
`APPEND
`
` FIG. 4 ‘YES
`
`(cid:25)
`
`
`
`SAMPLE VOICE
`AND DIGITIZE
`
`RETRIEVE BLDG.
`DIRECTORY FILES
`
`
`
` CALCULATE
`
`CONT. RATING
`
`LOCATE & RETRIEVE
`GRAPHIC FILE
`FOR SELECTED ENTRY
`
`DISPLAY GRAPHIC FILE
`
`
`
`U.S. Patent
`
`M.m5W
`
`US 8,290,778 B2
`
`///,,.\\\\/\nwIFES5.5..mxm\2528mm:Hm\\\\_,,///m>z§280Ex
`
`(cid:26)
`
`
`
`U.S. Patent
`
`Oct. 16, 2012
`
`Sheet 6 of 24
`
`US 8,290,778 B2
`
`mamomm
`
`mmmoom
`mmz5a<mm
`
`4<uog,
`
`(cid:27)
`
`
`
`
`U.S. Patent
`
`Oct. 16,
`
`2012
`
`Sheet 7 of 24
`
`US 8,290,778 B2
`
`(cid:28)
`
`
`
`U.S. Patent
`
`Oct. 16, 2012
`
`Sheet 8 of 24
`
`US 8,290,778 B2
`
`
`
`
`
`mmfifiadE<ooooma2%
`
`m:
`
`:mza2%:Bmza
`
`K
`
`CS
`
`8.UE
`
`10
`(cid:20)(cid:19)
`
`
`
`
`U S Patent
`
`Oct. 16, 2012
`
`Sheet 9 of 24
`
`US 8,290,778 B2
`
`m:
`
`Qoqzaoa
`
`M5.oBm
`
`Q<OqZ>,.OQ
`
`mmmfima
`
`Q<OgZ2/OD
`
`mamz
`
`zozozza
`
`mGE
`
`(cid:20)(cid:20)
`
`
`
`
`
`
`12
`(cid:20)(cid:21)
`
`U.S. Patent
`
`00S
`
`2
`
`HwGEW,HAQQ%3V1U&2:>>>>
`U........W2;MAMEWwowMWMEW.MII.
`_.o;WWmVEEWMeHo“«VMVV
`NEWRMWE.WW8”Sflmm
`mommmuofi.56IMHW.H.om:.ZHIOMmomM2C"mA_EWmM:nWt.55WMmEgo.m%w%oAWEWma“0\§2“----é
`
`2 w
`
`......
`
`5
`
`moon
`
`momzmm
`
`ca
`
`
`
`
`U.S. Patent
`
`Oct. 16, 2012
`
`Sheet 11 of 24
`
`US 8,290,778 B2
`
`FIG. 9
`
`13
`(cid:20)(cid:22)
`
`
`
`U.S. Patent
`
`Oct. 16, 2012
`
`Sheet 12 of 24
`
`US 8,290,778 B2
`
`
` OBTAIN SIGNAL
` COMPARE # OF
`
`
`
`ADJACENT PAIRS
`
`FROM EACH SENS OR
`
`COUNT# OF
`
`NON-ZERO OUTPUTS
`
`
`
`
`
`ANY
`PAIR MEMBER
`< THRESHOLD
`
`OUTPUTS
`
`INTEGRATE OVER t
`
`? SUM ALL NON-ZERO
`
` COMPUTE
`
`
`
`
`
`CORRECTION
`
`SCALE TO OBTAIN OE
`
`OBTAIN # OF FLOORS
`SELECTED IN CAR
`
`
`
`APPLY
`CORRECTION
`T0 OMAXU
`
`
`
`
`
`COMPARE OE, OMINP,
`OMINS, & OMAXC
`AND CHOOSE LARGEST
`
`
`
`
`NEXT
`FLOOR
`
`REACHED
`
`?
`
`
`
`GENERATE
`BYPASS CONTROL
`SIGNAL
`
`FIG. 10
`
`14
`(cid:20)(cid:23)
`
`
`
`U.S. Patent
`
`Oct. 16, 2012
`
`Sheet 13 of 24
`
`US 8,290,778 B2
`
`1140
`
`MOTION
`
`V1
`53
`
`><
`
`EDL
`
`)
`cuC0
`
`/'
`
`I122
`
`LIGHT: ‘\
`
`1150
`
`IR
`
`VIDEO
`
`171
`
`V‘
`E.—u
`I--4
`
`
`
`1104
`
`1104
`
`:24
`O
`E495
`§<
`a1‘)
`5
`
`N
`53
`
`('\l
`v-%
`
`-
`CD»-4
`
`L14 SECURITY CALL
`
`
`
`©v—4
`
`""
`—~
`
`$
`v—4
`S3
`
`(cid:20)(cid:24)
`
`
`
`U.S. Patent
`
`Oct. 16, 2012
`
`Sheet 14 of 24
`
`US 8,290,778 B2
`
`16
`(cid:20)(cid:25)
`
`
`
`U.S. Patent
`
`Oct. 16, 2012
`
`Sheet 15 of 24
`
`US 8,290,778 B2
`
` FIG.14a
` FLOOR
`
`NUMBER
`
`(cid:20)(cid:26)
`
`
`
`U.S. Patent
`
`Oct. 16,2012
`
`Sheet 16 of 24
`
`US 8,290,778 B2
`
`m:
`
`gm:
`
`52$:EE5
`
`zomzom
`
`
`
`SE/Eomémdm
`
`maizeE5
`
`$58mo:.>Bm
`
`355%zo
`
`SS6:
`
`Q8:
`
`
`
`mOZOEWHOAmZONQmibmfimmLO
`
`
`
`mzoEE2zoE§mmEoz<
`
`7:.55
`
`
`
`
`
`mzoNaflumzmmmfiumzmmzo
`
`-em:
`
`gm:
`
`
`
`:m>m,_aflumdmzoSam:
`
`£2
`
`GE
`
`18
`(cid:20)(cid:27)
`
`
`
`
`
`
`
`U.S. Patent
`
`Oct. 16, 2012
`
`Sheet 17 of 24
`
`US 8,290,778 B2
`
`E21/1mmm<ms.<m
`
`_mmm8<
`
`rIIIIlllilllll
`
`1IIIIIIIIIIIll
`
`II\\
`|$
`ll
`|\
`\II
`I\
`
`\1\\\
`
`\
`
`mmémm
`
`(cid:20)(cid:28)
`
`
`
`
`U.S. Patent
`
`Oct. 16, 2012
`
`Sheet 18 of 24
`
`US 8,290,778 B2
`
`
` READER
`
`ACCESS
`
`PASSWORD
`
`FILE
`OF DATABASE
`
`
`
`START
`
`USER ENTER
`ELEVATOR CAR
`
`READER
`ACTIVATE
`
` READER INTERROGATE
`9
`
`
`
`
`GENERATE
`
`TAC X T
`CONTROL
`READER
`SIGNAL REMOVING
`I-13013511
`
`
`
`BLOCK FROM
`RECOGNIZED”
`AUTHENTICATED
`
`WARNING
`AUTHORIZED FLOORS
`?
`
`
`
`RFID TAG
`
`RFID TAG DECRYPT
`READER EMISSION
`
`
`
`
`
`
`
`READER DECRYPT
`REID EMISSION
`
`READER ACCESS
`DATABASE
`
`LOG DATA
`IN DATABASE
`
`
`ERRED
`
`
`AUTHORIZED"
`AU
`,_,R Z
`WARNING
`Y
`
`TAGS%§'£I’}F1D
`
`DEIASIEQTE
`
`READER ENABLE
`INPUT DEVICE
`
`USER ENTER PAS SWORD
`
`FIG. 16
`
`20
`(cid:21)(cid:19)
`
`PASSWORD
`MATCH
`
`
`
`ENABLE UTILITY
`
`FUNCTION KEYS
`
`USER SELECT
`DESIRED FUNCTIONS
`
`
`
`
`DISPLAY
`"INCORRECT
`
`PASSWORD"
`WARNING
`
`
`
`
`
`
`
`U.S. Patent
`
`Oct. 16, 2012
`
`Sheet 19 of 24
`
`US 8,290,778 B2
`
`N02
`
`5.05
`
`u7memo~H
`
`g<moqo
`
`eomgmm
`
`mobfi
`
`(cid:21)(cid:20)
`
`
`
`U.S. Patent
`
`Oct. 16, 2012
`
`Sheet 20 of 24
`
`US 8,290,778 B2
`
`SAMPLE SPEECH
`OF OCCUPANTS
`
`
`
`
`
`PARSEIMAGE
`DATA ADDRESS
`FROM ALL
`
`RETRIEVE ALL
`IMAGE DATA
`
`
`
`CONVERT
`SAMPLED
`SPEECH To
`DIGITAL FORMAT
`
`
`
`ALLOCATE ONE
`IMAGE DATA
`FILE TO EACH DISPL.
`
`SET
`
`COMPARE
`SAMPLED
`SPEECH TO
`LIBRARY
`
`
`
`
`AMBIGUITY FLAG
`
`
`
`MATCH
`ANY LIBRARY
`WORD
`
`
`‘.7
`
`
`IDENTIFY
`SUB-FILE(S)
`
`
` SUB FILE
`
` I
`
`
`
`
`
`MATCH
`PREVIOUS
`SUB-FILE(S
`'7
`
`22
`(cid:21)(cid:21)
`
`
`
`
`PARSE IMAGE/
`AUDIO FILE
`ADDRESS(ES)
`
`
`
`
` IMAGE
`OR AUDIO
`
`DATA
`CURRENTLY
`RETRIEVE
`IN USE
`9
`IMAGE/AUDIO
`FILES
`
` DISPLAY/PLAY
`
`
`RETRIEVED
`
`DATA ON
`ALL DISPLAYS
`
`FOR PRED ETERMINED
`
`PERIOD
` FIG. 1821
`
`
`
`
`
`U.S. Patent
`
`MMnmnmm
`
`US 8,290,778 B2
`
`o2%
`
`E::2
`
`BE
`
`édSfimam
`
`£2.65
`
`23
`(cid:21)(cid:22)
`
`
`
`
`U.S. Patent
`
`Oct. 16, 2012
`
`Sheet 22 of 24
`
`US 8,290,778 B2
`
`
` NEW CALL
`SIGNAL REC‘D
`?
`
`
`
`
`
`
`OTHER
`SELECTED
`CALL SIGNALS
`
`BY OCCUPANTS
`
`
`PRESENT
`‘I
`
`
`
`
` PARSE ID
`
`
` ESTIMATE TIME TO NEXT
`
`
`DATA
`
` FLOOR?
`
`
`DETERMINE DIRECTION
`OF TRAVEL
`
`DETERMINE
`DIRECTION
`
`
`
`DATA
`
`ORDER CALL SIGNALS
`BASED ON DIRECTION
`
`RETRIEVE
`
`SELECTNEXT FLOOR
`
`
`
`DATA FOR ID
`
`FLOOR ENCOUNTERED
`
`DISPLAY/PLAY
`RETRIEVED
`
`
`REACHED
`
`Y
`
`ACCESS BLDG. DIRECTORY
`FOR NEXT FLOOR
`
`RUN TENANT
`SELECTION
`ROUTINE
`
`
`
`MULTIPLE
`TENANTS ON
`FLOOR
`?
`
`
`
`
`FIG. I80
`
`24
`(cid:21)(cid:23)
`
`
`
`N
`
`
`
`
`CALL SIGNAL
`PRESENT
`?
`
`SELECTED
`BY CAR9OCCUP.
`
`
`
`
`
`U.S. Patent
`
`Oct. 16, 2012
`
`Sheet 23 of 24
`
`US 8,290,778 B2
`
`
`
`
`LARGEST D
`
`SELECT
`SUB—FILE WITH
`
`
`
`RETRIEVE DATA
`FILE FOR SUB-FILE
`WITH LARGEST D
`
`
`
`
`
`DISPLAY DATA
`FILE
`
`
`
`25
`(cid:21)(cid:24)
`
`UPDATE HISTORICAL
`DISPLAY FILE FOR
`FILE DISPLAYED
`
`
`
`INCREMENT
`SINCE LAST
`COMPARISON
`‘.7
`
`
`
`
`WAIT PREDET.
`PERIOD
`
`START
`
`SAMPLE
`SPEECH
`
`
`
`CONVERT
`TO DIGITAL
`
`
`
`PARSE ISUBTILE
`D
`
`RETRIEVE
`SUB—FILE
`STATISTIC FILE
`
`INCREMENT
`STATISTIC
`FILE BY ONE
`
`STORE
`STATISTIC
`FILE
`
`WAIT PRESET
`PERIOD
`
`FIG. 18d
`
`
`
`
`
`
` RETRIEVE
`STATISTIC
`
`FILES FOR
`ALL K SUB-FILES
`
`
`
`
`
`
`
`HISTORICAL
`DISPLAY FILE
`DISTRIBUTION TO
`
` COMPARE
`
`
`STATISTICAL FILES
`
` DISTRIB.
`
`
`
`
` RETRIEVE
`COMPARE- HISTORICAL
`
`
`DISPLAY FILES FOR
`To LIBRARY
`
`ALL K SUB-FILES
`
`
`
`U.S. Patent
`
`Oct. 16, 2012
`
`Sheet 24 of 24
`
`US 8,290,778 B2
`
`
`
`USER SELECT DEDICATED
`FUNCTION KEY OR TOUCH
`SCREEN FUNCTION KEY
`
`
`
`
`
`
`
`
`PROCESSOR GENERATE
`ID CODE FOR
`
`SELECTED FUNCTION
`
`
`
`
`
`PROCESSOR RETRIEVE
`
`STORED "TAG" FILE FOR
`
`ADVERTISING SUB-FILES
`
`
` COMPARE GENERATED
`
`ID CODE TO TAG
`ASSOCIATED WITH ONE
`
`(OR MORE) SUB-FILES
`
`PROCESSOR SEQUENCE
`TAGS
`
`
`
`
`
`PROCESSOR RETRIEVE
`DATA FILE FOR nTH
`SUB-FILE IN SEQUENCE
`
`
`
`DISPLAY nTH
`SUB-FILE DATA FILE
`
`
`
`WAIT PREDETERMINED
`PERIOD
`
`
`
`
`
`LAST
`TAG FILE
`DISPLAYED
`?
`
`n=n+1 FIG. 19
`
`
`N
`
`INCREMENT n:
`
`26
`(cid:21)(cid:25)
`
`
`
`1
`COMPUTERIZED INFORMATION
`PRESENTATION APPARATUS
`
`US 8,290,778 B2
`
`2
`
`This application is a continuation of and claims priority to
`co-owned and U.S. patent application Ser. No. 13/357,487
`filed Jan. 24, 2012 and entitled “ELECTRONIC INFORMA-
`TION ACCESS SYSTEM AND METHODS”, which is a
`continuation of and claims priority to co-owned and U.S.
`patent application Ser. No. 12/711,692 filed Feb. 24, 2010 and
`entitled “ADAPTIVE INFORMATION PRESENTATION
`APPARATUS AND METHODS”, now U.S. Pat. No. 8,117,
`037, which is a continuation of and claims priority to co-
`owned and U.S. patent application Ser. No. 11/506,975 filed
`Aug. 17, 2006 and entitled “SMART ELEVATOR SYSTEM
`AND METHOD”, now U.S. Pat. No. 7,711,565, which is a
`divisional of and claims priority to co-owned U.S. patent
`application Ser. No. 10/935,957 filed Sep. 7, 2004 and
`entitled “ELEVATOR ACCESS CONTROL SYSTEM AND
`
`METHOD”, now U.S. Pat. No. 7,093,693, which is a divi-
`sional of co-owned U.S. patent application Ser. No. 10/651,
`451 filed Aug. 29, 2003 and entitled “SMART ELEVATOR
`SYSTEM AND METHOD”, now U.S. Pat. No. 6,988,071,
`which is a continuation of co-owned U.S. patent application
`Ser. No. 09/330,101 filed Jun. 10, 1999 and entitled“SMART
`ELEVATOR SYSTEM AND METHOD”, now U.S. Pat. No.
`6,615,175, each ofthe foregoing incorporated into the present
`application by reference in its entirety. This application is also
`related to U.S. patent application Ser. Nos. 12/703,666 filed
`Feb. 10, 2010 entitled “ADAPTIVE ADVERTISING APPA-
`RATUS AND METHODS”, now U.S. Pat. No. 8,065,155,
`Ser. No. 12/704,431 filed Feb. 11,2010 entitled“ADAPTIVE
`ADVERTISING APPARATUS AND METHODS”, now
`U.S. Pat. No. 8,078,473, Ser. No. 12/711,857 filed on Feb. 24,
`2010 entitled “ADAPTIVE INFORMATION PRESENTA-
`TION APPARATUS AND METHODS”, now U.S. Pat. No.
`8,065,156, Ser. No. 13/357,487 filed Jan. 24, 2012 and
`entitled “ELECTRONIC INFORMATION ACCESS SYS-
`TEM AND METHODS”, Ser. No. 13/362,902 filed Jan. 31,
`2012 and entitled “ADAPTIVE INFORMATION PRESEN-
`TATION APPARATUS”, Ser. No. 13/364,194 filed Feb. 1,
`2012 and entitled “COMPUTERIZED INFORMATION
`PRESENTATION APPARATUS”, and Ser. No. 13/369,850
`filed Feb. 9, 2012 and entitled “COMPUTERIZED INFOR-
`MATION PRESENTATION APPARATUS”, each incorpo-
`rated herein by reference in its entirety. This application is
`also related to U.S. patent application Ser. Nos. 13/404,606
`entitled “COMPUTERIZED INFORMATION PRESENTA-
`TION APPARATUS”, Ser. No. 13/405,046 entitled “COM-
`PUTERIZED INFORMATION PRESENTATION METH-
`ODS”, and Ser. No. 13/404,980 entitled “COMPUTERIZED
`INFORMATION PRESENTATION APPARATUS”, each
`filed contemporaneously herewith on Feb. 24, 2012 and
`incorporated herein by reference in its entirety. This applica-
`tion is also related to U.S. patent application Ser. Nos. 13/410,
`080 entitled “Network Apparatus and Methods for User Infor-
`mation Delivery” filed Mar. 1, 2012, and 13/406,408 entitled
`“Computerized Information Selection and Download Appa-
`ratus and Methods” filed Feb. 27, 2012.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`
`The present invention relates to the field ofpersonnel trans-
`port apparatus, and specifically to elevators and similar
`devices for transporting people from one location to another
`which incorporate various information technologies.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2. Description of Related Technology
`Elevators and similar personnel transport devices (such as
`moving walkways or shuttles) are important aspects of
`modem urban life. Commonly used in ofiice buildings, air-
`ports, shopping malls, and other large structures,
`these
`devices transport large numbers of people and equipment
`between two locations on a routine basis. Elevators in par-
`ticular are widely used throughout the world.
`Depending on loading, a person may spend up to several
`minutes on an elevator during travel between floors. Signifi-
`cant amounts of time may also be spent waiting for the eleva-
`tor to arrive when called. This time is usually “dead” from the
`standpoint that very little can be accomplished or very few
`tasks undertaken during these few minutes. However, often
`times an individual may require information which will be of
`use after leaving the elevator. For example, the person may
`wish to obtain travel information such as directions to the
`
`nearest airport or public transportation node, or the location
`of a nearby restaurant. Weather-related information or trafiic
`reports may also be useful. A plethora of different types of
`information, including financial data, breaking news head-
`lines, sports scores and the like may also be of interest to one
`waiting for or riding on an elevator or other transport device.
`An associated problem relates to determining the location
`of a person, firm, or store within a building when unfamiliar.
`Building directories are often posted in the lobby ofthe build-
`ing, yet these require the user to manually or visually locate
`the name of the person, firm, or store which they are looking
`for, and remember the location information associated there-
`with. Additionally, such directories often do not provide pre-
`cise location information, but rather merely a floor number
`and/or suite number. The user often times does not have a
`
`graphical representation of the desired location in relation to
`the elevators, thereby resulting in additional wasted time in
`finding the location once off of the elevator. Even if a graphi-
`cal display is provided, it often requires the user to spatially
`orient themselves to determine relative location.
`
`Security is also a concern when riding elevators late at
`night or to remote locations. Many elevator systems are used
`partly or entirely within parking garages, which often may be
`sparsely populated at off hours. People are all too frequently
`assaulted or robbed when departing from elevators under
`such conditions. Unfortunately, existing elevator systems do
`not have the facility to provide the occupant(s) with the ability
`to selectively observe the area immediately surrounding the
`elevator doors on one or more destination floors, or otherwise
`take precautions to enhance their security.
`Another problem associated with existing elevator systems
`relates to their loading capacity. Often, especially at peak use
`hours such as during the noon hour, the call buttons for several
`different floors within a building will be activated, and eleva-
`tor cars which are at or near their loading capacity will
`respond. With no additional room available in the elevator, the
`person depressing the call button on a given floor is left to wait
`for the elevator doors to close, depress the call button again,
`and wait for another (hopefully partially vacant) car to arrive.
`This process not only delays the person waiting for the car, but
`also those on the elevator car(s), and those waiting on other
`floors.
`
`In addition to the foregoing, many elevators must have a
`means of restricting access to certain floors during certain
`time periods while not interfering with other operations.
`These elevators generally also include means by which cer-
`tain users may gain access to the restricted floors, such as a
`magnetic striped card which is inserted into a card reader on
`the elevator. However, such card readers are prone to wear and
`having to re-swipe the card several times in order to obtain
`
`27
`(cid:21)(cid:26)
`
`
`
`US 8,290,778 B2
`
`3
`access. Furthermore, as the card wears due to repeated swip-
`ing or bending (such as when left in the pocket of the indi-
`vidual carrying the card), the card will be more prone to
`failure and will eventually require replacement. Also, such
`cards are prone to unauthorized use. Someone stealing or
`finding the lost card can simply insert it into the card reader of
`the elevator and gain access to the restricted floor(s). It is also
`noted that since access is restricted to certain floors typically
`during late-night or weekend hours, HVAC and lighting sys-
`tems are typically turned off or dormant in order to conserve
`energy. Hence, when the user arrives at one ofthese restricted
`access floors, several minutes are typically spent turning on
`the HVAC, lights, and any other number of electrical devices.
`Some systems require the user to insert their magnetic strip
`card in a separate reader, such as in the control room for the
`HVAC (which is typically located on a different floor), in
`order to initiate equipment operation. This is obviously time
`consuming and cumbersome.
`Lastly, there is often an element of discomfort associated
`with riding an elevator car, especially when several individu-
`als are present in the car. Due in part to minimal space within
`the car and nothing to occupy the occupants attention visu-
`ally, there is a natural tendency for one to stare up, down, or
`forward at the door of the elevator, or at the visual floor
`indicators so as to avoid prolonged eye contact with the other
`occupants.
`Heretofore, many of the technologies necessary to address
`the aforementioned issues have not been available or, alter-
`natively, have been cost or space prohibitive to implement.
`However, recent advances in data networking, thin or flat
`panel display technology, personal electronics, and speech
`recognition and compression algorithms and processing have
`enhanced the viability of such features from both technologi-
`cal and commercial perspectives.
`Based on the foregoing, there is a need for an improved
`elevator system and method of operation which will reduce
`the time spent waiting for and travelling on the elevator car,
`reduce the frustration associated with repeated stops at dif-
`ferent floors, and allow the occupants of the elevator (as well
`as those waiting for the car) to use their time more efficiently
`and obtain needed information. Additionally, such an elevator
`system would enhance the security of the occupants upon
`egress, and allow for automatic recognition of an individual in
`order to provide access to certain restricted locations and
`initiation of certain functions such as lighting and HVAC.
`
`SUMMARY OF THE INVENTION
`
`In a first aspect of the invention, computerized apparatus is
`disclosed. In one embodiment, the apparatus includes: a wire-
`less interface; data processing apparatus; a touch-screen input
`and display device; a speech recognition apparatus in data
`communication with the data processing apparatus; and a
`storage apparatus in data communication with the data pro-
`cessing apparatus, the storage apparatus comprising at least
`one computer program. In one variant, the at least one pro-
`gram is configured to: receive a digitized speech input via the
`speech recognition apparatus, the input relating to an organi-
`zation or entity which a user wishes to locate; based at least in
`part on the input, cause identification of a location associated
`with the organization or entity; and provide a graphical or
`visual representation ofthe location on the touch screen input
`and display device in order to aid a user in finding the orga-
`nization or entity, the graphical or visual representation of the
`location also comprising a graphical or visual representation
`of the surroundings of the organization or entity.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`
`In another embodiment, the at least one program is config-
`ured to: receive a digitized speech input via the speech rec-
`ognition apparatus, the input relating to an organization or
`entity which a user wishes to locate; based at least in part on
`the input, cause identification ofa location associated with the
`organization or entity; and provide a graphical or visual rep-
`resentation of the location on the touch screen input and
`display device in order to aid a user in finding the organization
`or entity, the graphical or visual representation ofthe location
`comprising a map graphic showing the location of the orga-
`nization or entity relative to other organizations or entities
`proximate thereto.
`In one variant, the digitized speech is received via a micro-
`phone associated with the speech recognition apparatus, the
`microphone being mounted within the computerized appara-
`tus proximate the touch-screen input and display device so
`that the user can speak into the microphone while viewing the
`touch- screen input and display device. In a further variant, the
`at least one program is further configured to cause display of
`advertising selected by one or more remote servers accessed
`via a network in data communication with the computerized
`apparatus via the wireless interface, the advertising being
`selected based at least in part on an attribute or aspect of the
`organization or entity; and the identification of the location
`comprises accessing a remote server via a network in data
`communication with the computerized apparatus via the
`wireless interface; and the at least one computer program is
`further configured to receive and utilize inputs in an iterative
`or hierarchical fashion to progress through a menu structure
`comprising multiple possible matching organizations or enti-
`ties. In yet a further variant, the computerized apparatus is
`further configured to provide a user a graphical representation
`of directions from their current location to a business or
`
`organization, the graphical representation of directions com-
`prising the map graphic displayed on the touch-screen input
`and display device having at least one arrow showing the path
`for the user to follow; and comprises an interface compliant
`with an IEEE 802.11 standard.
`
`In yet another embodiment, the at least one computer pro-
`gram, the at least one program is configured to: receive a
`digitized speech input via the speech recognition apparatus,
`the input relating to an organization or entity to which a user
`wishes to obtain directions; receive form a remote network
`entity a location associated with the organization or entity, the
`location having been determined based at least in part on the
`input; display the directions from the user’s current location
`to the organization or entity on the touch screen input and
`display device; and provide a graphical or visual representa-
`tion of the location of the organization or entity on the touch
`screen input and display device in order to aid a user in finding
`the organization or entity, the graphical or visual representa-
`tion of the location also comprising a graphical or visual
`representation of the surroundings of the organization or
`entity.
`the computerized apparatus
`In a further embodiment,
`includes: a wireless interface; means for data processing; a
`touch-screen input and display means; a speech recognition
`apparatus in data communication with the means for data
`processing; and a storage apparatus in data communication
`with the means for data processing, the storage apparatus
`comprising at least one computer program. In one variant, the
`at least one program is configured to: receive a digitized
`speech input via the speech recognition apparatus, the input
`relating to an organization or entity to which a user wishes to
`obtain directions; receive form a remote network entity a
`location associated with the organization or entity, the loca-
`tion having been determined based at least in part on the
`
`28
`(cid:21)(cid:27)
`
`
`
`5
`input; display the directions from the user’s current location
`to the organization or entity on the touch screen input and
`display means; and provide a graphical or visual representa-
`tion of the location on the touch screen input and display
`means in order to aid a user in finding the organization or
`entity, the graphical or visual representation of the location
`also comprising a graphical or visual representation of the
`surroundings of the organization or entity.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a block diagram of one embodiment of the infor-
`mation and control system of the invention, showing those
`components local to each elevator car.
`FIG. 2 is a plan View of a first embodiment of the interface
`panel ofthe information and control system of FIG. 1, includ-
`ing the touch keypad and the display device.
`FIG. 3 is a block diagram of one embodiment of the infor-
`mation and control system network architecture.
`FIG. 4 is a logic diagram illustrating the operation of one
`embodiment of the building directory sub-system of the
`invention.
`
`10
`
`15
`
`20
`
`FIG. 5 is a plan view of one embodiment of a building
`directory sub-system graphic location file, as shown on the 25
`display device of the information and control system.
`FIG. 6a is a plan view of one embodiment of a network
`input device having dedicated function keys thereon.
`FIGS. 6b and 6c illustrate one embodiment of an exem-
`
`plary coordinated graphic weather display according to the 30
`present invention.
`FIG. 7 is a plan view of one embodiment of the PED data
`download terminal of the invention.
`
`FIG. 8 is a block diagram of one embodiment of the capac-
`ity sensing sub-system according to the present invention.
`FIG. 9 is a plan view of one embodiment of the elevator
`floor sensor array used in conjunction with the capacity sens-
`ing sub-system of FIG. 8.
`FIG. 10 is a logic diagram illustrating the method of opera-
`tion of the capacity sensing sub-system of FIG. 8.
`FIG. 11 is a block diagram illustrating one embodiment of
`the monitoring and security sub-system of the present inven-
`tion.
`FIG. 12 illustrates one embodiment of the elevator car
`
`35
`
`40
`
`touch panel used in conjunction with the monitoring and 45
`security sub-system of FIG. 11.
`FIG. 13 is a block diagram of a second embodiment of the
`monitoring and security sub-system of the present invention.
`FIGS. 14a and 14b are plan views of one embodiment of
`the parking and video monitoring displays, respectively, of 50
`the monitoring and security sub-system of FIG. 11.
`FIG. 15 is a block diagram illustrating one embodiment of
`the identification and access sub-system ofthe present inven-
`tion.
`
`FIG. 16 is a logic diagram illustrating the operation of the 55
`identification and access sub-system of FIG. 15.
`FIG. 17 is a plan view of one embodiment of a utility
`services selection display associated with the identification
`and access sub-system of FIG. 15.
`FIG. 18a is a logic diagram illustrating the operation of a 60
`first embodiment of the prompt mode of the adaptive adver-
`tising sub-system of the invention.
`FIG. 18b illustrates the library data file structure used in
`conjunction with the advertising sub-system of the invention.
`FIG. 18c is a logic diagram illustrating the operation of a 65
`second embodiment of the advertising sub-system of the
`invention.
`
`US 8,290,778 B2
`
`6
`FIG. 18d is a logic diagram illustrating the operation of a
`third embodiment of the adaptive advertising sub-system of
`the invention.
`
`FIG. 19 is a logic diagram illustrating the operation of a
`fourth embodiment of the adaptive advertising sub-system of
`the invention.
`
`5
`
`DESCRIPTION OF THE INVENTION
`
`Reference is now made to the drawings listed above,
`wherein like numerals refer to like parts throughout.
`It is noted that while the system and methods of the inven-
`tion disclosed herein are described primarily with respect to
`an elevator car, certain aspects of the invention may be useful
`in other applications,
`including, without limitation, other
`types of personnel transport devices such as trams or shuttles
`or moving walkways, or stationary devices such as kiosks
`within the lobby or elevator waiting areas of a building. As
`used herein, the term “building” is meant to encompass any
`structure, whether above ground or underground, permanent
`or temporary, used for any function.
`General Description
`Referring now to FIGS. 1 and 2, one embodiment of an
`improved elevator information system is generally described.
`As shown in FIG. 1, the system 100 includes an input device
`102, speech recognition (SR) module 104, central processor
`106 with associated motherboard 121, video RAM 107, non-
`volatile storage device 108 containing a database (not
`shown), graphics co-processor 109, volatile or dynamic stor-
`age device 110 with associated DMA module 139, audio
`amplifier and speaker module 111, speech synthesis module
`112, micro-controller 123, PCI slots 147, and display device
`113. The system also includes a serial bus with universal
`asynchronous receiver transmitter (UART) 117 or altema-
`tively universal serial bus (USB), as described in greater
`detail below with respect to FIG. 7. As shown in FIG. 2, the
`input device 102 of the present embodiment is a touch-sen-
`sitive keypad and/or display screen of the type well known in
`the electrical arts. The input device 102 includes a variety of
`different functional keys 114 on a keypad 116 (and/or on a
`touch-sensitive display screen 113, as described below)
`which allow the user to initiate a query of the database either
`manually via the keypad 116, display device 113, or audibly
`through the speech recognition module 104.
`As shown in FIG. 1, the speech recognition module 104 of
`the present invention includes a high quality, high SNR audio
`microphone 118, analog-to-digital converter (ADC) 141, and
`linear predictive coding (LPC)-based spectral analysis algo-
`rithm run on a digital signal processor 125 having associated
`SR module RAM 127. It will be recognized that other forms
`of spectral analysis, such as MFCC (Mel Frequency Cepstral
`Coefficients) or cochlea modeling, may be used. Phoneme/
`word recognition in the present embodiment is based on
`HMM (hidden Markov modeling), although other processes
`such as, without limitation, DTW (Dynamic Time Warping)
`or NNs (Neural Networks) may be used. Myriad speech rec-
`ognition systems and algorithms are available, all considered
`within the scope of the invention disclosed herein.
`In the present embodiment, CELP-based voice data com-
`pression is also utilized for transmission and storage of voice
`data. CELP algorithms in general are useful for converting
`analog speech to a compressed digital format which is more
`rapidly and easily manipulated and stored within a digital
`system using less bandwidth and memory. CELP algorithms
`and low bit rate vocoder technology are well known in the
`signal processing art, and accordingly will not be described
`further herein. Note that as used herein, the term CELP is
`
`29
`(cid:21)(cid:28)
`
`
`
`US 8,290,778 B2
`
`7
`meant to include any and all variants ofthe CELP family such
`as, but not limited to, ACELP, VCELP, and QCELP. It is also
`noted that while CELP is used as the basis of compression
`within the system 100, other types of compression algorithms
`and techniques, whether based on companding or otherwise,
`may be used. For example, PCM (pulse code modulation) or
`ADPCM (adaptive delta PCM) may be employed, as may
`other forms of linear predictive coding (LPC).
`As illustrated in FIG. 1, signals generated by the micro-
`phone 118 are digitized by the ADC 141 and processed using
`the aforementioned speech recognition algorithm and the
`DSP 125 to produce digital representations of the user’s
`speech. The sp