(12) United States Patent
`Gazdzinski
`
`(10) Patent N0.:
`(45) Date of Patent:
`
`US 6,615,175 B1
`Sep. 2, 2003
`
`US006615175B1
`
`(54) “SMART” ELEVATOR SYSTEM AND
`METHOD
`
`Karen Jacobs (Dec. 7, 1999) “Elevator Maker to Add
`Commercial Touch,” The Wall Street Journal, pp. 1—2.
`
`(76) Inventor. Robert E Gazdzinski, 5862]) Mission
`Center Rd” San Diego, CA (Us) 92123
`
`Lewis Perdue (Jul. 20, 1999) “Forget Elevator Music, Here
`Comes Elevator Internet, Internet VC Watch, pp. 1—2.
`
`_
`( * ) Notice:
`
`_
`_
`_
`_
`SubJect to any disclaimer, the term of this
`patent is extended or adjusted under 35
`USC 154(b) by 0 days,
`
`(21) AppL NO‘: 09/330,101
`
`Stevens Institute of Technology, Spring 1999 Final Report,
`pp 1_12_
`
`Kenji Yoneda, et al. (Dec., 1997) “Multi—Objective Elevator
`Supervisory—Control System With Individual Floor—Situa
`tion Control,” Hitachi RevieW, p. 1.
`
`(22) Filed?
`
`Jun- 10! 1999
`
`* cited by examiner
`
`(51) Int. Cl.7 .............................................. .. G10L 15/22
`(52) US. Cl. ..................... .. 704/275; 704/246; 704/251;
`_
`187/396
`(58) Field of Search ............................... .. 704/251, 246,
`704/271, 272, 273, 275; 187/384, 392,
`396
`
`(56)
`
`References Cited
`
`,
`
`,
`
`Sll]1 e a.
`
`Us PATENT DOCUMENTS
`4,534,056 A * 8/1985 Fe?chenfeld et a1_ _____ __ 704/272
`4,577,177 A
`3/1986 Marubashi
`4,708,224 A * 11/1987 schrooder _________________ __ 187/388
`4,749,062 A
`6/1988 Tsujietal.
`4,979,593 A 12/1990 Wetanabe et a1-
`4,995,479 A
`2/1991 Fullwara et a1~
`11:
`1g;
`¥°n§dat 6: 91'
`5,200,583 A * 4/1993 Kupersmith et al. ...... .. 187/384
`5,255,341 A 10/1993 Nakajima
`5,287,266 A
`2/1994 Malec et aL
`5,295,064 A
`3/1994 Malec et a1_
`5,485,897 A
`1/1996 Matsumoto et al.
`5,551,532 A
`9/1996 Kupersmith
`5,606,154 A
`2/1997 Dolgan et 31-
`2 * 1;;
`ii’nmaot
`~~~~~~~~~~~~~~~~~~ ~~ 187/384
`5 955 710 A * 9/1999 DiFranZa ~~~~~~~~~~~~~~~~~~ u 187/396
`6’O73’727 A * 6/2000 DiFranZa et a1‘ _
`187/396
`6’082’500 A * 7/2OOO AInO et aL _____ __
`187/391
`6j202j008 B1 * 3/2001 Beckert et al.
`701/33
`6,206,142 B1 * 3/2001 Meacham ....... ..
`187/392
`6,223,160 B1 * 4/2001 Kostka et al. ............ .. 704/275
`
`7
`
`7
`
`0 e a .
`
`OTHER PUBLICATIONS
`
`D. K. Kahaner (Mar. 16, 1991) “Hitachi 1991 Technology
`Exhibition, Tokyo,” Asian Technology Information Pro
`gram, pp. 1—14.
`
`Primary Examiner_Danie1 Abebe
`(74) Attorney, Agent, or Firm—GaZdZinski & Associates
`
`(57)
`
`ABSTRACT
`
`.
`
`.
`
`_
`
`An information and control s stem for ersonnel trans ort
`Y
`P
`P
`devices. In one embodiment, the information and control
`system is coupled to the elevator system of a building, and
`includes a touch panel input device, a ?at panel display
`havtigig a touch sensitive screen,h and speech recorlgtrliition ang
`syn esis sys ems serving eac e eva or car.
`e speec
`recognition and synthesis systems and input device(s) are
`operatively coupled to a processor and storage devices
`having a plurality of different types of data stored thereon.
`Each elevator car is also a client connected to a LAN, WAN,
`intranet, or Internet, and capable of exchanging data With
`t‘nfd remf'vmg ‘21am ther‘i'from' Fullcnlotas Performed by thg
`in ormation an contro system incu e a voice-actuate
`building‘ directory, doWnload of selected data to personal
`electronic devices (PEI'Ds), monitoring of areas adJacent to
`the elevator car on destination ?oors, and control of lighting
`and security monitoring in selectable areas of destination
`?oors. The system is also optionally ?tted With an RFID
`interrogator/reader capable of recogniZing RFID tags carried
`by passengers on the elevator, thereby granting access to
`various controlled locations automatically after passWord
`authentication. The RFID systemalso alloWs the authenti
`?agcpasirlgedstg Control utltllmesd S11<;h 4S hg?htlng ?lld
`Wit in speci cZones ont eir estination oors.
`e
`information and control system is also optionally equipped
`With an occupancy estimating sub-system Which alloWs
`elevator cars to bypass calling ?oors When their capacity is
`reached or exceeded.
`
`~
`
`25 Claims, 24 Drawing Sheets
`
`\‘IDEO 5r
`LIGHTING
`CONTROL (‘151'
`
`12.‘
`‘
`
`El ,FVATOR
`CONTROL
`CIRCUIT
`
`TOIFROVI
`c .
`AI
`EVTR .
`SERVER
`(1101
`
`SPEECH
`SY‘ITII'ESIS
`MODULE
`
`IIZ
`
`STORAGE
`DI:\'ICE
`
`1
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 1 0f 24
`
`US 6,615,175 B1
`
`s5 _1 ....................................... -.
`
`
`EHZMU A240 * I
`
`mmzam " 3/ 5S
`3658 AIIIV 25 E A E
`
`_ 2g ........................... l -
`
`meg/Em _ I. m / mommmco? m
`526 m 0: m
`SE28 AIIIT 01 P6 ms) #2
`
`5: n J m \
`
`
`
`i m ...... -.<.-."
`
`Q 05> m
`
`as A9548 (6 M
`
`
`
`m: 89> W
`
`wzimoi /(|\\ m
`
`m. .... -- x75
`
`
`
`
`
`woT\) mU/EOHw :UmmEm
`
`H .GE
`
`
`
`SEE WEEEM v
`3:82
`
`NF
`
`2
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 2 0f 24
`
`US 6,615,175 B1
`
`3
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 3 0f 24
`
`US 6,615,175 B1
`
`HQ
`
`kmzmmté
`
`O2? m 52ml
`
`gm)‘
`
`Nam
`
`EH”
`
`9:8 “2
`
`Q22
`
`m .GE
`
`232 H2
`
`4
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 4 0f 24
`
`US 6,615,175 B1
`
`USER SELECT
`"BUILDING DIRECTOR "
`FUNCTION KEY
`
`SYSTEM
`PROGRAMMED
`FOR AUDIO
`OR VISUAL
`PRQNPT
`
`RETRIEVE CELP FILE
`
`'
`
`-
`
`SYNTHESIZE
`VOICE PROMPT
`("NAME")
`I
`
`>
`
`.
`.
`USER
`AUDIO INPUT,
`
`CALCULATE
`CONT. RATING
`
`V
`SAMPLE VOICE
`AND DIGITIZE
`Y
`RETRIEVE BLDG.
`DIRECTORI Y FILES
`
`,
`
`RETRIEVE BUILDING
`
`DIRECTORY FILE
`
`I
`DISPLAY DIRECTORY
`FILE ON DISPLAY
`DEVICE
`
`=1
`
`'
`
`A
`
`INPUT DEVICE
`
`V
`LOCATE & RETRIEVE
`GRAPHIC FILE
`FOR SELECTED ENTRY
`1
`YES DISPLAY GRAPHIC FILE
`
`COMPARE SAMPLED
`VOICE WITH DIRECTORY
`FILE
`
`FLOOR
`SELECTED
`7
`
`YES
`
`CONT
`'
`REPS
`,
`-
`
`NO
`
`I
`
`V
`
`=
`
`4*
`
`F
`SYNTHESIZE PROMPT
`L
`
`4f\
`A
`
`I
`
`SAMPLE
`
`NO
`
`FILE
`?
`YES
`
`F
`GENERATE SEQUENCE
`LIST OF MATCHES
`i
`SYNTHESIZE NEXT PROMPT
`BASED ON MATCHES
`
`USER INPUT
`
`SYNTHESIZE PROMPT
`
`ili/gggg NO
`
`5
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 5 0f 24
`
`US 6,615,175 B1
`
`\ \ Sm
`
`m x u
`
`n w m u
`
`8m M du M
`
`
`m 2528 um? / ,H H T
`
`M/:::\“ @ /.\ om:
`
`/ lx?mwimw. H A, \ /k\
`
`92/ h . . . ................................ -
`
`/,.( \\II§
`
`
`
`\\:_:/// \ ,lfrlTIwl HIZEES \ \ __ __ / ,i/ u 5
`
`m 11 W 1
`M QEEE m zwwlal?
`
`m .Uwm
`
`\
`
`AH
`
`6
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 6 of 24
`
`US 6,615,175 B1
`
`,i¢DmDmm
`
`moomEva<2M567:mzofiQg<5z<za
`
`so
`
`3ADE
`
`7
`
`
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 7 0f 24
`
`US 6,615,175 B1
`
`woo \/
`
`
`
`kumimw QB mh?lm EUDOH
`
`8
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 8 of 24
`
`US 6,615,175 B1
`
`m:
`
`2mzaBE5mza
`
`
`
` zmzasmzagwmzaE§anDEBmmamayZOEE04E04E04E04Sem2omQmmEQ
`
`OHEnemaOHzmpemmmzfia
`
`.2:<3$2magmmmima
`
`0%
`
`3GE
`
`
`
`mmizmaA<,_Lm<OUcomaz<m
`
`
`
`
`
`9
`
`
`
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 9 of 24
`
`US 6,615,175 B1
`
`Q<OAZ>>OQ
`
`412
`
`\\\\\
`
`SH
`
`
`
`
`
`ofiszaomQ<Ou_Z>>OQQ<O1_Z2/OD
`
`B.05
`
`MEdoammmE<mBmamz
`
`10
`
`10
`
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 10 of 24
`
`US 6,615,175 B1
`
`aw
`
`Q3
`
`moon
`
`momzmm
`
`405200
`.955Em
`
`caeumimmmommmuomm
`
`.56IombaI:
`
`COUNTER
`
`m;E
`
`3
`
`v5
`
`N;
`
`Eg
`
`.2;AMHMwowWWAEwow1W,.i----.,.o.w
`......
`
`QQUfHT......AMEmgmM
`
`11
`
`
`
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 11 0f 24
`
`US 6,615,175 B1
`
`55
`
`FIG. 9
`
`12
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 12 0f 24
`
`US 6,615,175 B1
`
`V
`A%?,¥§§§¥ #1131155
`
`ANY
`PAIR MEMBER
`<THRESHOLD
`
`'
`
`SET OMAXC
`=0MAXU
`
`COMPUTE
`V
`APPLY
`CORRECTION
`TO OMAXU
`OMAXC
`
`V
`OBTAIN SIGNAL
`FROMIEACH SENSOR
`V
`COUNT # OF
`NON-ZERO OUTPUTS
`OMAXU
`
`N
`
`Y
`
`SUM ALL NON-ZERO
`OUTPUTS
`V
`INTEGRATE OVER 2
`V
`
`VOE
`OBTAIN # OF FLOORS V
`SELECTED IN CAR
`OMINP
`
`VOE
`OMINS V V
`COMPARE OE, OMINP,
`OMINS, & OMAXC
`AND CHOOSE LARGEST
`
`GENERATE
`BYPASS CONTROL
`SIGNAL
`
`FIG. 10
`
`13
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 13 of 24
`
`US 6,615,175 B1
`
`3:O:
`
`89>
`
`E-mmzam
`
`3:3:
`
`ow:ZOFOEmEmsumm
`
`Sfl
`
`NaCE
`
`E
`
`NS
`
`E:
`
`ma§m>o89>:2:
`
`
`
`30memo:Efiomm8:
`
`14
`
`14
`
`
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 14 0f 24
`
`US 6,615,175 B1
`
`2 .GE
`
`22
`
`522
`amt/50mm
`
`z/
`
`QDQOE
`
`mmmT/l
`amt/ED
`95$
`
`HMO
`
`_
`
`m2?
`55%5
`
`15
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 15 0f 24
`
`US 6,615,175 B1
`
`s:
`
`
`
`@:)\ Emmi
`
`X $23
`\\\ @mzoN m mmzoN / .......................................................... x .... :\ 5Z8 / x / , _ _ ~\ \
`1 § \ \\\\\
`m:/\\) m \\
`\\\\\\.\\\\\\\\ /
`@mzoN " .............. -.\
`
`$23 \\ _
`
`
`
`
`
`~28‘ mmmzaz mood
`
`El .UE
`
`16
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 16 0f 24
`
`US 6,615,175 B1
`
`
`
`//\\ 252
`
`17
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 17 0f 24
`
`US 6,615,175 B1
`
`\ SE28
`8: l_ _ k
`
`$22 mix
`
`5:
`
`
`
`063 1|!
`
`3 3.
`\\ f 22 5
`
`" mmmuu< "
`
`mamcamméur ..... a
`
`mmza “ ....... \
`............ - ._ X \ -‘
`
`
`
`62/ 54mm
`
`18
`
`

`
`U.S. Patent
`
`Sep. 2,
`2003
`
`Sheet 18 0f 24
`
`US 6,615,175 B1
`
`READER
`ACCESS
`PASSWORD
`FILE
`OF DATABASE
`
`PASSWORD N
`
`GENERATE
`CONTROL
`SIGNAL REMOVING
`BLOCK FROM
`AUTHORIZED FLOORS
`V
`ENABLE UTILITY
`FUNCTION KEYS
`*
`USER SELECT
`DESIRED FUNCTIONS
`
`V
`
`DISPLAY
`"INCORRECT
`PASSWORD"
`WARNING
`
`@)
`
`USER ENTER
`ELEVATOR CAR
`V
`READER
`ACTIVATE
`V
`READER INTERROGATE
`RFID TAG
`V
`RFID TAG DECRYPT
`READER EMISSION
`
`READER
`AUTHENTICATED
`?
`
`TAG EMIT RFID
`SIGNAL
`V
`READER DECRYPT
`RFID EMISSION
`V
`READER ACCESS
`DATABASE
`
`ACCESS
`AUTHORIZED
`?
`
`READER ENABLE
`INPUT DEVICE
`
`USER ENTER PASSWORD
`
`FIG. 16
`
`TAG XMIT
`"NOT
`RECOGNIZED"
`WARNING
`
`DEACTIVATE
`READER
`
`V
`T
`I
`
`LOG DATA
`IN DATABASE
`
`DISPLAY
`"NOT
`AUTHORIZED"
`WARNING
`
`19
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 19 0f 24
`
`US 6,615,175 B1
`
`32k
`
`v m N
`
`w q H _|
`
`| l | A
`
`
`2E 35 @256: wzimui @ _ _
`
`died 55% $530 \ 55%
`
`w
`
`sT/v
`
`
`
`@: \/\ Em; (\
`
`. . . 55mm 8:
`
`\
`
`2:
`
`(32
`
`20
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 20 of 24
`
`US 6,615,175 B1
`
`
`
`PARSE IMAGE
`vATAADDREss
`FROM ALL
`
`S5%’cL&?§E1E%§*
`
`
`
`
`RETRIEVE ALL
`IMAGE DATA
`
`SET
`
`
`
`CONVERT
`SAMPLED
`SPEECH To
`
`DIGITAL FORMAT
`
`
`
`
`
`
`COMPARE
`SAMPLED
`SPEECH TO
` LIBRARY
`
`ALLOCATE ONE
`IMAGE DATA
`FILE TO EACH DISPL.
`
`
`
`AMBIGUITY FLAG
`
` MATCH
`ANY LIBRARY
`WO)RD
`
`
`
`
`IDENTIFY
`
`SUB—FILE(S)
`
`--——-———--(---------—
`
`SUB FILE
`MATCH
`PREVIOUS
`SUB—FILE(S)
`7
`
`
`
`
`
`PARSE IMAGE/
`AUDIO FILE
`ADDRESS(ES)
`
`
`
`
`
`
`IMAGE
`OR AUDIO
`DATA
`CURRENTLY
`IN USE
`7
`
`
`
`
`RETRIEVE
`IMAGE/AUDIO
`FILES
`
`DIS PLAY/PLAY
`
`RETRIEVED
`
`DATA ON
`ALL DISPLAYS
`
`FOR PREDETERMINED
`
`PERIOD
`
`
`
`FIG. 18a
`
`21
`
`21
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 21 of 24
`
`US 6,615,175 B1
`
`Sufi
`
`mo<§
`
`mmmm
`DQ<
`
`3
`mH
`
`mam
`
`<H<Qmsimzm
`
`£3.05
`
`2%
`
`22
`
`22
`
`
`
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 22 of 24
`
`US 6,615,175 B1
`
`START
`
`NEW CALL
`
`
`
`
`
` SIGNAI; REC'D
`
`
`
`
`
`
`
`SELECTED
`
`BY OCCUPANTS
`OF CAR
`?
`
` OTHER
`CALL SIGNALS
`
`PRESENT
`')
`
`
`
`SELECTED
`BY CAR OCCUP.
`‘.7
`
`
`
`
`
`OTHER
`CALL SIGNAL
`PRESENT
`?
`
` N
`
`
`
`DETERMINE DIRECTION
`OF TRAVEL
`
`DETERMINE
`DIRECTION
`
`
`
`ORDER CALL SIGNALS
`BASED ON DIRECTION
`
`
`
`PA]§1§}3A}D
`
`RETRIEVE
`IMAGE/AUDIO
`DATA FOR ID
`
`
`DISPLAY/PLAY
`RETRIEVED
`
`DATA
`
`
`
`? TIME 2
`
`PRESET VALUE
`
`?
`
`
`
`ACCESS BLDG. DIRECTORY
`FOR NEXT FLOOR RUN TENANT
`SELECTION
`ROUTINE
`
`MULTIPLE
`TENANTS ON
`FLOOR
`‘.7
`
`
`
`FIG. 180
`
`23
`
`FLOOR
`REACHED
`
`23
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 23 of 24
`
`US 6,615,175 B1
`
`START
`
`
`
`
`RETRIEVE
`STATISTIC
`
`
`FILES FOR
`
`
`ALL K SUB -FILES
`
`
`
`
`RETRIEVE
`
`
`
`HISTORICAL
`
`
`
`DISPLAY FILES FOR
`ALL K SUB-FILES
`
`
`
`
`
`
`
`
`
`COMPARE
`HISTORICAL
`DISPLAY FILE
`DISTRIBUTION TO
`STATISTICAL FILES
`DISTRIB.
`
`
`
`
`
`
`
`
`
`SELECT
`SUB -FILE WITH
`LARGEST A
`
`
`
`
`
`RETRIEVE DATA
`FILE FOR SUB-FILE
`WITH LARGEST A
`
`DISPLAY DATA
`FILE
`
`
`
`
`
`
`UPDATE HISTORICAL
`DISPLAY FILE FOR
`FILE DISPLAYED
`
`WAIT PREDET.
`PERIOD
`
`
`
`
`
`
`
`
`INCREMENT
`SINCE LAST
`COMPARISON
`?
`
`
`
`
`
`PARSE SUB-FILE
`ID
`
`RETRIEVE
`SUB —FILE
`STATISTIC FILE
`
`INCREMENT
`STATISTIC
`FILE BY ONE
`
`STORE
`STATISTIC
`FILE
`
`WAIT PRESET
`PERIOD
`
`SAMPLE
`SPEECH
`
`CONVERT
`TO DIGITAL
`
`T8()L1}’{3P1@f1‘§Y
`
`MATCH
`WORD
`‘.7
`
`FIG. 18d
`
`24
`
`24
`
`

`
`U.S. Patent
`
`Sep. 2, 2003
`
`Sheet 24 of 24
`
`US 6,615,175 B1
`
`
`
`USER SELECT DEDICATED
`FUNCTION KEY OR TOUCH
`
`SCREEN FUNCTION KEY
`
`PROCESSOR GENERATE
`ID CODE FOR
`SELECTED FUNCTION
`
`
`
`
`
`
`
`
`PROCESSOR RETRIEVE
`STORED "TAG" FILE FOR
`
`ADVERTISING SUB—FILES
`
`
`
`
`
`
`
`
`COMPARE GENERATED
`ID CODE TO TAG
`ASSOCIATED WITH ONE
`
`(OR MORE) SUB -FILES
`
`
`
`
`PROCESSOR SEQUENCE
`TAGS
`
`
`
`PROCESSOR RETRIEVE
`DATA FILE FOR nTH
`SUB-FILE IN SEQUENCE
`
`
`
`DISPLAY nTH
`SUB -FILE DATA FILE
`
`WAIT PREDETERMINED
`PERIOD
`
`
`
`LAST
`TAG FILE
`DISPLAYED
`
`N
`
`9 .
`
`
`
`
`
`INCREMENT 11:
`n=n+1
`
`FIG. 19
`
`25
`
`25
`
`

`
`US 6,615,175 B1
`
`1
`“SMART” ELEVATOR SYSTEM AND
`METHOD
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`
`The present invention relates to the field of personnel
`transport apparatus, and specifically to elevators and similar
`devices for transporting people from one location to another
`which incorporate various information technologies.
`2. Description of Related Technology
`Elevators and similar personnel transport devices (such as
`moving walkways or shuttles) are important aspects of
`modern urban life. Commonly used in office buildings,
`airports, shopping malls, and other large structures, these
`devices transport large numbers of people and equipment
`between two locations on a routine basis. Elevators in
`
`particular are widely used throughout the world.
`Depending on loading, a person may spend up to several
`minutes on an elevator during travel between floors. Sig-
`nificant amounts of time may also be spent waiting for the
`elevator to arrive when called. This time is usually “dead”
`from the standpoint that very little can be accomplished or
`very few tasks undertaken during these few minutes.
`However, often times an individual may require information
`which will be of use after leaving the elevator. For example,
`the person may wish to obtain travel information such as
`directions to the nearest airport or public transportation
`node, or the location of a nearby restaurant. Weather-related
`information or traffic reports may also be useful. A plethora
`of different types of information, including financial data,
`breaking news headlines, sports scores and the like may also
`be of interest to one waiting for or riding on an elevator or
`other transport device.
`An associated problem relates to determining the location
`of a person, firm, or store within a building when unfamiliar.
`Building directories are often posted in the lobby of the
`building, yet these require the user to manually or visually
`locate the name of the person, firm, or store which they are
`looking for, and remember the location information associ-
`ated therewith. Additionally, such directories often do not
`provide precise location information, but rather merely a
`floor number and/or suite number. The user often times does
`not have a graphical representation of the desired location in
`relation to the elevators,
`thereby resulting in additional
`wasted time in finding the location once off of the elevator.
`Even if a graphical display is provided, it often requires the
`user to spatially orient
`themselves to determine relative
`location.
`
`Security is also a concern when riding elevators late at
`night or to remote locations. Many elevator systems are used
`partly or entirely within parking garages, which often may
`be sparsely populated at off hours. People are all
`too
`frequently assaulted or robbed when departing from eleva-
`tors under such conditions. Unfortunately, existing elevator
`systems do not have the facility to provide the occupant(s)
`with the ability to selectively observe the area immediately
`surrounding the elevator doors on one or more destination
`floors, or otherwise take precautions to enhance their secu-
`rity.
`Another problem associated with existing elevator sys-
`tems relates to their loading capacity. Often, especially at
`peak use hours such as during the noon hour, the call buttons
`for several different floors within a building will be
`activated, and elevator cars which are at or near their loading
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`capacity will respond. With no additional room available in
`the elevator, the person depressing the call button on a given
`floor is left to wait for the elevator doors to close, depress the
`call button again, and wait for another (hopefully partially
`vacant) car to arrive. This process not only delays the person
`waiting for the car, but also those on the elevator car(s), and
`those waiting on other floors.
`In addition to the foregoing, many elevators must have a
`means of restricting access to certain floors during certain
`time periods while not interfering with other operations.
`These elevators generally also include means by which
`certain users may gain access to the restricted floors, such as
`a magnetic striped card which is inserted into a card reader
`on the elevator. However, such card readers are prone to
`wear and having to re-swipe the card several times in order
`to obtain access. Furthermore, as the card wears due to
`repeated swiping or bending (such as when left in the pocket
`of the individual carrying the card), the card will be more
`prone to failure and will eventually require replacement.
`Also, such cards are prone to unauthorized use. Someone
`stealing or finding the lost card can simply insert it into the
`card reader of the elevator and gain access to the restricted
`floor(s). It is also noted that since access is restricted to
`certain floors typically during late-night or weekend hours,
`HVAC and lighting systems are typically turned off or
`dormant in order to conserve energy. Hence, when the user
`arrives at one of these restricted access floors, several
`minutes are typically spent turning on the HVAC, lights, and
`any other number of electrical devices. Some systems
`require the user to insert their magnetic strip card in a
`separate reader, such as in the control room for the HVAC
`(which is typically located on a different floor), in order to
`initiate equipment operation. This is obviously time con-
`suming and cumbersome.
`Lastly, there is often an element of discomfort associated
`with riding an elevator car, especially when several indi-
`viduals are present in the car. Due in part to minimal space
`within the car and nothing to occupy the occupants attention
`visually, there is a natural tendency for one to stare up,
`down, or forward at the door of the elevator, or at the visual
`floor indicators so as to avoid prolonged eye contact with the
`other occupants.
`Heretofore, many of the technologies necessary to address
`the aforementioned issues have not been available or,
`alternatively, have been cost or space prohibitive to imple-
`ment. However, recent advances in data networking, thin or
`flat panel display technology, personal electronics, and
`speech recognition and compression algorithms and pro-
`cessing have enhanced the viability of such features from
`both technological and commercial perspectives.
`Based on the foregoing, there is a need for an improved
`elevator system and method of operation which will reduce
`the time spent waiting for and travelling on the elevator car,
`reduce the frustration associated with repeated stops at
`different floors, and allow the occupants of the elevator (as
`well as those waiting for the car) to use their time more
`efficiently and obtain needed information. Additionally, such
`an elevator system would enhance the security of the occu-
`pants upon egress, and allow for automatic recognition of an
`individual in order to provide access to certain restricted
`locations and initiation of certain functions such as lighting
`and HVAC.
`
`SUMMARY OF THE INVENTION
`
`The present invention satisfies the aforementioned needs
`by providing an improved elevator information and control
`system and method of operating the same
`
`26
`
`26
`
`

`
`US 6,615,175 B1
`
`3
`invention provides an
`the present
`In a first aspect,
`improved elevator information and control system which
`enables an user to rapidly locate a desired firm or individual.
`In a first embodiment, the system includes an interactive
`building directory having a speech recognition system and
`other input device such as a touch pad. The user utilizes the
`input device to activate the system, and then speaks the
`name of the firm or individual whose location is desired. A
`speech generation algorithm and processor generates speech
`(and/or a graphical representation via a minimum profile fiat
`panel display) based on data retrieved from a database per
`the user’s request. The user is also prompted to determine if
`they desire to select the floor of the firm or individual that
`they were trying to locate. The user then may use the speech
`recognition system, or alternatively the aforementioned
`input device, to respond. The database also maintains data
`on other nearby buildings in case the user is at the wrong
`location.
`
`In a second aspect of the invention, the information and
`control system further includes a network interface that is
`coupled to the aforementioned input and display devices. In
`one embodiment,
`the network (e.g., Internet) interface is
`configured to provide rapid access to a variety of web sites
`or URLs of interest, such as those providing local weather,
`directions from the elevator to local points of interest, stock
`market quotations, breaking news headlines, etc. Preset
`functions are provided which enable the user to access,
`download, and display the desired information with a single
`actuation of the input device. Aplurality of different input/
`display devices are disposed within the smart elevator to
`allow multiple occupants to obtain information simulta-
`neously.
`the smart elevator
`In a third aspect of the invention,
`includes one or more data terminals which are compatible
`with personal electronic devices (PEDs) so as to allow an
`occupant of the elevator to download a predetermined or
`adaptively determined “package” of data for later retrieval
`or use. Such data may include news, weather, financial data,
`listings of building tenants, firm resumes, parking rates,
`hours of operation, and the like. In one embodiment, the
`download of data is initiated automatically upon the inser-
`tion of the PED into the data terminal, thereby reducing the
`time necessary to download to a minimum.
`In a fourth aspect of the invention, the information and
`control system includes a sensor array and logic which
`detects the loading of the elevator car and selectively
`bypasses floors when the car’s capacity is met, unless the
`floor is selected by one of the occupants of the car. In one
`embodiment, the flooring of the elevator car is equipped
`with piezoelectric sensors that generate signals based on the
`pressure applied to them. This pressure is correlated to the
`weight and location of the occupants in the car, and with the
`number of different floors selected, to derive an estimate of
`the occupancy. When the capacity of the elevator is reached
`as determined by this estimate, any subsequent call signals
`received by the system are routed to another available car.
`In a fifth aspect of the invention,
`the aforementioned
`display device within the car may be configured to provide
`a video display of the area immediately surrounding access
`to the elevator on certain floors, such as parking garages.
`The user can over-ride the car stopping at that floor if
`desired, contact security, and/or initiate temporary addi-
`tional lighting in the area via a series of fixed or “soft”
`function keys. A motion sensor is also optionally used to
`provide the elevator user with information regarding the
`presence of moving objects in areas adjacent to but out of
`view of the video units. When accessing a parking garage or
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`structure, the user may also input the location of their car
`using additional function keys; lighting and security moni-
`toring of the path between the elevator and the car is then
`initiated to enhance user safety.
`In a sixth aspect of the invention, an RFID tag and reader
`system is employed to uniquely identify occupants and
`provide them access to certain floors. RFID monitors with
`limited ranges are placed in certain locations near the
`elevator access points. These monitors interrogate the RFID
`tags and initiate a call signal for specific floor during
`after-hours operation. The user is then required to authen-
`ticate via a password input via the input device located
`inside elevator. The elevator system can optionally notify
`security (and/or the destination floor) of the individual’s
`destination and identity, and maintain a record of access. The
`user may also optionally perform other functions such as
`lighting and environmental control from the elevator. The
`user’s RFID tag may also be programmed to interface with
`the aforementioned PED data download device such that the
`
`tag pre-configures the system for download.
`In an seventh aspect of the invention, the aforementioned
`display devices and information and control system are
`programmed to provide adaptive advertising or information
`display. In one embodiment, the speech recognition system
`previously described is used to select and display informa-
`tion based on one or more parameters including statistical or
`anecdotal sampling of the speech patterns of the occupants.
`Alternatively, information entered via the aforementioned
`input device (and network interface) may be used as a
`determinant in the adaptive advertising system.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a block diagram of one embodiment of the
`information and control system of the invention, showing
`those components local to each elevator car.
`FIG. 2 is a plan view of a first embodiment of the interface
`panel of the information and control system of FIG. 1,
`including the touch keypad and the display device.
`FIG. 3 is a block diagram of one embodiment of the
`information and control system network architecture.
`FIG. 4 is a logic diagram illustrating the operation of one
`embodiment of the building directory sub-system of the
`invention.
`
`FIG. 5 is a plan view of one embodiment of a building
`directory sub-system graphic location file, as shown on the
`display device of the information and control system.
`FIG. 6a is a plan view of one embodiment of a network
`input device having dedicated function keys thereon.
`FIGS. 6b and 6c illustrate one embodiment of an exem-
`
`plary coordinated graphic weather display according to the
`present invention.
`FIG. 7 is a plan view of one embodiment of the PED data
`download terminal of the invention.
`
`FIG. 8 is a block diagram of one embodiment of the
`capacity sensing sub-system according to the present inven-
`tion.
`
`FIG. 9 is a plan view of one embodiment of the elevator
`floor sensor array used in conjunction with the capacity
`sensing sub-system of FIG. 8.
`FIG. 10 is a logic diagram illustrating the method of
`operation of the capacity sensing sub-system of FIG. 8.
`FIG. 11 is a block diagram illustrating one embodiment of
`the monitoring and security sub-system of the present inven-
`tion.
`
`27
`
`27
`
`

`
`US 6,615,175 B1
`
`5
`FIG. 12 illustrates one embodiment of the elevator car
`
`touch panel used in conjunction with the monitoring and
`security sub-system of FIG. 11.
`FIG. 13 is a block diagram of a second embodiment of the
`monitoring and security sub-system of the present invention.
`FIGS. 14a and 14b are plan views of one embodiment of
`the parking and video monitoring displays, respectively, of
`the monitoring and security sub-system of FIG. 11.
`FIG. 15 is a block diagram illustrating one embodiment of
`the identification and access sub-system of the present
`invention.
`
`FIG. 16 is a logic diagram illustrating the operation of the
`identification and access sub-system of FIG. 15.
`FIG. 17 is a plan view of one embodiment of a utility
`services selection display associated with the identification
`and access sub-system of FIG. 15.
`FIG. 18a is a logic diagram illustrating the operation of a
`first embodiment of the prompt mode of the adaptive adver-
`tising sub-system of the invention.
`FIG. 18b illustrates the library data file structure used in
`conjunction with the advertising sub-system of the inven-
`tion.
`
`10
`
`15
`
`20
`
`FIG. 186 is a logic diagram illustrating the operation of a
`second embodiment of the advertising sub-system of the
`invention.
`
`25
`
`FIG. 18d is a logic diagram illustrating the operation of a
`third embodiment of the adaptive advertising sub-system of
`the invention.
`
`FIG. 19 is a logic diagram illustrating the operation of a
`fourth embodiment of the adaptive advertising sub-system
`of the invention.
`
`DESCRIPTION OF THE INVENTION
`
`Reference is now made to the drawings listed above,
`wherein like numerals refer to like parts throughout.
`It
`is noted that while the system and methods of the
`invention disclosed herein are described primarily with
`respect to an elevator car, certain aspects of the invention
`may be useful
`in other applications,
`including, without
`limitation, other types of personnel transport devices such as
`trams or shuttles or moving walkways, or stationary devices
`such as kiosks within the lobby or elevator waiting areas of
`a building. As used herein, the term “building” is meant to
`encompass any structure, whether above ground or
`underground, permanent or temporary, used for any func-
`tion.
`
`General Description
`Referring now to FIGS. 1 and 2, one embodiment of an
`improved elevator information system is generally
`described. As shown in FIG. 1, the system 100 includes an
`input device 102, speech recognition (SR) module 104,
`central processor 106 with associated motherboard 121,
`video RAM 107, non-volatile storage device 108 containing
`a database (not shown), graphics co-processor 109, volatile
`or dynamic storage device 110 with associated DMA module
`139, audio amplifier and speaker module 111, speech syn-
`thesis module 112, micro-controller 123, PCI slots 147, and
`display device 113. The system also includes a serial bus
`with universal asynchronous receiver transmitter (UART)
`117 or alternatively universal serial bus (USB), as described
`in greater detail below with respect to FIG. 7. As shown in
`FIG. 2, the input device 102 of the present embodiment is a
`touch-sensitive keypad and/or display screen of the type
`well known in the electrical arts. The input device 102
`includes a variety of different functional keys 114 on a
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`
`keypad 116 (and/or on a touch-sensitive display screen 113,
`as described below) which allow the user to initiate a query
`of the database either manually via the keypad 116, display
`device 113, or audibly through the speech recognition mod-
`ule 104.
`
`As shown in FIG. 1, the speech recognition module 104
`of the present invention includes a high quality, high SNR
`audio microphone 118, analog-to-digital converter (ADC)
`141, and linear predictive coding (LPC)-based spectral
`analysis algorithm run on a digital signal processor 125
`having associated SR module RAM 127. It will be recog-
`nized that other forms of spectral analysis, such as MFCC
`(Mel Frequency Cepstral Coefficients) or cochlea modeling,
`may be used. Phoneme/word recognition in the present
`embodiment is based on HMM (hidden Markov modeling),
`although other processes such as, without limitation, DTW
`(Dynamic Time Warping) or NNs (Neural Networks) may be
`used. Myriad speech recognition systems and algorithms are
`available, all considered within the scope of the invention
`disclosed herein.
`
`In the present embodiment, CELP-based voice data com-
`pression is also utilized for transmission and storage of voice
`data. CELP algorithms in general are useful for converting
`analog speech to a compressed digital format which is more
`rapidly and easily manipulated and stored within a digital
`system using less bandwidth and memory. CELP algorithms
`and low bit rate vocoder technology are well known in the
`signal processing art, and accordingly will not be described
`further herein. Note that as used herein, the term CELP is
`meant to include any and all variants of the CELP family
`such as, but not limited to, ACELP, VCELP, and QCELP. It
`is also noted that while CELP is used as the basis of
`
`compression within the system 100, other types of compres-
`sion algorithms and techniques, whether based on compand-
`ing or otherwise, may be used. For example, PCM (pulse
`code modulation) or ADPCM (adaptive delta PCM) may be
`employed, as may other forms of linear predictive coding
`(LPC).
`As illustrated in FIG. 1, signals generated by the micro-
`phone 118 are digitized by the ADC 141 and processed using
`the aforementioned speech recognition algorithm and the
`DSP 125 to produce digital representations of the user’s
`speech. The speech library or dictionary stored within the
`SR module memory 127 is used by the DSP 125 to match
`phenome strings resulting from the LPC analysis with
`known words. Once a “match” is identified,
`the central
`processor 106 and/or micro-controller 123 implement the
`desired functionality, such as re