United States Patent
`Nishiumi et al.
`
`[19]
`
`US005903257A
`Patent Number:
`Date of Patent:
`
`[11]
`[45]
`
`5,903,257
`May 11, 1999
`
`[54] OPERATING DEVICE AND IMAGE
`PROCESSING SYSTEM USING SAME
`
`[75] Inventors: Satoshi Nishiumi; Kazuo Koshima;
`Mitsunori Yamada, all of Kyoto, Japan
`
`[73] Assignee: Nintendo Co., Ltd., Kyoto, Japan
`[21] Appl. No.:
`08/836,787
`[22] PCT Filed:
`Oct. 9, 1996
`
`[86] PCT No.:
`PCT/JP96/02932
`§ 371 Date:
`May 16, 1997
`§ 102(e) Date: May 16, 1997
`
`[87] PCT Pub. No.: WO97/14089
`
`PCT Pub. Date: Apr. 17, 1997
`Foreign Application Priority Data
`
`[30]
`
`Oct. 9, 1995
`Jun. 13, 1996
`
`[JP]
`[JP]
`
`Japan .................................. .. 7-288006
`Japan .................................. .. 8-176005
`
`[51]
`
`Int. Cl.6 ............................ .. G09G 5/00; G09G 5/08;
`A63F 9/22
`[52] US. Cl. ........................ .. 345/157; 345/156; 345/161;
`463/38; 463/44
`[58] Field of Search ................................... .. 345/156—162;
`463/36—47; 273/148 B
`
`OTHER PUBLICATIONS
`
`3D Ballz Instruction Booklet, Accolade, San Jose, Califor
`nia, #3050—00231 Rev. A 6 Photographs of Sony Play
`Station: 1) top case and compact disk; 2) hand controller; 3)
`internal circuit boards (top vieW); 4) internal circuit boards
`(top vieW); 5) compact disk reader (bottom vieW); and
`internal main circuit board (bottom vieW).
`Knuckles Chaotix Intruction Manual, SEGA, Redwood City,
`California, #84503 (1995).
`Nitendo Power, vol. 30, p. 22, PilotWings article.
`Nintendo Power, vol. 31, p. 35, PilotWings article.
`Nintendo Power, vol. 31, pp. 74—76, PilotWings article.
`Nintendo Power, vol. 38, p. 25, PilotWings article.
`Nintendo Power, vol. 46, PilotWings article.
`PilotWings Instruction Booklet, Super Nintendo Entertain
`ment System, SNS—PW—USA, copyright 1991.
`PilotWings, It’s a Festival of Flight, Top Secret PassWord
`Nintendo Playr’s Guide, pp. 82—83 and 160, copyright 1991.
`PilotWings, Soar with the Flight Club, Super Nintendo
`Entertainment System Play’s Guide, pp. 100—105, copyright
`1991.
`Sega Genesis 32X Instruction Manual, SEGA, Redwood
`City California, #672—2116 (1994).
`(List continued on neXt page.)
`
`Primary Examiner—Jeffery Brier
`Assistant Examiner—David L. LeWis
`Attorney, Agent, or Firm—NiXon & Vanderhye PC.
`
`[56]
`
`References Cited
`
`[57]
`
`ABSTRACT
`
`U.S. PATENT DOCUMENTS
`
`D. 316,879
`D. 317,946
`
`5/1991 Shulman et al. .
`7/1991 Tse .
`
`(List continued on neXt page.)
`
`FOREIGN PATENT DOCUMENTS
`
`268 419 5/1988 European Pat. Off. .
`O 470 615 2/1992 European Pat. Off. .
`553 532 8/1993 European Pat. Off. .
`685 246 12/1995 European Pat. Off. .
`724 220 7/1996 European Pat. Off. .
`4O 18 052 12/1990 Germany .
`
`An operating device is connected to an image processing
`apparatus that generates image data to be displayed on a
`display according to a program. The operating device sup
`plies a signal for varying the image data to be generated by
`the image processing apparatus. A joystick includes a lever
`and a disc interlocked thereWith, and the rotation of the disc
`is detected by a photo-interrupter. Pulses from the photo
`interrupter are counted by a resettable counter. A reset signal
`is supplied to the counter When three buttons are simulta
`neously depressed, When a poWer supply is turned on, or
`otherWise When a signal is received from a CPU of the image
`processing apparatus.
`
`(List continued on neXt page.)
`
`40 Claims, 28 Drawing Sheets
`
`PHVMCAL CMRDWATE nr mama
`
`msmv SCREEN
`
`,
`
`@l a
`
`SCEA Ex. 1004 Page 1
`
`

`

`5,903,257
`Page 2
`
`US. PATENT DOCUMENTS
`
`4/1995 W11 -
`D. 357,712
`D. 363,092 10/1995 Hung .
`D. 375,326 11/1996 Yokoi et al. .
`4,359,222 11/1982 Smith, III et al. .
`4,469,330
`9/1984 Asher -
`4,552,360 11/1985 Brompley et al. .
`4,587,510
`5/1986 Kim -
`4,659,313
`4/1987 Kuster et al. .
`4,748,441
`5/1988 Brzezinski .
`4,868,780
`9/1989 Stern -
`4,887,966 12/1989 Gellerman .
`4,924,216
`5/1990 Leung .
`4,933,670
`6/1990 Wislocki .
`4,974,192 11/1990 Face et al. .
`4,976,429 12/1990 Nagel.
`5,001,932
`3/1991 Hall-Tipping .
`5,012,230
`4/1991 Yasuda .
`5,046,739
`9/1991 Reichow .
`5,203,563
`4/1993 Loper, III .
`5,207,426
`5/1993 Inoue et al. .
`5,213,327
`5/1993 Kitaue .
`5,245,320
`9/1993 Bouton .
`. 273/148 B
`5,259,626 11/1993 H0
`5,286,024
`2/1994 Winblad ............................ .. 273/148 B
`5,290,034
`3/1994 Hineman .
`5,390,937
`2/1995 Sakaguchi et al. .
`5,436,640
`7/1995 Reeves .
`5,451,053
`9/1995 Garrido ............................. .. 273/148 B
`5,459,487 10/1995 Bouton ..... ..
`..
`5,473,325 12/1995 McAlindon ........................... .. 345/161
`5,515,044
`5/1996 Glatt.
`5,551,693
`9/1996 Goto et al. .
`5,563,629 10/1996 Caprara.
`5,593,350
`1/1997 Bouton et al. .
`5,607,157
`3/1997 Nagashima -
`5,615,083
`3/1997 Burnett -
`5,624,117
`4/1997 Ohkubo et al. .
`5,632,680
`5/1997 Chung ................................... .. 345/156
`
`5,640,177
`5,643,087
`5,649,862
`
`6/1997 Hsu . . . . . . . . .
`. . . .. 345/161
`7/1997 Marcus et al. .................... .. 273/148 B
`7/1997 Sakaguchi et al. ..................... .. 463/44
`
`5,653,637
`5,706,029
`1 4,870,389
`
`8/1997 Tai.
`1/1998 Tai_
`6/1997 Ishiwata et al. .
`
`FOREIGN PATENT DOCUMENTS
`50-22475
`3/1975 Japan _
`57-18236
`1/1982 Japan .
`
`1/1982 Japan -
`57-2084
`57-136217 8/1982 Japan .
`59-40258 3/1984 Japan .
`59-121500 7/1984 Japan .
`61-16641
`1/1986 Japan .
`61-198286 9/1986 Japan _
`61-185138 11/1986 Japan .
`62.269221 11/1987 Japan _
`2-41342 3/1990 Japan .
`2.68404 5/1990 Japan _
`3.16620
`1/1991 Japan _
`3-248215 11/1991 Japan .
`4.26432
`1/1992 Japan _
`4-20134 2/1992 Japan .
`4-42029
`2/1992 Japan .
`4-104893
`9/1992 Japan _
`4-29148 10/1992 Japan,
`5-100759
`4/1993 Japan _
`5-19925
`5/1993 Japan .
`5-177057 7/1993 Japan .
`5-241502 9/1993 Japan _
`6-23148 2/1994 Japan _
`6-54962 3/1994 Japan .
`6-68238 3/1994 Japan .
`6410602 4/1994 ]apan_
`6.114683
`4/1994 Japan _
`6-190145
`7/1994 Japan .
`6.190147 7/1994 Japan _
`6-205010 7/1994 Japan .
`6_285259 10/1994 Japan _
`6.315095 11/1994 Japan _
`7.104930 4/1995 ]apan_
`7-222865
`8/1995 Japan,
`7-288006 10/1995 Japan .
`7-317230 12/1995 Japan,
`8-45392 2/1996 Japan _
`2 244 546 12/1991 United Kingdom .
`2 263 802 8/1993 United Kingdom .
`WO 92/09347 6/1992 WIPO _
`WO 94/12999
`6/1994 WIpO _
`
`WOW/17651 5/1997 W1PO_
`
`OTHER PUBLICATIONS
`
`_
`_
`.
`Sega Genesis Instruction Manual, SEGA, Hayward, Cali
`f0rnia,#3701—926—0—01 (1994)
`Sonic 2 the Hedgehog Instruction Manual, SEGA, Hayward,
`California, #672—0944 3701_925_(»01 (1992).
`Sony PlayStation Instruction Manual, and informational
`materials, Sony Computer Entertainment Inc. 1995.
`
`SCEA Ex. 1004 Page 2
`
`

`

`U.S. Patent
`
`May 11,1999
`
`Sheet 1 0f 28
`
`5,903,257
`
`FIG.
`
`1
`
`1 _iOO
`GO
`GO
`
`SCEA Ex. 1004 Page 3
`
`

`

`U.S. Patent
`
`May 11,1999
`
`Sheet 2 0f 28
`
`5,903,257
`
`FIG. 2
`
`EXTERNAL ROM
`
`CARTRIDGE
`CONNECTOR
`
`13
`9
`
`I
`
`T CPU ” BUS CONTROL
`
`MUS I C SIGNAL
`GENERATION
`
`-->
`
`IMAGE SIGNAL
`
`I
`CONTROLLER CONTROL
`
`I83
`
`I84
`
`SCEA Ex. 1004 Page 4
`
`

`

`U.S. Patent
`
`May 11,1999
`
`Sheet 3 0f 28
`
`5,903,257
`
`FIG. 3
`
`CPU MEMORY MAP
`
`\
`
`|MAGE DATA REGION
`
`211.
`
`ZQZ
`
`PROGRAM DATA REGION
`
`I 4]
`
`CONTROLLER DATA REGION
`
`>
`
`EXTERNAL
`MEMoRY AREA
`
`<
`
`>w-RAM AREA
`
`/
`
`SCEA Ex. 1004 Page 5
`
`

`

`U.S. Patent
`
`May 11,1999
`
`Sheet 4 0f 28
`
`5,903,257
`
`FIG. 4
`
`K; I
`
`‘
`
`\f 171
`
`DATA TRANSFER CONTROL
`
`]74\_/—-
`
`172
`
`cm 7
`
`_...> TRANS-
`T
`Ml TING
`
`CH2
`CH3
`CH4
`
`7
`
`'7
`
`:
`V
`
`RAM
`
`173
`
`CH1
`CH2
`‘4-. RECEIV- ‘ CH3
`ING
`I CH4
`
`'
`
`SCEA Ex. 1004 Page 6
`
`

`

`U.S. Patent
`
`May 11,1999
`
`Sheet s 0128
`
`5,903,257
`
`F I G. 5
`
`"I" SIGNAL
`
`tL
`
`tH
`
`"0n SIGNAL
`
`4
`
`tL
`
`tH
`><——>
`
`SCEA Ex. 1004 Page 7
`
`

`

`U.S. Patent
`
`May 11,1999
`
`Sheet 6 0f 28
`
`5,903,257
`
`FIG. 6
`
`RAM I74
`
`ICH COMMAND STORAGE
`POSITION
`
`174a
`
`ICH TRANSMISSION/RECEPTION
`DATA STORAGE POSITION
`
`IT4b
`ZCH COMMAND STORAGE
`POSITION
`
`174c
`
`ZCH TRANSMISSION/RECEPTION
`DATA STORAGE POSITION
`
`174d
`3CH COMMAND STORAGE
`POSITION
`
`I74e
`
`3CH TRANSMISSION/RECEPTION
`DATA STORAGE POSITION
`
`1T4f
`4CH COMMAND STORAGE
`POSITION
`
`174g
`
`4CH TRANSMISSION/RECEPTION
`DATA STORAGE POSITION
`
`174h
`
`SCEA Ex. 1004 Page 8
`
`

`

`U.S. Patent
`
`May 11,1999
`
`Sheet 7 0f 28
`
`5,903,257
`
`FIG. 7
`
`SCEA Ex. 1004 Page 9
`
`

`

`U.S. Patent
`
`May 11,1999
`
`Sheet 8 0f 28
`
`5,903,257
`
`SCEA Ex. 1004 Page 10
`
`

`

`U.S. Patent
`
`May 11,1999
`
`Sheet 9 0f 28
`
`5,903,257
`
`FIG. 10
`
`i947?
`
`% [/4710
`
`5255a 466a
`éesba I [.76 :Q:\ ‘ 467a
`I‘: 1.51. /
`\\
`456D
`‘*v’ 0452
`460
`E
`r
`
`SCEA Ex. 1004 Page 11
`
`

`

`U.S. Patent
`
`May 11,1999
`
`Sheet 10 0f 28
`
`5,903,257
`
`SCEA Ex. 1004 Page 12
`
`

`

`U.S. Patent
`
`May 11,1999
`
`Sheet 11 0f 28
`
`5,903,257
`
`FIG. 12
`
`z.
`
`1
`
`/
`X .
`(dz. \.\‘\_
`‘\ 1
`Q : a =
`" 1 \O‘,
`_
`-'"
`I;
`\ s/
`
`F"
`
`'
`
`492
`
`486 490
`
`:
`
`.
`
`\
`
`I//.\\\\\\\\
`Ila
`g,
`J1
`
`“[184
`
`—466
`
`‘
`
`g“
`
`'
`
`\
`
`Q1/1187 "m I
`
`1
`
`I
`
`I
`
`'
`
`s 473
`4254476 489 462
`\\\\\\x\\\\\\\\ \ \‘ 641
`460
`
`FIG. 13
`
`488D
`
`N 474 491
`. 488a
`
`‘ “2p
`
`SCEA Ex. 1004 Page 13
`
`

`

`U.S. Patent
`
`May 11,1999
`
`Sheet 12 0f 28
`
`5,903,257
`
`F | G.
`
`1 4
`
`/ 444
`
`f
`Z-SHAFT
`PULSE
`COUNTER
`4?“
`X
`Y
`C?lJNTEkR CPUNTER
`444x
`
`442
`
`45
`
`RESET 0 /
`
`448
`,/
`
`C
`
`42
`_> TRANSM | - _’ CONVER- [
`TT I N6
`3 ION
`‘
`'
`
`Ag
`1
`
`\ 44
`
`/
`
`445
`j
`
`43
`>
`
`RESET PIN
`J:
`y
`
`-—:\——
`O
`
`COMMAND
`RESET
`443
`
`POWER
`0"
`55$“
`SW
`RESET
`447
`LEFT _0
`RIGHT ——O} 5'"
`START_O
`RESET
`
`7
`
`SW. SIGNAL DETECTlON
`
`0
`:
`RECEW
`R
`0 F ING
`L
`|
`)
`441
`
`403 — 407
`
`"
`JOYPORT CONTROL
`
`_
`
`\ 446/
`\
`
`i
`
`AD-
`DATA DRESS
`
`j
`
`1k
`50
`\ 46
`RD/WR/CS ;
`
`V
`
`V
`
`4
`
`5 '
`
`/
`
`RAM
`
`SCEA Ex. 1004 Page 14
`
`

`

`U.S. Patent
`
`May 11,1999
`
`Sheet 13 0f 28
`
`5,903,257
`
`FIG. 15
`
`T BYTE
`
`B
`
`A
`
`2 BYTE JSRST
`
`0
`
`G
`
`L
`
`START
`
`I
`
`l
`
`<—- -->
`
`R
`
`E
`
`D
`
`c
`
`F
`
`3 BYTE
`
`4 BYTE
`
`‘
`
`X
`
`ORDINATE
`
`Y
`ORDINATE
`
`’ '
`
`'
`
`SCEA Ex. 1004 Page 15
`
`

`

`U.S. Patent
`
`May 11,1999
`
`Sheet 14 0f 28
`
`5,903,257
`
`FIG. I6
`COMMAND O: TRANSMITTING TYPE OF CONTROLLER
`RECEPTION: I BYTE TRANSMISSION: 3 BYTES
`
`d7
`
`d6
`
`d5
`
`d4
`
`d3
`
`d2
`
`d1
`
`d0
`
`RECEP
`Tl ON
`
`1 BYTE
`
`I BYTE ‘
`
`2 BYTE ‘
`
`TRANS—
`MISSION
`
`COMMAND O
`
`TYPE L
`
`TYPE H
`
`3 BYTE _
`
`STATUS
`
`FIG. IT
`
`r
`
`V
`
`V
`
`,
`
`COMMAND 1 ; ACCESSING STANBARO CONTROLLER
`RECEPTION: I BYTE TRANSMISSION: 4 BYTES
`
`d7
`
`d6
`
`d5
`
`d4
`
`d3
`
`d2
`
`d1
`
`d0
`
`RECEP—
`Tl ON
`
`I BYTE ‘
`
`COMMAND 1
`
`'
`
`IBYTE
`
`B
`
`A
`
`2 BYTE JSRST"
`
`O
`
`G
`
`L
`
`START
`
`T
`
`l <- -—>
`
`R
`
`E
`
`D
`
`c
`
`F
`
`TRANS—
`MISSION
`
`3 BYTE ‘
`
`4 BYTE
`
`X
`ORDINATE
`
`Y
`ORDINATE
`
`'
`
`'
`
`* HIGH LEVEL WHEN L, R AND START BUTTONS ARE
`SIMULTANEOUSLY DEPRESSED
`
`SCEA Ex. 1004 Page 16
`
`

`

`U.S. Patent
`
`May 11,1999
`
`Sheet 15 0f 28
`
`5,903,257
`
`FIG. 18
`
`COMMAND 2: READ-OUT RAM
`RECEPTION: a BYTES TRANSMISSION: as BYTES
`d?
`as
`d5
`d4
`d3
`
`d2
`
`d1
`
`3
`
`1 BYTE <
`
`COMMANDZ
`
`2 BYTE ‘
`
`ADDRESS H
`
`V
`
`V
`
`3 BYTE <--—ADDRESS L —+<-—-— ADDRESS CRC -—-——>
`
`1 BYTE 4
`
`2 BYTE :
`
`DATA 0
`
`DATA 1
`
`32 BYTE
`
`DATA 3]
`
`33 BYTE ‘
`
`DATA CRC
`
`V
`
`r
`
`V
`
`:
`
`RECE
`PTIDN
`
`TRAN
`SMIS
`SIDN
`
`SCEA Ex. 1004 Page 17
`
`

`

`U.S. Patent
`
`May 11,1999
`
`Sheet 16 0f 28
`
`5,903,257
`
`WR I TE T0 RAM
`COMMAND 3 :
`RECEPT | ON I 35 BYTES TRANSM I SS l ON 1
`l BYTES
`
`d7
`
`d6
`
`d5
`
`d4
`
`d3
`
`d2
`
`d1
`
`d0
`
`1 BYTE
`
`A
`
`COMMAND
`
`'
`
`r
`
`2 BYTE
`
`A
`
`ADDRESS H
`
`y
`
`3 BYTE <—— ADDRESS L ——><———— ADDRESS CRC /———>
`
`RECE
`PT | ON
`
`4 BYTE ‘
`
`DATA 0
`
`5 BYTE ‘ '
`
`DATA 1
`
`35 BYTE ‘
`
`DATA 3 I
`
`TRAN
`sms-
`SIDN
`
`1 BYTE ‘
`
`DATA CRC
`
`>
`
`r
`
`V
`
`7
`
`SCEA Ex. 1004 Page 18
`
`

`

`U.S. Patent
`
`May 11,1999
`
`Sheet 17 0f 28
`
`5,903,257
`
`F|G.20
`
`INITIAL SETTING
`
`$1 I
`
`TRANSMIT ‘CONTROLLER
`DATA REQUEST
`COMMAND
`
`s12
`
`V
`PROCESS GAME PROGRAM
`
`‘Y
`
`DI SPLAY IMAGE ON THE
`DATA
`BASIS OF CONTROLLER
`
`813
`
`314
`
`SCEA Ex. 1004 Page 19
`
`

`

`U.S. Patent
`
`May 11,1999
`
`Sheet 18 0f 28
`
`5,903,257
`
`(
`
`POWER ON
`
`)
`
`V
`
`IS THERE CONTROLLER DATA
`REQUEST COMMAND‘?
`
`INPUT COMMAND T0
`CONTROLLER CONTROL 17
`
`S22
`
`S DATA ENTRY FROM CONTROLL
`CONTROL 1'! BEEN COMPLETED?
`
`S23
`
`TRANSFER DATA FROM
`CONTROLLER 17 TO
`W-RAM 14
`
`$24
`
`SCEA Ex. 1004 Page 20
`
`

`

`US. Patent
`
`May 11,1999
`
`Sheet 19 0f 28
`
`5,903,257
`
`FIG.
`
`22
`
`POWER 0N
`
`
`
`
`
`
`
`S WRITING DATA FROM BU
`CONTROL IC WAITED FOR?
`
`YES
`
`33]
`
`NO
`
`I1
`
`{I
`
`SCEA Ex. 1004 Page 21
`
`SCEA Ex. 1004 Page 21
`
`

`

`US. Patent
`
`May 11,1999
`
`Sheet 20 0f 28
`
`5,903,257
`
`
`
`FIG.
`
`23
`
`IS THERE
`PUT COMMA |
`
`YES
`
`SS4
`
`
`
`852
` STATUS
`NO
`REQUEST
`
`COMMAND?
`
`
` PAD DATA
`NO
`REQUEST COMMAND
`
`?
`
`356
`XTENSIO‘
`
`
`CONNECTOR
`
`
`
` TRANSFER STATUS
`.RITE—OUT REQUES
`
`CMMAND?
`$58
`
` EXTENSION
`N0
`CONNECTOR READ-IN
`
`QUEST COMMAI=
`
`
`
`TRANSMIT BAD DATA
`
`SS5
`
`
`COMMAND?
`
`
`
`
`WRITE OUT EXTENSION
`CONNECTOR
`
`RESETTING
`
`
`
`
`
`RESET COUNTER
`
`
`READ IN EXTENSION
`CONNECTOR
`
`SCEA Ex. 1004 Page 22
`
`SCEA Ex. 1004 Page 22
`
`

`

`US. Patent
`
`May 11,1999
`
`Sheet 21 0f 28
`
`5,903,257
`
`FIG. 24
`
`COMMAND 255: CONTROLLER RESETTING
`RECEPTION I BYTE
`TRANSMISSION:
`3BYTE
`
`RECEP-
`TION
`
`IBYTE
`
`COMMAND 255
`
`“7 unnnnnn
`
`
`
`
`
`
`
`
`
`
`I BYTE
`
`2 BYTE
`
`3 BYTE
`
`TRANS~
`MISSION
`
`
`
`TYPE L
`
`TYPE H
`
`STATUS
`
`SCEA EX. 1004 Page 23
`
`SCEA Ex. 1004 Page 23
`
`

`

`US. Patent
`
`May 11,1999
`
`Sheet 22 0f 28
`
`5,903,257
`
`FIG. 25
`
`HAVE L,
`
`R AND START BUTTONS
`
`SIMULTANEOUSLY DEPRESSED?
`
`POWER ON
`
`
`
`
`RESET X COUNTER AND Y
`
`3434
`
`COUNTER
`
`FIG.
`
`26
`
`POWER ON
`
`RESET X COUNTER AND Y
`COUNTER
`
`
`
`
`
`
`S442
`
`SCEA Ex. 1004 Page 24
`
`SCEA Ex. 1004 Page 24
`
`

`

`US. Patent
`
`May 11,1999
`
`Sheet 23 0f 28
`
`5,903,257
`
`FIG.
`
`27
`
`PHYSICAL COORDINATE 0F JOYSTICK
`
`DISPLAY SCREEN
`
`Y F
`
`IG.
`
`2!!
`
`PHYSICAL COORDINATE 0F JOYSTICK
`
`DISPLAY SCREEN
`
`
`
`SCEA EX. 1004 Page 25
`
`SCEA Ex. 1004 Page 25
`
`

`

`US. Patent
`
`May 11,1999
`
`Sheet 24 0f 28
`
`5,903,257
`
`FIG. 29 »
`
`
`
`MAXIMUM SPEED
`
`g;
`
`A
`—O
`
`g; {E
`
`,_1_L
`B
`
`O
`
`O
`
`160km/hr
`
`250km/hr
`
`
`
`g; g; {E i
`
`C
`
`
`
`: BZOkm/hr
`
`
`
`FIG. 30
`
`
`
`
`
`SCEA EX. 1004 Page 26
`
`SCEA Ex. 1004 Page 26
`
`

`

`US. Patent
`
`May 11,1999
`
`Sheet 25 0f 28
`
`5,903,257
`
`FIG.
`
`31
`
`DISPLAY LACING CARS
`
`A-C 0N SCREEN
`
`SI 5 I
`
`
`
`
`
`READ IN CONTROLLER
`
`DATA
`
`
`DEPRESSED?
`
`IS BUTTON A
`
`DETERMINE RA IN
`
`CAR
`
`IS UPPER/LOWER
`
`KEY DEPRESSED?
`
`
`
`
`SET MAXIMUM SPEED
`
`
`
`
`
`1 6 Okm/hr
`
`
`
` CAR A
`
`
`CAR B
`
`CAR C
`
`2 50km/hr
`
`3 2 0km/hr
`
`
`
`
`
`
`
`SI 5 5
`
`MOVE CURSOR FOR
`SELECTING RACING CAR
`
`TO GAME SCENE
`
`SCEA Ex. 1004 Page 27
`
`SCEA Ex. 1004 Page 27
`
`

`

`US. Patent
`
`May 11,1999
`
`Sheet 26 0f 28
`
`5,903,257
`
`
`DISPLAY INITIAL
`
`SCREEN OF RACING
`
`SCENE
`
`FIG. 32
`
`SI 6 I
`
`
`
`
`READ IN CONTROLLER SI 6 2
`I
`DATA
`
`
`
`NO
`OF CROSS SWITCH
`
`
`DEPRESSED
`
`
`
` RACING C-
`SPEED AT MAXIMUM
`
`SPEED
`?
`
`SI 6 9
`
`DECELERATE RACING
`CAR.
`
` STOPPED?
`
`
`
`
`ACCELERATE RACING
`CAR
`
`
`
`PROCESS OTHER
`
`CONTROLLER DATA
`
`
`5 I 6 6
`
`
`
`
`
`DISPLAY RACING
`
`SCENE
`
`
`816‘ 7
`
`SCEA EX. 1004 Page 28
`
`SCEA Ex. 1004 Page 28
`
`

`

`US. Patent
`
`May 11,1999
`
`Sheet 27 0f 28
`
`5,903,257
`
`FIG.
`
`33
`
`DISPLAY RACING CARS
`
`A-C
`
`
`
`
`
`READ IN CONTROLLER
`
`(JOYSTICK) DATA
`
`IS BUTTON A
`
`
`
`DEPRESSED?
`
`
`
`
`
`
`
`RESET INITIAL POSITION
`OF JOYSTICK
`JOYSTICK ANGLE
`
`
`
`OEPENDING ON
`
`MOVE RACING-CAR
`
`SELECTING CURSOR
`
`TO GAME SCENE
`
`SCEA EX. 1004 Page 29
`
`SCEA Ex. 1004 Page 29
`
`

`

`US. Patent
`
`May 11,1999
`
`Sheet 28 0f 28
`
`5,903,257
`
`FIG.
`
`34
`
`DISPLAY INITIAL
`
`
`
`
`SCREEN 0F RACING
`
`SCENE
`
`SI 8 1
`
`READ IN CONTROLLER
`(JOYSTICK) DATA
`
`3‘ 8 2
`
`RACING CAR SPEED
`: CONST.
`X JOYSTICK
`
`ANGLE
`
`S I 8 3
`
`PROCESS OTHER
`
`CONTROLLER
`
`SCENE
`
`(JOYSTICK) DATA
`
`DISPLAY RACING
`
`SI 8 4
`
`S I 8 5
`
`SCEA EX. 1004 Page 30
`
`SCEA Ex. 1004 Page 30
`
`

`

`1
`OPERATING DEVICE AND IMAGE
`PROCESSING SYSTEM USING SAME
`
`FIELD OF THE INVENTION
`
`This invention relates to an operating device and an image
`processing system using same. More particularly, this inven-
`tion is concerned With an operating device (joystick) With
`Which the function is extendable for an image processing
`apparatus such as a personal computer, a video game
`machine, and so on, to enable transmission and reception of
`any data.
`
`BACKGROUND AND SUMMARY OF THE
`INVENTION
`
`Conventional joysticks are structured to detect in Which
`direction and to What degree an operating member thereof is
`inclined. The “home” or neutral position to Which the
`operating member returns When not operated by an operator
`is the origin point from Which inclination of the operating
`member is measured. Because the origin point is fixed and
`not alterable by a user, the user cannot freely modify the
`location of the origin point.
`It is therefore an object of the present invention to provide
`an operating device in Which errors incurred through mass
`production can readily corrected and the origin point of the
`operating device can be determined and modified freely by
`an user.
`
`It is another object of the present invention to provide an
`image processing system using such an operating device.
`An operating device is connected during use to an image
`processing apparatus (10) that generates image data to be
`displayed on a display according to a program, to supply a
`signal for providing variation to the image data to be
`generated by an image processing apparatus, the operating
`device comprising: an operating member (451), a rotating
`member (457, 467), a rotation detecting means (459, 469),
`a count means (444X, 444Y), a reset signal generating
`means (442, 443, 447, 448), and a transfer means (442, 445,
`43).
`The operating member is supported to be tilt-operated by
`an operator so as to incline Within a predetermined range and
`rest, When not operated by the operator, at a predetermined
`neutral position. The rotating member is arranged for rota-
`tion depending upon an inclination amount of the operating
`member. The rotation detecting means detect a rotational
`state of the rotating member. The count means varies a count
`value thereof depending on a rotational amount of the
`rotating member detected by the rotation detecting means.
`The reset signal generating means generates a reset signal to
`reset the count value of the count means. The transfer means
`
`transfers the count value counted by the count means to the
`image processing apparatus.
`An image processing system includes an image process-
`ing apparatus for generating image data to be displayed on
`a display according to a program, and an operating device
`for connecting during use to the image processing apparatus
`so as to supply a signal for the image data to be generated
`by the image processing apparatus. The image processing
`apparatus (10) includes a program memory (20), a first
`receiving means (173), a central processing means (11), a
`first transmitting means (172), and an image signal gener-
`ating means (16), and wherein the operating device (40)
`includes an operating member (451), a rotating member
`(457, 467), a rotation detecting means (459, 469), a count
`means (444X, 444Y), a reset signal generating means (442,
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`5,903,257
`
`2
`
`443, 447, 448), a second receiving means (173), a transfer
`means (171), and a second transmitting means (172).
`The program memory is stored With a program for image
`processing. The first receiving means receives data gener-
`ated by the operating device. The central processing means
`generates command data according to the program stored in
`the program memory, and generating image data depending
`upon the program and the data received by the first receiving
`means. The first transmitting means transmits the command
`data generated by the central processing means to the
`operating device. The image signal generating means gen-
`erates an image signal for displaying an image on the display
`depending upon the image data from the central processing
`means. The operating member is supported to be tilt-
`operated to be inclined Within a predetermined range by the
`operator and rested, When not operated by an operator, at a
`predetermined position. The rotating member is arranged for
`rotation depending upon an inclination amount of the oper-
`ating member. The rotation detecting means detects a rota-
`tional state of the rotating member. The count means has a
`count value varied depending on the rotational amount of the
`rotating member detected by the rotation detecting means.
`The reset signal generating means generates a reset signal to
`reset
`the count value of the count means. The second
`
`receiving means receives the command data transmitted
`from the first transmitting means. The transfer means out-
`puts the count value data counted by the count means in
`response to reception of predetermined command data by
`the second receiving means. The second transmitting means
`transmits the count value data output by the transfer means
`to the image processing apparatus.
`When the operator holds the operating device in hand and
`inclines the operating member, the rotating member rotates
`depending upon the inclination. As a result,
`the rotation
`detecting means generates an electric signal responsive to
`the rotation of the rotating member. In response to the
`electric signal, the count means counts the rotational amount
`of the rotating member. The reset signal generating means
`generates a reset signal to reset the count value of the count
`means. The transfer means transfers the count value of the
`
`count means to the image processing apparatus. In response
`to this, the image processing apparatus generates an image
`signal varied depending on the count value.
`The central processing means generates command data
`according to the program stored in the program memory.
`The first transmitting means transmits the command data to
`the operating device. The transmitted command signal is
`received by the second receiving means. The transfer means,
`in response to the reception of the commaqnd signal by the
`receiving means, outputs data of the count value counted by
`the count means. The count value data is transmitted by the
`second transmitting means to the image processing appara-
`tus. This transmitted count value data is received by the first
`receiving means. The central processing means generates
`image data based on this count value data and a program. In
`accordance With this image data, the image signal generating
`means generates an image signal for displaying an image on
`the display.
`According to the present invention, the number of pro-
`gram steps for image processing can be reduced so that the
`program is simplified and the shortening of programmer
`operating time is shortened and operation is simplified.
`The above and other objects, features, aspects, and advan-
`tage of the present invention Will become more apparent
`from the ensuing detailed description of the present inven-
`tion When taken in conjunction With the accompanying
`drawings.
`
`SCEA EX. 1004 Page 31
`
`SCEA Ex. 1004 Page 31
`
`

`

`5,903,257
`
`3
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a schematic illustrative view showing one
`embodiment of the present invention;
`FIG. 2 is a block diagram showing in detail an image
`processing apparatus in the FIG. 1 embodiment;
`FIG. 3 is an illustrative view showing a memory map in
`CPU of FIG. 2 embodiment, demonstrating an external
`memory and a W—RAM incorporated in a cartridge;
`FIG. 4 is a block diagram showing in detail a controller
`control circuit in FIG. 2 embodiment;
`FIG. 5 is an illustrative view showing a modulating/
`demodulating method for data;
`FIG. 6 is an illustrative view showing a memory map of
`a RAM in FIG. 4;
`FIG. 7 is a perspective view of a controller of FIG. 2
`embodiment as viewed from the above;
`FIG. 8 is a perspective view of the controller of FIG. 2
`embodiment as viewed from the bottom;
`FIG. 9 is a perspective view of showing an analog joystick
`unit capable of being utilized in the embodiment;
`FIG. 10 is a perspective view showing major portions of
`FIG. 9 unit;
`FIG. 11 is an exploded perspective view showing major
`portions of FIG. 9 unit
`FIG. 12 is a sectional illustrative view showing major
`portions of FIG. 9 unit;
`FIG. 13 is an illustrative view showing a state where a
`lever is guided by a guide ring;
`FIG. 14 is a block diagram showing in detail the controller
`and an expansion device;
`FIG. 15 is an illustrative view showing data of the analog
`joystick and respective buttons of the controller;
`FIG. 16 is an illustrative view of transmission and recep-
`tion data by the control circuit when a command “0” is
`transmitted from the controller control circuit;
`FIG. 17 is an illustrative view of transmission and recep-
`tion data by the control circuit when a command “1” is
`transmitted from the controller control circuit;
`FIG. 18 is an illustrative view of transmission and recep-
`tion data by the control circuit when a command “2” is
`transmitted from the controller control circuit;
`FIG. 19 is an illustrative view of transmission and recep-
`tion data by the control circuit when a command “3” is
`transmitted from the controller control circuit;
`FIG. 20 is a flowchart showing operation of the CPU of
`FIG. 2 embodiment;
`FIG. 21 is a flowchart showing operation of the bus
`control circuit of the FIG. 2 embodiment;
`FIG. 22 is a flowchart showing operation of the controller
`control circuit of FIG. 2 embodiment;
`FIG. 23 is a flowchart showing operation of the controller
`circuit of FIG. 2 embodiment;
`FIG. 24 is an illustrative view of transmission and recep-
`tion data by the control circuit when a command “255” is
`transmitted from the controller control circuit;
`FIG. 25 is a flowchart showing a first method of origin
`point resetting;
`FIG. 26 is a flowchart showing a second method of origin
`point resetting;
`FIG. 27 is an illustrative view showing the correspon-
`dence of a physical coordinate of the joystick to a display
`screen;
`
`4
`FIG. 28 is an illustrative view showing the correspon-
`dence of the physical coordinate of the joystick to the
`display screen when resetting an origin point;
`FIG. 29 is an illustrative view showing a display screen
`for selecting a racing car;
`FIG. 30 is an illustrative view showing one example of an
`initial screen of a racing game;
`FIG. 31 is a flowchart showing the conventional operation
`for selecting a racing car;
`FIG. 32 is a flowchart showing the conventional operation
`for a racing game;
`FIG. 33 is a flowchart showing the operation for selecting
`in the embodiment a racing car; and
`FIG. 34 is a flowchart showing the operation of a racing
`game in accordance with an example embodiment of the
`present invention.
`
`DETAILED DESCRIPTION
`
`Referring to FIG. 1, there is illustrated an external view
`showing a system structure of an image processing system
`according to one embodiment of the present invention. The
`image processing system is for example a video game
`system, which inclusively comprises an image processing
`apparatus main body 10, a ROM cartridge 20 as one
`example of an external memory device, a display 30 as one
`example of a display means connected to the image pro-
`cessing apparatus main body 10, a controller 40 as one
`example of an operating means, and a RAM cartridge 50 as
`one example of an extension device detachably attached to
`the controller 40. Incidentally, the external memory device
`stores image data and program data for image processing for
`games, and audio data for music, effect sound, etc. A
`CD-ROM or a magnetic disc may alternatively be employed
`in place of the ROM cartridge. Where the image processing
`system of this example is applied to a personal computer, an
`input device such as a keyboard or a mouse is used as the
`operating means.
`FIG. 2 is a block diagram of the image processing system
`of this example. The image processing apparatus 10 incor-
`porates therein a central processor unit (hereinafter “CPU”)
`11 and a bus control circuit 12. The bus control circuit 12 is
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`connected with a cartridge connector 13 for detachably
`attaching the ROM cartridge 20, as well as a working RAM
`14. The bus control circuit 12 is connected with an audio
`
`50
`
`55
`
`60
`
`65
`
`signal generating circuit 15 for outputting an audio signal
`processed by the CPU 11 and a video signal generating
`circuit 16 for outputting a video signal, and further with a
`controller control circuit 17 for serially transferring operat-
`ing data of one or a plurality of controller(s) 40 and/or data
`of RAM cartridge(s) 50. The controller control circuit 17 is
`connected with controller connectors (hereinafter abbrevi-
`ated as “connectors”) 181—184 which are to be provided at
`a front face of the image processing apparatus 10. To the
`connector 18 is detachably connected a connection jack 41
`and the controller 40 through a cable 42. Thus, the connec-
`tion of the controller to the connector 181—184 places the
`controller 40 into electric connection to the image process-
`ing apparatus 10, enabling transmission and reception of
`data therebetween.
`
`More specifically, the bus control circuit 12 inputs therein
`a command outputted by a parallel signal from the CPU 11
`via a bus to parallel-serial convert it for outputting a com-
`mand by a serial signal to the controller control circuit 17,
`and converts serial signal data inputted from the controller
`control circuit 17 into a parallel signal for outputting it to a
`
`SCEA EX. 1004 Page 32
`
`SCEA Ex. 1004 Page 32
`
`

`

`5,903,257
`
`5
`bus. The data outputted through the bus is subjected to
`processing by the CPU 11, stored in W—RAM 14, and so on.
`In other words,
`the W-RAM 14 is a memory temporary
`storing the data to be processed by the CPU 11, wherein
`read-out and write-in of data is possible through the bus
`control circuit 12.
`
`FIG. 3 is a diagrammatic illustration showing memory
`regions assigned to respective memory spaces. The memory
`spaces accessible by the CPU via the bus control circuit 12
`involves an external memory region of the ROM cartridge
`20 and a memory region of the W—RAM 14. Although the
`ROM cartridge 20 is structured by mounting on a board a
`ROM stored with data for game processing and accommo-
`dating the same board in a housing, the ROM storage data
`is shown by the external memory region shown in FIG. 3.
`That is, the ROM includes an image data region 201 stored
`with image data required to cause the image processing
`apparatus 10 to generate image signals for the game, and a
`program data region 202 stored with program data required
`for predetermined operation of the CPU 11. In the program
`data region 202, there fixedly stored are an image display
`program for performing image display based on image data
`201, a time-measuring program for carrying out measure-
`ment of time, and a determination program for determining
`that the cartridge 20 and an extension device 50, hereinafter
`referred to, are in a predetermined relationship. Incidentally,
`the details of the time-measuring program and the determi-
`nation programs will be stated later. On the other hand, the
`memory region of W-RAM 14 includes a region 141 for
`temporarily storing data representative of an operating state
`from a control panel.
`FIG. 4 is a detailed circuit diagram of a controller control
`circuit 17. The controller control circuit 17 is provided for
`transmission and reception of data in serial between the bus
`control circuit 12 and the controller connector 181—184, and
`includes a data transfer control circuit 171, a signal trans-
`mitting circuit 172, a signal receiving circuit 173 and a RAM
`174 for temporarily storing transmission and reception data.
`The data transfer control circuit 171 includes a parallel-
`serial conversion circuit and a serial-parallel conversion
`circuit for conversion of data format during data transfer,
`which also performs control of write-in and read-out of the
`RAM 174. The serial-parallel conversion circuit converts
`serial data supplied from the bus control circuit 12 into
`parallel data to provide it to the RAM 174 or the signal
`transmitting circuit 172. The parallel-serial conversion cir-
`cuit converts parallel data supplied from the RAM 174 or the
`signal receiving circuit 173 into serial data to provide it to
`the bus control circuit 12. The signal transmission circuit
`172 converts data for signal read-in control of the controller
`40 supplied from the data transfer control circuit 171 and
`write-in data (parallel data) to the RAM cartridge 50 into
`serial data, which data is transmitted through a correspond-
`ing channel CH1—CH4 to each of the plurality of controllers
`40. The signal receiving circuit 173 receives in serial read-
`out data, representative of an operating state of each of the
`controller 40,
`inputted through a corresponding channel
`CH1—CH4 to each of the controller 40 as well as read-out
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`them into
`to convert
`data from the RAM cartridge 50,
`parallel data to provide it to the data transfer control circuit
`171.
`
`60
`
`The signal transmitting circuit 172 and the signal receiv-
`ing circuit 173 adopt a duty-cycle modulation and demodu-
`lation (hereinafter
`referred to as “modulation/