`
`IROBOT 2009
`Shenzhen Zhiyi Technology v. iRobot
`IPR2017-02061
`
`
`
`1
`
`0145683
`
`INDUSTRIAL ROBOT
`
`The invention relates to an industrial robot of the
`
`kind disclosed in the preamble to the accompanying Claim 1.
`
`Such robots are previously known and widely spread in
`
`various fields of industry. Programming normally takes
`
`place in that the robot is caused by an operator, while
`
`guiding it moment by moment,
`
`to perform a specific series
`
`of operation.
`
`In certain cases the operator thereby grips
`
`around the robot's arm to make it execute a desired pattern
`
`of movement, although it has been found more beneficial for
`
`this purpose to use a programming device provided with a
`
`joystick.
`
`A joystick is a suitable instrument for two-
`
`dimensional generation of analog signals. A third dimension
`
`can be added by turning the control knob, producing in this
`
`way a signal which is then independent of the two "x—y
`
`signals". More than three dimensions however cannot be
`
`controlled with the aid of a joystick. Taking into consi—
`
`deration the three longitudinal dimensions of a room, plus
`
`the additional turns, a robot must be controllable in a
`
`10
`
`15
`
`20
`
`plurality of other dimensions, and for this reason the
`
`significance of the joystick movements must be variable by
`
`adjustment. The programming device of prior art industrial
`
`robots has therefore been provided with a push~button set
`
`for adjustment of the control mechanism.
`
`25
`
`30
`
`35
`
`Although the function of such a known system is
`
`otherwise satisfactory,
`
`there is the disadvantage that the
`
`operator must be very well trained on the equipment in
`
`order to readily and quickly perform a programming opera-
`
`tion. It would be desirable therefore to have a system
`
`affording extended possibilities of cooperation between the
`
`system and the Operator. It would furthermore be desirable
`
`to let the operator concentrate all his visual attention to
`
`the robot itself,
`
`increasing thereby the operational Speed
`
`as well as improving the pattern of movement for the robot.
`
`These and other objects and advantages to be de-
`
`2
`
`
`
`2
`
`0145683
`
`scribed in the following can be achieved according to the
`
`invention by equipping an industrial robot of the kind
`
`mentioned by way of introduction in the way disclosed in
`
`the characterizing clause of Claim 1.
`
`Speech analysis and speech synthesis devices are
`
`previously known and commercially available. A particular
`
`difficulty in this known equipment is associated with the
`
`fact that a powerful computer support is generally required
`
`for the recognition of human speech. Therefore,
`
`to create
`
`10
`
`the fundamental condition for a final solution of the
`
`practical problems,
`
`the device should not have to recognize
`
`too many different commands.
`
`In practice at present,
`
`the
`
`use of a speech analyzer of the kind available on the
`market at a reasonable cost is in fact based on the condi-
`
`15
`
`tion that the operator himself has initially dictated each
`
`single command into the device for enabling it later to
`
`identify said command upon repetition. It is then also
`
`understood that the number of commands to be searched for
`
`identification, when reading in a command, must not be too
`
`20
`
`great.
`
`As a purely practical measure for settling the
`
`inventive problem,
`
`the number of possible commands in each
`
`instant must be restricted, and in many cases less than the
`
`total number of commands used for the programming sequence.
`
`According to the invention, this is achieved by means of a
`
`branched programming system. At start there is made a
`
`choice for example between a restricted number of basic
`
`conditions each of which being associated with a likewise
`
`restricted number of functions, etc. obtaining in this way
`
`a system of treewshaped configuration.
`
`The speech synthesizer is preferably permitted to
`
`read aloud a list of all the commands available to the
`
`operator when making his choice, while also emitting a
`
`receipt signal by repeating a given command. Alternatively,
`
`a display unit can be arranged indicating the last—given
`
`command. Furthermore, it should suitably be possible for
`
`the operator to make the speech synthesizer repeat its
`
`25
`
`30
`
`35
`
`3
`
`
`
`3
`
`0145683
`
`last—spoken phrase.
`
`The invention will now be described on the basis of
`
`a non-limiting exemplary embodiment illustrated in the
`
`drawings. Fig.
`
`1 shows an example of a robot's arm provided
`
`with gripping means. Fig.
`
`2 shows schematically a block
`
`diagram for the invention. Fig.
`
`3 shows an example of an
`
`Operational sequence with an associated program. Fig.
`
`4
`
`shows an example of a branch program, and Fig.
`
`5 shows the
`
`various alternatives in a basic condition of the program.
`
`A robot arm of the immediately considered type is
`
`shown in Fig. 1. The arrows indicate various alternatives
`
`of movement, giving rise to six generally independent
`
`degrees of freedom. For each rotational axis there is
`
`accommodated a motor and a sensor,
`
`these parts together
`
`being connected to a control unit
`
`(computer) for enabling
`
`a programmed movement of all motors. It is clearly seen
`
`that all movements are basically rotary, but it is known
`
`that combined rectilinear movements can be obtained by
`
`programming. when controlling the movements with the use of
`
`a joystick, either direct control of two or three rotational
`
`axes can be selected for an "economic" di5placement of the
`tool center point, or indirect control in rectangular
`
`Cartesian coordinates can be selected demanding however a
`
`heavier computer support for its performance and resulting
`
`sometimes in a certain delay. This selection of Coordinate
`
`system is normally included in the alternatives according
`
`to the invention.
`
`The essential feature of the invention is illustra—
`
`ted in Fig. 2. A robotic control system 1
`
`is connected to
`
`the various arrangements of movement in a robot according
`
`to Fig. 1, each "degree of freedom" being individually con-
`
`trolled and monitored under the guidance and coordination
`
`of the control system 1.
`
`In automatic Operation this is
`
`conventionally done by using computer programs capable of
`
`receiving sensory signals as well, responding for example
`
`to touch or the like. This is all prior art technique how—
`
`ever and will therefore not be further discussed.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`4
`
`
`
`4
`
`0145683
`
`The invention instead relates to control and pro—
`
`gramming of the system. Fig. 2 illustrates a joystick 2
`
`which Can be used for programming patterns of movement. To
`
`some extent,
`
`the use of joysticks is also part of known
`
`technique insofar as such instruments have been previously
`
`used.
`
`The novel feature however resides in that programming
`
`occurs,
`
`in accordance with the invention, while utilizing a
`
`microphone 3 connected to a speech analyzer 4, and in that
`
`1U
`
`the control system 1 can transmit spoken messages with the
`
`aid of a speech synthesizer 6 and a loudspeaker 5. Normally,
`
`the operator carries a pair of earphones to which is con—
`
`nected a microphone disposed close to his mouth.
`
`The Speech analyzer 4 and the speech synthesizer 6
`
`15
`
`are both devices available on the market. For a construc—
`
`tional embodiment there are thus used a speech analyzer
`
`INFOVOX RA~101 and a speech synthesizer INFOVOX SA—101, both
`
`manufactured by Infovox AB, Svenska Utvecklingsbolaget AB,
`
`Stockholm. According to the manufacturer,
`
`the speech
`
`analyzer may recognize words and phrases having a maximum
`
`duration of 2.5 seconds. Upon recognition,
`the unit emits
`to the control system 1, via a V24 standard output, an
`
`electric code associated with the recognized phrase. The
`
`synthesizing device 6 functions as follows. When the control
`
`system transmits a text string in the form of coded common
`
`characters, this code is synthesized via said device into
`
`speech while applying the pronunciation rules appropriate
`
`for e.g. Swedish, English or any other language.
`
`As already mentioned,
`
`the analysis equipment is
`
`utilized quite specifically for safeguarding optimum secur-
`
`ity. There is thus arranged for the analyzer 4 to expect at
`
`each instance only a limited number of commands, and a
`
`command dictated into the microphone will be compared with
`
`just a few patterns stored in the memory. Since "identity“
`
`is determined by correlation between patterns,
`
`the correla-
`
`tion coefficient for accepted identification can therefore
`
`in practice be set to a lower value, resulting as well in
`
`20
`
`25
`
`30
`
`35
`
`5
`
`
`
`5
`
`0145683
`
`a quicker recognition.
`
`Reading into the analyzer 4 is performed by the
`
`operator pronouncing each phrase five times for example,
`
`registering thereby an average for the pattern which will
`
`serve as a basis for the comparisons.
`
`In order to give a simple picture of the programming,
`
`an example will now be shown with reference to Fig. 3. The
`
`task is here to displace the tool center point of the arm
`
`from one point A to another point B,
`
`leaving it at B for
`
`4.5 seconds and then allowing it to return. The program is
`
`conventionally indicated in the figure.
`
`In practice, a
`
`programming sequence is performed as follows. The operator
`
`talks into the microphone 3 according to Fig. 2, saying the
`
`word "POSITION". If desired,
`
`the synthesizer can then be
`
`made to repeat the said command. As will be seen in the
`
`following,
`
`this command signifies that the monitoring
`
`program in the control unit 1 is set to one of numerous
`
`basic conditions, and that a small number of commands is
`
`now available. If he is unsure,
`
`the operator can make the
`
`speech synthesizer 6 read these commands by saying "SCAN".
`
`Let us suppose however that he knows what he wants in this
`
`case, and that he gives the command "SPEED". The speech
`
`analyzer will now expect digits. The operator dictates
`
`“TWO",
`
`"ZERO", and "READ IN". In this way the speed of the
`
`arm has been set to reach 20% of the maximum rate.
`
`(It is
`
`presupposed here that the actual coordinate system has been
`
`selected for the joystick 2,
`
`to keep it prepared). The
`
`robot's arm can now be moved by the operator gripping the
`
`joystick 2 situated on a small box, not shown, which can be
`
`held in his hand.
`
`In this way the robot's tool center point
`
`is displaced from A to B. Thereafter the operator commands
`
`"POSITION" and returns to the primary basic condition, i.e.
`
`the commands "SPEED", "EIGHT",
`
`"ZERO", and "READ IN". The
`
`robot's arm is now programmed for waiting. This is done
`
`first by commanding "FUNCTION" which relates to a basic
`
`condition, and then "WAIT" which is included among the
`
`permitted functions, i.e.
`
`"TIME" and "FOUR",
`
`“COMMA”,
`
`"FIVE"
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`6
`
`
`
`5
`
`0145683
`
`and "READ IN". A waiting time of 4.5 seconds has then been
`
`read into the programming sequence. Now is the moment for
`
`return to the starting point A. The commands "FUNCTION" and
`
`"RETURN" are now read in, and the small programming sequence
`
`is finally recorded. This program is of course extremely
`
`simplified but well suited to explain the function of the
`
`invention while also demonstrating its advantages.
`
`The program in the robotic system 1
`
`thus has a level-
`
`like structure of which the uppermost levels may be called
`
`the basic conditions, wherein a branched selection is made
`
`for each individual condition. Fig. 4 illustrates the fun-
`
`damental principle thereof. Of the commands used above,
`
`"POSITION" and "FUNCTION" will be found among the branches
`
`C1, C2 ... Ci ... Cm in Fig. 4. Suppose for example that
`
`"POSITION" is represented by Ci. In this basic condition
`
`there is then a choice between several subordinate condi-
`
`tions TPi,
`
`IS1 ... ISj which generally permit additional
`
`subsidiary conditions, etc. Fig.-5 shows for example the
`
`various branches possible in the basic condition "POSITION".
`
`If "SPEED" is selected,
`
`then the control unit will expect
`
`to receive digits followed by the end command "READ IN".
`
`A detailed example of branchedeout routines of the
`
`kind utilized in the invention is given in our Swedish
`
`patent application 8203974—4 the teaching of which is here-
`
`by declared to be incorporated by reference in the present
`
`description.
`
`It is possible to utilize character windows and the
`
`like together with the invention for elucidating the
`
`various programming steps, whereby a character window or an
`
`alphanumeric table can be arranged on a control box, or on
`
`the box carried by the operator and in which is mounted the
`
`joystick 2 shown in Fig. 2.
`
`' With the inventive combination of a program struc-
`
`tured into tree-shape, which provides recognition of
`
`commands via a speech analyzer adapted thereto, and a
`
`speech synthesizer equipment, an extremely practical inter-
`
`active programming will be achieved. The very concreteness
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`7
`
`
`
`7
`
`0145683
`
`of the system makes it available for use by operators
`
`lacking all essential programming experience, and the
`
`system can be taught in practice in only a few hours'
`
`time
`
`to an operator, whose skill will then be quite sufficient
`
`for normal industrial operation.
`
`8
`
`
`
`8
`
`CLAIMS
`
`0145683
`
`' 1.
`
`Industrial robot, movable in several degrees of
`
`freedom (Fig. 1) and coacting with a programmable control
`
`computer
`
`(1) with associated programming means which
`
`include a joystick (2)
`
`intended during programming to make
`
`the robot perform arbitrary movements and programming said
`
`movements into the control computer for creating an opera~
`
`tional program therein, characterized by the combination of
`
`a microphone (3)
`
`incorporated in the control equipment and
`
`having a speech analyzer (4) connected to it for reading in
`
`of oral commands to be subsequently recognized for sending
`
`preset control signals associated with each such command,
`
`and a speech synthesizer (6) connected to a sound sensor
`
`(5)
`
`for sending spoken messages to an operator, a command memory
`
`in the control computer
`
`(1) having a branched structure
`
`(Fig. 4) so that a primary command (Cl-Cm), of which there
`
`is a limited number, is arranged to select a sub-group (TPi,
`
`IS1 ... ISj) having a limited number of commands,
`
`the speech
`
`analyzer
`
`(4) being adapted to recognize at each instant only
`
`the commands permitted in consideration to a set branch
`
`10
`
`15
`
`20
`
`point.
`
`'
`
`2.
`
`Industrial robot as claimed in Claim 1, charac-
`
`terized in that its speech synthesizer (6)
`
`is adaptable for
`
`repeating each command read into the microphone (3) and
`
`recognized in the speech analyzer
`
`(4).
`
`9
`
`
`
`1/3
`
`0145683
`
`
`
`ROBOT
`CONTROL
`SYSTEM
`
`
`MANUAL
`POSITIONING
`
`
`COMMAND
`
`STRING
`
`
`
`
`
`3MICROPHONE
`FOR VOICE
`COMMAND
`
`FIG.2
`
`GUIDELINE
`SPEECH
`
`10
`
`10
`
`
`
`CT
`
`C1
`
`wm—-
`
`-—.———.~
`
`CI
`
`2/3
`
`014569%
`
`IDI
`
`011
`
`012
`
`.ITT ..
`
`FOR"
`
`POR12
`
`PORq1
`
`ISZ
`
`Cm
`
`HGA
`
`11
`
`11
`
`
`
`3/3
`
`0145683
`
`B
`A
`o——-—-——-———————o
`
`IO
`
`2Q3Q40
`
`PROGRAM:
`
`10 P05 v 20:
`20 P08 v 80%
`30 HAIT 4,5 3
`40 RETURN
`
`FIG.3
`
`'
`I
`I
`
`I
`
`:SCAN
`I
`
`:
`,
`
`|
`
`'
`l
`
`r9
`
`I
`I
`
`I
`I
`
`:
`l
`
`F10
`
`:
`l
`
`I
`|
`
`r11
`
`,
`
`:
`,
`
`r12
`
`I
`
`29
`
`“0
`
`“I
`
`hZ
`
`Y
`
`12
`
`I SPEEDI
`I
`I
`
`I
`I
`I
`
`I
`
`I
`,
`,
`
`l
`
`I
`
`II
`
`.PENDUL.,
`
`L—fyL—I—JLG’:
`
`I POINT:
`
`12
`
`
`
`Q) 22:?“ 3°"
`
`P!
`
`t
`
`-
`
`EUROPEANSEARCHREPORT
`
`DOCUMENTS CONSIDERED TO BE RELEVANT
`
`0145683
`.
`‘
`
`WM"m"
`
`
`EP 84850281 . 1
`
`
`
`
`
`
`
`EP - Bl - O 023 864 (ASSOCIATION
`
`
`9/18
`B 25 J
`DES OUVRIERS EN INSTRUMENTS DE
`
`PRECISION)
`.
`
`* Fig. 1; column 7,
`lines 1—5;
`column 7,
`line 45 *
`
`
`
`
`
`EP — Al — O 056 507 (BLOOMSTEIN)
`
`* Fig. 1-4; page 7,
`23*
`
`lines 20w
`
`
`
`
`
`
`US — A - 3 742 143 (AWIPI)
`
`* Abstract; fig. 1,2 *
`
`
`
`TECHMCAL FIELDS
`SEARCHED (Int. 01.4)
`
`Dmofcompluionofmnuch
`
` Pinata-ten
`
`VIENNA
`
`12—03—1985
`
`CATEGORY OF CITED DOCUMENTS
`fl
`T :
`thoocy or principlo undoriying tin invnntion
`8
`E : earlier pawn docum. but published on. or
`
`
`, XxmmmmuwnanNNMmDMM
`ahuflnMMgmm
`g
`Y : particulafly relevant sf combined with mom“
`D : documom am in the application ,
`’
`dammunmunumncflunn
`demmmunduduxomunumwn
`
`§ A:Nw~qumubummumm
`‘mw.mwwwmmwmmwflw. WWMWW”, I
`
`"-
`D : non-Wm dhclosun
`a. : mm at the am: patent funny. corruponding
`g
`PHMmmwhumxmmm
`mmmmm
`
`
`
`
`13
`
`13
`
`