Biblio ra hic Data
`Int.Cl.
`H04M 1/725
`Published Date
`20090818
`
`Registration No.
`1009128770000
`Registration Date
`20090812
`
`Application No.
`1020070123247
`
`Application Date
`20071130
`Unexamined Publication No.
`1020080050336
`Unexamined Publication Date
`20080605
`
`Priority Claims
`1020060121091 | 20061202 | KR
`Requested Date of ExaminatiOn
`20071130
`
`Agent.
`Kwon Tae Bok | LEE, Hwa Ik
`Inventor
`
`KIMJongJin
`Applicant
`Electronics and Telecommunications Research Institute
`
`Rightholder
`MNSTAR
`
`Title of Invention
`A MOBILE COMMUNICATION TERMINAL HAVING A FUNCTION OF THE CREATING 3D AVATA
`MODEL AND THE METHOD THEREOF
`
`Abstract
`
`The present invention relates to an apparatus and method for producing 3D avatar which the
`real person using the face image which takes a picture of the camera to the model of the
`mobile communication terminal, and the memory of storing the standard 3D face model for
`3D avatar creating, the front side face image obtained through the camera of the mobile
`communication terminal and the image processing unit assembling the side face image, the
`standard 3D face model, stored in the memory the front side face image combined from the
`image processing unit and 3D model transformation part producing 3D avatar model using
`the side face image, 3D avatar model generated in 3D model transformation part and the
`text inputted to the addition or the animation combiner assembling voice and produces 3D
`avatar animation data, and the animation data generate part assembling multiple 3D avatar
`animation data generated in the animation combiner and edits and produces animation data
`are comprised.
`3D avatar, the face image, animation, the contents, the face model .
`
`Scope of Claims
`
`Claim 1:
`
`The mobile communication terminal equipped with 3D avatar creating function of comprising
`the memory of storing the standard 3D face model for 3D avatar creating, the front side face
`image obtained through the camera of the mobile communication terminal and the image
`processing unit assembling the side face image, the standard 3D face model, stored in the
`memory the front side face image combined from the image processing unit and 3D model
`transformation part producing 3D avatar model using the side face image, 3D avatar model
`generated in 3D model transformation part and the text inputted to the addition or the
`animation combiner assembling voice and produces 3D avatar animation data, and the
`
`

`

`animation data generate part editing multiple 3D avatar animation data generated in the
`animation combiner with the combination - and produces animation data.
`
`Claim 2:
`
`The mobile communication terminal of claim 1, wherein 3D model transformation part
`comprises 3D avatar creating function of comprising the standard 3D face model
`transformation part, and 3D face skin material generating unit producing the skin material
`plated on 3D face model that automatically transforms the form of the standard 3D face
`model based on the front side face image combined from the image processing unit and side
`face image.
`
`Claim 3:
`
`The mobile communication terminal of claim 1, wherein the animation combiner comprises
`3D avatar creating function of comprising the example face model generation part, the face
`example data generate part, and 3D face model mixing portion mixing the example face
`model and face example data that produces various example face models according to the
`gesture using 3D avatar model and phoneme, and as to the face example data generate part,
`the user produces necessary face example data to the mobile communication terminal based
`on the direct text input or voice in animation.
`
`Claim 4:
`
`As for claim 3, the mobile communication terminal equipped with 3D avatar creating function
`of being generated according to any one of example face model is the Hangul utterance, and
`the gesture ofjoy and anger together with sorrow and pleasure and English pronunciation.
`
`Claim 5:
`
`The mobile communication terminal and 3D avatar creating method comprising assembling
`with 3D face model the above-mentioned text received or voice the step of producing 3D face
`model to the camera of the mobile communication terminal using the front side of the
`individual, the step: front side of taking a picture of the side face image, and the side face
`image and text or voice are received to produce face animation data.
`
`Claim 6:
`
`The mobile communication terminal and 3D avatar creating method of claim 5, wherein the
`combination - the above-mentioned generated face animation data further include the step.
`Technical Field
`
`The present invention relates to an apparatus and method for producing 3D avatar, more
`particularly, to an apparatus and method for producing 3D avatar which the real person using
`the face image which takes a picture of the camera to the model of the mobile
`communication terminal.
`
`The invention is drawn to the part of the IT new growth power core technology development
`project of ministry of information and communications and information and communication
`research institute from the research [the assignment management number : 2006-5-044-01,
`and the task name: multi core central processing unit and MPU base *** platform game
`technique development] performed.
`
`Background Art
`Generally, in the avatar is the cyber space, it was defined as the animated character
`replacing the role of the user and it had the disadvantage that the existing two dimensional
`avatar was implemented as the simple graphic and the real feeling was insufficient and it is
`3D avatar to improve and appear such disadvantage.
`But conventionally, manufacture was possible only when 3D model producer went through
`the some process for 3D avatar creating using the separate 3D graphics program. Especially,
`the skin material or the facial animation etc. could not help using data received as the
`separate equipment used for 3D avatar.
`For example, the expensive facial motion capture equipment is needed in order to make the
`natural facial animation and the , moreover, various post processing works are necessary.
`This has many hours 3D avatar is made and the difficulty of being many because the human
`agency and expensive equipment are needed.
`In order to solve this problem, 2001-0089329 A (prior art 1) produces the avatar on the
`internet using its own photograph and it discloses about the mobile image and the avatar
`autogenous program which can provide the various interesting stuff changing into the style in
`which oneself wants using the avatar mail by making its own photograph the avatar to the
`mode which captures only the existing magnetography by transmitting this with the mobile
`
`

`

`communication terminal and it transmits. But the troublesome procedure of to producing the
`avatar on the internet because it takes the mode which again transmits the avatar which the
`prior art 1 produces on the internet with the mobile is obligatorily required.
`It discloses about the form of business providing the high quality illust for the mobile
`communication terminal in which 2003-0025588 A (prior art 2) uses the real image
`photograph, and the animation character production and application service and the user of
`the mobile communication terminal transmits its own photograph to the service provider and
`the usage professional designer makes the high quality illust and the photograph is provided
`to the character of the moving picture (two dimensional or 3D) form to the mobile
`communication terminal of the user.
`
`But the prior art 2 has time the form in which the professional designer which is not user
`makes the avatar is taken the advantage that the high quality character provision is possible
`is provided and the disadvantage of being uneconomical in the cost side.
`Summary of Invention
`
`Problem to be solved
`
`The invention is provided to solve above-described problems. And the mobile communication
`terminal and 3D avatar creating method equipped with 3D avatar creating function of
`producing 3D avatar the real person using the face image which the object of the present
`invention takes a picture of the camera of the mobile communication terminal to the model
`and making various 3D contents using this are provided.
`Hereinafter another object of the present invention and advantages will be explained and it
`knows with the embodiment of the invention. Moreover, it can be realized by the means and
`the combination which purpose and advantages of the present invention show in the claims.
`
`Means to solve the problem
`It comprises the memory that the mobile communication terminal equipped with 3D avatar
`creating function according to the present invention to achieve above object stores 3, and the
`standard 3D face model for the dimension avatar generation; the front side face image
`obtained through the camera of the mobile communication terminal and the image processing
`unit assembling the side face image; the standard 3D face model, stored in the memory the
`front side face image combined from the image processing unit and 3D model transformation
`part producing 3D avatar model using the side face image; and the animation data generate
`part editing 3D avatar model generated in 3D model transformation part and the text
`inputted to the addition or the animation combiner: assembling voice and produces 3D avatar
`animation data and the multiple 3D avatar animation data generated in the animation
`combiner with the combination - and produces animation data.
`Moreover, 3D avatar creating method according to the present invention comprises the front
`side of the camera of the mobile communication terminal the individual, the step of taking a
`picture of the side face image, the step of producing 3D face model using the front side, and
`the side face image, and the step after it receives the text or voice of assembling the above-
`mentioned text received or voice with 3D face model and producing face animation data.
`
`Effects of the Invention
`
`As described above, according to the invention, presently, the image used for 3D avatar is
`easily obtained by using the camera of the universally used mobile communication terminal
`and 3D face model is made based on this image with the automated system and the camera
`has the effect that 3D avatar model and animation production are possible to the effort and
`the time which is less by producing the animation based on 3D face model when additionally
`inputting moreover, the text or voice.
`Such 3D contents can be manufactured to the contents which is more various and is
`
`interesting than the service including the text message based on a text or mail, the chatting
`etc. and because it is provided to the moving picture in which the resolution which instead of
`accompanies voice with text is moreover small is high the advantage that the user easily can
`recognize is provided.
`
`Detailed Description
`Hereinafter, 3D avatar creating function according to the present invention is particularly
`illustrated with reference to the mobile communication terminal included and drawing which
`is 3D avatar creating method attached.
`Figure 1 is a configurated block diagram of the mobile communication terminal equipped with
`3D avatar creating function according to a preferred embodiment of the present invention.
`
`

`

`The memory unit (102), the control unit (104), the RF part (106), the voice processor (108),
`the speaker (110), the microphone (112), the key input unit (114), the display unit (116),
`the camera (118) and 3D avatar creating unit (120) are comprised.
`The memory unit (102) stores the program in which the procedure for performing 3D avatar
`creating function is programmed.
`Moreover, in the memory unit (102), the operation program of the control unit (104), and the
`system program is stored and especially, 3D avatar is produced but the standard 3D face
`model information for the necessary program, and 3D face modeling is stored.
`The control unit (104) controls the overall operation of the mobile communication terminal.
`Simultaneously the program stored in the memory unit (102) is in read and 3D avatar is
`produced from the face image performing the programmed procedure and is photographed in
`the suitable program and it controls using this so that various 3D producting content is
`possible.
`The RF part (106) controls transmission and/or reception of the radio frequency signal.
`The voice processor (108) modulates the electric signal inputted with the microphone (112)
`and it converts into audio data and it outputs to the RF part (106) or encoded audio data
`which are inputted from the RF part (106) are demodulated into the electric signal and it
`outputs to the speaker (110).
`The generally the key input unit (114) consists of the key matrix structure. It is made of the
`function key for performing the multiple numerickeys, the direction key and various kinds
`function and the electrical signal of key data is outputted with the key input of the user to the
`control unit (104).
`The display unit (116) indicates the terminal current state or the changing of progressing
`condition of the program is indicated. Moreover, the receive short message etc. are indicated.
`Such display device can arrange with the display device including the liquid crystal display
`(Liquid Crystal Display : LCD) etc.
`The camera (118) includes the part of the digital camera like the semiconductor image
`sensor, flexible printed circuit board (FPCB), lense for camera, at least one flash etc like the
`solid imaging device (CCD) or the CMOS image sensor (CIS) and the operation of taking a
`picture of the external object according to the control signal of the control unit (104) and
`obtaining video data is performed.
`Moreover, the mobile communication terminal according to the present invention includes 3D
`avatar creating unit (120). 3D avatar creating unit (120) consists of the image processing
`unit (122), 3D model transformation part (124), animation combiner (126), animation data
`generate part (128).
`In the image processing unit (122), the guide-line in which face is positioned is indicated so
`that the image of face is appropriately used. This guide-line indicates the front face position
`guide and side face position guide. The photographer fits to this guide-line and the front face
`and side face image are continuously taken a picture of and in order to be used the front side
`face image and side face image as to the photographed image, are data of the following step
`combined.
`
`In one embodiment, according to the image processing unit (122) is the photographing
`command through the key input unit (114), the front side inputted through the camera
`(118), and the side face are taken a photograph and the front side face image and side face
`image are assembled and the face image which is combined it produces 3D avatar is stored in
`the memory (102).
`Then, in the state where the image processing unit (122) is aimed at the face of the
`photographing object by the user, if the operation of the key input unit (114) commanding
`photography is made 3D avatar all kinds of the screens required for a series of procedure for
`the production is indicated in the display unit (116).
`For example, it is inputted through the camera (118) and the guide-line screen which shows
`the guide-line of face in order to set one's sight on the object which takes a photograph so
`that the case where the photographic Mode is performed by the image processing unit (122),
`and photography by the guide-line technique are made, is overlaid on the image indicated on
`the display unit (116) and it indicates.
`In the guide-line of the front face indicated on the display unit (116), the face contour is
`seen. That is,
`in the display unit (116), the guide-line showing *** of the eyebrow, eye, the
`nose, the mouth is overlaid in the state where the face image inputted through the camera
`(118) is indicated and the state is indicated.
`
`

`

`Accordingly, the collimation about the photographing object can be performed so that the
`correspondence part of the photographing object is matched for the guide-line in which the
`user controls the position of the mobile communication terminal and which is overlaid in the
`display unit (116) and which is indicated.
`Fig. 2 is the detail composition block diagram of 3D model transformation part in fig. 1. 3D
`model transformation part (124) comprises the front side face image, the standard 3D face
`model transformation part (124a) 3D avatar model is produced using the face image which
`the side face image is combined, and 3D face skin material generating unit (124b).
`Referring to Figure 2, for 3D face model, the standard 3D face model is served. The form is
`automatically transformed into based on the front side in which this standard 3D face model
`is obtained in the image processing unit (122), and the side face image. As to the this, the
`standard 3D face model transformation part (124a) manages.
`In the standard 3D face model transformation part (124a), transformed 3D face model is
`actually transformed into into human and similar form of the face image. 3D face skin
`material generating unit (124b) produces the skin material which it next plates on 3D face
`model in the front side, and the side face image.
`If the skin material is generated, the material plates on 3D face model according to the
`determined skin coordinate and 3D avatar model is generated.
`Preferably, the system transforming the standard 3D face model using the front side, and the
`side face image is separately supported as the program for the mobile communication
`terminal.
`
`Fig. 3 is the detail composition block diagram of the animation combiner in 1.
`Referring to Figure 3, the animation combiner (126) comprises 3D avatar model generated in
`fig. 2, the example face model generation part (126a), and the face example the data
`generate part (126b) the text or the voice inputted to the addition is assembled, and 3D face
`model mixing portion (126c).
`The example face model generation part (126a) creates various example face models
`according to the gesture and phoneme using 3D avatar model. For example, according to
`example face models is the Hangul utterance, the English pronunciation, and the gesture of
`joy and anger together with sorrow and pleasure, it is generated.
`As to the primary principles, several chassises are connected in the standard 3D face model
`in fig. 2 and it moves this according to the determined pattern and it creates each example
`face model.
`
`The user the face example the data generate part (126b) creates necessary face example the
`data in animation with the mobile communication terminal based on the direct text input or
`vouce.
`
`In these data is 3D face model mixing portion (126c), it is previously mixed with made 3D
`face models. Then, it fits to data inputted to the text or voice and corresponding example 3
`dimension face models are mixed.
`
`3 dimension face models mixed to such process are connected to for each frame and 3D
`avatar animation is completed.
`In this way, the several 3D avatar animation datas generated in the animation combiner
`(126) is edited by the animation data generate part (128) with the combination -.
`The several 3D avatar animation datas generated in the pre-phase can assemble in the two-
`step and it can edit.
`The animation length and order etc. can be diversified in the editing.
`It is stored as the universal data format so that 3D avatar animation edited with final is used
`
`in the mobile communication terminal for various 3D contents provided. It utilizes for the
`multiplex contents including 3D mail, the chatting etc. and these datas can be used as each
`contents data in common.
`
`In the above, it showed and it illustrated for the preferred embodiment of the invention.
`However the invention is not restricted in the above-described specific embodiment and
`without deviating from the gist of the invention claimed in the claims it experiences and such
`transformation execution ises are individually the normal knowledge understood in the
`technical field in which the design belongs by the excitation person from the technical
`mapping of the invention or the prospect. The various transformation execution is possible.
`Eflflilll
`
`

`

`3 EH5 2% 3—4 ElEUIEEEi 553% E49 Xlgtflgl MAEIE OlgoH é'iéfiEl
`
`(BIELIEL [Gal/H $§§12§ 22%| Jiggm 911004,
`.2 $H§ Xl21% as;
`
`5% Pigllell 9.3+ ,tHgI,§% EHN8l.= 140$ OlgEIOl/HE 9i E'LIEl. MAE!
`
`[Hol
`3—4 H|E$439| ggflH-EOH 'jelé'iét 29h] $Er #éi, HIOIElBI §%i|%01|
`04 3948 E15104 393% XIII E’gfiLIEl 3 EH5 Cal/RBI ME %9 SIOI 93%
`
`0| 815 Cé'PJ EHEE <wD—ISH DB 3—4 AlfiElOll Xl’élEIOl XHé'i, % l, HHE-‘E‘ ¢ 81
`%% gaiEElLIEl
`
`(The document produced by using the high-tech machine translation
`system for the patent and science & technology literature. Therefore, the
`document can include the mistranslation, and it should not be used as a
`translation by a professional translator. We hold no legal liability for
`inconsistency of mistranslation, partial omission, and data generated by
`feature of system and network. We would like to inform you that the
`document cannot be regenerated, copied, and distributed by being stored
`in DB and system for unauthorized general public without our consent.)
`
`

`

`2- 3H § 51 10-2008-0050336
`
`
`
`(11) $1113:
`
`10-2008—0050336
`
`(43) 5017119424
`
`2008110620524
`
`1111. c1.
`(51)
`H048 1 40 2006.01
`(21) @9414: (
`1032007—0123247
`_ LL
`(22) gay}
`zoomingsoa
`WWIQX}
`2007611§30$1
`
`(30) 5221;4an
`1020060121091 2006612§02<§ WEWJflKR)
`
`Xdfl1i3?%?i%6%
`
`(71) @3111
`6&1 }E*1°4:rL°J
`L
`1.;< 0 LL 1'.
`W11 To”? 7V§% 161W]
`Lug
`(72) 1:)“
`7“ ° 73
`W6 %*31 7P‘é% 161‘jdx]
`(74) “a?
`flflfl,flfl%
`
`
`
`(54) Sik‘fl 43%} *3/21 71%% $3133 °]%%<‘l 6&7] B—l3i}% OWE} 43% “chi!
`
`
`
`€—%@%°Hfifll%gflfl7HWE:%%§€E§§%%O%flfi/%mfl%%lw&ifiE3fl%°WM§
`%%§%:flE5W1QEHM1%§%EEq3fl%°WW}%%%$fi}E%3T%€E§E%%XfifihlflE
`%%41%%flfl flflfl§4%fl 22%:gaefiiqMflq-éa
`E §%a% @fiflfi
`
`% :fiflUMRM1fl%flfi2R:%fl§EE3R£QEEQQV$Hfififlfi%ififiifl%>%3%%°Wl
`XM¥§€€£§flflfl§°%flfi3%%°WW¥£%%%§&E3DE%%§$%;%fl3033%%%%fifi
`%%3fl%oww+fiafli%fiifla %%fliEé§%%fié~i%fifi3%%°WW¥%H%QEE%WE§®
`flfiE°WWwMié%%%:%flOWWMMiéfifiwH»%$a%¢flfl3%%°WW¥%H%WEHMH%%
`éfi-fiflflfi°WWMM1WQH§4M$H?%H%QEE%W1%%%EE§RP%?%%W.
`I—El
`
`
`
`
`
`
`

`

`2- 3H § 5% 10-2008-0050336
`
`2006-8-044-01
`
`@E%fl%
`Hd%%%aflflfl%fl%4fi
`gflifiCWEQWWW}i%%fi%7MJE§fl%
`fiififl§dfi¥%
`2006.03.01.~ 2009.02.28
`
`
`
`

`

`2- 3H § 5% 10-2008-0050336
`
`
`
`%?%1
`
`BEEOWWEEEEEW_EEBTEEEEEEEHEEEEEEEEE
`
`o1EEE EE71E E1J11E1E EE1 EEE EE EE o1E1A1E EE EE o1E1A1E EEE1E EAOJJEJ
`04E
`
`E71:J1EE011 AJAJEoJ°JE AJ71 EE 3H1} EEEE EJ AOJ71 EAOJEJEJEEEEJ EEE EE
`EE Eo1E1A1E o1EE1E1 3E1E o1J1E1EEE AEAEE1E 3D EEE ;E;
`
`AJ71 3D EEEEE<>11AJ AME 3E1J o1JJ1E1 EEE E71E EEEE EEE EE EAEE EEE1E1 3E1E 011E
`E1 °HJ4JJJ10W EJ1o1E1E AEAJ E1E 01Eu11o1AEEE; EJ
`
`E71 °HJ4JJJ10W EEEEonAJ AEAJE EE711E3 E o1JJ1E1 °HJ4JJJ10W EJ1o1E1EE EEJ- EJEE1E1 01EE101AE
`
`EJ1o1E1E AEAEE1E 01EE1o1AE EJ1o1E1 AEAJEE EEE1E 7iE—ZE EEEE EE 3E1E o1JJ1E1 EA; 71EE EJ1E
`OIEEN EL‘EL7] .
`
`%¥%2
`
`x111EJoJ1 EJ01AJ AJ71 3D EEEEEE
`
`EEE3
`
`x111EJoJ1 EEAJ, E71 oHE1u1101AE EEEE
`
`E71 BER/1 OWE} EJ‘EE OIEEJOE E1334 E6011 FEE 0431 7R1 OJIAJ] OEE EJ’EE AEAJEJE OJIAJ] OEE EE’
`£313.? -
`
`A1EA171 o1EEAJ EEJ71E AJAJ EEE EEEE EAEE 71EEE 01E1u11o1E<>11 EEE EE 011x11 EJ1o1E1E
`
`AEAJEJE EE <J1AJ1
`
`rJ1o1E1 AEAJE- EJ
`
`01W 04% ELEM} *L71 04% 01W EJLOIHE §§EL5LE STE/l 0E4? PEEL EELE—E EELELE fig: Efiii
`*L71
`0}: Sib‘f/l OLHLEL *3/‘3 71EE ELHIEL °]%%fl ELEV].
`
`0301 L'EL%,
`0W1] 04% EEELO 5L1 L'EL%,
`*oL7]
`“1380”” 5301/“,
`”Lg/LJQE 725% E Lii 01-: 57H}; o}1j}1;} xg/g 71%,;
`E
`
`‘3‘; §1§°HEJL91 3% § 01: 8PIN]
`%
`
`[ELF/L 7474
`
`
`
`1111 E E E
`A115EJ<>11 EEAJ, AJ71 AEAJE EE 01E1u11o1AJ EJ1o1E1EEE - LE
`1.
`E o1EEAJ EEJ71 EJ 3E1E o1JJ1E1 EA; EE.
`
`
`J1 0L4 [0W 01.
`IL H HELL2L r1‘
`2L r1‘
`r-E A 111111
`1110
`x“.
`
`
`
`

`

`2- 3H § 5% 10-2008-0050336
`
`EEEE EEE E 21E
`
`EE XEEEEE 01E
`
`
`EEEEE EEEE X10111 E7E<>J1X1 X1E71E EEE EXEEE 1EE1o1XE EEEE EEEE 7E127E
`EEEE EEE :EEEE EEEE EEEE EEE EEE E01 EEE o1EJ EEE 71EJa1o1 EEE E01
`
`EEE o1EEo1E.
`
`EEE EEEE BEE EEE EEE EEE EEE EEE x11E7171 EEE EEE EEE EEEEE EEEE
`0m
`E121 EEE EEEE EEE 71E EEE. EE, EEE o1EEoJ1 X1EEE EE x1Eo1E EE o1Eu11o1XE EE
`EEE EEE EEEE E1o1EEEo1EE E11011 EEE.
`
`GREECE, XPE EEE EXE 0111411110 IXEEEEE71 HEW: 1719] EIOIXE EXE 711EX% E13171 EEEEI 0] EEE
`0131 71X] EEE XE‘EO] EEEE. 031E “1% CHEF/1E X11XE<>171°11 EEE WEE 0EE‘, 1E1 1719] XJEW
`Efiémofl EEE CHEESE 71X11 9;
`
`EEE EEEE E1EE71 EEE, EEE 71EE E12001— 0089329E<EJE71E1>E EEEEEXJ 71EJE X1EJE
`
`EEEE EEEE EEE: 01E o1EEEJ EE71E EEE EEEE 611% EEE 71EE1 7171 X1E1EE E71
`5101 EJEEE EEEE EE 71EJE X1EJEE EEEE EEEEE EEEEEE EEEE 71EJo1 EJa1E EEE
`
`E EEE E EEE EE E EEEEE EEE E EEE EEE 0111171 E EEE 7171X11E EEEEE 141511 71X1
`
`EEEE EEE EJE71E1E EEE XEoJ1X1 EEE EEEE EX1 EEEE EEEE EEE E48171 EEE
`EEE XEoJ1X1 EEEE XEXJ 01E 51E EEEE Ex171 EEEEE EEEE.
`
`EEE 711E61 x112003— 0025588:(XJ E171E21E XEX1X1E1E— OIEE o1EEX1 EE71
`
`010 H EMNE
`E1011 7HX1<>11 (“0131 OIEEEJ E11117 ° X1EX171 EEE]
`“E EE MEIEE EEEE XFE‘ EEE]
`EH XEXE
`X1XEE HEM 711EX1°J1711 XEEEE] 1 X1XE9— OIE XEE EIXMLM EEXEE] EEEE
`EEE 321E) EEE] 7HEE1E X1EX1E] 01EEXE EE71011 711% 011 a}
`.
`
`> m
`
`9
`
`iii
`
`011 0.91.
`
`1i
`
`:4:
`
`EEE EJE71E2E EEEE EEE EEE 71E EEE EEE x11EEX1EX1E7171 01E EE E71o1E71
`EEEE x11Ea1E—E EEE EEE: X17E E E1EEo11XJJJ17Ex11EE EEE 71EE.
`
` E
`
`EE
`
`E
`
`E1Ea171 E51010EEE EEE, E EEE EEE o1EEEJ EE71E1 EEE:
`EEE EEE EE 371E 01E E XEXEEE 01E EEEE EEE EEE
`
`EEEE EEE E EEE 321E EEE XEXJ 71EEEE1E o1EEEJ EE71 E EEE EEE XEXE EEE EE
`EE EEE.
`
`
`
`
`/\\i
`
`C) V
`
`11>
`
`

`

`2- 3H E 51 10-2008-0050336
`
`33 737333 3D 133333— 3J *J7J SD 33333—011*J 73733 37J3 OJJJJEJ JJ3JJ 37J3 0J3J 3 WE
`33 3733 3.3331 37J3 OJJJJEJ 013010173 310133 *J7J3J3 01301013 3.3333 *J7J
`°1JJJJJ11°1*J 73
`
`3—013 73733 33719133J73 OJJJJEJ 013010173 3101333 3.33 - 373331 013310173 310133 73333 OH
`3010173 3013 73733—3 3333 3J3 3 J23 33.
`
`33 3 33301 3J3 3303 OJJJJEJ 7% JJJJ33, 013373 337191 30133 33331 733, 33 033 013171
`
`3 30333 371; 7371 733, 33 033 0131713 01333 37J3 033333 737333 371; 3 33:3 33
`3733 033333 3, *371 03333 33:3 33 3733 7371 37J3 0333331 3.3331 033 01114 10173 3101
`
`3J3 73733: 3713 :33: 3J3 37333 313
`
`v
`
`/\ >. LN
`
`<14>
`
`
`
`013, 3 JJJJJoJJ 3J3 37J3 OJJJJEJ 7373 7133 3313 013373 3371 U3 37J3 OJJJJEJ 7373 3333 33—3
`
`13 3 3 3391 33*1 011011 1J3 37J3J OJHJEJ *MJ 713 3%13 013311 1337191 3* 331391, U11:3
`@3002), 7J10J3(104J, RF1‘H106), 3*J7JFJJJ—(108J,
`i:7J(110J, UJ°1333(112J,
`71
`(116), 7JJJJ1BH118J,
`“J 37J°J OJJJJEJ *J*33(120J3 333m 3333.
`
`3133341023 3733 OJJJJEJ *MJ 7133 3811371 3J3 737J7J 33131333 3313313 7170131 a}
`
`£33, 31333—(102J0113 31013—1104) 91 3711 331331, *1éE3J 33133101 7170133, 331 37J3J OJHJEJ3 *3
`
`*33 331 3313 331331331) 033 33133 3J3 33 31) 03333 3337170131 93‘
`
`.
`
`L 37113 7J10JJJJJ 3*1011, 313334102011 7J7J3 3313313 3
`3OJ 3113J 331331011 331313331 737J3 #7 3JOJ 30331033 °1JJ17133EJ 37J°J 0JJJJEJ3 *J*J3J1,
`01
`0130J0J 3°33 373371 F31: 7171101 #33133 71017331
`
`RF‘?(106JE ‘JEZJQ’F/‘JEQ €163 711013351.
`
`11111
`
`3*37JPJJJ—(108J3 U10121§3(112J011 3311 (31333 7171 11:3 333M 3*: 3131313 3331, RFl‘HlO61E
`3731317JJJ E3 RF3<106J33EJ 037‘7313 33331 3*:
`E1101 13 7371 11:3 33—313 éjJ7J(11oJi33131
`
`:1
`
`71QQE—(114JE QEQEE 71 “HEQi EEE E/‘JQEQ, QEQ 7/371 71Q “017317191 731% 71%: #8318171
`$31331 71371E °1E0171U1 *13‘371Q 71 Q7310“ Q31 71 E11°1E1Q 7171;101 NEE 711Q3<1041EE E3.33131.
`
`E1E<116JE E17371 Q711Q ”141% E*16171L1 EEJJ‘J‘Q 731831 @1701 EEQE E*1§1E1. E731 #11 E13“: WW
`1
`X1 E13: ELL/431151. 0133 E/J1 X(171% Q1113 E/J1 X0171(Liquid Crystal Display 1 LCD) gm} 71:}% EA] 0171i 3?
`@631 5? 931:1
`
`0112171 7JJ7J 373313713
`o1JJ171 *317J(CISJ9J 73% 3111371
`7JUJ1BH118J3 171 3%} 371(CCDJ £33 CMOS
`(FPCB), 313131301 3112, 730113 81% 01391 331*1 34 733 E171% 3131313] 333 EH1810J,7J1°J3(104J
`Q 7J1°J £11011 EJBJ 54391 31333 33333133 03% EJ1°1E13 353313 333 #311313.
`
`333, 33'3333011 1J3 013311 J3 “3713 37J°J OJHJEJ *J*J‘J(1120J3 JJJJME 931331, 37J°J OJJJJEJ *J*J‘J
`(120J3 0*J7JFJJJ—(122J,
`3D 3333,3(124J 011JJJJJ1°1*3 3.33 (126),
`011JJJJJ1°1*J EJ1°1EJ *J*J3<128J3 3
`33:1
`
`

`

`232121ET<12212121E EE21 21212121 212.121 21EE T 2152 EE21 2121211 2121: 212L1E E2121TE211.
`o1 2121: 212L1E 2.12.1; EE 2121 2121521 E?! EE 1121 71°1EE E21'L1T1. E2321E o1 2121: 212L121 E
`
`21 21E EE1 E‘E EE 212121E E2121 E23211, E2321. 212121E 21% E2121 21121E1E 2121221 1121 21
`E EE 21212121 221 EE 212121122112121.
`
`2- 3H E 51 10-2008-0050336
`
`E121,21121121 232012121T(1221E 21TE1E1
`EEE 2.1232121 21E EE 21212121 EE EE 212121
`E 212121E 211E121(1021211 212012121.
`
`21211. 321E 21111E1E 221232121 1121
`
`
`
`
`
`11?.1131.1119
`
`21211 21232120121 EE<>11 EEE 212121121 E23 E E25121E 21EET<1141
`23201 2121T(1221E 2120221211
`21111,
`21 E2121 21T2121E 321E 212121E 212323: 1121 E12121 E21211 EE2L1 71E 21EE E21T(1161211E21‘L121.
`Ea
`T:L_1_
`
`21,2121 2121T(1221211 212112.123 EE212E1211EE210T, 2121E 21E 21111211 E2L1
`
`EEE E12123: EEET2 21211 2121 T1211°E1E21 2121: 212L1E E2121: 212E
`
`5'3m12
`
`111' (‘3.
`
`E2011°E11
`
`21 21T<1161211E E21E 23201 T1211 52111211212121 E212L121.
`
`figé
`
`(118
`
`
`
`“111111‘“1111
`
`E21T(1161o11 E21EE 21E EEE 2121E 212L1211E°1EEE121 E212L121. E, E21T(1161211E 21211E1<11
`1E E211 21EEE EE 21212121E21E 2012121121 E21: E, E, E121 EEEE L1121111E 2121E 212L121 E111
`:1121E21 E21E21.
`
`21211 E£121, 21E21E 21EE2L1 E212121 T121E EE2121 E21T(1161211 32121121 E21 E21E 2121E 212L121
`E23 2120121 211ETTE221 2121EE
`E12L1 EEE TEE T 9121.
`E1
`E
`
`2EE12112121 311E EEETE 20121 T23 E
`E
`EE21,
`311 LEEL 21LT(1241E21E EE 21212121 EE 2E1
`2L1
`E 21:12121 E21E21 E21 EE 212121E 212022121 321E 2121121 EEE 21212121, EE 321E EE EE 21
`E1L T(124a1 E1 321E EE 21T2112E1 2121T<124b1E E21211 91
`.
`
`12L 2E EE21E 3’1E EE EEE T121121E EE 321:1 21EEE1E 211212121.
`
`21 EE 3’1E EEEEE 23
`
`2122121T1122121121 E212L1 21E, EE EE 212121E 21EE 212121 21E2E E2 21E21. 21E EE 3’1E E
`E EE EEEET(124a121 EE2L121
`
`V—fr 31% ‘EE EE’
`2:
`1
`
`
`
`‘11E1EE-r(124a10112121%ii THE 321% EEEE’T E211L
`
`111, 321% ‘EE 31T2112E1 23*3T(124b171 1 9% 23E, EE1:
`
`‘EE 0112121E 21E311 111
`0E1 E 01131210121 321%
`
`2122—2121:,
`
`211112112123 E21TE(1261E221121 2123E 321E 21111121 EE1311 T71E °1EE EEE EE
`
`21211 EE EE 2121T(126a1, EE 211211 E12121
`EE2121 321E 21111121 211112112123 E1121E1E 21212121,
`2123T(126b1, E1 32111 o1EEE'E1 E21T(126c1E E21211 9121
`
`23/132111? EIEEOE,
`
`21211
`
`‘EE EEEE 2L1E TEE,
`
`0301 TEE, EIE°HE1E E13011
`
`EE’E 0122312101 E13311 E2601 111% 0131 7121 01121
`
`‘EE EE’E
`
`11131 47% 23/133711
`
`71E£1°J EEE, E221121T1 ET 32111 ‘EE EE1 E1211 0131 711% 111111171 032233019401 01E 2321111 E11EL1211
`11131 01%2171 4491 21211 ‘EE EE’E 23/132171?
`
`EE 21211 111013 23*3T<126b1E 2122312171 WEE/1L1 EE7
`
`11'“
`
`11$ 112$ m9 .1111. r1 1% 11 1m L U100?. 11110 i 115Io 11'“
`
`:9: L E 3
`
`”EON EEL ‘EE 01121 111°1E1E 23/132171?
`
`TL EE EE1 E21T(126c1o1121 212121 2L1
`EEEE E/‘OEE EEE E1121E1E 211
`‘21T
`21121 211211 321231
`
`(28>
`
`<31>
`
`<3 5:2
`
`<3 91:2
`
`(.471 \.~_/
`
`

`

`2- 3H § 5% 10-2008-0050336
`
`oJDd AJAJAA DAJDAJLAJ 3AJDJAAD EDJDD AAJAJDJ: oJoJAJ 3AJ°LJ oJDJDJ AJDJDJJA JALJ D ALJAJAJAJ AJLDJ.
`
`oJD—JAJJ AJDJDJJAJAJ AAJD (126JoJJAJ AJJAJ AJLAJDJ AJAJ
`AJAJD<128>AJAJAALJ-AJJAJLDJ.
`
`3AJ°LJ oJDJDJ oJDJuJJoJALJ DJJAJDJDD AJDJDJJAJAJ DJJAJDJ
`
`ALJDLJAJJoJJAJ AJAJAJ «ADJ AJAJ 3AJDLJ oJDJDJ oJDJuJJoJALJ
`
`:JJAJDJDAJ oJ DLJAJJoJJAJ AAJAJ: ALJAJALJ D AJDJ.
`
`ALJAJ AJoJJD oJDJuJJoJALJ
`
`€019}
`
`3A1 D LAJAJALJ D AJDJ.
`
`AJA ALJAJAJL 3AJJ2J oJDJDJ oJDJDJJoJAaD oJDDALJ DLJDLJAJAJJAJ AJJ—AJAJD DJALJALJ
`
`oJ DJJAJDJDD 3AJJ2J
`DJAJAJAJ DJJAJDJ ADA: AJAOJDLDJ.
`AJ AJLDJJ: DJJOIEJE ADAg: A}%% D 22
`
`“11%,
`
`‘HEJ DAJ DJALJAJ AJLJJAoJJ ALJJs-JAJ
`
`oJAJoJJAJD DLD DJDJAJ DJDJAJALJ AJAJAJJ oJJ DJJAJAJ CAJAJE AJDJAJAJAJDJ D DLJDJD ALJgALJ DAJAJ AJAJoJJoJJ AJ
`
`AJDAJ oJDJAJDJ AJAJDJDJoJJAJ AJAJAJD D DJDJAJ 3A1% DJAJJJAJ
`AJAJ AJAJD AJALJAJoJJ AJAJ DJAoJ ALJ DJAJAJAJAJ AJDALJ AD D
`
`€20]
`
`DJAJ
`
`D
`
`AJAoJoJDJ AJDJAADDJ AJJDLJAJALDL oJAJDoJAJAJD ALJDJ AJAJDJ.
`
`
`LDL 1% D DLJDgAJ AJAJAJoJJoJJ :43 3AJDJ oJDJDJ AJAJ AJDDDDJALJ oJJgDDALJDLJDJDLJAJDJ DA; DDE oJDJ.
`
`E 2% E IOJWD] 3D EDJJJDEDLJE—D] OJAJI $A§ 55501:}.
`01J
`
`LTAD]MI W: 53301:}.E 3% E ION/‘19] OHJDIUJIOI/q i 11]:
`
`
`
`
`
`
`
`. L. w
`J,”
`§ at;
`
`
`
`

`

`10-2008-0050336
`
`53
`
`E:
`
`2O
`
`DH
`
`3.
`..L‘»
`
`35.373333132329533
`£1.23}
`
`.3gmma...i
`
`n......
`""3
`5'3: ~
`3
`
`Hmm.
`
`mm.
`
`.3.
`gg.
`
`L...
`”suffix:
`
`1.
`
`
`
`"333333333333._3\\\\\\\\\\\\\\\\\
`
`.s}...
`
`«H.H.&.....u
`
`
`
`«V5..M...!uvil‘iii-31.113!m”.0«3'3]..l3rllM3_.
`
`
`MI...MHa.E..wan.Eaw333333333,”MMaat3T...
`
`“»
`
`
`
`.3..33.3.,3.3?3.
`
`mmm
`
`.”a
`gamma
`
`
`
`
`
`
`
`
`

Accessing this document will incur an additional charge of $.

After purchase, you can access this document again without charge.

Accept $ Charge

This document could not be displayed.

We could not find this document within its docket. Please go back to the docket page and check the link. If that does not work, go back to the docket and refresh it to pull the newest information.

Your account does not support viewing this document.

You need a Paid Account to view this document. Click here to change your account type.

Your account does not support viewing this document.

Set your membership status to view this document.

With a Docket Alarm membership, you'll get a whole lot more, including:

  • Up-to-date information for this case.
  • Email alerts whenever there is an update.
  • Full text search for other cases.
  • Get email alerts whenever a new case matches your search.

Become a Member

One Moment Please

The filing “” is large (MB) and is being downloaded.

Please refresh this page in a few minutes to see if the filing has been downloaded. The filing will also be emailed to you when the download completes.

Your document is on its way!

If you do not receive the document in five minutes, contact support at support@docketalarm.com.

Sealed Document

We are unable to display this document, it may be under a court ordered seal.

If you have proper credentials to access the file, you may proceed directly to the court's system using your government issued username and password.


Access Government Site

We are redirecting you
to a mobile optimized page.

We are unable to display this document.

PTO Denying Access

Refresh this Document
Go to the Docket