United States Patent [19J
`Mattes
`
`111111
`
`1111111111111111111111111111111111111111111111111111111111111
`US006038295A
`[11] Patent Number:
`[45] Date of Patent:
`
`6,038,295
`Mar. 14,2000
`
`(54) APPARATUS AND M ETHO D FOR
`RECORDING, CO MMUNICATING AND
`ADMINlSTERING DIGITAL IMAGES
`
`[75]
`
`inventor: Heinz Mattes, Municb, Germany
`
`[73] As.signee: Siemens A ktiengesellschaft, Municb,
`Germany
`
`[21] Appl. No.: 08/877,488
`
`l22J Filed:
`
`Jun. 17, 1997
`
`[30]
`
`For eign Application Pr iority Data
`
`[DE] German y ........................... 196 24 128
`
`Jun. 17, 1996
`Int. C l.7
`.......... ... ... .. ............................... ... H04M 11/00
`l51]
`[52] U.S. C l . ........................ 379/93.25; 348/211; 704/270
`[58 ] Field of Search ................................ 348/14-17, 211,
`348/223, 232, 231, 7, 239, 522; 455/418-420;
`379/88-89, 93.21, 93.25; 707/3- 5, 10;
`395/2.66; 704/270; 396/283
`
`[56]
`
`References C ited
`
`U.S. PATENT DOCUMENTS
`
`5,063,587
`5,182,765
`5,260,989
`5.576,759
`5,594,736
`5,633,678
`5,640,198
`5,666, 159
`5,689,303
`5,721,827
`5,737,491
`
`11/1991 Semasa et a! ............................. 379/53
`1/1993 Ishii et al .................................. 379/88
`11/ 1993 Jenness et al. ............................ 379!59
`11/ 1996 Kawamura et al. .................... 348/231
`1/ 1997 Tatsumi et al. ......................... 348/232
`5/ 1997 Parulsk.i ct al. ......................... 348/231
`6/1997 Makiyama et al ........................ 348/17
`9!1997 Parulski et al. ......................... 348/2 ll
`ll/ 1997 Kuroiwa .................................. 348/232
`2/1998 Logan ct al. .............................. 348/ 13
`4/1998 Allen et al. ............................. 3481211
`
`5,737,592
`5,748,841
`5,748,898
`
`4/1998 Ng\•yen et al. ............................. 707/4
`5/! 998 Morin et al. ...... ..................... 395/2.66
`5/ 1998 Ueda ........................................... 348n
`
`FOREIGN PATENT DOCUMENTS
`
`0 624 968
`0 702 490
`41 26 105
`44 08 738
`195 42 122
`44 41 685
`6 268582
`
`ll / 1994 European Pat. Off ........ H04M Ll /06
`3/1996 Eu ropean Pat. Off .......... 1104N 7/14
`2/1993 Germany ...................... H04M ll/00
`9/ 1995 Germany ...................... !104M ll/00
`5/1996 Germany ........................ H04M 3/42
`6/1996 Germany ...................... H04M ll/00
`9/ 1994
`Japan ............................. H04N 5/225
`
`OTHER PUBLICATIONS
`
`Japanese Abstract, vol. 15, No. 351, 3-136487, Jun. 11,
`1991.
`Markiiibersicb: Low-cost- Digitalkame ras, Canon: Power(cid:173)
`Shot 600, MACup Apr. 1996, pp. 100-101.
`
`Primary Examiner-Paul Loomis
`Assistanl Examiner-George Eng
`Attorney, Agent, or Firm-Hill & Simpson
`
`[57]
`
`ABSTRACT
`
`A communication system includes at least one telepbone
`unit, a transmission system for communicating from the
`telepbone unit, and a server for receiving information via the
`transmission system. The telepbooe u.olt includes a d.igital
`image pick up by wbicb images are recorded, transmitted to
`the server, and stored in the server depending upon classi(cid:173)
`fication information wbicb characterizes tbe digital in1ages
`and wbich is associated witb tbe digital image data. The
`clas.sification information is determined by an analysis unit
`in the server.
`
`26 Claims, 4 Dra wing Sheets
`
`US
`
`SERVER
`
`TRANSMISSION
`SYSTEM
`
`IMAGE
`ANALYSIS
`UNlT
`
`RECEPTION
`UNIT
`
`0001
`
`Twitter
`Ex. 1011
`IPR1 of U.S. Pat. No. 6,895,557
`
`Exhibit 2037, Page 1
`Google Inc. v. Summit 6 LLC
`IPR2015-00806, Summit 6 LLC
`
`

`
`U.S. Patent
`
`Mar.14,2000
`
`Sheet 1 of 4
`
`6,038,295
`
`TELEPHONE
`UNITS
`TE
`
`FIG. 1
`
`us
`
`SERVER
`
`TRANSMISSION
`SYSTEM
`
`IMAGE
`ANALYSIS
`UNIT
`
`BAE
`
`CONTROL
`'-~UNIT
`
`ST
`
`RECEPTION
`UNIT
`
`0002
`
`Exhibit 2037, Page 2
`Google Inc. v. Summit 6 LLC
`IPR2015-00806, Summit 6 LLC
`
`

`
`U.S. Patent
`
`Mar.14, 2000
`
`Sheet 2 of 4
`
`6,038,295
`
`ANTENNA
`
`FIG. 2
`
`A
`
`FLASH
`
`BL
`
`LI
`
`LENS
`
`SU
`
`HM
`1
`(
`EARPHONE
`
`TE
`
`MEMORY
`RAM
`
`(
`
`KEYPAD
`
`TELEPHONE
`UNIT
`MEMORY
`
`PROCESSOR
`
`CLASSIFICATION
`INFORMATION
`ALLOCATOR
`
`BE
`"\
`\
`OPERATING
`FIELD
`
`LS ...
`(
`MICROPHONE
`
`AL
`
`TRIGGER
`
`VOICE
`RECOGNITION
`
`000
`3
`
`Exhibit 2037, Page 3
`Google Inc. v. Summit 6 LLC
`IPR2015-00806, Summit 6 LLC
`
`

`
`U.S. Patent
`
`Mar.14, 2000
`
`Sheet 3 of 4
`
`6,038,295
`
`FIG. 3
`
`RECORD AN
`IMAGE
`
`STORE IMAGE
`AS DIGITAL
`FORM
`
`TRANSMIT DATA CONTAINING DIGITAL
`IMAGE TO SERVER VIA TRANSMITSSION
`UNIT
`
`RECEIVE DATA
`
`EXTRACT CLASSIFICATION
`INFORMATION FROM RECEIVED DATA
`
`STORE DIGITAL IMAGE TAKING INTO
`CONSIDERATION THE CLASSIFICATION
`INFORMATION
`
`0004
`
`Exhibit 2037, Page 4
`Google Inc. v. Summit 6 LLC
`IPR2015-00806, Summit 6 LLC
`
`

`
`0005
`
`Exhibit 2037, Page 5
`Google Inc. v. Summit 6 LLC
`IPR2015-00806, Summit 6 LLC
`
`

`
`6,038,295
`
`1
`APPARATUS AND METHOD FOR
`RECORDING, COMMUNICATlNG AND
`ADMINISTERING DIGITAL IMAGES
`
`BACKGROUND OF THE INVENTION
`
`5
`
`2
`recorded, optimizes the communication of the image data
`and provides a method for administering the storage of the
`digital images, which is simple, fast aod surveyable so that
`the digital images may be archived.
`These problems arc solved by a communication system
`tor recording and administering the digital images which
`includes at least one telephone uni t that in addition to a
`telephone function bas a digital image pick up unit for
`recording images, a telephone memory for storing the digi tal
`10 images, and a processor fo r processing the digital images.
`The telephone unit may associate clas.sification information
`with the digi tal images. A transmission system is coupled to
`the telephone unit and to a server for transmilling of the data
`which includes the digi tal images and potentially the clas(cid:173)
`sification information from the telephone unit to the server.
`15 The server bas a receiving unit for receiving the da ta sent by
`the telephone unit, and an analysis uni t for analyzing the
`data with respect to the classification information which
`characterize the digital images, and a memory in which the
`digital images may be archived, taking into consideration
`20 tbe classification information during the archiving step.
`Specifically, the communication system has at least one
`telephone unit, a server and a transmission system for
`transmilling tbe data from the telephone unit to tbc server.
`The telephone unit has a telephone portion and at least one
`25 digital image recorder wbich has the function of a digi tal
`camera, a telephone unit memory for storing the digi tal
`images taken by the digital camera and a data processor fo r
`processing the digital image data. The server includes a
`reception unit, an analysis unit which analyzes the data that
`30 is scot from tbe telephone unit wit b respect to classification
`information, also referred to as order features, as well as a
`memory for storing the digital images. The order features, or
`classification information, cha.racterize the digital in1ages
`and are taken into consideration as the images are stored.
`As the method of the present invention, the digital images
`are recorded and administered by, first, recording the images
`by a digital image pick up unit which is included in the
`telephone unit, converting tbe images to digital form as
`digital images and possibly stored, traosmilling data which
`40 contains tbe digi tal images as well as classification infor(cid:173)
`mation which characterize the digi tal images to a server,
`receiving the data in the server, extracling the classification
`information from the data, and storing the digital images in
`tbe server taking into consideration the classification infor-
`45 mation du.ring the storing step.
`Tbe communication system of the present invention
`exhibits a number of advantages. 'Jbe present communica(cid:173)
`tion system cao transmit speech as in .a standard telephone
`system using the telephone unit and can additionaUy trans-
`so mit still picture, in other wo rds photogtapbs, over this same
`communication system. T be telephone unit which records
`tbe digital images in the digital image picb:up also transmits
`the data which contains these digital images using the
`telephone functions. Addition data may be transmitted with
`ss the digital image data as well. Classification information
`which is found in the transmitted data is extracted in the
`analysis uni t and are used for storing the digi tal images in
`such a way that they can be easily relocated, even when a
`great nu mber of digi tal images are stored aod administered.
`60 In this way, it is possible to implement an automated
`archiving of digital images in the server. Since the storing
`step depends upon the extracted classification information
`that characterize the individual digital images, a simple, fast
`and surveyable archiving of the digital images is automati-
`65 call y carried out.
`According to tbe present method, the images are acquired
`and stored in digital foJOl as digi tal images. Data is trans-
`
`1. Field of the Invention
`The present invention relates generally to an apparatus for
`recording of a digital image, communicating the digi tal
`image from the recording device to a s torage device, and to
`administering the digital image in the storage device. The
`present invention al<;O relates to a method lor recording,
`communicating and administering the digital image.
`2. Description of the Related Art
`In the field of telecommunications, data of a wide variety
`of da ta types is transmilled from a sender to a receiver, either
`unidirectionaUy or bidirectionally. lbe data which is trans(cid:173)
`milled may be, for example, voice signals, image signals, or
`written characters which have been converted into digital
`signals . Video conferencing systems are used to transmit
`spoken data in combination with in1age data and/or written
`character data. These systems share the operation of various
`applications. Video cooferencing systems require a high
`performance, expensive and bulky computer with an exter(cid:173)
`nal video camera at both the sender end as well as at the
`receiver end.
`Digital image cameras are currently available on the
`market, as known, for example, from the publication " Mar(cid:173)
`ket Over View: Low-Cost Digital Cameras, Canon: Power(cid:173)
`shot 600", MACup, pages 100-101, No.4, 1996.
`So called cellular telephones may be utilized for image
`transmission, as is known, for example, from the U.S. Pat.
`No. 5,260,989, entitled " Method and System for Enhanced
`Data Transmission in a Cellular Telephone System".
`An arrangement with a television camera and a telephone 35
`which provides for audio data and image data to be trans(cid:173)
`milled in common through a telephone line is known, for
`example, from the U.S . Pat. No. 5,063,587 entitled "Trans(cid:173)
`mission System for Still-Picture T.V. lelephone". The dis(cid:173)
`closed apparatus makes it possible to digi tize, compress and
`transmit individual still pictures, such as photographs.
`When a large number of d ig ital images are recorded and
`are to be archived in a central computer unit, then the
`organization of the data base becomes a problem. In
`particular, the problems of locating the data of an image data
`file increase as the number of images to be archived
`increases.
`A book by S. Naumann eta!. enti tled "Parsing", leubner
`Verlag, Stullgart, 1$1 Edition, ISBN 3-519-02139-0, pages
`155- L66, 1994 discloses devices referred to as parsers.
`An image and audio communication system having a
`graphical annotation capability is disclosed in the European
`Patent document EP 0 64 968 A2 in which voice, data and
`image communications are used in telephone systems. The
`circuit arrangement provides that still pictures and/or mov(cid:173)
`ing pictures can be recorded during a voice and data com(cid:173)
`munication on a picture screen of a PC (personal computer)
`ia parallel to the da ta displayed on the screen.
`
`SUMMARY OF THE INVENTION
`'The present invention addresses the problem of a com(cid:173)
`municating and administering digital images by providing
`for recording, administration and archiving of digital images
`simply, fast and in such way that the informa tion therefor
`may be easily tracked. Furthermore, the present invention
`simplifies transmis.5ion of digital images which have beea
`
`0006
`
`Exhibit 2037, Page 6
`Google Inc. v. Summit 6 LLC
`IPR2015-00806, Summit 6 LLC
`
`

`
`6,038,295
`
`4
`unit and/or the te lephone nu mber of the server in tbe da ta
`accompanying the digital inlage. This permits the particular
`telephone unit or server to be identified by the classification
`information included with the digital image.
`The classificat ion information, according to an advanta-
`geous development, may directly contain particular infor(cid:173)
`mation about the location in the serve.r memory where the
`digital images should be stored. For example, a direct path
`indication of the directory in the server in which the digital
`10 image is stored may be included as the particular informa(cid:173)
`tion accompanying tbe digital image. This simpl ifies the
`analysis of the clas.siflcation infom1ation so that the method
`of the present invention can be implemented considerably
`faster and the communication system <:an be realized with
`15 less outlay for hardware.
`A data bank system may be provided as a server in the
`present communication system in a preferred embodiment.
`It is advantageous to provide an image analysis unit in the
`server to determine the quality of the digital images so that
`20 the relationship between the required image qual ity and the
`data transmis.sion rate in the transmission system may be
`improved. When the image quality which is required is
`higher than the image quality wbich is supplied, then a
`higher image resolution for the digi tal images may be
`25 requested by the server from the telephone unit according to
`yet another development of the present invention. When, on
`other hand the image quality transmitted by the telephone
`unit is higher than that required in the server, then a lower
`data transmission rate can be set and a lower image quality
`30 cao be requested from the telep hone unit. Thus, the present
`communication system may include a control unit in the
`server for controlling the resolution of the digital images in
`the telephone unit and/or for controlling the transmission
`rate of the data to be used in the transmission system. T he
`35 transmission rate and the costs for the transmission of the
`digital images can thereby be reduced.
`Further, features of the present invention provide for a
`speech analysis unit for analyzing parts of speech and a
`40 extracting therefrom information for the clas.sifying infor(cid:173)
`mation to be included with ihe image s ignals. In anoilier
`development, the server may ioclude a speech syntbesis uni t
`for generating speech s ignals to transmit to the telephone
`unit. It is contemplated that the telephone unit may be
`45 connected to tbc server via tbe internet.
`BRIEF DESCRIPTION OF T HE DRAWINGS
`FIG. 1 is a block diagram of a communication system
`including a plurality of telephone units according to the
`principles or the present invention;
`FIG. 2 is a plan view of a telephone uni t to be used in the
`communication system of the present invention;
`FIG. 3 is a flow chart illustrating tbe method steps
`according to the method of the present invention; and
`FIG. 4 is a block diagram showing various classification
`information, or order features, which may be as.sociated with
`ibe image data according to the present invention.
`
`5
`
`3
`milled from the telephone unit to the server, the data
`containing at least the digital images. The classification
`information which characterize the d igital images is
`extracted in the server and the digital images is stored in the
`server taking into consideration the classification informa-
`lion.
`In a development of the present invention, the telephone
`unit is a wireless telephone which wirelessly transmits the
`data over the transmission system. In other words, the
`telephone is a mobile telephone unit, which makes it pos(cid:173)
`s ible to immediately register the image and voice informa(cid:173)
`tion and to have this information avai lable at any arbitrary
`location. It is, thus, possible to distribute image and voice
`information over the mobile telephone quickly and possibly
`to distribute it to multiplied locations.
`It is within the framework of the present invention that the
`user may provide the classification information which is
`allocated to the digital images and which identify the digital
`images. The communication system of the present invention
`provides a means for allocating this classification informa(cid:173)
`tion as prescribed by the user of the present device to the
`digital images. The communication system provides that
`additional information about the recorded image may be
`altached at the time of the image acquisition directly by the
`individual implementing the recording of the image. Tbis
`avoids additional information editing which may potentially
`be required for the digital images at the server end. Another
`adva.ntage is tha t the individual who records the image
`probably best understands the information wbich describes
`the image and can easily allocate that descrip tion to the
`image data.
`As a fllrther development of the communication system,
`a speech recognition unit is provided in the telephone unit.
`The recognized speech data can be easily transmitted with
`the image data since the compression rate for recognized
`speech data (which is in the form of text) is greater than for
`the audio information.
`According to the various embodiments of the present
`communication system, the classification infom1ation may
`have differen t embodiments containing different info rma(cid:173)
`tion. It is advantageous in one developmenl of the inven tion
`tbat the classification information includes audio data. The
`archiving of such data is very simple and user friendly since
`the user merely has to speak the information describing the
`recorded image into the telephone unit as in a telephone
`conversation. In addition to speech, the audio data included
`with the image data may provide other classification infor(cid:173)
`mation for the image. For example, it is envisioned that
`specific sounds or noises which characterize the image data 50
`or freely selectable music passages be included as classifi(cid:173)
`cation information in the transmilled data. The classification
`information may contain at least the time and/or time of day
`at wbich the image was recorded or at which the image data
`was transmitted to the server. As a result, the clas.siflcation 55
`information may be extracted in a very simple way in the
`server and can be directly converted into information about
`the location in the memory at which the digital image should
`be stored. By converting tbe time and da te information into
`a form usable by the server, tbe received digital images may 60
`be stored in lists or directories in the server which are
`classified according to the time at which the image was
`acquired or the time of the transmis.sion of the digital image,
`which information is transmitted along with the digi tal
`image to the server or obtained upon transmission.
`As a furt her development, the classification inli:>rmation
`may contain at least the telephone number of the telep hone
`
`DETAILED DESCRIPTION OF THE
`PREFERRED EMBODIMENTS
`The communication system according to the present
`invention as shown in FIG. 1 including as components an
`arbitrary number of telephone units TE, a server S, and a
`transmission system US that is coupled to the telephone
`65 units TE as well as to the server S and that is used fo r
`transmitting data between the telephone units TE and the
`serverS.
`
`000
`7
`
`Exhibit 2037, Page 7
`Google Inc. v. Summit 6 LLC
`IPR2015-00806, Summit 6 LLC
`
`

`
`6,038,295
`
`10
`
`5
`The server S is a computer system which serves for
`organizing a database which includes a large number of
`digital images as well as classification information OM
`which may potentially be allocated to the digital images. The
`server S includes at least the following components, an
`receiving unit EE for receiving the data that is sent from tbe
`telephone unit TE via the transmission system US and an
`analysis unit A£ that is coupled to the receiving unit EE and
`which extracts the classification information from data
`received by the serverS. Various possible embodiments for
`tbe analysis unit AE will be described later. Ln addition, a
`memory SP for storing the data as well as the digital images
`which is contained in tbe data is provided in the serverS.
`ln one embodiment, the servers includes an image analy(cid:173)
`sis unit BA£ which determines the quality of the digi tal
`image that is provided to the serverS. For example, the noise
`level within the digital image is determined by the image
`ana lysis uni t BAE and the quality of the image is estimated
`depending upon tbe amount of noise which is detected.
`In addition, a control unit ST is provided in the serverS
`in one embodiment of the communication system. The
`control unit ST controls tbe image resolution of the digital
`images using the image compression in the telephone unit,
`for example. In particular, image compression methods
`utilize a control parameter to set the image compression 25
`level for the digital images such as the quantizing factor in
`a JPEG (joint photographic expert group) image date com(cid:173)
`pression. Tbe control unit ST determines this quantizing
`factor to be used to obtain the desired image quality.
`The control unit ST also controls the transmission rate 30
`during transmission of the data via the transmission system
`us.
`Further developments of tbe present communication sys(cid:173)
`tem provide for including a means for analysis of voice
`signals which are spoken into the telephone unit TE, from
`which the classification information OM may be extracted.
`In a preferred development, this voice analysis means is
`provided in the image analysis uni t BA£. It is also contem(cid:173)
`plated in the present invemion to provide a speech synthesis
`unit in the server S. The speech synthesis unit includes
`digitally stored voice information wllicb is converted into
`speecb which is then presented to a user of the present
`communication system as a natural language output.
`The server S is configured with an arbitrary data bank
`system in which tbe digital images may be administered.
`The analysis unit AE provides the administering function,
`which will be described in greater detail here and after.
`Although the present commu.nicatioo system is envi(cid:173)
`sioned as including a plurality of telephone units TE, the
`communication system will be described hereinafter with
`reference to only a single telephone unit TE for simplicity
`and without limiting the scope of the present invention. The
`single telephone unit TE is shown in FIG. 2. Tbe telephone
`unit includes the standard features of a telephone unit
`including, fo r example, an earphone HM, a keypad TA
`which serves as an operating fie ld for the telephone unit TE,
`as well as a microphone LS. The telephone unit also includes
`a digital image pick up unit for recording images, the digital
`image pick up unit being integrated into the telephone unit
`TE. In FIG. 2, the telephone unit TE includes a Ieos Ll and
`a view finder SU and may possibly include a photoflash BL.
`A<; an alternative to an integrated image pick up unit and
`telephone unit, the image pick up unit may be spatially
`separated from tbe telep hone unit but connected to one
`another via a connection such as a line connection, a
`plug-type connection or a radio link.
`
`6
`Tbe digital image pick up unit operates as a digital photo
`camera of the type which is koowo. A telephone uni t
`memory TS is provided for storing the images registered by
`the digital image pick up unit in digital form in the telephone
`5 unit TE. The digital images may be compressed using still
`picture image data compression methods such as JPEG. The
`compression method is implemented using a data processor
`P which includes a memory RAM. The data processor P
`serves for processing the digital images. However, the
`processor P can be used for other processing tasks as well
`including, for example, pattern recogn·ition or voice recog(cid:173)
`nition within tbe telephone unit TE.
`Tbe telephone unit TE can be used as a "normal tele(cid:173)
`phone" to make calls or as an image recording device with
`15 its expanded functionality. It is provided, according to one
`development of the invention, to provide a mode key MT by
`which the operating mode of the telephone unit TE is
`switched such as between operation as a no rmal telephone or
`as an image pick up and transmill ing unit according to the
`20 present communication system. When set to operate as an
`image pick up unit, a separate trigger, or shutter button, AL
`is provided for recording of the images by tbe image pick up
`unit.
`The various functions provided by the present telephone
`unit TE may be controlled and/or displayed in an operating
`field BE. For instance, the operating field BE may be utilized
`in the allocation of speech spoken by the user to individual
`digital images. The telephone unit thus temporarily func(cid:173)
`tions as a "dictating machine", with control via the operating
`Jkld BE. While the various controls such as the mode key
`MT, tbe shutter ALand the operating field BE are shown as
`separate controls, they need not be fashioned as separate
`keys but may be integrated in terms of their various func(cid:173)
`tions into tbe keypad TA for the telephone unit TE by using
`35 key combinations.
`The present telephone unit may be operated via a tele(cid:173)
`phone line or may alleroately be operated wirelessly as a
`mobile telephone using an antenna A for transmission and
`reception of data. Thus, the telephone unit TE is fashioned
`40 as a mobile telephone (a so called cellular phone) or as a
`cordless telephone.
`In the illustra ted embodiment, a mea·ns MZ is provided in
`the telephone unit TE for allocating the classification infor(cid:173)
`mation OM which are prescribed by tlhe user to the digital
`45 images a.nd thus characterizing the digital images. ln terms
`of its function, the allocation means MZ may be integrated
`into tbe keypad TA, for example, by using key combinations.
`The telephone unit TE also includes a speech recognition
`unit which converts open speech into text. The text can then
`so be allocated to the digital images and tra nsferred with ibe
`digital image data. Referring to FIG. 4, tbc various possi(cid:173)
`bilities for the clas.<;ification information OM are illustrated.
`The classification information OM which are unambigu(cid:173)
`ously allocated to the digital images serve to characterize the
`ss digital images so that a surveyable, unambiguous s torage of
`the digital images in the serverS may be carried out in such
`a way that the digi ta.J images can be quickly relocated in
`their stored locations. The following classification informa(cid:173)
`tion OM is not intended to be all inclusive but only as
`60 examples of information which may be included as classi(cid:173)
`fication information. The classification information OM may
`be implicitly contained in the digital image itself, such as
`being derived from tbe image content such as identifying a
`specific building in the photo, identifying a specific reco rded
`65 landscape, or a specific recorded vehicle type. The analysis
`uoitAE of Lhe server serves to anal yze tbe image content and
`record the image according to the meaning derived from the
`
`0008
`
`Exhibit 2037, Page 8
`Google Inc. v. Summit 6 LLC
`IPR2015-00806, Summit 6 LLC
`
`

`
`6,038,295
`
`7
`image analysis. When the classification information OM are
`implicitly contained in the digital image, then lhc analysis
`unit AE io.cludes a pattern recognition unit which searches
`the image for specific, prcdctcrminccl features in the digital
`image.
`The classification information OM may also be included
`io the transmitted data as forvvarded from the telephone unit
`TE to lhe serverS with the digital images. Such information
`may be the address or the telephone number of the telephone
`unit TE which transmits the data. Funhermore, the Lime of 10
`recording of the respective digital image and/or the time of
`transmission of the digi tal image to the server may be
`provided as classification information for the image data.
`When this is the case, the analysis unit AE is fashioned such
`the this time and date, or address, or telephone number 15
`information can be extracted from the transruiued data. This
`information can be included as a header field provided with
`the transmiued message that contains the image data and, as
`such, analysis thereof is quite simple.
`In a preterred embodiment, the classification information 20
`OM as shown in FIG. 4 include the following types of data:
`an arbitrary form of audio data 401 such as melodies,
`songs, noises, or speech 402 which is spoken into the
`telephone unit TE by lhe user;
`the time of day and/or the date of lhe recording of the
`image and/or the time of day and/or the date of the
`transmission of the data 403;
`the telephone number of the telephone unit TE which
`obtained and transmillcd the image data and/or the 30
`telephone number of the server S 404 which received
`the data, or some other type of identification of the
`telephone unit TE and/or of the server S such as an
`unambiguous address for lhe telephone unit TE or for
`the server S;
`some particular information about the location in lbe
`memory at which the digital image should be stored
`405. This may be an unambiguous path indication
`which indicates lhc location in memory or in lhe
`directory s tructure and the serverS at which the respec(cid:173)
`tive digi tal image should be stored; and
`other alphanumeric data which may be input into the
`telephone unit TE via the key pad TA in, for example,
`an ASCll format 406.
`The analysis unit AE is fashioned so that it may extract the
`classification information OM from the data received by the
`server S and, as such, it is fashioned in accordance with lhe
`expected classification information OM. Various realizations
`of the analysis unit AE may be utilized including in a type
`of parser with which the respective information is extracted.
`A parser may be of the type which is known.
`The classification information OM which are transmitted
`with the digital image or which are allocated to the digital
`image are used for archiving the images in the server
`memory.
`A method according to lhe present invention is illustrated
`in FIG. 3, including a first step 301 in which images arc
`recorded with the digital image pick up unit that is integrated
`into the telephone unit TE. According to the step 302, tbe
`images are stored in digital form in the telephone unit 60
`memory TS as digital images. The images arc transmitted in
`step 303, either in compressed form or non-compressed
`form, from the telephone uni t TE to the server S via the
`transmission system US. The data is received at step 304 at
`the server S and tbe classification infom1ation OM which 65
`characterize the d igital images are extracted at s tep 305 from
`the data received in the server. The digital images and
`
`8
`possibly the classification information OM and potentially
`fu rther information that characterize or described the digital
`images arc stored at step 306 in the server. During the storing
`step, the clas.sification information OM is taken into con-
`s sideration.
`The classification information OM may be prescribed by
`a user of the telephone unit TE, for example, by simply
`speaking the information into the microphone LS of the
`telephone unit TE or by inputting a character sequence into
`the key pad TA.
`As a development of the method, the spoken language by
`the user may be recognized and stored in a compressed form,
`for example, as text. This achieves a further reduction in the
`transmission rate for the digital image with accompanying
`classification information. Also included in a development
`according to the present invention is the identification of the
`quality of the image and the control of the required or
`available transmission rate in lhe transmission system US by
`which the data is transmilled,the controlled being dependent
`upon the quality of the image desired. When the quality of
`the image is classified as too low in the server, a
`re-transmission of tbe digital images requeste