,,
`'
`
`~
`
`Case 2:12-cv-07360-MRP-MRW Document 71-18 Filed 04/04/13 Page 2 of 8 Page ID #:809
`
`Donna BaldWin
`,.
`From:
`Sent:
`To:
`Cc:
`Subject:
`
`Gordon Bell [gbell@microsoft.com]
`Friday, February 16, 2001 8:06AM
`support@enfish.com ·
`Louise.~r.~ieF@entrSJ'fbafn;--bo_uise_Wannier@enfish. com; wannier@enfish.com
`epa_p.er. of Office 10 requires a pl~n ... please pass this message on to your developmellt
`I
`.
`'
`anal oroduct manaqement folks
`
`~
`
`,,
`
`CACM A Personal
`F 0 1 k S ,
`Digital Store ...
`Let me congratulate you on a great product and a ke y component for my own
`CyberAll. As you know , indexing service doesn 't index Ou t look -- which for
`mos t of us who li ve in cyberspace, is a requirement .
`
`I wrote a paper in the Corron . of· the ACM, Janua+y 2001 about putting
`
`BTW:
`all
`of my content i~ Cyberpace and being able to retrieve all of it, quickl y
`and
`eas i ly i s essential . A copy is a t tached .
`
`epaper i s Microsoft's great new tif v i ewer and OCR th a t includes a
`background OCR that also needs to be indexed . This i s essential fo r a ll of
`us who scan paper doc umen t s that we want to retrieve by content .
`
`I would happ i ly l ike
`. Although I ' m not anxio us to be a beta tes te r ,
`inte ract with you regarding your fut u re product.
`
`t o
`
`BTW : what ' s the plan for how you make money ?
`produc t !
`·~, ·
`
`I am very h appy t o b uy your
`
`g
`
`·~· ·
`
`<<CACM A Peisonal Di gital Store Ol Ol. pdf>>
`Gordon Bel l
`425 785 7508 (eel~ and ma in l ine); 415 778 8225 (BARC)
`Gateway 425 936 7329
`
`94105 -224.1
`
`1
`
`Enfish, LLC; IPR2014-00574
`Exhibit 2231
`Page 1 of 7
`
`

`

`Case 2:12-cv-07360-MRP-MRW Document 71-18 Filed 04/04/13 Page 3 of 8 Page ID #:810
`
`G ORDON B ELL
`--------------------------
`Finding l1 place to effidently store all of
`one's digital materials.
`
`A PERSONAL
`DIGITAL STORE
`
`.Aii.s=~m yberAll' .is a project to encode, store,
`and allow e;1$y retrieval of all of a per(cid:173)
`sotis information tor pe~>onal <\nd
`ptotilssio11al
`(lSc. The archive
`indudes books1 CDs, com-spon-
`dcJtcc (such as letters, memos, a.nd
`···
`email), cransactions, papers, photos and albums, and
`. vi<ko. Ii1 2000, only 16 gigabytes arc reqUired to
`~tore all rhc media in my persoiu.l and. pro£essioJ1al
`life-at a cost of $160 fot ~~s~ sroqgc. 'Iwo gigabyres
`are c..,;pe~ted ro be added next ye.,(. E•1codu.lg, index(cid:173)
`ing, and dara-ma~agemc.>J1t cost~ far exceed the stor-
`age e.xpense. The challenge is ro automate
`capture, search, an<\
`retrieval.
`CvhetAll is a
`personal ontol(cid:173)
`<>g}' [5) .in con(cid:173)
`tta$t to a libnuy ( 6)
`or 1\;:lble's effort to archive rbe
`Web and rclevislon channels
`(sec www.archive. org). It is my
`srore f()t dC>cumcntS, photos of people jl.O.d comput·
`it1g artifacts, music, ap_d videos :\S described by BU$h ,
`in [2J and Cates in {4].
`
`also
`CyberAll
`holds
`reference
`articks, clipped
`graphs
`that
`
`1C,·beJ~II :u><l CYSBI\:.11
`;uc prott'CI~ :tnd C<)>?·
`•>f'
`ci~Jtf~d
`uam~i
`\Jnicc<l &n·i.;t$ ·loth'·
`o:ttiun.:.tl. (..."yhN:di.<(IJ)I,
`
`heretofore would be physically stored, C()mputer
`manuals, and magazines. At present; books <U'C in
`'Q.rop)ic" form; but CyherAll will induc!e dwm as
`th<,7 become e-books?
`Within the next decade personal compurcrs w,ill
`be capable of sroting a terabyte of Information on an
`.indivldl,lal machine. In 2000, 40GB drives costing -
`.$400 are more rhao adequate to hold the contctlt for
`mosr of a ptofesslonal's lifetime reading, presenra(cid:173)
`tions, and audio recordings. A CD encoded at
`128Kbps C;tl.\ pe stored <1t a cost of $0.60. A user's CD
`collection is likely to tt$e more s~or·
`age space than the user's com(cid:173)
`puter-genetated and scanned
`paper files,
`The nexr ph;~se of Cyber(cid:173)
`All wJU capture conversations,
`interviews, meetings, and pte$eur.ar
`rions. Recordittg speed.1 from one's personal and pro(cid:173)
`fessional lives will require over a terabyte (at
`8Kbps)-but only a modest 25GB/year. Video is
`t-'\'eu more d1alkagiug. f<Jr. home \tsc, a tcraqytc
`hC>lds 500 hours of DVD quality video and 15()0
`CDs., bt•t mote comptes~jo,l). inqca:'ies the c~pacicy by
`a factor of at lc:m 10. Recording a lifetime of every(cid:173)
`thing sc:en requires lOOTB. Doing· this economically
`is stillmore than a dce;\de away~i~ ;v9uld currently
`cost .more than $10,000 per year. But in tW6 dec.-<dcs,
`ir should cost c,mly $100 per year and require an
`
`~\~V\v.rc;-~ardunicrosofc.tom/ ... ~bcli/Cybq'M~Jnt•~,bs.bf'm. lfok-1$ ilcms of hj:J•
`torical iritcre::~r~uch u- HoiJcrirh'sl~arenr. Amdahl's lAw. V3riOUs ()jgi.t.'\l.l!t:t~ipti~nt
`COfpoJ~rioo> dq;;omonu. iuclu<Uog thos< for· l'DY-l and CDC: 6600, "'"""!<·
`posl~r~. phoros; and a lafk ~llQ(l\ ScyrnoutCray.
`
`8 6
`
`)allwilf)' 2001/Vol. 4<1, No. I COMMUt<ltCAnONS OF TH£ ACH
`
`Enfish, LLC; IPR2014-00574
`Exhibit 2231
`Page 2 of 7
`
`

`

`Case 2:12-cv-07360-MRP-MRW Document 71-18 Filed 04/04/13 Page 4 of 8 Page ID #:811
`
`infrnstrocturc u.ulikc anything we currencly know.
`The ·rechnologies f()r c.yberizatiou are improving at
`che !'ate of Moore's Law-<l.<Jubling every 18 .month.~.
`These indude proces..o;or speed, srorage capacir:y, scan(cid:173)
`ner speed and accuracy, camera resolution and soft(cid:173)
`mre, OCR aCCI.I.r'.tcy and capability (for e.'(ample,
`scan-to-HTML), audio and video encoding, printing
`and d.isplay, and standards. Thus, <>ne can always wait
`f(lr a better system. or ~tand;mls--chlngs will be twice
`as good in 18 months. However, cohr.cnt and <:apcurc
`cost arc almost acceptable, and the longer we wait, the
`more informacion is lose forever, so it is important tc>
`begin the procc.~s.
`Based on my ~pcrience of being able to only go
`back 25 yc:.trs t(,r some content, the most serious con(cid:173)
`c:.em of CyberAll is choosing form.:tts that will be rc:td(cid:173)
`able in 1 0 ro SO yetrs. C)bcrAll requires a mechanism
`for carrying data forward ti'Om l~acy media, ~'}'Sterns,
`and programs.
`
`Motivation and Goals
`he motiv-ation fur CyberAll ranges
`from
`the technical challenges(cid:173)
`because we can-
`ro a desire to have
`an c:duustive archive. Electronic fil(cid:173)
`ing c-.tbiners such as Ricoh's cCabiner
`(3] accepr both computer-generated
`and sc.tnncd documents aud index the documents
`they hold. }<iJing systems such as d1osc used by
`Microsoft \V.ndows 2000 and Office index their
`docun1ems.
`Many people have a "pack mt" memality, and
`·attempt w smre everything possible to remind our(cid:173)
`selvc:s or others. Cybe.AII is an attic ro srpre every(cid:173)
`thing that can answer a question or explain wbar it
`was like whC'.n. lt is amcmo1y aid and a dcwic:.e to hdp
`tell scories. For some, this lJligh.r m~n storing every(cid:173)
`thing--our first drawings, school report cards, and
`hom~:: videos. New Web
`sites
`such as
`Wlvw.123456789.nct, www.lcgacy.com,
`and
`www.mcmorymoun1aiu.com o.ffer co store letters,
`c.o;s;tys. photos, and stories "fc1rever" and pass them on
`ro their fimtre generations of users.
`Another goal of the CybcrAll project is to under(cid:173)
`Stand the problems of ~"Oping with the c:xponemial
`increase in dH~ amount of information (for example,
`email, Web pllbll:S, images, audio, and video) that is
`bet"Oming part of both our personal and professional
`Jives. Given the tools to mass-produce documents, we
`:trc forced to become ftling clerks!
`The goal oJ CyberAll is borh to encode everything
`
`and to eliminate paper rhat is used for
`sc<wtge (ftl.ing) and transmission.
`Paper will remain a domimmr read(cid:173)
`ing intedacc where its advantages
`are well known. Many docu(cid:173)
`me.t1ts that repre,o;eut money(cid:173)
`paper currenc:y, bank notes,
`smck, and c.·wcclled checks ha.ve
`to be retained. 1
`
`Using and Accessing
`CyberAII
`Table 1 shows me kinds of content
`rhat occur in nn individual's pl!i'(cid:173)
`sonal and pwfcssional lives for
`archival (mainly reference) and
`daily (working) use, such as con(cid:173)
`tracts, email, and music, This
`includes encoded legat.y content such
`as papers, photos, audio and vid~'O­
`tapes to computer-created papers, prc(cid:173)
`senratlons, photos, . "ripped" CDs, and
`videotapes. CylxrAll can play all of the
`content from photos l'O CDs on comput-
`ers, home ste!reo, and TV sets.
`CyberAll is for personal use as opposed to provid(cid:173)
`ing a general server. CybcrAll
`operates in my COMOHO
`(commercial
`office,
`mobile office, and
`home oilke) environ(cid:173)
`ment, pll)Yidin,g acc~'S
`anywhere, ~nytime. The m:tin deskt op com.-
`putet i11 rhe l~ARC lab (C,O) holds all files and is well
`backed up. The author's portable COJliputer
`..
`(MO) contajns a large subset "cache" of
`the CO. It is the principal compute~;
`used in rhc: MOHO environmems.
`In MO locations, modems, hotel
`Lt\Ns, and so fimh commuuicate
`via the corporate network to CO
`for "uncached" docurne~tts.
`In the HO, ADSL and cable
`moderns lirtk to CO, allowing audio
`and picture files to be "played." By k«-ping
`all infonnarion, CyberAil should be able to provide a
`useful ser of answc~ and services including:
`
`I
`
`~lbc: tit'Kll'lc:i:tl comnntalty-hldiog bcfund •,I.K'f rC"UstuM.~ -it d«a...U: lxhiad in
`dt:tHn~with irttnJ N lli'J"C" bu~. 'lbt ji4.0C 20UO 1~ :lol)pi'O\'ji'S (kcrmnic,.;gn~rucu
`e.limin;u:~, ..:me mocc b~cckr.
`
`COMMUNIC'AllON SOf THf ACM )>IIU;vy200 1/VW.~, No.l
`
`87
`
`Enfish, LLC; IPR2014-00574
`Exhibit 2231
`Page 3 of 7
`
`

`

`Case 2:12-cv-07360-MRP-MRW Document 71-18 Filed 04/04/13 Page 5 of 8 Page ID #:812
`
`Table I. Data types and use for timeliness
`and user context.
`
`• Recall a Chicago hotel stay over the last 10 years or
`a restaurant or wine from a dinner in Patis about
`tiJUr years ago.
`• Find a c.1ncdled check or receipt.
`• Show figures from papers on supercomputers dur(cid:173)
`ing 1980-1990.
`• Find articles and papers that mention Amdahl's
`laws, including the original articles.
`• Recall email ~md letters to or about x about five
`years ago even though it was not specified to be a
`letter or email correspondence. List letters, recom(cid:173)
`mendations, and papers written in 1989.
`• Display an album from a fishing uip or takcn dur(cid:173)
`ing July 1.999 on the TV set, or display all the pho(cid:173)
`tos randomly on a large flat-panel display.
`• Play a set of selections on a particular computer or
`the home stereo.
`
`CyberAII Storage
`CyberAll is currently held in the \Vtndows file system.
`A decision was made tO not use a database. This was
`based on: variation of document types; cost to create
`and maintain database columns, keyvi'Ords, or meta(cid:173)
`data; inflexibility of moving or modifYing files in an
`established database; concern that any databa~e i~ not
`a "golden" data type and hence is likely to become
`obsolete; a belief that programs should be able to
`automatically extract any relevant meradata (letters,
`forms); and the ability of ordinary indexing and
`searching to solve most personal needs. Items are
`stored in a relatively flat two- or three-level folder hier(cid:173)
`archywith a few dozen f<Jlders in the first level and an
`average of four folders in the second level. A plethora
`of specialized music database programs manage the
`encoding, org,mization, and playing of CDs, music
`files and music sources. Photos represent a challenge.
`The photo collection is calk-d. the shoebox, and indeed
`has that flavor. My database colleagues have yet to con(cid:173)
`vince me that they can do better than "grep" searching
`the free text or viewing thumbnails.
`The author has also used descriptive file names to
`
`88
`
`january2001jVo1.44, No, I COMMUNICATIONSOFTHEACM
`
`aid retrieval. A name might include subject, organiza(cid:173)
`tion, keyvvords and a date. Many file types, including
`Word tiles and JPEG images have extensive metadata.
`Photos in JPEG format include tide, subject, location,
`description, category, keyvvords, dates (taken, modi(cid:173)
`fied, and so forth), and camera information.
`Documents ate retrieved by searching file content~.
`For example, searching
`is
`instantaneous using
`Alta Vista or the Windows 2000 file system. Eventually
`all the information of or about a file inherent in the file
`is needed. Systems need to "understand" the docu(cid:173)
`ment~. f(Jr example, the letters and receipts they hold.
`
`Photos
`Photos are stored as individual photos in a set of per(cid:173)
`sonal and professional folders, and albums-when
`there is a story. Retrieval is by date, photo name or any
`other text attributes when thev have been so labeled.
`Most of us are unwilling to label and describe each
`photo since a year of photos by a prolific amateur
`could take several davs to labeL Thus, the alternative is
`viewing a folder o{ thumbnails and using emerging
`image searching programs.
`A photo (or a pointer-shortcut-to it) is stored in
`eve1y folder where a user might expect to flnd it. Fold(cid:173)
`ers provide an organized, yet open-ended filing struc(cid:173)
`ture. Folders arc grouped as: time-based events (trip,
`parry, conference); and subjects (family member,
`hobby, mountain scene, food). One can easily have
`three attributes or folder sets where a single photo (or
`poime1) is stored, for C'\':ample, French 1997 trip,
`French mountain scenes, and all mountain scenes that
`include France. Sunsets might get a fourth filing. Each
`time a new, usefi.d category is found .. thumbnails are
`made and inserted in an appropriate folder. Toob hlr
`compound searches such as mountain and sunsets
`would be useful.
`Obviously, there are a plethora of functions that can
`be invented to facilitate filing. labeling, and retrieval.
`Speech input, for example, offers great potential to
`assist
`filing.
`Arcsoft's
`Photobase
`(see
`www.arcsoft.cornf) creates albums with searchable
`keywords and audio segments for each image.
`
`Capturing and Encoding Everything
`(Items and Formats)
`Lcg~<cy data types such as CD, paper, photo, and
`vid<:.Dtape have stood the test of time and various tools
`have allowed them to be cyberized. ln contrast, ±or
`computer-created items, the applic~ttion progran1 that
`created an item may often no longer be available, so
`items are essentially lost. Over the long term, older
`versions of complex programs like databases, word
`processors, and computer games may no longer run
`
`Enfish, LLC; IPR2014-00574
`Exhibit 2231
`Page 4 of 7
`
`

`

`Case 2:12-cv-07360-MRP-MRW Document 71-18 Filed 04/04/13 Page 6 of 8 Page ID #:813
`
`ings, including recognized tc.xr, JPEG, and GIF objecrs
`will make scanning more col.lVenient, <X:Onomical
`and useful
`Furure TIF scand:uds include rhc image, OCR'd
`text for searching, and meradara (the various dares,
`author, and keywords that fimher describe the docu(cid:173)
`me.nc). Sc:mne1;s that dire<.·tly ronnect ro a personal
`comptlter usually just pwv:ide bio:nap images and,
`depending on the inrerface sofuvare, images can be
`stored in a vru:ious formats.
`Captm·it1g phoros mul creating albmns. Photos
`are sc:rumcd imo folders . . Albums hold stories .mch as a
`rrip, birthday party, or a period of ;t family's lite. Pow~
`CJ:lloiut .is the main con.taincr f(>r albums, but in addi(cid:173)
`ciO!l rhc photos arc reClined in folders since one photo
`may appear in several album..~.
`PowerPoint can be converted d.irecdy co HTML
`tl.mnat. for Web llO~ting. or altemacivcly au HTML
`document contai.Wng the photos c~m be cre.tted using
`v.uious Web-authoring tools. PDJ< albtuns are used to
`encode legacy paper albums (multiple pictures
`mounted on a page). All photos arc JPEG; TIF is no~
`used as rhe intermediate images format ~-a.use of size.
`.Kodak'~ photo CD conversion service, and Nikon and
`HP scanners were used for photo input.
`Time muU or cosu to s«m rmd eruode prtpl!l; pho(cid:173)
`tos, and CDs. As a role, simple iccms such as a page, a
`phoro, or a slide cost about one dollar from commer(cid:173)
`cial servi~. Articles approximately l 0 pages in lcllo<Jth
`can be scanned directly imo PDF in abour rwo min(cid:173)
`utes wirh the HP Sender and caprmcd in Acroba~ for(cid:173)
`mat at three pages per mi.nu.cc using a 400MHz PC.
`Photo scanners Jcquire approxlma.ccly 20 seconds to
`cwo minutes per photo. One ma.y want w recognize a
`document and convert it to a perfect, cd~cable docu(cid:173)
`mem sud1 a~ DOC/RTF or 1-ITML. This requires
`"perfect" recognition rogetber with the n.eed to f()rtnat
`rhe document ex.<lcdy like the original. Such a doCll(cid:173)
`ment i~ being republished. To scan, recognize, and edit
`a page ca11 easily require I 0 minutes to create a for(cid:173)
`matted documem that is su.imb.le ti)r n:purposed usc.
`The time to encode or "rip'' a CD depends on the CD
`reader speed, tools, and availability of darabasc.~ that
`can be used to creme labels. CDs took roughly 10
`minutes of attention time to read and label the cracks.
`
`How Long Will a Data Format Remain
`Valid? (Conside r 8-track Tape)
`The most serious impediment to a lasting archive is the
`evolution of tn<!dia, platforms, tormats, and the appli(cid:173)
`cations rbat create the~n. Unique, propricta.ty. and
`constandy evolving d:1ta fonnat:l s ud1 as Ao:obar-4,
`MPEG-4, Oracle 8, Quicken 2001, Real G2, and
`Word 2000 suggest or even guacanree obsolescence.
`
`'
`
`on new systems. Int<mnat.ion must be held in a few
`golden primitive fcmnats because che.w: have to be sup·
`to date, only TXT fcm11ac. seems to be
`ported n)rever-
`readable over decades. CyhcrAil documents arc Stored
`in at least two formats to increa~e the likelihood of
`n:ading rhe document in the future. Black-and-white
`documenrs arc sc:anned and retained as TIP files and
`also converted to some OCR'd form, for ex;~mple,
`PDF for retrieval. Some documents ;lfC converted to
`Word or HTML for x-arching, viewing, prinring, and
`wen editing. For example, a scanned copy of the 188 9,
`13-page Hollerim patent TIP fJJe requires 700KB and
`79MB for black-and-white and. color, respectively. A
`PDF .61e of me image for limited on-screen viewing,
`printing, and searching is about l MR DjVu-stored
`(sec www.DjVu.com) color doctuncllts appear ro
`cnmde compound color and text documents in half
`the size of other formats. File formats such as "IPEG,
`HTML, POI~ RTF/DOC and TIF are "golde~" for(cid:173)
`mars; PowerPoint is a con tainer for phocos.
`Capturi"g pttper docummts. An HP Digital
`Sender was used ro scan r.o eirher black-and-whire or
`colot TIP or !JOE• For most wodriti.g docwlle.Jlts
`PaperPort is used to scan to a TIF dialect with implicit
`OCR. It is difficult, though necessary, ro cut a rel.a·
`r.ivcly rare bound book, pape[, or reporr apart ro scan
`ru1d di.~card: Some documents ( engineeripg noreboob
`and notes, for example) have not been sc:anncd due to
`readability and contrast. Jf a document needs to be
`permanently preserved, it is converted to a golden for(cid:173)
`mar to im;rcasc its likelihood of pem1aneucy. The TIP
`format is the basis fi)r virtually all OCR and page(cid:173)
`input programs, as shown in Figure l..
`Various OCR programs cau recognize and convert
`a dncument into a repurposed, ncar likeness of the
`original or even :tn HTML page. 1bc MHT format,
`derived !Tom MlME, can hold d1e collecriou of files
`for an HTML page in a single file. The evolution of
`Tlf and HTML-XML to hold different im;lge encod-
`
`'rf,c I'OP fueiR4C Gt A auu:n.f, $innlffL:~.nt- dt facb) $Uud.ud dai1ning apt'coxt.m.J~t~Jy
`tmc l~UiM <(.)(.umaus. jmplying a •uttt c..ra~icr <A., (~q JOtn"S.
`
`Enfish, LLC; IPR2014-00574
`Exhibit 2231
`Page 5 of 7
`
`

`

`Case 2:12-cv-07360-MRP-MRW Document 71-18 Filed 04/04/13 Page 7 of 8 Page ID #:814
`
`The m .. w version may not re.-ad leg•lcy data on legacy
`platforms fc>rever. The basic qucsrion is: "How will rhe
`dam be readable in 10 or 50 years-whac arc chc few.
`'golden' dam formarli that we can depend on ti.m"Yer?"
`Sinc;c CyberAll will store ;11l personal infomlation,
`including doa.unents, photos, and videos, this data
`needs co be valid and hence understood in an iud~:cer­
`miu~ltt tururc! High-quality paper will hold infurro;l(cid:173)
`cion for a millennium (or ;1t least st.veral centuries),
`and film is sometimes rated at several hundred years (if
`you keep it very cold). A CD is likely to be readable in
`50 )ll!ars, bur finding rhc CD rcadcrlcompurer and file
`systcm/app to read it will dearly be impo_ssible .if
`history is a guide.' Is paper che only rrue long-rerm
`storage medium?
`Digital documents arc committed to a conversion
`treadmill. With eadl generation of media (circa 1978
`8-ind1 floppie.~). the oomputer system (CPM). and the
`applicatloo (\X.'<>rdsr<Jr), a cotwersion il; required. This
`happens about once a decade .. if we pick foimars care(cid:173)
`fully. For pla.i.tt docum.enrs, the alternative is paper
`sr:td<.~ of personal information in file cabinets, as com·
`pulsive .information pa.ck rats do today. versus a single
`OVD rhar a com purer can searm. The }PEG foimat
`is con~traincd by camera equipment and. the need to
`inccroper:.ttc; TlF is constraint'<! ;ts a f.tcsimile sran(cid:173)
`dml. Starkweather's Pcdisril system [7] scans docu(cid:173)
`ments (books, journals, papers) into TlF at 400dpi
`followed by OCR for recrieval.
`F<l.r data co be understood in t!ic titrurc, it cannot
`be subject ro applications that change every ye-ar such
`that a particular version has to be maintained (for
`t-xaUlple, Quicken 95-2000).' As applicationli evolve,
`
`s31.100 ofchca~~th(.lf·~, cCnc:uftwuu, ciru 1975 'ullil({ uo 8-lnc.ll n,,rJ>.rd'o.t~ ctnt.ed oft
`•l>•fi'II\II'())J.S ~~~J t.,.OOC,.ciJ.lf.py.fke~, ~f'tl:wm--attd iD1t. Mi<mcdi Word font.,.<
`~io(J 14 PI) P-It cmul..c(lt' running WPS 8 .wlfY(.t.l~
`'1)o~ctW(ltfte lt1 J9?0 em a ~·it~oHHh. md c:;.Qn..\"ffttd 1hrw.ml SJt a nKu·c ncc-ncv~f1i<ln
`i$ wnh1t \'ft g'IK1,1r" rf'PQI1'. ()~a; v"itlf'lll)ll 11: M~ntw.b '-'"ltlru>t be- cuov<:ull!'d a.:cU\1
`{dlaf ».. r~) h•) a,l)(; wi1h.oHt m~noid dlhu. M<4..:.f)JZ\Y aoJ Dmv tf.r rhc P<.: h~vt'
`li1nil>.rptc•hkm~.
`
`90
`
`Janu:wy2001/Vol, +4.No. I COMHU!UCAnONSOFTH~ ACH
`
`this means dma rnaiut:1ins rhc crcaring version of rhc
`applica.tion or all past dam associated wirh a named
`applicarion has ro be COJI\'Crtcd f(,rward. This is also
`an issue and perhaps failure of object technology rhar
`runs on a single, univcrs;'l} machine.
`Alternatively, the one ·way co ensure interpretability
`is to tran~orm data cmauating from :1 program, into a
`geueric format. The current solution for longevity is to
`usc a fuw widely accepted data type$ th:tt data is traus(cid:173)
`formcd into. For example, yearly Quicken reportS end
`up as te.n files.
`Given rhc vast amoWlt of data in Adobe's PDF, or
`Microsoft's Office1 wbar cotmnirmcm wiU rhe apps
`make co their clara? Will the JP£G and TlF working
`group ensure that my old files can be read?
`
`Economics
`Table 2 give.~ rhe storage requirements and cosrs for
`various data. The cost of documems and photographs
`in a CyberAll is nearly zero, hence purging miyching is ·
`gene1-ally a bad strateg}r. The <".OSt f(lr storing encoded
`CDs is about I./20th the cost of a CD, not counting
`the e11coding rime. The encoding cost is comparable
`to a CD cost. Playbadt appliances and persou:U con1·
`putcrs ;trc likely ro change the music distribution
`industry, rmtlciag CDs obsolete within a decade.
`Table 3 estimar.c:; chc requirements for storing an
`individual's conrcnc fi1r lite. Ouc will be able ro record
`all of the information accumulated in rhcir entire per(cid:173)
`sonal and professional life in a few tcr.tbytes, including
`evcryrhing spoken, but nut everything caprured via
`video. This archive would include all home videos tor
`most families. 'lbe Lable shows the various jumps in
`storage roquiroo going !Tom nx.'Ording l.iferin1c text,
`transcribed or encoded speech, and video. The need w
`
`1t).luwriuw io tbcc:.dy \9lSOJ 12n 1X'I"ta oo.tsYtt1:ai fot¥Ntrdl!orn Ma-.:imo.\JI·vtts»r.~
`{JJ -and<·on,'tfu·d aCf(IM 10 d1t PC Office :!flrl!O Stinda.rc.k forlixttl. Po~<trP<-int, ant\
`WOJd. P(twnP~nr fl1(.'1 Clll be: c:u~vtrctd t.o JPF.G or H'~L fonn;at(.
`
`Enfish, LLC; IPR2014-00574
`Exhibit 2231
`Page 6 of 7
`
`

`

`Case 2:12-cv-07360-MRP-MRW Document 71-18 Filed 04/04/13 Page 8 of 8 Page ID #:815
`
`complex. Video will be rhe foros for many users'
`CyberA!l Wairing for better editing, searching (tspe(cid:173)
`cially using recognized text), and rett.1eval rools aud
`even larger disks is my strategy; Already, the projecr has
`convit1ced me thar a goal of paperless srorage and
`rransmissi<m is attainable now for eve.ryrhi~;1g except
`book~ and .item~ th:~r repre,o;ent money.
`.\
`· !''·
`
`Conclusion
`In 2000 the cost to stot·e all persoJ).al '!l)d p~dh~ional
`related, c;(lmpute.r generaced and p;1.per fonns <if irifi?.r(cid:173)
`ru~tion, iL1cloding CDs aod photogriiphs is·11il, ~~pc­
`cially compared with physi<;.<il ohj~~· ~c i~ cosqy} b '
`load a persoual store an.d to maiMaiilit for the i}.l.~~~­
`nite fi1ture. Informacion is held iu multiple forniacft.o
`increase the likelihood for long-term rctrievability.
`Scanners to Y.IF with rext OCR will make paper input
`as easy as discarding ir. Thus, a state of paperless stor(cid:173)
`age and tr.msmission is ncar, Standards and ease of usc
`are now the key enabling technologies.
`,
`' 1n the next five years, anyone will be able to have a
`personal computer that retains evcryrb ing they've read;
`written, and presented via video d1at originated fi:om a
`computer or leb>acy source such as paper or videotape.
`This wouJd i11clude all of d1c tl'ansactions for a F.uuily.
`ranging from general correspondence to every concciv(cid:173)
`ablc medical and finaudalrccord. l.n 1 0 )'<4:f5, systems
`should be able to rocall cvety personal lifetime conver(cid:173)
`sation. Currcndy, significant cfforr is required to build
`and utilize such sysrcms if they involve the entry of
`legacy docwncms--oonsidcr modifiying and organiz(cid:173)
`ing colleccions of boolts, papers, photos, or videotapes.
`A sys1cm such a..~ CyberAII could quite possibly be a
`killer app fol' person~ I computers. D
`
`REJ.?.EltllNCilS
`J.llcU, (i. l>m Appy, How 'Onlmirrtd :w you~ Sigl>od ln>r ~od ii>rgouen
`dat~. ACM VbitJIIUJ (l'eb. :W(IO); www.•em.<>rslubi<lllitylviewSI
`~II_J.hmu
`2. Du•h, V. A1s we may rhink. Atlm"i< M111rrh!y.
`www.L•g,sfl•.uv • dutl>itrf rnl>dvbush/vbu$b~hrmJ
`~ . .!::Cabin« Produ<.t lkochur<. (,."'ov. 19~.1')), l{i<:<>h (brpOt-ation; www.<!ooh-
`
`(July 1945);
`
`U!~c""·oot.
`
`4. G•t<s. II. 1'11< &X1ti.Aix111ll!'"nll"in )},.,~c.., 19?6.
`.5. Huhm, M.N. and Srephe•~•. I..N. l'a·~>tul on~•lot;i<s. ll!flf! /IJJUIJ(t C•m·
`puri".,( .~. 5 (Sept./Ocr. 1.99!>). 8$-8,9.
`6. 1 ... 1;, M. l't'"ilul Digi11d Lil>mrill. M"'!;"' K.,J'rnonn l'ubtishCl>, Son
`l'r.~nt:ilsc'<>. 1997.
`7. Swl<"""thct• G.K PrJisJAk A Pm•"ntDI<rmwnr lmotJnt SJ1te~n. Micro<ofc
`R~~<••ch Tcchnir:W Rcpon MS'R-TR-2000.103.
`June 2000.
`
`GoROON B HU (.~bell@microsoft.ccm) is Senior Resem::~ at the
`Mi«<.«ft l»y /\reo R.-.eotdl (;;,nc<'t in S.n l'r.wcis<:o.
`
`Peo•i.oMo oo ,,.dlf,ttd ntl>.,<h..,;.. ol >II or J"U' old'"""'k Loo-J'Cf'On'l oc ~·
`mom''"',. ftAorcd \Virhol,t JQ: I><OY.drd rt..J .:.ot,;e, 11< 0<>1 Mlode .. di>uib<ll<d 6>r
`p3Dfir <• Q)rwntrdAI ad'l~Mt. aod cb~ <opia bt:M· fhit: n.)ri«: ;2nd tbetitU ci;;Jti.,n on
`the ~ ~- 'JO q,- Ml)(nri~ en "'-"P!bti.dt, b) Pf* oa :JN'\'eu M t1) t«fisnibut-t to
`Gm. ~i:liu l''M,[ l:p<\."itk. p<'l'l>l~O ~Rd/ftf-. *
`
`02001 ACM 0002~71f2/0JIOIOO $S.OO
`
`COHMUHICI.TIONS OFTHf ACM )'"""'Y2001/Vol . ..... No. I
`
`91
`
`rmnscribed speech is dear
`recognize
`based on sr.orage and searching needs.
`The aaual stomge (lable 4) of triy.CyberAll is quite
`small. Until recently 1 purgcJ.. pa~>ci files to stay within
`cabiner and searching constraintS, hence my CyberAil
`.is incom~lece. These arc 2-15MB PowerPointalbums
`ofJPEG·photos.
`Deciding among the array of progr.uns using
`mostly proprier:uy data formats and de\tf;lopiug a
`process to deal with the encoding of dot.'i.uiieri£S tor
`pcrsonaVprofessional and archive/working use is prob(cid:173)
`ably the most difliwit decision in building one's
`CybcrAll. These fo.rrnats have to be maintained or
`converted in the future. One scracegy .is to wair for an
`ideal solution and stabiticy' that will hopefully come
`widliu five years. A1ternacivel}~ keeping data in the
`most primitive, $Canned or encoded form-TIF and
`Jl>EG-allows for future flexibility, including being
`able to u.tilize better cools, such as OCR and encoding.
`Photo stomge and retrieval are cermin tO improve.
`Camc.ms and acquisition sofr.ware .must maintain
`dares. Cameras should include audio recording for
`voice rumocation, memdam for reu·ieval, and .improv(cid:173)
`ing the value of the image wirh a b.ir of sound or vo.ice.
`Advances in query software to find like images Sllch as
`buildings. people, or sunsers using color spectra,
`shapes, aod orhe.r amihures is improving ro the point
`of usefulnc.~. lr is necess;uy to widen CyberAll's scope
`to include :~11 f:1mily members iu order to get a better
`handle on everyday archiving and usc for noncom(cid:173)
`puter \Jsers. My CybcrAII operates with and is aided by
`my file organization. i\ general system to operate over
`decades would have to posit a structure and tools to aid
`users and cope with the inrcrgCilerntion problem.
`Cybc.:rA11 requires rools chat relate to privacy. especially
`the abilitr to lock files until time has elapsed or events
`occur. And dle ability ro limit visibility of documents
`ro specific people or people in specific roles.
`In the future, retaining conversations aod video are
`po~iblc. D~-viccs to record inrcrvic:ws and meetings
`would be welcome and necessaty. \'<1hen conversations
`arc added, ownership and. privacy become even more
`
`Enfish, LLC; IPR2014-00574
`Exhibit 2231
`Page 7 of 7
`
`