0
`
`
`
`35233
`
`1B2
`
`a2) United States Patent
`Dunningetal.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 8,352,331 B2
`Jan. 8, 2013
`
`(54)
`
`(75)
`
`RELATIONSHIP DISCOVERY ENGINE
`
`Inventors: Ted E. Dunning, San Diego, CA (US);
`Bradley D. Kindig, San Diego, CA (US)
`
`1/1993 Ejiri
`5,182,708 A
`8/1993 Kuorsawa
`5,241,674 A
`4/1994 Komeda
`5,303,150 A
`4/1994 Burrows
`§,303,302 A
`12/1994 Register
`5,371,807 A
`2/1995 Geist
`5,392,212 A
`4/1995 Levinson
`5,404,505 A
`5/1995 Damashek
`5,418,951 A
`5,497,488 A
`3/1996 Akizawa
`(*)
`Notice:—Subject to any disclaimer, the termof this
`5,499,046 A
`3/1996 Schiller
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 1619 days.
`
`(73)
`
`Assignee: Yahoo! Inc., Sunnyvale, CA (US)
`
`(Continued)
`
`(21)
`
`Appl. No.: 09/846,823
`
`(22)
`
`Filed:
`
`Apr. 30, 2001
`
`(65)
`
`Prior Publication Data
`
`US 2002/0082901 Al
`
`Jun. 27, 2002
`
`Related U.S. Application Data
`
`(60)
`
`Provisional application No. 60/201 ,622, filed on May
`3, 2000.
`
`(51)
`
`(52)
`
`(58)
`
`(56)
`
`Int. Cl.
`(2006.01)
`G060 30/00
`(2006.01)
`GIIB 21/08
`(2006.01)
`GO06F 13/00
`(2006.01)
`GO6F 17/00
`US H@Gris 705/26.7; 369/30.1: 369/30.08:
`711/111; 700/94
`Field of Classification Search ........................ None
`See application file for complete searchhistory.
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`3,568,156 A
`4,384,329 A
`4,833,610 A
`4,996,642 A
`§,062,143 A
`
`3/1971 Thompson
`5/1983 Rosenbaum
`5/1989 Zamora
`2/1991 Hey
`10/1991 Schmitt
`
`AU
`
`FOREIGN PATENT DOCUMENTS
`A-5303 1/98
`8/1998
`
`(Continued)
`
`OTHER PUBLICATIONS
`
`Lauren B. Doyle, “Indexing and Abstracting by Association—Part
`1.’ pp. 25-38, Santa Monica, CA,, Found in: Readings in Information
`Retrieval, Edited by Karen Sparck Jones and Peter Willett, Morgan
`Kaufmann Publishers, Inc., San Francisco, CA, © 1997.
`
`(Continued)
`
`Primary Examiner — Yehdega Retta
`(74) Attorney, Agent, or Firm — Berkely Law & Technology
`Group, LLP
`
`(57)
`
`ABSTRACT
`
`A system, method, and computer program product discover
`relationships among items and recommend items based on
`the discovered relationships. The recommendations provided
`by the present invention are based on userprofiles that take
`into account actual preferences of users, without requiring
`users to complete questionnaires. An improved binomial log
`likelihood ratio analysis technique is applied,
`to reduce
`adverse effects ofoverstatement ofcoincidence and predomi-
`nance ofbestsellers. The invention may be used, for example,
`to generate track lists for a personalized radio station,
`
`97 Claims, 52 Drawing Sheets
`
`Tally Documents
`i
`
`
`
`
`
`‘Gonvert and Trim Fields
`1307
`
`Add Track List to Index
`1308
`
`EX1048
`Roku V. Media Chain
`U.S. Patent No. 9,715,581
`
`EX1048
`Roku V. Media Chain
`U.S. Patent No. 9,715,581
`
`

`

`US 8,352,331 B2
`
`Page 2
`
`10/2000 Linsk
`6,138,142 A
`U.S. PATENT DOCUMENTS
`11/2000 Robertset al. o...ccc00...... 709/219
`6,154,773 A
`eee g
`HIKER Baa HK
`i)
`9.
`&
`i
`al
`+
`.
`ag «!
`oe is ; oes ce
`5,548,507 A
`8/1996 Martino
`RisTaED A
`13000 Rehulss
`5.583.763 A
`12/1996 Atcheson
`6139142 BL
`12001 Win
`5,592,511 A
`1/1997 Schoen
`6135560 Bl
`2/2001. You:
`5,608,622 A
`3/1997 Church
`soe
`‘
`ous
`5.616.876 A
`4/1997 Cuts
`6,192,340 Bl
`2/2001 Abecassis
`5661.787 ‘A’
`8/1997 Pocock
`6,205,126 Bl
`3/2001 Moon
`Peeve a
`ino eal
`>»
`ie
`=
`=!
`+
`£
`i
`I
`eeeee cent
`ieee
`5,678,054 A
`10/1997 Shibata
`650193. BL
`3/2001. Robert
`5,706,365 A
`1/1998 Rangarajan
`6.230.207 BI
`5/2001 Roberts
`S108,7108 8
`LIRR Rise
`
`5.713.016 A*[1998 Hill ..ccccccccssccscssesesseeeeeee 707/S SoaN4s) BL 8001 Rabets
`
`
`5,726,909 A
`3/1998 Krikorian
`Se
`;
`ee
`5.740134 A
`4/1998 P
`6,246,672 Bl
`6/2001 Lumelsky
`eaGaE A
`aGoe hice
`6,249,810 Bl
`6/2001 Kiraly o..cccccsesecsseseees, 709/217
`ay
`4
`f
`!
`>
`t
`5.751.672 A
`5/1998 Yankowski
`epee a Se He “s
`5,754,938 A
`5/1998 Hertz
`ears
`eet
`3758957 A
`Sess 4
`6,272,456 Bl
`8/2001 de Campos
`5764035 A
`6/1998 Hunt
`tal
`6,272,495 BL
`8/2001 Hetherington
`5°774°357 A
`6/1998 Hofer
`6,282,548 BL
`8/2001 Burner
`Sent A
`ORGOOR Tan
`erat
`6,292,795 Bl
`9/2001 Peters et al.
`5700035 A
`a/1a58 Pacts an
`6.298.446 Bl
`10/2001 Schreiber
`eee|
`Sone GoLameel
`6.314.421 BI
`11/2001 Sharnoff
`ea ‘
`oldmanet al.
`6.317.761 Bl
`11/2001 Landsman etal............. 707/513
`are .
`ihe ree eal,
`6,321,205 BL*
`11/2001 Eder
`cceosssesnstessseaseesseee 7058/7
`5.862.220 A
`‘1/1999. Perlman
`ee ee en Ce
`5862339 A
`‘1/1999 Bonnaure
`eee : ae pies
`5,864,868 A
`1/1999 Contois
`6353340 BI
`3/2002 Linsk
`
`5,872,921 A SVIOAiS. BE|AONE Min2/1999 Zahariev etal.
`
`5.881.234 A
`3/1999 Schwab
`eo
`cher earad
`
`eobe k.|ahNe eo 6,370,513 BL* 4/2002 Kolawaetal. o..ccc.... 705/10
`
`Sona) k
`BiGae De,
`6,389,467 BL
`5/2002. Eyal
`
`SeaGL A:|LOSS tiie 6,405,203 BI 6/2002. Collart
`
`BiaGan XK
`Sisee Raa
`6,430,539 B1*
`8/2002 Lazarus et al. «1...705/10
`3.913.041 A
`6/1999. Ramanathan
`Geiss pl,
`Bante Rupee
`:
`926207 A
`7/1999. Vaughan
`6,438,579 BL*
`8/2002 Hosken veces. 709/203
`
`rOsseG A|OSD Toateon 6.487.598 BL 11/2002. Valencia
`
`a,
`!
`AL
`a
`Soutee
`CAGGE Uncen
`6,490,553 B2
`12/2002 Van Thong
`5.931.907 A
`8/1999 Davies
`See ee es
`Sele, DI) Dea
`6.513.061 BI
`1/2003 Ebata
`5,945,988 A
`8/1999 Williams
`es!
`:
`=
`
`yok|Siege Cex 6,522,769 BL 2/2003 Rhoads
`
`3086-48) A
`9/1900 Aorboin
`6,526,411 BL*
`2/2003 Ward o..ceccsesesessseeneees 707/102
`5.960.430 A
`9/1999 Haimowitz
`Sree, ee
`cant. aecbues
`5,969,283 A
`10/1999 Looney et al. oscssccssscs.. 84/609
`6's38006 Bl
`3/2003. West
`5,977,964 A
`11/1999 Williams
`CASTOR GA
`-dO0s. Steptlenasd
`5,983,176 A
`11/1999 Hoffert
`6560403 Bi
`5/2003 Tanaka Kr
`Mae A
`ttc be
`6,560,704 B2
`5/2003 Dieterman
`6,000,008 A
`12/1999 Simeoe
`oS EF ee ee
`6,009,382 A
`12/1999 Martino
`rt
`cea
`Paisook 4
`aie meace
`6,611,813 Bl
`8/2003. Bratton
`6020883 A pa sone
`6,614,914 BL
`9/2003 Rhoads
`6.021.203 A
`5/2000 Dou
`6,615,208 BL*
`9/2003 Behrenset al. wi.cccccccc.... 707/5
`6096308 A
`S00 aca ‘
`6,655,963 BI*
`12/2003 Horvitz etal.
`..
`434/236
`
`12/2003 Weare etal. ices. 84/668
`REaio A
`ShON Chowihaey
`6,657,117 B2*
`6,029,195 A
`2/2000 Herz
`SHORTS! BE Leet bee
`
`6.031.795 A_—-2/2000 Wehmeyer Spelst at teens: 2 conned
`
`
`6.031.797 A
`2/2000 Van Ryzin
`See aee
`6.035.268 A
`3/2000 Carus
`ee a ee
`6,038,527 A
`3/2000 Renz
`Cet A200) Tineoan
`6,038,591 A
`3/2000 Wolfe
`Sees GaNO8: Fare
`6.047.251 A
`4/2000 Pon
`eee ZF
`Beene cementite
`6,047,268 A
`4/2000 Bartoli
`SGosidl Bi
`a800e.
`tenesTH
`6,047,320 A
`4/2000 Tezuka
`ae?
`-
`snes
`SO47307 4.
`4060
`6,952,523 B2
`10/2005 Tanaka
`6052717 A.
`—«4/2000 Rey
`id
`2001/0005823 Al
`6/2001 Fischer
`Catt6a He
`pena Sheet ce
`2001/0042107 Al
`11/2001 Palm
`ccseescosssseeee 705/26
`6,064,980 A
`5/2000 Jacobi et al.
`200110042109 Al
`11/2001: Bolas et al.
`6.065.051 A
`5/2000 Steele
`2001/0044855 Al
`LL/2001 Vermeire
`6.065058 A
`5/2000 Hailpernet al.
`...esew...... 709/231
`2001/0052028 Al
`12/2001 Roberts
`6,070,185 A
`5/2000 Anupam
`2001/0055276 Al
`12/2001 Rogers
`6,085,242 A
`7/2000 Chandra
`2002/0002039 Al
`1/2002 Qureshey etal.
`6,097,719 A
`8/2000 Benash
`2002/0004839 Al
`1/2002 Wineetal.
`6,102,406 A
`8/2000 Miles
`2002/0007418 Al
`1/2002 Hegdeetal.
`6,105,022 A
`8/2000 Takahashi
`2002/0010621 Al
`1/2002 Bell et al.
`6,131,082 A
`10/2000 Hargrave, III
`2002/0010714 Al
`1/2002 Hetherington
`6,134,532 A * 10/2000 Lazaruset al. occ... 705/14
`2002/0010789 Al
`1/2002. Lord
`
`

`

`US 8,352,331 B2
`Page 3
`
`2002/0013852 Al
`2002/0016839 Al
`2002/0035561 Al
`2002/0045717 Al
`2002/0056004 Al
`2002/0065857 Al
`2002/0082901 Al
`2002/0095387 Al
`2002/0099696 Al
`2002/0099737 Al
`2002/OL11912 Al
`2002/0129123 Al
`2002/0152204 Al
`2002/0175941 Al
`2003/0002608 Al
`2003/0007507 Al
`2003/0028796 Al
`2003/0046283 Al
`2003/0083871 Al
`2003/0093476 Al
`2003/0133453 Al
`2003/0135513 Al
`2003/0139989 Al
`2003/0165200 Al
`2003/0182139 Al
`2003/0190077 Al
`2003/0206558 Al
`2005/0149759 Al
`
`1/2002 Janik
`2/2002 Smith etal.
`3/2002 Archer
`4/2002 Grenda
`§/2002 Smith
`/2002 Michalewicz
`6/2002 Dunning
`7/2002 Sosa
`7/2002 Prince
`7/2002 Porter
`$/2002 Hunter
`9/2002 Johnson
`10/2002 Ortega
`11/2002 Hand
`1/2003 Glenn
`1/2003 Raywan et al.
`/2003 Roberts
`3/2003 Roberts
`5/2003 Foote
`5/2003 Syed
`7/2003 Makishimaetal.
`7/2003 Quinn
`7/2003 Churquina
`9/2003 Pugel
`9/2003 Harris
`10/2003 Ross
`11/2003. Parkkinenetal.
`7/2005 Vishwanath
`
`EP
`EP
`ne
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`GB
`JP
`JP
`WO
`Wo
`WO
`WO
`WoO
`WO
`WO
`WO
`WO
`WO
`WoO
`WO
`WO
`WO
`WO
`
`FOREIGN PATENT DOCUMENTS
`0 173 639 A2
`3/1986
`0 643 359 A2
`3/1995
`O7S1471 Al
`1/1997
`0860785 Al
`8/1998
`0 $47 156 A2
`10/1998
`0955592 A2
` ILI1/1999
`0955 592 A3
`11/1999
`1050830 A2
`11/2000
`1050833 A2
`11/2000
`| 236 354
`5/2001
`1010 098 BL
`6/2003
`1324 567 A2
`7/2003
`1324 567 A3
`7/2003
`2 306 869
`T/AGOT
`2001202368
`7/2001
`2001521642 T
`11/2001
`WO 97/07467
`2/1997
`WO 98/25269 Al
`6/1998
`WO 98/33135
`T/1998
`WO 98/47080 A2
`10/1998
`WO 99/27681
`6/1999
`WO 99/43 111
`8/1999
`WO 00/04474
`1/2000
`WO 00/31964
`6/2000
`WO 00/46681 Al
`8/2000
`WO 01/33379 Al
`5/2001
`WO 01/35667 Al
`5/2001
`WO 01/54323 A2
`7/2001
`WO 01/73639 Al
`10/2001
`WO02/42862 A2
`5/2002
`WO 03/012695 A2
`2/2003
`
`OTHER PUBLICATIONS
`
`MLE. Maron andJ.L. Kuhns, “On Relevance, Probabilistic Indexing
`and Information Retrieval,” pp. 39-46, Found in: Readings in Infor-
`mation Retrieval, Edited by Karen Sparck Jones and Peter Willett,
`Morgan Kaufmann Publishers, Inc., San Francisco, CA, © 1997,
`Cyril Cleverdon, “The Cranfield Tests on Index Language Devices,”
`presented Apr. 27” 1967, pp. 47-59, Found in: Readingsin Informa-
`tion Retrieval, Edited by Karen Sparck Jones and Peter Willett,
`Morgan Kaufmann Publishers, Inc., San Francisco, CA, © 1997.
`G. Salton and M. E. Lesk, “Computer Evaluation of Indexing and
`Text Processing,” pp. 60-84, Found in: Readings in Information
`Retrieval, Edited by Karen Sparck Jones and Peter Willett, Morgan
`Kaufmann Publishers, Inc., San Francisco, CA, © 1997.
`Chapter 3—Key Concepts.”pp. 85-92 Found in: Readingsin Infor-
`mation Retrieval, Edited by Karen Sparck Jones and Peter Willett,
`Morgan Kaufmann Publishers, Inc., San Francisco, CA, © 1997,
`
`W.J. Hutchins, “The Concept of “Aboutness’ in Subject Indexing,”
`presented Apr. 18, 1977, Chapter 3—Key Concepts, pp. 93-97,
`Foundin: Readings in Information Retrieval, Edited by Karen Sparck
`Jones and Peter Willett, Morgan Kaufmann Publishers, Inc., San
`Francisco, CA, © 1997.
`Cyril W, Cleverdon and J. Mills, “The Testing of Index Language
`Devices.” presented Feb. 5, 1963, Chapter 3—Key Concepts, pp.
`98-110, Found in: Readings in Information Retrieval, Edited by
`Karen Sparck Jones and Peter Willett, Morgan Kaufmann Publishers,
`Inc., San Francisco, CA, © 1997,
`Gerard Salton and Michael J. McGill, “Introduction to Modern Infor-
`mation Retrieval,’ Computer Science Series, pp. 1-435, © 1983 by
`McGraw-Hill, Inc., McGraw-Hill Book Company, USA.
`C. J. van Rijsbergen B.Sc., Ph.D., M.B.C.S, “Information Retrieval,”
`Department of Computing Science-University of Glasgow[online],
`1979 [retrieved on Aug. 24, 2001] Retrieved from.
`Hayes, Conor et al., Smart Radio—A Proposal, Technical Report
`TCD-CS-1999-24, Online! Apr. 1999 , pp. 1-14, XP002279579,
`Trinity College Dublin,
`Ireland, Retrieved from the Internet
`<URL :http://www.cs.ted.ie/publications/tech-reports/reports.99/
`TCD-CS-1999-24 pdf>, retrieved on May 7, 2004.
`Hoffman, Thomaset al. Latent Class Models for Collaborative Fil-
`tering, Proceedings of the Sixteenth International Joint Conference
`on Artificial
`Intelligence,
`IICAI 99, Stockholm, Sweden, Jul.
`31-Aug. 6, 1999, Online! pp. 688-693, XP002279578, Retrieved
`from the
`Internet:
`<URL:http://www.cs.brown.edw/(th/papers/
`HofmannPuzicha-LJCAI99.pdf>, retrieved on May 7, 2004.
`Loeb, Shoshana, Architecting Personalized Delivery of Multimedia
`Information, Communications of the ACM, vol. 25, No. 12. Dec.
`1992, pp. 39-50, XP002 102709.
`Nichols, David M. et al., Recommendation and Usagein the Digital
`Library, Technical Report Ref. CSEG/2/1997, Online! 1997, pp.
`1-15, XP002279577, Retrieved from the Internet: <URL:ftp://fip.
`comp.lancs.ac.uk/pub/reports/1997/CSEG.2.97,pdf>,
`retrieved on
`May 7, 2004.
`Schafer, J. Ben et al., Recommender Systems in E-Commerce, Pro-
`ceedingsACM Conference on Electronic Commerce, 1999, pp. 158-
`168, XP002 199598,
`Supplementary European Search Report in Application No. EP 01 95
`1043 (dated Mar. 28, 2007).
`<URL:http://www.des.gla.ac.uk/keith’preface .html> (213 pages).
`Alan Griffiths, H. Claire Luckhurst and Peter Willett, “Using
`Interdocument Similarity Information in Document Retrieval Sys-
`tems,” pp. 365-373, © 1986 by John Wiley & Sons, Inc.
`Karen Sparck Jones, “Search Term Relevance Weighting GivenLittle
`Relevance Information.” pp. 329-338, (originally located in Journal
`of Documentation, vol. 35, No. 1, Mar. 1979, pp. 30-48),
`E. Michael Keen, “Presenting Results of Experimental Retrieval
`Comparisons,” Department of Information & Library Studies, Uni-
`versity College ofWales, Aberystwyth, Sy23 3AS U.K., pp. 217-222.
`Brian P. Mc Cune, Richard M. Tong, Jeffrey S. Dean, and Daniel G.
`Shapiro, “Rubric: A System for Rule-Based Information Retrieval,”
`pp. 440-445.
`S.E, Robertson, “The Probability Ranking Principle in 1R.” School of
`Library, Archive, Information Studies, University College of Lon-
`don, pp. 281-286.
`S.E. Robertson and 8S. Walker, “Some Simple Effective Approxima-
`tions to the 2—Poisson Model for Probabilistic Weighted Retrieval,”
`Centre for Interactive Systems Research, Departmentof Information
`Science, City University, Northampton Square, London, EC1V OHB,
`U.K., pp. 345-354.
`G. Salton and M.J. McGill, “The SMART and SIRE Experimental
`Retrieval Systems,” pp. 381-399.
`G. Salton, A. Wong and C.S. Yang, “A Vector Space Model for
`Automatic Indexing,” Cornell University, pp. 273-280.
`Gerard Salton
`and Christopher Buckley,
`‘“Term-Weighting
`Approaches in Automatic Text Retrieval,” (received Nov. 19, 1987;
`accepted in final form Jan. 26, 1988), Department of Computer
`Science, Cornell University, Ithaca, N'Y.
`Tomek Strzalkowski, “Robust Text Processing in Automated Infor-
`mation Retrieval,” Courant Institute of Mathematical Sciences, pp.
`317-322.
`
`

`

`US 8,352,331 B2
`Page 4
`
`Jean Tague-Sutcliffe, “The Pragmatics of Information Retrieval
`Experimentation Revisited,” School of Library and Information Sci-
`ence, University of Western Ontario, Canada, pp. 205-216.
`M. F. Porter, “An Algorithm for Suffix Stripping.” Computer Labo-
`ratory, Corn Exchange Street, Cambridge, 313-316.
`W. B. Croft and D. J. Harper, “Using Probabilistic Models of Docu-
`ment Retrieval without Relevance Information,’ Department of
`Computer & Information Science, University of Massachusetts, pp.
`339-344.
`U.S. Appl. No. 60/144,377, filed Jul. 16, 1999, Benjamin E. Hosken.
`U.S. Appl. No. 60/165,726, filed Nov. 15, 1999, Sean Michael Ward.
`U.S. Appl. No. 60/165,727, filed Nov. 15, 1999, Sean Michael Ward.
`U.S. Appl. No. 60/166,039,filed Nov. 17, 1999, Sean Michael Ward.
`“Fast Algorithms for Projected Clustering,” Charu C. Aggarwal,
`Cecilia Procopiuc, Joel L. Wolf, Philip S. Yu, and Jong Soo Park.
`Proceedings of the ACM SIGMOD International Conference on
`Management ofData, 1999.
`“Mel-Frequency Cepstral Analysis,” [online] [retrieved on Feb. 2,
`2001] Retrieved from the Internet <URL:http://cerma-www.
`standford.edu/~unjung/mylec/mfce.html>, pp. 1-3.
`Agosti, M., Gradenigo, G. Marchetti, P-G., “A Hypertext Environ-
`ment for Interacting with Large Textual Databases,” pp. 469-477.
`Hull, David A. and Grefenstette, Gregory, “Querying Across Lan-
`guages: A Dictionary-Based Approach to Multilingual Information
`Retrieval,” pp. 484-492.
`Belkin, N.J. Oddy, R.N., Brooks, H.M., “The Journal of Documen-
`tation,” vol. 38, No. 2, Jun. 1982, pp. 299-304.
`R. Brody, Ph.D., “The Conditions and Consequences of Profiling in
`Commercial and Governmental Settings.” Technology and Society.
`1998. ISTAS 98. Wiring the World: The Impact of Information Tech-
`nology on Society, Proceedings ofthe 1998 International Symposium
`on South Bend, IN, USA Jun. 12-13, 1998, NY, NY, USA, IEEE, US,
`Jun. 12, 1998, pp. 148-154, XP010291443, ISBN: 0-7803-4327-1
`*the whole document”.
`Carl de Marcken, “The Unsupervised Acquisition of a Lexicon from
`Continuous Speech,” Massachusetts Institute of Technology Artifi-
`cial Intelligence Laboratory: Center for Biological and Computa-
`tional Learning, Department of Brain and Cognitive Sciences, A.I.
`Memo No. 1558 and C.B.C.L. Memo No. 129, Nov. 2001, pp. 1-27.
`Internet Papers: Freetantrum: Songprint 1.2, and computer code;
`www.freetantrum.org; Dec. 11, 2000; 46 pages.
`
`Jones, Karen Sparck, Jones, G.J.F., Foote, J.T. and Young, S.J.
`“Experiments in Spoken Document Retrieval.” pp. 493-502, Dec. 7,
`1995.
`
`Jones, Karen Sparck and Willett, Peter, “Readings in Information
`Retrieval,” Morgan Kaufmann Publishers, Inc., 1997, pp. 25-110,
`205-246, 257-412, 440-445, 469-502, 527-533.
`lan Goldberg, Steven D. Gribble, David Wagner, Eric A. Brewer “The
`Ninja Jukebox” Oct. 14, 1999,
`Lancaster, F.W., “Medlars: Report on the Evaluation of Its Operating
`Efficiency,” pp. 223-246.
`Z. Liu, et al., “Audio Feature Extraction and Analysis for Scene
`Segmentation and Classification”, 1998,
`MusicMatch Literature downloaded from web.archive.org—7 pages
`total.
`RealNetworks Literature downloaded from web.archive.org—16
`pagestotal, Jan. 17, 1999,
`Lisa F. Rau, “Conceptual Information Extraction and Retrieval from
`Natural Language Input.’ Artificial
`Intelligence Program GE
`Research and Development Center, Schenectady, NY 12301, pp.
`$27-533.
`Salton, Gerard, Allan, James, Buckley, Singhal, Amit, “Automatic
`Analysis, Theme Generation, and Summarization of Machine-Read-
`able Texts.” pp. 478-483.
`Shah, Tej, “Improving Electronic Commerce Through Gather Cus-
`tomer Data,” TCC402 [online] Apr. 23, 1998 XP002379874, Univer-
`sity of Virginia, USA, Retrieved from the Internet: <URL:http://
`wwwilib.virginia.edu> [Retrieved on May 8, 2006] *the whole
`document*.
`Stubblefield, Adam and Wallach, Dan S., “A Security Analysis of
`My.MP3.com and the Beam-it Protocol,” Department of Computer
`Science, Rice University.
`Witten, Ian H. and Frank, Eibe, “Data Mining, Practical Machine
`Learning Tools and Techniques with JAVA Implementations,” Aca-
`demic Press, pp. 57-76, 2000.
`Wold, Erling, Blum, Thom, Keislar, Douglas and Wheaton, James,
`“Content-Based Classification, Search, and Retrieval of Audio,”
`IEEE MultiMedia, Fall 1996.
`Written Opinion of the Patent Cooperation Treaty for International
`Patent Application no. PCT/US802/03504, Jun. 16, 2004.
`
`* cited by examiner
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 1 of 52
`
`US 8,352,331 B2
`
`s}si]Aued
`
`Oz)
`
`ple
`
`VlOld
`
`leqo1
`
`UONOYNON
`
`BLAIS
`
`Sil
`
`Ayedpig
`
`st]
`
`JOJEJBUSS)
`
`lit
`
`Ayedpig
`
`Bujebey
`
`BLAIS
`
`Sib
`
`Zbb
`
`aQbL
`<<[ausvoneie
`
`60"ageulugsdiysuoyejay
`eseqejeqnii7I
`
`
`SeteAouaAu|JUBAZY07SJOUOOJu|
`
`sieG08)PUEX8pUmre
`
`BLOW901JeSmolg
`
`SOauibuyJeyiusued
`
`jJeuosiddBUSGaN
`Sh801601
`
`—pOolS001
`OltCol
`thiSOL
`‘SPYCc
`aseqejequaju04man
`
`
`
`
`desunesisIdyPawed)
`
`-USWW009YOIpey
`
`uonepgouenbas
`SeoLOL
`LOLel
`
`punoging
`
`UONeOYHON
`
`wyew-3
`
`punoging
`
`Ja\jQ0N
`
`youees
`
`q2M
`
`jua]uo9
`
`
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan.8, 2013
`
`Sheet2 of 52
`
`US 8,352,331 B2
`
`Station
`Format
`
`User
`Preference
`162
`
`Random
`Penalty
`
`165
`
`Available
`Audio Files
`
`Score
`Fusion
`166
`
`Next Song
`Selection
`168
`
`167
`
`Listener
`History
`
`FIG. 1B
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 3 of 52
`
`US 8,352,331 B2
`
`4st Hour
`174
`
`2nd Hour
`172
`
`3rd Hour
`173
`
`
`
`2 Hour
`Counts
`175
`
`
`
`
`
`Last 1
`Counts
`177
`
`Last 3
`Counts
`178
`
`181
`
`2nd and 3rd to
`Last
`
`FIG. 1C
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 4 of 52
`
`US 8,352,331 B2
`
`Ayu
`
`Buixapu|
`
`O12
`
`Buiyoyey\
`
`Xapu|
`
`We
`
`éOld
`
`607
`
`aseqejeq
`
`yb
`
`607
`
`siSAjeuy
`
`ell
`
`8[YOd
`
`aseqejeg
`
`Zh
`
`Janes607
`
`202
`
`si9sf)
`
`012
`
`THN8Al]
`
`eseqejeg
`
`
`
`saysoISNYy
`
`£02
`
`yang
`
`9|NPEyos
`
`102
`
`1a
`
`aseqeleq
`
`602
`
`JOVENSIUIUIPY
`
`80z
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 5 of 52
`
`US 8,352,331 B2
`
`yes|-O}-YORI
`SO[O1g
`80€
`JSIPY-O}-y9RJ]
`OjuyYORIPe
`
`pul
`
`pul4
`
`Buiddew
`
`OE
`
`Burddeyy
`
`OE
`
`yord|
`
`Q0€
`
`Oju]YORI
`
`MOPUIMA
`
`payejay
`
`SyOed|
`
`jsenbey
`
`Jasp
`
`SuOoNoY
`
`L0€
`
`607Aeld
`
`aseqejeq
`
`yh
`
`
`
`ayeiauasaye1auas
`
`
`
`Isy-0)-J8S/)yoed|-0}-J8S/)
`
`
`
`BuiddeyyBuiddey
`
`€0€OE
`
`aloud
`
`aseqeieq
`
`ZH
`
`€Old
`
`LOE
`
`MOPUIM
`
`jeeISNJON
`
`
`
`SUOIEPUBLULUOD9Ysonepuouneg08%
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 6 of 52
`
`US 8,352,331 B2
`
`
`
` Tracks
`People
`
`
`
`They Heard
`WhoListen
`
`402
`403
`
`
`
`
`
`
`
`Find
`
`
`
`Prune by
`Related
`
`
`Over-represented
`Tracks
`Threshold
`
`
`Tracks
`
`
`406
`405
`
`404
`
`
`
`
`
`
`
`
`
`FIG. 4
`
`
`
`
`
`Tracks
`Augment with
`
`They Heard
`Related Tracks
`
`403
`701
`
`
`
`
`Find
`Over-represented
`Tracks
`404
`
`Prune by
`Threshold
`405
`
`FIG. 7
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 7 of 52
`
`US 8,352,331 B2
`
`
`
` 903 Find Related501 Find Artists for
`
`
`Related
`
`
`Artists
`Those Tracks
`
`
`502
`
`Tracks
`
`FIG. 5
`
`
`
`
`Related
`Find Artists for
`
`
`
`
`Artists
`Those Tracks
`
`
`903
`502
`
`Find Related
`Tracks
`901
`
`FIG. 6
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 8 of 52
`
`US 8,352,331 B2
`
`
`
`
`Profile
`
`Inventory
`Database
`
`
`108
`
`112
`
`
`
`
`
`
`Profile of
`Recommendation
`
`
`Engine
`107
`
`
` LearnedArtist
`
`
`Relationships
`1605
`
`
`FIG. 8A
`
`
`
`UserList
`Notification Criteria
`601
`
`
`
`115
`
`Outbound Notifier
`116
`
` Direct E-mail to User
`
`811
`
` Current Price
`
`
`
` 809
`Learned Artist
`
`
`Relationships
`1605
` FIG. 8B
`
`Offers
`808
`
`Recommendation
`
`Engine
`107
`
`Current Events
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 9 of 52
`
`US 8,352,331 B2
`
`
`
`bs
`
`Estimated Period
`
`MP3 Checksum
`URL
`
`J,
`
`90
`
`an
`
`91) ee1ha; <
`
`Log Database
`902
`903
`Content Database
`
`
`
`j
`904
`g
`Last Version
`g
`veg
`
`
` Upload Time
`Ip
`
`
`IP Address
`Email Address
`
`
`MP3 Checksum
`MP3 HeaderInfo
`Description
`
`
`
`CD ID
`Publisher
`Genre
`Description
`J
`
`
`
`1
`i Profile
`|!
`gi2
`| Database
`I
`I
`
`
`||User Profile CD Expansion’|!Artist Expansion
`
`Related Track
`Related Track
`Related Track
`Related Track
`
`;|Weight Weight Weight Weight
`
`
`!
`|
`Explicit?
`Explicit?
`Explicit?
`Explicit?
`|
`|
`|
`|
`
`
`
`FIG. 9
`
`Legend
`O——® One to many
`@— Many to many
`Object Type
`zee
`
`r 900
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 10 of 52
`
`US 8,352,331 B2
`
`
`
`
`HTML
`Artist Name
`Unmapped
`
`
`
`Templates
`Equivalences
`Artist List
`1001
`1005
`1006
`
`
`
`
`
`
`Import Tool
`1007
`
`
`Database
`Builder
`1003
`102
`
`
`
`Import Tool
`1008
`
`Artist
`Relationships
`Import Tool
`1011
`
`
`
`Updates
`Artist-to-Artist
`
`
`(XML and MDB)
`Relationships
`
`1010
`1009
`
`
`
`FIG. 10A
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 11 of 52
`
`US 8,352,331 B2
`
`
`HTML
`Templates
`1001
`
`Content
`Page
`
`
`Database
`oar
`
`102
`LEN
`
`
`
`
`Find Representative
`Items for User
`1021
`
`
`
`
`
`
`
`Play Log
`Database
`
`
`114
`
`
`
`Profile
`Database
`112
`
`
`User Play
`Logs
`
`1024
`
`
`
`Jukebox
`
`103
`
`FIG. 10B
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 12 of 52
`
`US 8,352,331 B2
`
`1101
`
`[iemagemoics«|SSCS
`Fie Edt View TS
`Query
`
`©} Track Score type: @ Rescored
`
`‘
`
`1102
`
`miles davis
`ohn coltrane
`illie holiday
`miles davis & john coltrane
`louis armstrong
`etta james
`sonnyrollins
`ella fitzgerald
`franklin, aretha
`ben webster
`ella fitzgerald and dukeellington
`art blakely & the jazz messengers
`sarah vaugham
`randy newman
`peyroux, madeleine
`count basie
`benn sein
`chet baker
`james brown
`stan aet7
`
`Query type: @ Artist
`
`© Album
`
`© Frequency
`
`FIG. 11
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 13 of 52
`
`US 8,352,331 B2
`
`
`
`
`
`iWad34314dNHS409YvaTID[AVS
`
`Jo4suoyeziensi,
`
`
`
`Buosjuaung
`
`COZ
`
`
`
`ai\HOLWW@POISNIN
`
`Sirb805)9©GS]PSYwingiyAqmai,CJ
`
`JOALXSNdOlSSSVUSAVidOSHAdud
`
`COLLLoy)|}2021
`
`
`
`
`
`BUOS84,NOAJI};
`
`élOld
`
`
`
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 14 of 52
`
`US 8,352,331 B2
`
`Start
`1301
`
`Obtain Play Logs
`1302
`
`Tally Documents
`1309
`
`Apply Filters
`1303
`
`Prune and Calculate Weights
`1310
`
`Read Stop Files, Index Files,
`
`and Track Tables 1304
`
`End
`
`1311
`
`Parse Play Logs
`1305
`
`Apply StopLists
`1306
`
`Convert and Trim Fields
`1307
`
`Add Track List to Index
`1308
`
`FIG. 13
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 15 of 52
`
`US 8,352,331 B2
`
`
`
`Form Query
`1402
`
`Obtain List of Relevant Users
`1403
`
`Obtain Play Logs
`1404
`
`
`
`
`
`
`
`Merge, Rank, and Filter Play Logs
`1405
`
`FIG. 14
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 16 of 52
`
`US 8,352,331 B2
`
`Start
`1501
`
`Determine N = Number of Listeners
`1502
`
`Determine S = Total Numberof Tracks
`1503
`
`Determine SF and LF
`1504
`
`Weigh Results
`1505
`
`Determine Significant Tracks
`1506
`
`Output Recommendations
`1507
`
`End
`1508
`
`FIG. 15
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 17 of 52
`
`US 8,352,331 B2
`
`
`
`
`
`iI|
`
`
`
`UONdUISgnNSsul}-|edyMeniagwees
`
`
`
`JENSSwWI}-/edy
`
`yl
`
`
`
`AunoesJO}ues
`
`SYORI
`
`UoHeZOUNYOSI.ysanbay
`
`—ebobbxoqeynr
`
`
`761!JOJCISUDS)BOUBNDISOlpey
`
`IST€0l
`
`auul-123y
`
`aseqejeq
`
`9S
`
`}Ua}U0DpueUOReZuOUINY
`
`JONaS
`
`vL9L
`
`passeidwio9
`
`
`
`salijeuBis
`
`SLOL
`
`9}Old
`
`
`
`
`
`saywsues,aouanbasolpey
`
`12h
`
`je1auas)
`
`sjuleysuoD
`
`9L9L
`
`JeUO4
`
`uonluyaq
`
`Tl
`
`ud}epusWwWOddy
`
`aulbu3
`
`Z0L
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 18 of 52
`
`US 8,352,331 B2
`
`SeesU0984042hibuy't3sheqd
`
`
`fgualeseensBUDD34,04J“SSP
`peYy0}ua}si]oymajdoagy02‘aleve
`
`
`
`
`
`
`SSTT0}us}si|apes+02||(S06's,0g)4904Wapoy”dogpueY90y<<dISNYypul4
`
`“UPAANOABulylengshsar140pea'ol
`yey)olpesyoune)wag‘|Too0
`
`
`
`XOQUSIEWAgUOSeagxae
`¢Aqaysanegayydorg'z}3B
`
`
`UOZUOH[eDUEAin?LOLL——aneay|)3B
`ALINNWINOD.02xoquoyeyAguoseaspey
`Kqaseaingapejquazey|]%101¥9e9
`
`
`payseySAWNOOLOo}dn
`SNOLLVONSWINOOSY
`
`aisnusBuipeojumop
`
`wiaag$1009UI9g1,V0NNo,'EL
`xoquay\uoseagpew‘93)
`#191Nyneagyseq“pyou“¢3ha
`
`
`
`HISNeaIPSe)EaidoagSUAPH0eIg“Zh
`
`YvINdOdLSOWiIAbid-SHOW
`
`sar]JOpag’uid)mynneagIse7"ph[AINOZXOBINE
`
`
`wag6:Z0L1ouung8dang
`
`aqpjnodno,
`
`
`
`uvINdOdSOW
`
`say“
`
`AHdWES00SI0
`
`VL)Old
`
`-——4Wsdayez,9h:0/51:0
`
`xoquojey°GUO84,NOAJ]Auam,
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 19 of 52
`
`US 8,352,331 B2
`
`isvoavoua SLLL
`
`LEZLseidpaweied=LLL=POZh60Z1—~LOZbLOZ.«02h
`
`
`
`
`uaaysbuudsaorugAq,(qyBiuc)eWesoy,“pefjnoawod)
`
`
`
`SLISSSMS.NOILVLSOLODYOLISTSSNOILWLSgqL|C)|4UojelsOlpeseyoa}as
`
`uaajsGuudgeorugAqJuBinay)ulics,“¢ef
`
`
`ueaysuudseomgAq,peoyJapuny,“9ef
`
`usaisbuudsonea.beayAGuny,€of
`asked‘UEISIOL—BALAAILYAcpaiamog
`
`abilolavyLsvoavouaSA~—sHODIWWODISNW
`
`
`
`
`cAawwGOGRANSSWOHHSaus3ydols4|>
`
`
`
`SNOILWLSWOLSNDSNOILVLSYVINdOd
`
`xOWEdss4UOHREISAWolava
`
`DisnyapingaIsny)pueDp25o1pey
`
`
`SAQeUal|ydoy-diy9deyyooyS}IHdoyYJOOWSBYOSyoOYIISSB|Duno)ayyooWsyoyPleH“SIH@8H
`
`
`JUNOSISSB})SelDIOene5,08
`
`
`[NOSdISSB|)XI4904une)
`
`ayosoUeqBAHEWOYYNPYSHHYOS
`
`Yoreyoisnyy
`
`COZ
`
`oldva
`
`bunyaaug
`
`]
`
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 20 of 52
`
`US 8,352,331 B2
`
`NSWPeojuUMog MOPUIM
`@9[sdsansatvnm|orsnwanis|siuvno|sNouvanannoosa
`|=BrayYONIAKAN
`
`OazlWNOSYad
`
`
`
`NOILVGNSWWOD3YJO$33Yu930XIS
`
`
`
`iF3uAjou430/dxZ
`
`"218H4OND
`
`
`
`apins)dIsnyy
`
`—,SUING|EOIWEYDau)'eAIEAOU]“HOB
`
`
`
`
`IAEAnia“waemouinopugpeayoipeyyun
`
`
`
`
`Py~ta]UOWWWWOOUleAeyAjqissod‘yy'3"yPinosJeyAA
`
`EyEBGIpeayoipeyjosaaiBaqxis
`
`
`
`
`
`$a]JosaaiBapxisUiPPaYyoIpeYOo]YulPEAUSIOYpue
`
`SNOILVONANWOD3Y
`
`
`
`OISNWNJo@80QAlleqsnd,
`
`
`
`NOATymOo}paysrew
`
`SOW0}Uays|)
`
`Wolddol
`
`“JOUJO}19UYOU'D)
`
`
`
`‘Aegusaig
`
`JL}Old
`
`
`
`
`
`SISN|SIMOgSAISN/Ox3
`
`
`
`paseajauunAjsnoiad
`
`Aepuaba]wosye)
`
`‘aledBpeojunog
`
`!iI
`
`SIMOSGAG
`
`AVOAMSATYYQIM
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 21 of 52
`
`US 8,352,331 B2
`
`roelrrxogeXnr
`|
`
`nueymal,
` iwad3d
`
`
`
`uoddngjeaiuyoa)isanbaygSHOEI]SIACWOOXF
`Aeqay)jodiywadjeucnippyyaAuod=Adeiqi7ISM0}(8)49e1,MANPHY4aulluddja}
`
`
`
`
`diayxogeynruojeyaisnyyLOS(4+1Tv)nusols
`
`
`AaainguonoeysnesaulluQAod
`
`
`S08}(H+11v)nue;dja}
`
`
`
`
`
`(O+17¥)nus]suondoAveuaryAin
`
`SUONEPUSLWILUOOSYDISNjy}95)
`_
`
`
`YoreWDISNW\]Nody€0c}
`S+HlUS+H10sbumes
`
`FWdNHSwODUVF3AVSNadO|@©©®@©
`apeiidnennAueiqiyaisnyued
`
`
`
`“e2igxa]eGueYdysiJAeIULIY2918S
`SUNSpeolumMog1+)Go),voshewly(s)Be]yoes)IsIAej4
`
`
`
`
`
`sainjeajManPpaysaoAng
`
`Aseugr]isnJapiooay
`
`
`sapiooeyMOpUlABIPayabedey=mal
`ISI|AeIqBurAeldMON
`
`
`JakeapinddIsnyyAOipey
`
`
`
`
`C08)(AtTy)
`sjueuodwoebueuyony
`
`
`
`
`
`ywuaweouequgpunog08)(4+11v)nue;yp3
`
`AFH.pueoqdligwoypyBeyjayseg
`ysI|Ae|gWOYGDajealg
`
`
`
`
`
`JaAe|g[jewsdnabed+iyMAlAJAAR|g|INAumop
`
`p08!
`
`YyoyeWoisny)
`
`0021—>
`
`ier soo a)
`
`
`
`aJemyosajepdh)
`
`
`
`“ulysebueyd
`
`
`
`panelsGuryeg
`
`uonesjsiba
`
`SUONEZIENSIA,
`
`
`
`
`
`preogdijg0}pyAdo
`SIAR1ea|D)
`
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 22 of 52
`
`US 8,352,331 B2
`
`
`
`
`
`
`
`
`
`syoeyMeuBuippevayajsiiAejdjuauinasea\9[7]
`
`sceereffcaAddoryxeFB:{y]Addo[4]ewyesedur!,zdurxode’,'epo',)sayyBuoggy]:adAyjosayaeba|tSee|sy)AddlKi-]reyndwogAW[yl
`
`
`
`
`
`ddeeqopyCa:0ereqauayBezigleqaayOa|iTeeeaoer7'yenjassuiyonjessw.;
`
`
`borppue'sBvoseuBuguBinubiyAqAxeaqr7aesnyyey0}seyndwoosnoKuosyoenppeUeDnD,vi
`;
`GluesayyuoGuryarpaysuoyngys40ydau)BupjoyAqsyoegaidqynuwybeyBiyUeDNo),
`
`
`
`
`qr]Ssnyy0}S08]|PpyVE06LaaayaSiiaceahs
`y
`
`“yayndwioounouoanynodyeyo1sMwayy
`
`lO}UORGOSIL]BSNUBDNO)VAp{O}ay]UISHOBNauyePP!o}SaVOPaupgnsapnjoul,jojas
`
`
`
`
`
`SOWENBypauenuE)wanuog0}SgERNE
`
`
`
`
`
`a,yes!odw,'zdu,‘voda,‘eno,se,
`
`
`
`=‘soy‘MopauigS|
`
`
`
`dowysag(S48
`
`
`
`senug[EB
`
`
`
`
`
`SaUo}aIpPGNsapnjau||[A]
`
`
`
`
`
`poowpoquéieywomanIBAA
`
`V6lOld
`
`
`
`
`
`adAyejegvoreunsagadAyBegaainag
`
`
`
`ddesqopyCHAE:
`
`doo:d“Bi
`
`Jaheid0D@ysiyheid
`
`O+9
`
`SIAR]WOYQQalealg
`
`SHOBI]YSIAB|qWOdXy
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 23 of 52
`
`US 8,352,331 B2
`
`
`
`J(as)QIN€z‘pounds:coedspojewysy
`eSCd oisAWCO)
`FHyong,F6lSls
`
`
`
`(Lo)bress2psGemasny]:0atyosony
`TCwouaDaIeea|woa9a}ea7Q
`
`Areugy7aisnyy0}YORI)ManPp
`
`
`OIpngfens\,,yosousIpynoei:
`
`
`sakeepayyyosooyCFE:
`
`
`SiNGLS9JBAUpSiy]UOeiqeweneeoRds
`
`duornoyausCOsoyj"joueau|unepprsnyC)
`
`
`
`
`
`
` SeaaVINEdin}BEGCE[<<wad[funeiephowpmy]@ewesO
`
`BWOFsweyBuosQ9[Pd
`[U8]BWZOZ‘BINSb'SxDELL|]%9
`SdSeues001zjarlese]dH—:adA
`
`
`
`sdoorzduyOOT43ONVa\\‘alayyA
`
`
`
`ApeayJajuudynejaq:snjeig
`
`
`
`
`
`62:69Gurwewayouny
`
`
`
`
`
`Aveugi]aisnyyvedo
`
` malsapyo4Josyua|v0g[|1|:saidodyosequin
`
`
`AUC84,04,j|
`
`Ajuam)xoquoveW
`
`V2061
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 24 of 52
`
`US 8,352,331 B2
`
`
`
`uaaysGuudsaorugAqueayAiGuny,¢ef
`
`
`uaajsGuudsaangAq,dnumois),Zef
`
`
`uasysOuudsaorugAqauld,|ef
`
`W002
`
`
`
`
`
`
`
`uaaysGuudgeorugAQ(yyfiu0)ynoeui0d).eNeSOYy.pefZO81L(s)Beyyes,isteld
`
`
`
`
`
`
`
`usajsbuudseorugAgJUGINelyulWuids.Sey|
`
`
`
`:ISIARlgUIItyYaIag
`
`
`
`
`
`2210dWid343143NHS809 yyvaIDAWSfueogdl>0)LyAdon©©©®@@siheig
`
`VE002
`
`pueogdiigwo.WyBeLjaiseg
`
`uny0)wog
`
`
`
`
`
`uasysbuudssongC0ZL
`
`
`
`-——41sday001Of:b/OF:0
`
`COCL
`
`V0eSls
`
`
` Auo-pearseuadg[]=[4](GlN(dwa’,)sango3arpuedeunig|odkiyosap,
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 25 of 52
`
`US 8,352,331 B2
`
`
`
`
`“uMyOyWog\UNYOo]Wog\uaEsbuUdseomug):4‘Wied
`ge0zved?EE0Z2E0ZLE0Z
`
`
`edw'unyofWogiunyOLWogwaa|sbuudsaonigy:4‘yed
`
`
`80%VEOCE02cE0ZLEZ
`eZ5YI19]
`d0¢Sls
`L__so}[totwouaQuNN
`
`
`
` “OMTyes|3/0w|sig|Seton[souk]|je1eue9
`
`p02E02cE0e1E02
`
`edurunyo,wogwunyo,wogwaajsbuudssorugy:4eg
`
`
`
`[1G|S0ig]sajon[Sour7[ieiaua5|
`“Mojaq\sajoNayy
`VEE?
`
`8£02
`
`VL002
`
`YORI,
`
`edwuny0}Wwog
`
`
`
`(s}oweusyxed)
`
`
`
`sion]sei[SeinSoMTTeIeUsO]
`
`mojaqSigJeyUg
`
`SISe]peg
`
`
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 26 of 52
`
`US 8,352,331 B2
`
`
`
`
`gdurunyOLWogyUNyo,Wwog\uaaysfiuudsaong\:4:yjed
`
`“Tuna9Ang
`
`“TUNSil4oIpny
`
`aNsMy
`
`odwey
`
`‘poojy
`
`“uonenyls
`
`V8E02
`
`
`
`8E02VEO?C02ZEN?LENZ
`
`J0¢‘Sls
`
`VLP0dYOr0e
`
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 27 of 52
`
`US 8,352,331 B2
`
`()
`
`409
`
`
`
`
`POTOMTQuamxoqyoey|UOSEASPEW©E)
`dW3d34J1sSNHSYOBWIJAWSNadO
`
`
`
`60z}2021LOcL
`
`
`COZoIpeyUe)SISNW
`
`60z|LOZ}LOZL
`
`Xam\sersont[noi5oFHOLVIMEROISNN
`
`
`
`C08!—F|umopaBedsyymaiasafelgjews
`
`
`
`dnebedyiy—maipsadeiging~+—COLT
`squauodwo9sBueuyony
`
`
`juawieoueyuypunos
`
`do)uoskemy:L0
`SUONEZIIENS!/\,
`
`
`
`apinsdISNW)
`
`BulAe|4MON
`
`AuesgiAW
`
`MOPUIMEIA
`
`pscoay
`
`ausG9Ang
`
`VbeSls
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 28 of 52
`
`US 8,352,331 B2
`
`dpsudmai
`
`wotAOIVW.QROISNIN
`
`Vb0L2
`
`
`
`
`
`032d5LIWOYLVLEWHALN|FHL
`
`uuio?
`
`
`
`JNOABuysem
`
` ome‘auwui}
`
`
`
`OjpeyYrIeWIISNyy
`
`
`
`aping>/SnyWpue
`
`Aqnod0jjubnoJg
`
`
`
`
`
`(O33d813MIO"LWLNWaLMlFHL
`
`uaa}sbuudssongAq
`
`,veayAbuny,
`
`XamGesuedeRwFoTHOLVWRROISNN
`
`wuoDIYsSe]d=
`
`gv0lc
`
`d73H
`
`MOVedsS4
`
`
`
`olavyLSyodvoud
`
`eeWOLSND
`
`OlgvY
`
`HOLVW&OISNIN
`
`Q33dScise
`
`SeYviNdOd
`
`
`doy-diq9deyyOOYaAeUayySiHdol
`
`nj)eouegaAHeWAIly1INPYSIHYOS
`
`OYPJEH
`
`
`
`ypooyIISSe|D
`
`S8IpiOSHH5,08XI4904IHUne}
`dbéOld
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan. 8, 2013
`
`Sheet 29 of 52
`
`US 8,352,331 B2
`
`
`paseqdISNWMauWIAANOA
`Yo}eWuedam‘ABojouyza}
`
`Uolepuawwo0dal
`
`
`JouednsBuisp)
`
`WODYSE/4=x
`
`
`
`
`
`0239d5L3WI0HLY1INHSLNIFHL
`
`pazyeuosiad
`
`iLONYOLI3ARI149
`
`
`
`‘anbiunsuayo
`
`SPW30VeOdN|YALLSTSMAN|YOVEOSS4|SWOH
`
`
`
`
`
`
`Joeap!pootAyaud2nokeai6,’Buogyeaau,pueGu0g
`
`
`
`
`
`
`
`
`
`Aqwingjemau$,UOSUeWjoaseajalayy40)yjasunOAauedaid‘og
`
`SISNAONIS
`@)(___][_ansavem|oisnania|siuvio|sNouvaNannooaH
`
`
`
`
`
`AANBWA)IY
`dogpjooy
`
`iMONdfNOIS
`
`U8}S!|NOAJeyJBAYSN42]
`“JS3JBY)OP|[,9MPue'd}
`
`
`
`
`
`suondexogaynrau)ybnoiyy
`
`
`
`ONDWadSATSWWN
`
`Aq,weBy|pip|"jsdog
`
`
`
`sueadsAouug
`
`“wingiydoy
`
`
`
`“noJo,suomBuiypyew
`
`oIsnwJayaBy‘O})
`
`SISNW{JOWIN)UBDNOA,
`
`awAueyeBuiyoyew
`
`
`
`
`
`0}Ua}s!)0}O'9XOqeyNEYoReWOISNWPaeuNOY°310N
`
`
`
`nodyeu}sysiieayyUO
`
`MOU0}UB)S!|
`
`
`
`40xiWsnoajyBuesnidmaysadog,pue,ajdoagjnnneag,ani
`
`
`
`
`
`suaseald-pmolUOSUeWUAjURYYJeayjj,NO,‘ajge|leAesuONEYS
`
`
`
`
`
`
`“@IOWPUEO04‘Uje}sWUWeY‘AeqUaals‘au0gsyAzzQ
`
`
`
`
`OIpedYojeyyaisnyyGuysasayulsowayyjoauonoBunjaayo
`
`
`uajsi|NOADISNWB!OWau
`
`SPINE)SISNYO}EWOIsnyy
`
`paseqsuojepuawwo%a
`
`
`“syigeyBuiuaysiyiNOKuo
`
`AoyodAseaud-nuaw
`
`
`"yead’yp),wngiynym,SIyTePOOM,APHVa‘KemkuyHuysalayulVCMNBryay!,"Buog807ey,axl]sayyBuOgKEGunsAyoygndyueye;g