`
`
`
`I 1111111111111111 11111 1111111111 111111111111111 11111 11111 lll111111111111111
`US007548255B2
`
`c12) United States Patent
`Bear et al.
`
`(IO) Patent No.:
`(45) Date of Patent:
`
`US 7,548,255 B2
`Jun.16,2009
`
`(54) METHOD AND SYSTEM FOR CAPTURING
`VIDEO ON A PERSONAL COMPUTER
`
`(75)
`
`Inventors: Eric Gould Bear, Bellevue, WA (US);
`Chad Magendanz, Issaquah, WA (US);
`Aditha May Adams, Seattle, WA (US);
`Carl Ledbetter, Mercer Island, WA
`(US); Steve Kaneko, Medina, WA (US)
`
`(73) Assignee: Microsoft Corporation, Redmond, WA
`(US)
`
`( *) Notice:
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 905 days.
`
`(21) Appl. No.: 10/677,118
`
`(22) Filed:
`
`Sep.30,2003
`
`(65)
`
`Prior Publication Data
`
`US 2005/0068423 Al
`
`Mar. 31, 2005
`
`(51)
`
`Int. Cl.
`H04N 51225
`(2006.01)
`H04N 7114
`(2006.01)
`(52) U.S. Cl. ............................... 348/207.11; 348/14.01
`(58) Field of Classification Search .............. 348/14.01,
`348/207.7, 207.11
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`4,860,342 A
`5,159,445 A
`5,412,417 A
`5,487,181 A
`5,491,800 A
`5,519,772 A
`5,533,115 A
`
`8/1989 Danner
`10/1992 Gitlin
`5/1995 Tozuka
`1/1996 Dailey
`2/1996 Goldsmith
`5/1996 Akman et al.
`7/1996 Hollenbach
`
`308
`
`5,546,538 A
`5,568,540 A
`5,657,414 A
`5,675,374 A
`5,675,810 A
`5,764,901 A *
`5,768,164 A
`5,802,305 A
`
`379/88.25
`
`8/1996 Cobbley
`10/1996 Grecko ....................
`8/1997 Lett
`10/1997 Kohda .......................
`10/1997 Sellers
`6/1998 Skarbo et al. ............... 709/204
`6/1998 Hollon
`9/1998 McKaughan
`
`348/14.1
`
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`EP
`
`0772327 A2
`
`5/1997
`
`(Continued)
`
`OTHER PUBLICATIONS
`
`U.S. Appl. No. 11/509,437, filed Aug. 23, 2006, Bear.
`
`(Continued)
`
`Primary Examiner-Justin P Misleh
`(74) Attorney, Agent, or Firm-Workman Nydegger
`
`(57)
`
`ABSTRACT
`
`A system and method for improved video capture on a per(cid:173)
`sonal computer
`is provided. The personal computer
`is
`equipped with video controls and a camera with a privacy lens
`cover. A sensor for sensing when the lens cover is closed may
`be used along with an actuator for mechanically opening the
`lens cover, so that the system may optionally open the lens
`cover automatically for video capture applications. A user
`may easily capture a video stream or still images using the
`video controls provided. A user may also answer an incoming
`phone call that supports video by pressing the camera button
`or, optionally, the user can set a preference so that the camera
`is automatically enabled whenever answering a call that sup(cid:173)
`ports video. Additionally, the system may automatically tran(cid:173)
`sition to or from video anytime during a call.
`
`18 Claims, 11 Drawing Sheets
`
`Tab --
`
`@
`2
`
`A
`
`$
`4
`
`D
`
`Shift
`0
`Ctrl
`
`z
`
`X
`
`Alt
`
`306
`
`404
`
`402 -41 _
`
`__....
`
`308
`
`162
`
`IPR2020-00200
`Apple Inc. EX1005 Page 1
`
`

`

`U.S. PATENT DOCUMENTS
`5,907,604 A *
`5,959,622 A *
`5,991,836 A
`5,999,613 A
`6,006,285 A
`6,052,442 A
`6,101,610 A
`6,144,363 A
`6,144,644 A
`6,172,703 Bl
`6,208,373 Bl
`6,215,420 Bl
`6,237,846 Bl
`6,240,168 Bl
`6,266,714 Bl
`6,279,056 Bl
`6,282,435 Bl
`6,346,934 Bl
`6,362,440 Bl
`6,380,968 Bl *
`6,390,371 Bl
`6,417,849 B2
`6,438,216 Bl
`6,438,585 B2
`6,453,027 Bl
`6,483,905 Bl
`6,484,019 Bl
`6,496,860 B2
`6,507,356 Bl
`6,513,128 Bl
`6,516,356 Bl
`6,518,957 Bl
`6,519,335 Bl
`6,546,262 Bl
`6,603,855 Bl
`6,628,194 Bl
`6,628,267 B2
`6,658,095 Bl
`6,671,356 B2
`6,671,743 Bl
`6,674,457 Bl *
`6,680,845 B2 *
`6,691,233 Bl
`6,718,183 Bl
`6,731,316 B2
`6,732,365 B2
`6,741,232 Bl
`6,757,372 Bl
`6,806,867 Bl
`6,816,881 Bl
`6,819,961 B2
`6,831,657 B2
`6,882,326 B2
`6,888,562 B2
`6,892,074 B2
`6,897,851 B2
`6,902,332 B2
`6,912,283 B2
`6,918,123 Bl
`6,937,950 B2
`6,938,174 B2
`6,944,700 B2 *
`6,970,556 B2
`6,973,167 B2
`6,976,216 Bl
`6,980,641 Bl
`6,996,445 Bl
`7,000,237 Bl
`7,036,110 B2
`7,096,391 B2
`7,123,370 B2 *
`
`379/88.19
`
`....... 348/14.05
`
`379/93.24
`
`348/14.06
`
`340/7.5
`
`........... 715/864
`
`379/142.06
`......................
`5/1999 Hsu
`9/1999 Greer et al. .................
`715/719
`1111999 Renda
`12/1999 Nabkel
`12/1999 Jacobs
`4/2000 Cooper et al .............
`8/2000 Beebe
`345/618
`........................
`11/2000 Alloul
`11/2000 Bajzath et al.
`.............. 370/259
`1/2001 Lee .........................
`348/14.08
`348/14.16
`3/2001 Fong et al ................
`4/2001 Harrison et al. ............... 341/22
`5/2001 Lowell
`5/2001 Stanford et al.
`7/2001 Jacobs
`8/2001 Jacobs
`8/2001 Wagner et al. .............. 455/566
`2/2002 Wugofski
`...................
`345/158
`3/2002 Karidis
`4/2002 Alexander et al.
`5/2002 Armga
`7 /2002 Lefebvre
`8/2002 Akata
`8/2002 Mousseau
`9/2002 Kang
`11/2002 Kikinis ....................
`11/2002 Aklian
`12/2002 Ludtke
`1/2003 Jackel et al ..............
`1/2003 Wang
`2/2003 Belknap et al.
`2/2003 Lehtinen et al.
`2/2003 Bushnell
`4/2003 Freadman
`8/2003 Cannon et al.
`9/2003 Hellebust ....................
`9/2003 Karidis
`12/2003 Yoakum
`379/88.13
`12/2003 Lewis ......................
`709/321
`12/2003 Verity
`........................
`1/2004 Davies et al.
`............ 348/14.01
`1/2004 Agata et al. .................
`361/683
`2/2004 Gannage
`4/2004 Blust
`5/2004 Herigstad et al.
`5/2004 Belknap
`............... 345/156
`5/2004 Siedlikowski
`379/142
`6/2004 Dunlap et al ................
`10/2004 Arruda
`11/2004 Mohindra
`11/2004 Jacobs
`345/589
`12/2004 Tsutsumi et al .............
`345/1.1
`4/2005 Hirayama
`...................
`5/2005 Rambo et al. ............ 348/14.16
`5/2005 Tarkiainen
`.................. 455/466
`5/2005 Carini
`................... 400/472
`6/2005 McLoone
`6/2005 Meyerson et al. ...... 379/428.04
`7/2005 Shteyn
`8/2005 Cragun
`8/2005 LeKuch
`9/2005 Bateman et al. ............. 710/300
`11/2005 Wall et al. ..............
`379/355.01
`12/2005 Kikinis ......................
`379/67.1
`12/2005 Peskin et al. ................ 715/716
`12/2005 Stanford et al. ............. 379/387
`2/2006 Kamijo . ... ... .. ... ... ... ... .. . 700/94
`2/2006 Sinha
`4/2006 Jeyaraman
`8/2006 Johnson
`10/2006 Watanabe et al.
`
`US 7,548,255 B2
`Page 2
`
`7,221,331 B2
`7,231,229 Bl
`7,243,130 B2
`7,272,660 Bl
`7,292,588 B2
`7,302,637 Bl
`7,401,053 B2
`2001/0040551 Al
`2002/0004855 Al
`2002/0015020 Al
`2002/0080967 Al
`2002/0087225 Al
`2002/0099456 Al
`2002/0114430 Al
`2002/0131072 Al
`2002/0167458 Al
`2002/0167460 Al
`2003/0021290 Al
`2003/0025674 Al
`2003/0037180 Al
`2003/0046448 Al
`2003/0069689 Al
`2003/0074590 Al
`2003/0112325 Al
`2003/0118003 Al
`2003/0122874 Al
`2003/0131148 Al
`2003/0146903 Al *
`2003/0188041 Al
`2003/0197685 Al*
`2003/0227471 Al
`2004/0103144 Al
`2004/0114032 Al
`2004/0135819 Al
`2004/0141012 Al
`2004/0155956 Al
`2004/0177361 Al
`2004/0210628 Al
`2004/0222977 Al
`2004/0222978 Al
`2004/0223058 Al
`2004/0223061 Al
`2004/0223599 Al
`2004/0225502 Al
`2004/0225892 Al
`2004/0225901 Al
`2004/0240167 Al
`2004/0240650 Al
`2005/0068423 Al
`2005/0069101 Al
`2005/0071437 Al
`2005/0071626 Al
`2005/0182822 Al
`2005/0186942 Al
`2005/0193396 Al
`2005/0259032 Al
`2005/0262302 Al
`2006/0007051 Al
`2006/0048062 Al
`2006/0061516 Al
`2006/0095525 Al
`2006/0130075 Al
`2006/0164324 Al
`2006/0284787 Al
`
`.................
`
`345/156
`
`345/156
`
`370/466
`
`345/168
`
`.............. 348/14.08
`
`345/827
`348/14.16
`
`5/2007 Bear
`6/2007 Hawkins
`7 /2007 Horvitz
`9/2007 Powers
`11/2007 Milley
`11/2007 Maguire
`7/2008 Kamimura
`11/2001 Yates et al.
`1/2002 Cox
`2/2002 Mobin ........................
`6/2002 Abdo
`7/2002 Howard
`7/2002 McLean
`8/2002 Murata
`9/2002 Jackson
`11/2002 Baudisch
`11/2002 Baudisch
`1/2003 Jones
`.........................
`2/2003 Watanabe
`2/2003 Madineni et al. ............ 709/321
`3/2003 Fischer
`4/2003
`Ihara
`4/2003 Fogle
`6/2003 Boyden et al. ........... 348/14.16
`6/2003 Geck
`7 /2003 Dieberger
`7/2003 Kelley et al. ................ 717/101
`8/2003 Yi ..............................
`345/168
`10/2003 Fillmore
`10/2003 Yi ..............................
`12/2003 Eglit
`5/2004 Sallam
`6/2004 Kakii et al.
`7/2004 Maa
`7/2004 Tootill ........................
`8/2004 Libbey
`....................
`9/2004 Bernhard et al.
`10/2004 Inkinen
`............... 340/815.4
`11/2004 Bear et al.
`11/2004 Bear
`..........................
`345/172
`11/2004 Richter
`348/207 .1
`11/2004 Bear
`.......................
`379/215.01
`11/2004 Bear
`.....................
`704/270
`11/2004 Bear
`..........................
`11/2004 Bear
`. ... ... ... ... ... .. ... ... ... .. 726/2
`11/2004 Bear
`..........................
`713/300
`12/2004 Ledbetter et al. ............ 361/683
`12/2004 Bear
`.......................
`455/426.1
`3/2005 Bear
`..........................
`345/156
`3/2005 Bear
`.......................
`379/90.01
`3/2005 Bear
`.............................
`713/1
`3/2005 Bear
`8/2005 Daniel
`8/2005 Griffin
`9/2005 Stafford-Fraser
`11/2005 Morris
`11/2005 Fuller
`1/2006 Bear
`3/2006 Adamson
`3/2006 Campbell
`5/2006 Mousseau
`6/2006 Rhoten
`.......................
`7 /2006 Polivy ........................
`12/2006 Bear
`
`719/328
`709/206
`
`FOREIGN PATENT DOCUMENTS
`
`EP
`EP
`EP
`EP
`WO
`
`0777394 Al
`000816990
`0838934 Al
`0772327 A3
`WO9602049 Al
`
`6/1997
`1/1998
`4/1998
`2/1999
`1/1996
`
`.......... 358/1.14
`
`IPR2020-00200
`Apple Inc. EX1005 Page 2
`
`

`

`US 7,548,255 B2
`Page 3
`
`WO
`
`03/085960
`
`10/2003
`
`OTHER PUBLICATIONS
`
`U.S. Appl. No. 11/559,821, filed Nov. 14, 2006, Bear.
`U.S. Appl. No. 11/685,014, filed Mar. 12, 2007, Bear.
`Anonymous, Copy oflnternational Search Report in Corresponding
`EP Application No. EP 04 00 9868.
`Office Action dated Oct. 15, 2008 cited in U.S.Appl. No.11/509,437.
`Office Action dated Oct. 10, 2008 cited in U.S.Appl. No.11/509,431.
`Office Action dated Nov. 6, 2008 cited in U.S. Appl. 10/996,557.
`Office Action dated Oct. 1, 2008 cited in U.S. Appl. No. 10/996,371.
`U.S. Appl. No. 11/837,302, filed Aug. 10, 2007, Bear.
`Oxford On-line Dictionary, http://dictionary.oed.com/entrance.dtl,
`Oxford University Press 2007, on the definition of the word "physi(cid:173)
`cal" under III/7b.
`Office Action dated Aug. 8, 2007 cited in related U.S. Appl. No.
`10/996,371.
`Office Action dated Jul. 31, 2007 cited in related U.S. Appl. No.
`10/677,084.
`Office Action dated Jul. 27, 2007 cited in related U.S. Appl. No.
`10/996,557.
`Office Action dated Jul. 30, 2007 cited in related U.S. Appl. No.
`10/430,369.
`Office Action dated Jul. 6, 2007 cited in related U.S. Appl. No.
`10/429,943.
`Notice of Allowance dated Sep. 7, 2007 cited in related U.S. Appl.
`No. 10/429,931.
`Office Action dated Sep. 24, 2007 cited in related U.S. Appl. No.
`10/429,933.
`Office Action dated Feb. 15, 2008 cited in related U.S. Appl. No.
`10/429,933.
`Notice of Allowance dated Jan. 30, 2008 cited in related U.S. Appl.
`No. 10/429,931.
`Office Action dated Mar. 21, 2008 cited in related U.S. Appl. No.
`10/966,557.
`Office Action dated Feb. 28, 2008 cited in related U.S. Appl. No.
`10/966,371.
`Office Action dated Sep. 28, 2007 cited in related U.S. Appl. No.
`10/429,943.
`Office Action dated Mar. 26, 2008 cited in related U.S. Appl. No.
`10/429,943.
`Office Action dated Oct. 15, 2007 cited in related U.S. Appl. No.
`10/429,903.
`Notice of Allowance dated Apr. 2, 2008 cited in related U.S. Appl.
`No. 10/429,903.
`Notice of Allowance dated Apr. 23, 2008 cited in related U.S. Appl.
`No. 10/430,369.
`Office Action dated Jan. 11, 2008 cited in related U.S. Appl. No.
`10/677,084.
`
`Notice of Allowance dated Apr. 29, 2008 cited in related U.S. Appl.
`No. 10/677,084.
`Office Action dated May 15, 2008 cited in related U.S. Appl. No.
`11/837,302.
`Office Action dated Aug. 6, 2008 cited in U.S. Appl. 10/429,943.
`Office Action dated Aug. 20, 2006 cited
`in U.S. Appl. No.
`10/429,933.
`2007 cited in U.S.Appl. No. 10/429,905.
`OfficeActiondatedFeb.14,
`2007 cited in U.S.Appl. No.10/429,905.
`OfficeActiondatedMay21,
`Office Action dated Apr. 4, 2006 cited in U.S. Appl. No. 10/429,930.
`Office Action dated Jul. 14, 2006 cited in U.S. Appl. No. 10/429,930.
`Office Action dated Nov. 14, 2006 cited
`in U.S. Appl. No.
`10/429,930.
`Notice of Allowance dated Mar. 16, 2007 cited in U.S. Appl. No.
`10/429,930.
`Office Action dated Aug. 9, 2005 cited in U.S. Appl. No. 10/429,932.
`Office Action dated Oct. 4, 2005 cited in U.S. Appl. No. 10/429,932.
`Office Action dated Mar. 17. 2006 cited m U.S. Appl. No.
`10/429,932.
`Office Action dated Aug. 15, 2006 cited m U.S. Appl. No.
`10/429,932.
`Notice of Allowance dated Jan. 25, 2007 cited in U.S. Appl. No.
`10/429,932.
`Office Action dated Mar. 16, 2006 cited
`10/677,101.
`Office Action dated Sep. 6, 2006 cited in U.S. Appl. No. 10/677,101.
`Notice of Allowance dated Feb. 2, 2006 cited in U.S. Appl. No.
`10/677,101.
`Office Action dated Mar. 26, 2007 cited
`10/429,931.
`Office Action dated Sep. 26, 2006 cited in U.S.Appl. No. 10/430,369.
`Office Action dated Mar. 20, 2007 cited
`in U.S. Appl. No.
`10/430,369.
`Office Action dated Jan. 3, 2007 cited in U.S. Appl. No. 10/429,903.
`Office Action dated Feb. 6, 2007 cited in U.S. Appl. No. 10/429,943.
`Office Action dated Jul. 6, 2007 cited in U.S. Appl. No. 10/429,943.
`Office Action dated Mar. 6, 2007 cited in U.S. Appl. No. 10/429,933.
`Office Action dated Aug. 10, 2005 cited
`in U.S. Appl. No.
`10/677,084.
`Office Action dated Jan. 19, 2006 cited in U.S. Appl. No. 10/677,084.
`Office Action dated Nov. 1, 2006 cited in U.S. Appl. No. 10/677,084.
`OfficeActiondatedFeb.19,
`2009 cited in U.S.Appl. No. 10/996,558.
`Office Action dated Jan. 2, 2009 cited in U.S. Appl. No. 11/837,302.
`Notice of Allowance dated Feb. 6, 2009 cited in U.S. Appl. No.
`10/429,943.
`Office Action dated Feb. 20, 2009 cited in U.S.Appl. No. 11/053,186.
`
`in U.S. Appl. No.
`
`in U.S. Appl. No.
`
`* cited by examiner
`
`IPR2020-00200
`Apple Inc. EX1005 Page 3
`
`

`

`r---------------------1ro
`I System Memory
`ill
`:
`(ROM)
`
`I
`
`/ I BIOS rn I 11~0 I Pro~en~:ing
`
`I
`
`1
`
`I
`
`---------
`(RAM) lli
`OPERATING
`SYSTEM 134
`
`________________
`
`I 120 -
`
`190 192
`
`Video
`Interface
`
`Touch-
`Screen
`Interface
`
`Output
`Peripheral
`Interface '""I
`
`-~
`
`APPLICATION
`PROGRAMS~
`
`OTHER PROGRAM
`MODULES 136
`
`PROGRAM
`)
`DATA
`137
`
`Non-Removable
`Non-Vol. Memory
`Interface
`
`System Bus
`
`150
`
`Removable
`Non-Vol.
`Memory
`Interface
`
`'
`
`1517R
`
`---
`'
`' ' ,
`
`t---7t--
`155 ~~
`~
`
`15215
`
`'
`
`OPERATING APPLICATION OTHER 146 PROGRAM
`SYSTEM
`PROGRAMS
`PROGRAM DATA
`144
`145
`MODULES
`
`147
`
`FIG. 1
`
`100 __)
`
`163 Mouse
`
`~
`00
`•
`~
`~
`~
`
`~ = ~
`
`2'
`? ....
`
`~Cl's
`N
`0
`0
`1,0
`
`('D
`
`rJJ =(cid:173)
`('D .....
`....
`0 ....
`....
`....
`
`d r.,;_
`-....l
`tit
`~
`00
`'N
`UI
`
`UI = N
`
`I
`I
`
`'Monitor
`
`191
`
`195
`
`194
`
`1-
`
`--.1
`I
`I
`I
`I
`I
`I
`I
`I
`1 Local Area Network
`
`Speakers
`
`171
`
`180
`
`User
`Input
`Interface
`
`Network
`Interface
`
`:160
`
`170
`
`I
`I
`I
`I
`I
`J
`________
`172 Wide Area Network~------,
`
`11111
`
`I 181
`REMOTE
`APPLICATION 185
`PROGRAMS -
`
`IPR2020-00200
`Apple Inc. EX1005 Page 4
`
`

`

`U.S. Patent
`
`Jun.16,2009
`
`Sheet 2 of 11
`
`US 7,548,255 B2
`
`110~
`
`191
`
`204
`
`/I
`
`/I
`
`Main PC
`Housing
`
`222
`
`162
`
`214
`
`FIG. 2
`
`163
`
`~
`
`161
`
`IPR2020-00200
`Apple Inc. EX1005 Page 5
`
`

`

`U.S. Patent
`
`Jun.16,2009
`
`Sheet 3 of 11
`
`US 7,548,255 B2
`
`308
`
`306
`
`202
`
`304
`
`312
`
`314
`
`FIG. 3
`
`IPR2020-00200
`Apple Inc. EX1005 Page 6
`
`

`

`U.S. Patent
`
`Jun.16,2009
`
`Sheet 4 of 11
`
`US 7,548,255 B2
`
`-
`.
`
`I
`1
`
`@
`2
`
`#
`3
`
`$
`4
`
`Ofol
`5
`
`____.,.
`Tab
`.-
`
`Q
`
`w
`
`E
`
`R
`
`CAPS Loe~ A
`
`s
`
`D
`
`F
`
`Shift
`0
`
`Ctrl
`
`z
`
`Alt
`
`X
`
`C
`
`J
`j
`
`r
`
`306 .._
`r---..
`
`Video Controls
`
`'
`
`Cl
`
`~ i-- <1
`---
`Shutter
`_J
`
`'
`
`404
`
`402
`
`....b:::L
`[QJ
`
`~aptur>
`
`~
`
`308
`
`~
`
`,_}
`
`162
`
`FIG. 4
`
`IPR2020-00200
`Apple Inc. EX1005 Page 7
`
`

`

`U.S. Patent
`
`Jun.16,2009
`
`Sheet 5 of 11
`
`US 7,548,255 B2
`
`/I
`
`191
`
`540
`
`r#-s10
`
`FIG. 5
`
`Shutter
`
`402 ---
`
`308
`
`IPR2020-00200
`Apple Inc. EX1005 Page 8
`
`

`

`U.S. Patent
`
`Jun.16,2009
`
`Sheet 6 of 11
`
`US 7,548,255 B2
`
`/I
`
`191
`
`/I
`
`402 __
`
`_
`
`308
`
`FIG. 6
`
`IPR2020-00200
`Apple Inc. EX1005 Page 9
`
`

`

`U.S. Patent
`
`Jun.16,2009
`
`Sheet 7 of 11
`
`US 7,548,255 B2
`
`USBln
`
`USBOut
`
`/I;
`
`404
`
`308
`
`©
`
`DC Power
`
`II/
`
`740
`
`Shutter Capture Microphone Do Not Disturb Forward
`
`System
`
`E-Mail
`
`~Q ~ ~ ~ ~ ~ ~
`~ V
`,
`0P~er
`
`(cid:143)
`
`r
`
`Mute
`
`Volume
`
`Transport Controls
`
`FIG. 7
`
`Voice Mail Speakerphone
`CJ"'
`Cl
`
`,
`
`,P
`
`Security
`
`IPR2020-00200
`Apple Inc. EX1005 Page 10
`
`

`

`U.S. Patent
`
`Jun.16,2009
`
`Sheet 8 of 11
`
`US 7,548,255 B2
`
`I
`
`I
`
`135
`
`"----~
`
`Application
`Program
`
`...
`
`h
`
`134
`804
`_____ __, ____ _.1'----+·--__)
`Operating System
`---+---
`Indicator I
`Display
`logic
`
`Controls Handling
`_ _,
`Logic
`
`j
`
`, .
`
`806 -
`
`J
`
`Hardware
`Interface
`
`(
`
`802
`
`----/162
`__ 40__,_f--+------........
`
`J
`,
`I
`
`810
`
`J
`
`-
`
`-
`
`Video
`Controls
`
`Indicators
`(e.g., LEDs)
`
`Keyboard
`
`FIG. 8
`
`IPR2020-00200
`Apple Inc. EX1005 Page 11
`
`

`

`U.S. Patent
`
`Jun.16,2009
`
`Sheet 9 of 11
`
`US 7,548,255 B2
`
`Stopped
`
`Capturing
`
`Stop
`
`Stop
`
`Record
`
`Pause
`
`Paused
`
`FIG. 9
`
`IPR2020-00200
`Apple Inc. EX1005 Page 12
`
`

`

`U.S. Patent
`
`Jun.16,2009
`
`Sheet 10 of 11
`
`US 7,548,255 B2
`
`hP.nin
`
`yes
`
`no
`
`~-----''-----,
`
`___.-1004
`
`~----"---------'--,
`
`/
`
`1012
`
`Set Indicator
`
`Set Indicator
`
`1006
`
`1014
`
`Capture Image?
`
`Capture Video Stream
`
`no
`
`1008
`
`yes
`
`Set Indicator
`
`End?
`
`/
`
`1010
`
`~-------'J-----~
`
`no
`
`yes
`
`/
`
`1018
`
`Display Save Dialog Box
`
`Display Save Dialog Box
`
`end
`
`FIG. 10
`
`IPR2020-00200
`Apple Inc. EX1005 Page 13
`
`

`

`U.S. Patent
`
`Jun. 16, 2009
`
`Sheet 11 of 11
`
`US 7,548,255 B2
`
`1102
`
`406
`
`404
`
`402
`
`<]
`
`C>
`
`Video Controls
`
`C]
`
`<1[ ~
`
`Shutter
`
`Capture
`
`308
`
`FIG. 11
`
`IPR2020-00200
`Apple Inc. EX1005 Page 14
`
`

`

`US 7,548,255 B2
`
`1
`METHOD AND SYSTEM FOR CAPTURING
`VIDEO ON A PERSONAL COMPUTER
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`
`The present invention is related to the following United
`States Patent Applications filed May 5, 2003, assigned to the
`assignee of the present invention, and hereby incorporated by
`reference in their entireties:
`"Method and System for Auxiliary Display oflnformation
`for a Computing Device," Ser. No. 10/429,932;
`"Real-Time Communications Architecture and Methods
`for use with a Personal Computer System," Ser. No. 10/429,
`905;
`"Record Button on a Computer System," Ser. No. 10/429,
`904;
`"Method and System for Auxiliary Processing Oflnforma(cid:173)
`tion for a Computing Device," Ser. No. 10/429,930;
`"Computer System with Do Not Disturb System and
`Method," Ser. No. 10/429,903;
`"Computer Camera System and Method for Reducing Par(cid:173)
`allax," Ser. No. 10/429,943;
`"Control and Communications Panel for a Computer Sys(cid:173)
`tem," 10/429,933; and
`"Notification Lights, Locations and Rules for a Computer
`System," 10/429,931.
`
`FIELD OF THE INVENTION
`
`The invention relates generally to computer systems, and
`more particularly to an improved method and system for
`capturing video on a personal computer.
`
`BACKGROUND OF THE INVENTION
`
`The role of contemporary computers continues to evolve as
`a tool used for communications and media applications. Per(cid:173)
`sonal computers offer many new and exciting media applica(cid:173)
`tions for personal entertainment such as live television, per(cid:173)
`sonal video recording, playing or recording digital music,
`displaying or creating digital photographs, playing movies
`recorded on a DVD, and so forth. Video controls may be
`provided by a video application through its software user
`interface for interacting with video supported by that appli(cid:173)
`cation. However, such video controls are not available sys(cid:173)
`tem-wide to other applications for users to control different
`video content.
`In addition to handling media applications and customary
`communication applications such as email, instant messag(cid:173)
`ing, fax communications, and so forth, with the introduction
`ofVoice-over-IP (VOIP) and other IP telephony applications,
`computers may also be used for handling phone calls and
`voice mail. A personal computer with integrated telephony
`can enhance voice and video communication in ways that
`empower the user while increasing user productivity and
`enjoyment. For example, a personal computer may be
`designed that is capable of accepting incoming calls of vari(cid:173)
`ous kinds such as analog Public Switched Telephone Network
`(PSTN), private branch exchange (PBX), cellular telephony,
`VoIP, and/or cellular telephony. Application programs may
`use VOIP telephony, instant messaging and videoconferenc(cid:173)
`ing by integrating the use of a microphone, speakers and
`camera.
`While many media and communications programs work
`with video, such programs are neither intuitive nor straight(cid:173)
`forward for users to work with, nor consistent in how users
`
`2
`interact with them. What is needed is a simplified system and
`method for a user to interact with these various communica(cid:173)
`tions and media applications, in a consistent way across these
`communication modalities. The system and method should
`5 operate in what is perceived to be an intelligent manner with
`respect to handling video communications. For example, cap(cid:173)
`turing a video stream or still images, answering a phone call
`that supports video, and/or switching communications to and
`from video are possible usage scenarios that would benefit
`10 from improved video communications handling.
`
`SUMMARY OF THE INVENTION
`
`invention provides a system and
`Briefly, the present
`15 method for capturing and otherwise working with video on a
`personal computer. In one implementation, the present inven(cid:173)
`tion provides a camera that may include a microphone, a lens,
`a camera indicator light, a video capture button, and a lens
`cover that acts as a safeguard against inadvertent video
`20 recording or damage to the lens. In another implementation, a
`sensor for determining when the lens cover is closed may be
`used, along with an actuator for mechanically opening the
`lens cover, so that the system may optionally open the lens
`cover automatically for video capture applications. The
`25 actuator may be controlled by a button such as a shutter button
`or may be controlled by system software. Closing the lens
`cover secures active capture operations and, for example, may
`close an audio/video capture application. Opening the lens
`cover prepares the camera for capture, and may stream pre-
`30 view video to the audio/video capture application.
`The present invention also provides video controls which
`may be placed in various locations such as on the computer
`housing, on a keyboard, on a monitor or a remote control.
`With these controls, a user may easily capture a video stream
`35 or still images. The video controls include a capture button
`and a shutter button. Other video controls may be easily added
`such as such as a zoom button and/or pan button for adjusting
`a telescoping lens, a microphone button for muting the micro(cid:173)
`phone ( e.g., on the camera), and so forth. Pressing the capture
`40 button while an audio/video application is executing usually
`triggers an image or video stream capture, depending on the
`mode setting. There may also be an optional record button in
`close proximity to the video controls. Because the state of an
`individual video control button may not be readily apparent to
`45 a user, an indicator light such as an LED may be located
`adjacent to or integrated into each video control button.
`The present invention allows different types of video to be
`captured. For example, an audio/video application may cap(cid:173)
`ture a video stream or still images. If a user has selected still
`50 images to be captured, the audio/video application may set
`the camera capture indicator light to green to indicate that the
`application is in preview mode. A user may conveniently snap
`a still image by pressing the capture button. The application
`may then set the camera capture indicator light to blink red for
`55 a few moments while the image is captured. After the image
`has been captured, the application may display a confirmation
`dialog box to the user to allow for saving the image.
`There are many applications that may use the present
`invention for capturing video and still images. For example,
`60 whenever there is an incoming phone call that supports video,
`the camera indicator light may indicate such a call, such as by
`slowly blinking red to alert the user. The user may then
`answer the call immediately in that mode by pressing the
`camera button. In response, the system automatically opens
`65 the video monitor, lights the camera indicator, and/or starts
`streaming video. Optionally, the user can set a preference so
`that the camera is automatically enabled whenever answering
`
`IPR2020-00200
`Apple Inc. EX1005 Page 15
`
`

`

`US 7,548,255 B2
`
`3
`a call that supports video. Additionally, the system could
`automatically transition to video or from video ( e.g., to an
`audio only state, or a state that displays something else)
`anytime during the call whenever the lens cover is opened or
`closed, respectively. When the call is over, the user may hang
`up by pressing the camera button which will terminate the call
`and tum off the camera indicator light.
`The system and method is fairly comprehensive as well as
`flexible and extensible to handle essentially any video, and
`additional video controls may be easily added as needed. 10
`Other advantages will become apparent from the following
`detailed description when taken in conjunction with the draw(cid:173)
`ings, in which:
`
`4
`or configurations. Examples of well known computing sys(cid:173)
`tems, environments, and/or configurations that may be suit(cid:173)
`able for use with the invention include, but are not limited to:
`personal computers, server computers, hand-held or laptop
`5 devices, tablet devices, headless servers, multiprocessor sys(cid:173)
`tems, microprocessor-based systems, set top boxes, program(cid:173)
`mable consumer electronics, network PCs, minicomputers,
`mainframe computers, distributed computing environments
`that include any of the above systems or devices, and the like.
`The invention may be described in the general context of
`computer-executable instructions, such as program modules,
`being executed by a computer. Generally, program modules
`include routines, programs, objects, components, data struc(cid:173)
`tures, and so forth, which perform particular tasks or imple-
`15 ment particular abstract data types. The invention may also be
`practiced in distributed computing environments where tasks
`are performed by remote processing devices that are linked
`through a communications network. In a distributed comput(cid:173)
`ing environment, program modules may be located in local
`20 and/or remote computer storage media including memory
`storage devices.
`With reference to FIG. 1, an exemplary system for imple(cid:173)
`menting the invention includes a general purpose computing
`device in the form of a computer 110. Components of the
`25 computer 110 may include, but are not limited to, a process(cid:173)
`ing unit 120, a system memory 130, and a system bus 121 that
`couples various system components including the system
`memory to the processing unit 120. The system bus 121 may
`be any of several types of bus structures including a memory
`30 bus or memory controller, a peripheral bus, and a local bus
`using any of a variety of bus architectures. By way of
`example, and not limitation, such architectures include Indus(cid:173)
`try Standard Architecture (ISA) bus, Micro Channel Archi(cid:173)
`tecture (MCA) bus, Enhanced ISA (EISA) bus, Video Elec-
`35 tronics Standards Association
`(VESA)
`local bus, and
`Peripheral Component Interconnect (PCI) bus also known as
`Mezzanine bus.
`The computer 110 typically includes a variety of computer(cid:173)
`readable media. Computer-readable media can be any avail-
`40 able media that can be accessed by the computer 110 and
`includes both volatile and nonvolatile media, and removable
`and non-removable media. By way of example, and not limi(cid:173)
`tation, computer-readable media may comprise either com(cid:173)
`puter storage media or communication media. Computer stor-
`45 age media includes volatile and nonvolatile, removable and
`non-removable media implemented in any method or tech(cid:173)
`nology for storage of information such as computer-readable
`instructions, data structures, program modules or other data.
`Computer storage media includes, but is not limited to, RAM,
`50 ROM, EEPROM, flash memory or other memory technology,
`CD-ROM, digital versatile disks (DVD) or other optical disk
`storage, magnetic cassettes, magnetic tape, magnetic disk
`storage or other magnetic storage devices, or any other
`medium which can be used to store the desired information
`55 and which can accessed by the computer 110. Communica(cid:173)
`tion media typically embodies computer-readable
`instruc(cid:173)
`tions, data structures, program modules or other data in a
`modulated data signal such as a carrier wave or other transport
`mechanism and includes any information delivery media. The
`60 term "modulated data signal" means a signal that has one or
`more of its characteristics set or changed in such a manner as
`to encode information in the signal. By way of example, and
`not limitation, communication media includes wired media
`such as a wired network or direct-wired connection, and
`65 wireless media such as acoustic, RF, infrared and other wire(cid:173)
`less media. Combinations of the any of the above should also
`be included within the scope of computer-readable media.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a block diagram generally representing a com(cid:173)
`puter system into which the present invention may be incor(cid:173)
`porated;
`FIG. 2 is a general representation of a computer system
`arranged with integrated communications-related devices
`including a camera and video controls, in accordance with an
`aspect of the present invention;
`FIG. 3 is a general representation of a camera including a
`privacy shutter and video capture control, in accordance with
`an aspect of the present invention;
`FIG. 4 is a general representation of a partial keyboard with
`video controls incorporated into the keyboard, in accordance
`with an aspect of the present invention;
`FIG. 5 is a representation of a control panel positioned
`beneath a computer monitor with video controls incorporated
`into the control panel, in accordance with an aspect of the
`present invention;
`FIG. 6 is a representation of video controls incorporated
`into a monitor, in accordance with an aspect of the present
`invention;
`FIG. 7 is a representation of an alternative control panel
`with video controls, in accordance with an aspect of the
`present invention;
`FIG. 8 is a block diagram generally representing the com(cid:173)
`ponents in an exemplary embodiment of the telephony con(cid:173)
`trols, in accordance with an aspect of the present invention;
`FIG. 9 is a general state diagram representing states of
`operation when capturing video, in accordance with an aspect
`of the present invention;
`FIG. 10 is a flowchart illustrating an exemplary audio/
`video application using the camera to capture a video stream,
`in accordance with an aspect of the present invention; and
`FIG. 11 is a representation of video controls incorporated
`into a remote control, in accordance with an aspect of the
`present invention.
`
`DETAILED DESCRIPTION
`
`Exemplary Operating Environment
`FIG. 1 illustrates an example of a suitable computing sys(cid:173)
`tem environment 100 on which the invention may be imple(cid:173)
`mented. The computing system environment 100 is only one
`example of a suitable computing environment and is not
`intended to suggest any limitation as to the scope of use or
`functionality of the invention. Neither should the computing
`environment 100 be interpreted as having any dependency or
`requirement relating to any one or combination of compo(cid:173)
`nents illustrated in the exemplary operating environment 100.
`The invention is operational with numerous other general
`purpose or special purpose computing system environments
`
`IPR2020-00200
`Apple Inc. EX1005 Page 16
`
`

`

`US 7,548,255 B2
`
`5
`The system memory 130 includes computer storage media
`in the form of volatile and/or nonvolatile memory such as read
`only memory (ROM) 131 and random access memory
`(RAM) 132. A basic input/output system 133 (BIOS), con(cid:173)
`taining the basic routines that help to transfer informati