`(12) Patent Application Publication (10) Pub. No.: US 2009/0219383 A1
`PASSMORE
`(43) Pub. Date:
`Sep. 3, 2009
`
`US 200902193 83A1
`
`(54) IMAGE DEPTH AUGMENTATION SYSTEM
`AND METHOD
`
`(76) Inventorl
`
`ghalglss Grésgry gASSMORE,
`an lego’
`(U )
`
`Correspondence Address:
`DALINA LAW GROUP, P_C_
`7910 IVANHOE AVE #325
`LA JOLLA, C A 92037 (Us)
`
`_
`(21) Appl' NO"
`
`12/341’992
`
`(22) Filed:
`
`Dec. 22, 2008
`
`Related US. Application Data
`
`(60) Provisional application No. 61/016,355, ?led on Dec.
`21, 2007.
`
`Publication Classi?cation
`
`(51) Int CL
`(2006.01)
`H04N 13/00
`(52) us. Cl. ................................. .. 348/44; 348/E13.001
`(57)
`ABSTRACT
`
`Image depth augmentation system and method for providing
`three-dimensional vieWs from a two-dimensional image.
`Depth information is assigned by the system to areas of a ?rst
`image via a depth map. Foreground objects are enlarged to
`cover empty areas in the background as seen from a second
`viewpoint at an offset distance from a ?rst viewpoint of the
`?rst image. The enlarged objects are used to regenerate the
`?rst image and to generate the second image so that empty
`background areas are covered With the enlarged foreground
`objects. The resulting image pair may be vieWed using any
`type of three-dimensional encoding and vieWing apparatus.
`Can use existing masks from non-3D projects to perform
`depth augmentation and dither mask edges to provide for
`realistic soft edges for depth augmented objects.
`
`901
`
`Assign Depth to Image Areas
`of First Image
`l
`Enlarge Foreground Objects
`\J to Cover Empty Background
`Areas
`i
`\y Regenerate First Image with
`Enlarged Foreground Objects
`
`Generate Second image at
`offset from First image
`
`PRIME FOCUS EX 1005-1
`PRIME FOCUS v LEGEND3D
`
`
`
`Patent Application Publication
`
`Sep. 3, 2009 Sheet 1 0f 20
`
`US 2009/0219383 A1
`
`vggggg.
`
`PRIME FOCUS EX 1005-2
`PRIME FOCUS v LEGEND3D
`
`
`
`Patent Application Publication
`
`Sep. 3, 2009 Sheet 2 0f 20
`
`US 2009/0219383 A1
`
`N 959m
`
`SN 8N
`
`mom
`
`7 SN
`
`PRIME FOCUS EX 1005-3
`PRIME FOCUS v LEGEND3D
`
`
`
`Patent Application Publication
`
`Sep. 3, 2009 Sheet 3 0f 20
`
`US 2009/0219383 Al
`
`
`
`N QEJUML mom , com wow mom mom Pom
`
`PRIME FOCUS EX 1005-4
`PRIME FOCUS v LEGEND3D
`
`
`
`Patent Application Publication
`
`Sep. 3, 2009 Sheet 4 0f 20
`
`US 2009/0219383 A1
`
`Figure 4
`
`PRIME FOCUS EX 1005-5
`PRIME FOCUS v LEGEND3D
`
`
`
`Patent Application Publication
`
`Sep. 3, 2009 Sheet 5 0f 20
`
`US 2009/0219383 A1
`
`Figure 5
`
`PRIME FOCUS EX 1005-6
`PRIME FOCUS v LEGEND3D
`
`
`
`Patent Application Publication
`
`Sep. 3, 2009 Sheet 6 0f 20
`
`US 2009/0219383 A1
`
`Figure 6
`
`PRIME FOCUS EX 1005-7
`PRIME FOCUS v LEGEND3D
`
`
`
`Patent Application Publication
`
`Sep. 3, 2009 Sheet 7 0f 20
`
`US 2009/0219383 A1
`
`F 0.59m
`
`w. .. . ax
`
`
`
`
`
`. . . . . . . . . H H." m?? A"? . .HH. .
`
`
`
`1 3.1.4311113131111111. aqua aaa?1111..nanannnnnnnnnmnnnanana 1 3.1. 41113331114
`
`
`
`
`
`PRIME FOCUS EX 1005-8
`PRIME FOCUS v LEGEND3D
`
`
`
`Patent Application Publication
`
`Sep. 3, 2009 Sheet 8 0f 20
`
`US 2009/0219383 A1
`
`Figure 8
`
`102a 1023
`
`PRIME FOCUS EX 1005-9
`PRIME FOCUS v LEGEND3D
`
`
`
`Patent Application Publication
`
`Sep. 3, 2009 Sheet 9 0f 20
`
`US 2009/0219383 A1
`
`Figure 9
`
`l’
`901
`\ Assign Depth to Image Areas
`of First Image
`I
`902\
`Enlarge Foreground Objects
`\/ to Cover Empty Background
`Areas
`I,
`903
`\\J Regenerate First Image with
`Enlarged Foreground Objects
`l,
`904
`\\J Generate Second Image at
`offset from First Image
`
`PRIME FOCUS EX 1005-10
`PRIME FOCUS v LEGEND3D
`
`
`
`Patent Application Publication
`
`Sep. 3, 2009 Sheet 10 0f 20
`
`US 2009/0219383 A1
`
`igure 10
`
`1001
`
`1000
`
`1010
`
`PRIME FOCUS EX 1005-11
`PRIME FOCUS v LEGEND3D
`
`
`
`Patent Application Publication
`
`Sep. 3, 2009 Sheet 11 0f 20
`
`US 2009/0219383 A1
`
`Figure 11
`
`PRIME FOCUS EX 1005-12
`PRIME FOCUS v LEGEND3D
`
`
`
`Patent Application Publication
`
`Sep. 3, 2009 Sheet 12 0f 20
`
`US 2009/0219383 A1
`
`5E‘; a I31.5?.14.UIII.tif
`
`015114.011
`
`Figure 12
`
`PRIME FOCUS EX 1005-13
`PRIME FOCUS v LEGEND3D
`
`
`
`Patent Application Publication
`
`Sep. 3, 2009 Sheet 13 0f 20
`
`US 2009/0219383 A1
`
`Figure 13
`
`PRIME FOCUS EX 1005-14
`PRIME FOCUS v LEGEND3D
`
`
`
`Patent Application Publication
`
`Sep. 3, 2009 Sheet 14 0f 20
`
`US 2009/0219383 A1
`
`Figure 14
`
`PRIME FOCUS EX 1005-15
`PRIME FOCUS v LEGEND3D
`
`
`
`Patent Application Publication
`
`Sep. 3, 2009 Sheet 15 0f 20
`
`US 2009/0219383 A1
`
`Figure 15
`
`PRIME FOCUS EX 1005-16
`PRIME FOCUS v LEGEND3D
`
`
`
`Patent Application Publication
`
`Sep. 3, 2009 Sheet 16 0f 20
`
`US 2009/0219383 A1
`
`PRIME FOCUS EX 1005-17
`PRIME FOCUS v LEGEND3D
`
`
`
`Patent Application Publication
`
`Sep. 3, 2009 Sheet 17 0f 20
`
`US 2009/0219383 A1
`
`Figure 17
`
`PRIME FOCUS EX 1005-18
`PRIME FOCUS v LEGEND3D
`
`
`
`Patent Application Publication
`
`Sep. 3, 2009 Sheet 18 0f 20
`
`US 2009/0219383 A1
`
`00
`1
`Q)
`s...
`:3
`.97
`LL.
`
`PRIME FOCUS EX 1005-19
`PRIME FOCUS v LEGEND3D
`
`
`
`Patent Application Publication
`
`Sep. 3, 2009 Sheet 19 0f 20
`
`US 2009/0219383 A1
`
`Figure 19
`
`PRIME FOCUS EX 1005-20
`PRIME FOCUS v LEGEND3D
`
`
`
`PRIME FOCUS EX 1005-21
`PRIME FOCUS v LEGEND3D
`
`
`
`PRIME FOCUS EX 1005-22
`PRIME FOCUS v LEGEND3D
`
`
`
`PRIME FOCUS EX 1005-23
`PRIME FOCUS v LEGEND3D
`
`
`
`PRIME FOCUS EX 1005-24
`PRIME FOCUS v LEGEND3D
`
`
`
`PRIME FOCUS EX 1005-25
`PRIME FOCUS v LEGEND3D
`
`
`
`PRIME FOCUS EX 1005-26
`PRIME FOCUS v LEGEND3D