(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2010/0245585 A1
`FISHER et al.
`(43) Pub. Date:
`Sep. 30, 2010
`
`US 2010.0245585A1
`
`(54) HEADSET-BASED TELECOMMUNICATIONS
`PLATFORM
`
`(76) Inventors:
`
`Ronald Eugene FISHER, San
`Francisco, CA (US); Bryan
`Jonathan Davis, San Francisco, CA
`(US); Bradley Brian Bushard,
`Chaska, MN (US); Mark Joseph
`Meyer, Commerce Twp., MI (US);
`James Fisher, Walnut Creek, CA
`(US); Nitin Patil, San Ramon, CA
`(US); Ben Young, San Francisco,
`CA (US); Daniel Johnson,
`Petaluma, CA (US)
`Correspondence Address:
`GLENN PATENT GROUP
`3475 EDISON WAY, SUITEL
`MENLO PARK, CA 94025 (US)
`(21) Appl. No.:
`12/714,693
`
`(22) Filed:
`
`Mar. 1, 2010
`
`Related U.S. Application Data
`(63) Continuation of application No. PCT/US10/25603,
`filed on Feb. 26, 2010.
`(60) Provisional application No. 61/208,783, filed on Feb.
`27, 2009, provisional application No. 61/270,221,
`filed on Jul. 6, 2009.
`
`Publication Classification
`
`(51) Int. Cl.
`H04N 5/225
`H04M I/00
`H04N 5/228
`H04N 5/33
`
`(2006.01)
`(2006.01)
`(2006.01)
`(2006.01)
`
`
`
`(2006.01)
`H04N 5/262
`(2006.01)
`GOL 5/00
`(2006.01)
`H04B 700
`(2006.01)
`G09G 5/00
`(2006.01)
`GOIC 3/00
`(2006.01)
`GO6F 17/30
`(52) U.S. Cl. ...................... 348/164; 455/556.1; 348/373;
`348/222.1; 348/240.99; 348/240.3: 348/208.99;
`348/370, 704/275; 455/412; 455/572; 345/8:
`356/3: 348/E05.026; 348/E05.09; 348/E05.055;
`348/E05.029; 704/E15.001: 707/E17.01;
`707/822
`
`ABSTRACT
`(57)
`A hands-free wireless wearable GPS enabled video camera
`and audio-video communications headset, mobile phone and
`personal media player, capable of real-time two-way and
`multi-feed wireless voice, data and audio-video streaming,
`telecommunications, and teleconferencing, coordinated
`applications, and shared functionality between one or more
`wirelessly networked headsets or other paired or networked
`wired or wireless devices and optimized device and data
`management over multiple wired and wireless network con
`nections. The headset can operate in concert with one or more
`wired or wireless devices as a paired accessory, as an autono
`mous hands-free wide area, metro or local area and personal
`area wireless audio-video communications and multimedia
`device and/or as a wearable docking station, hot spot and
`wireless router Supporting direct connect multi-device ad-hoc
`virtual private networking (VPN). The headset has built-in
`intelligence to choose amongst available network protocols
`while Supporting a variety of onboard, and remote operational
`controls including a retractable monocular viewfinder display
`for real time hands-free viewing of captured or received video
`feed and a duplex data-streaming platform Supporting multi
`channel communications and optimized data management
`within the device, within a managed or autonomous federa
`tion of devices or other peer-to-peer network configuration.
`
`1
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 1 of 36
`
`US 2010/0245585 A1
`
`
`
`F.G. 1A
`
`2
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 2 of 36
`
`US 2010/0245585 A1
`
`
`
`3
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 3 of 36
`
`US 2010/0245585 A1
`
`
`
`4
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 4 of 36
`
`US 2010/0245585 A1
`
`
`
`N- / FIG. 2B
`
`5
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 5 of 36
`
`US 2010/0245585 A1
`
`FIG 3
`
`
`
`6
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 6 of 36
`
`US 2010/0245585 A1
`
`
`
`F.G. 6
`
`7
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 7 of 36
`
`US 2010/0245585 A1
`
`
`
`8
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 8 of 36
`
`US 2010/0245585 A1
`
`
`
`FG. 8
`
`FIG 9A
`
`9
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 9 of 36
`
`US 2010/0245585 A1
`
`FIG. 9B
`
`
`
`10
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 10 of 36
`
`US 2010/0245585 A1
`
`721
`
`FIG. 10c
`
`74
`
`
`
`11
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 11 of 36
`
`US 2010/0245585 A1
`
`FG, 11B
`
`Fiates free, wireless &
`FIG. 12 attornated systers xntrols
`
`
`
`
`
`12
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 12 of 36
`
`US 2010/0245585 A1
`
`F.G. 1 3.
`
`reless &
`artis-free,
`automated systers controls
`
`
`
`ands-free, wireless &
`attorated systers totals
`F.G. 14
`
`
`
`13
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 13 of 36
`
`US 2010/0245585 A1
`
`tards-free, wireless &
`FIG. 15A automated systerns controls
`
`
`
`FIG, 15B
`
`93.
`
`98.
`
`98.
`
`
`
`14
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 14 of 36
`
`US 2010/0245585 A1
`
`FIG. 16
`ands-free, wireless &
`automated systers controls
`
`
`
`15
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 15 of 36
`
`US 2010/0245585 A1
`
`F.G. 17A
`
`s
`
`FIG. 17B
`
`it
`
`
`
`16
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 16 of 36
`
`US 2010/0245585 A1
`
`
`
`FIG. 20
`
`17
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 17 of 36
`
`US 2010/0245585 A1
`
`
`
`62.
`
`FIG 21
`
`18
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 18 of 36
`
`US 2010/0245585 A1
`
`3.
`
`FG.22A
`
`3.
`
`
`
`19
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 19 of 36
`
`US 2010/0245585 A1
`
`13
`
`
`
`FIG. 23
`
`20
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 20 of 36
`
`US 2010/0245585 A1
`
`
`
`FG, 24
`
`21
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 21 of 36
`
`US 2010/0245585 A1
`
`
`
`FIG.25
`
`22
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 22 of 36
`
`US 2010/0245585 A1
`
`
`
`Connectivity
`IN
`
`WiMax
`
`IN
`
`AN
`
`ters
`
`Expansion
`
`Figure 26
`
`User interface
`
`Power management
`
`Power supply
`& Control
`
`23
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 23 of 36
`
`US 2010/0245585 A1
`
`Applications
`eyeCam
`Connections
`
`eyeCam
`Communicator
`
`eyeCam
`Options
`
`Browser
`
`Application framework
`
`Notification
`manager
`
`Activity
`manager
`
`Window
`manager
`
`Package
`manager
`
`
`
`
`
`
`
`Technology
`manager
`
`
`
`Content
`providers
`
`ReSOurce
`manager
`
`
`
`
`
`(one
`
`Location
`manager
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`LibWebCore
`
`2D graphics
`
`3D graphics
`
`FreeType
`
`System C
`
`Media lib
`
`Surface
`manager
`
`Surface
`manager
`
`Kernel
`
`Binder (IPC)
`driver
`N- 1
`
`Bluetooth
`driver
`
`
`
`
`
`Keyboard
`driver
`N
`
`Display driver
`
`Illumination
`driver
`
`Camera driver
`
`WiFi driver
`
`WiMax driver
`
`UMTS driver
`
`N -/
`
`Flash memory
`driver
`N- -
`
`USB driver
`
`Audio driver
`
`
`
`
`
`Accelerometer
`driver
`
`(e. driver
`
`Power driver
`
`/
`N
`
`Figure 27
`
`24
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 24 of 36
`
`US 2010/0245585 A1
`
`Headset State Transition Diagram
`
`Action
`
`State
`
`Result
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Direct incoming Call to Headset
`
`Call to Headset via Paired Device
`
`Manual (User) Action
`
`Motion Detection
`
`Voice Command
`
`Headset in Standby
`Mode
`
`
`
`Headset Woken up
`
`
`
`
`
`Figure 28
`
`25
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 25 of 36
`
`US 2010/0245585 A1
`
`Headset Woken Up by Incoming Call
`
`incoming Call
`
`Direct
`
`
`
`Headsetakes Over
`
`Direct to headset
`or via paired
`device
`
`
`
`
`
`Extraet
`
`Headset detects
`communications
`
`internet
`
`Paired Device
`
`Takes Over
`
`Direct
`a lar
`
`Headset Analyses Cai Metadata and
`Makes Decisions
`
`
`
`Call Metadata Received via EyeCam
`live or other internet hub
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Accept Processing
`
`Reject Processing
`
`Figure 29
`
`26
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 26 of 36
`
`US 2010/0245585 A1
`
`incoming Call via Paired Device
`
`Incoming Cellular or Internet
`Ca
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Bluetooth
`Paired device detects
`-
`incoming Protocol(s) &
`Selects Optimum pairing
`method
`
`Wi-Fi/Other
`
`Cal Metadata Received via
`EyeCamlive Hub or other Internet
`Hubs
`
`Combination
`of Bluetooth
`
`Cai forwarded to Headset
`
`Accept
`
`
`
`Reject
`
`Accept Processing
`
`Reject Processing
`
`
`
`Headset responds to and thru
`paired device
`
`Figure 30
`
`27
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 27 of 36
`
`US 2010/0245585 A1
`
`Headset Operational Systems
`
`Headset Operating System
`
`Communications Protocol Subsystem
`
`Call Type Management Subsystem
`
`Device Security Subsystem
`
`Power Management Subsystem
`
`Device Operations Subsystem
`
`Events/Context Management Subsystem
`
`Figure 31
`
`28
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 28 of 36
`
`US 2010/0245585 A1
`
`Headset Operational Systems
`
`Call Type Management Subsystem
`
`Voice Only
`
`Video Only
`
`Voice and Video
`
`
`
`Voice, Video and
`Data
`
`Data
`
`Bluetooth (paired mode)
`
`Cellular (paired or direct)
`Wi-Fi (paired or direct)
`
`Bluetooth (paired or direct)
`
`Cellular (paired or direct)
`Wi-Fi (paired or direct)
`
`Bluetooth only
`Voice - Bluetooth, Video - Wi-Fi
`Voice - Bluetooth, Video - Cellular
`
`Wi-Fi only
`
`Wi-Fi and Cellular
`Cellular
`
`Bluetooth only
`Voice - Bluetooth, Video - Wi-Fi
`Voice - Bluetooth, Video - Cellular
`
`Wi-Fi only
`
`Wi-Fi and Cellular
`Cellular
`Data on Bluetooth, Wi-Fi, Cellular, Internet
`
`Data on Bluetooth, Wi-Fi, Cefluiar, Internet
`
`Figure 32
`
`29
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 29 of 36
`
`US 2010/0245585 A1
`
`Headset Operational Systems
`
`Device Security/D Subsystem
`
`
`
`
`
`
`
`
`
`
`
`
`
`Caller D detection
`
`Device D, capabilities
`detection
`
`
`
`
`
`Manual Pass code
`
`GPS / Location
`
`Communications Protocols
`Subsystem
`
`
`
`
`
`
`
`Figure 33
`
`30
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 30 of 36
`
`US 2010/0245585 A1
`
`Headset Operational Systems
`
`
`
`Device Operations Subsystem
`
`
`
`
`
`
`
`
`
`
`
`
`
`Memory Management
`
`Camera Operations
`
`Manual Controls
`
`Audio Controls
`
`Event/Context Management
`Subsystem
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Context-aware Processing
`(especially in relation to other
`devices
`
`Time/Schedule-driven Events
`and Operations
`
`Motion and Light Conditions
`Response
`
`
`
`
`
`Sound and Voice Response
`System
`
`Figure 34
`
`31
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 31 of 36
`
`US 2010/0245585 A1
`
`Q- A S.
`
`
`
`<
`-1 Live (Hub)
`
`
`
`Wired
`
`Cellular
`<--Ge.
`
`
`
`NC
`
`32
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 32 of 36
`
`US 2010/0245585 A1
`
`
`
`Bluetooth
`
`Cellular
`
`s - A
`
`Figure 37
`
`
`
`Cellu
`
`Live (Hub)
`
`
`Bluetooth -
`
`::
`
`Cellular
`
`
`
`Á Cellular <-G-
`.
`
`W
`
`Figure 38
`
`33
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 33 of 36
`
`US 2010/0245585 A1
`
`
`
`
`
`A
`
`Bluetooth
`
`
`
`-
`
`Figure 39
`
`Wired
`
`
`
`A -1
`
`*
`
`Figure 40
`
`Wired / Wireless
`<-o-o-o-G>
`
`Headset w/ base
`
`Station
`
`Cellular
`
`en
`-ss
`
`
`
`34
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 34 of 36
`
`US 2010/0245585 A1
`
`Cellular
`
`
`
`S. G.
`
`Cellular
`
`Cellular
`
`Cellular
`
`Figure 41
`
`
`
`Cellular
`
`
`
`Cellular
`
`Á
`-8:v.
`(a
`N s Cellular
`
`r
`
`Live Hub
`
`Cellular
`Cellular
`
`Figure 42
`
`35
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 35 of 36
`
`US 2010/0245585 A1
`
`
`
`-1. (Hub)
`
`MM
`
`Cellular
`
`Figure 43
`
`
`
`Wi-Fi
`
`Cellular
`
`
`
`Live
`
`
`
`Cellular
`<--Ge.
`
`Figure 44
`
`36
`
`PINN-2010
`
`

`

`Patent Application Publication
`
`Sep. 30, 2010 Sheet 36 of 36
`
`US 2010/0245585 A1
`
`Wi-Fi
`
`<-- > .
`
`.
`
`. .
`
`-1 <-Wired
`
`Live (Hub)
`Cellular
`<-Ge.
`Cellular
`
`
`
`Cellular
`
`Figure 45
`
`
`
`Wired/ Wireless
`
`Cellula1ive (Hub)
`
`
`
`
`
`
`
`
`
`
`
`E:
`
`Cellular
`
`2
`
`-
`
`Á Cellular
`
`Figure 46
`
`37
`
`PINN-2010
`
`

`

`US 2010/0245585 A1
`
`Sep. 30, 2010
`
`HEADSET-BASED TELECOMMUNICATIONS
`PLATFORM
`
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`0001. This application is a Continuation of PCT Patent
`Application No. PCT/US 10/25603, filed 26 Feb. 2010, and
`claims priority to U.S. Provisional Patent Application Ser.
`No. 61/208,783, filed 27 Feb. 2009 and U.S. Provisional
`Patent Application Ser. No. 61/270.221 filed 6 Jul. 2009,
`which are incorporated herein in its entirety by this reference
`thereto.
`
`BACKGROUND OF THE INVENTION
`
`Technical Field
`0002. The invention relates to voice, data and audio-video
`streaming to and from a hands-free wireless mobile device.
`Further, the invention relates to multiple embodiments of a
`Video camera telecommunications headset with a retractable
`viewfinder/monocular display and a laser rangefinder offered
`as either a single unit hands-free wireless real-time bi-direc
`tional and multi-feed telecommunications headset or as a
`modular Bluetooth earpiece headphone (Headphone) unit
`with a detachable handheld cellular video camera unit, with
`the earpiece unit serving as either a stand-alone wireless
`BluetoothHeadphone and personal media player or as a wear
`able multimedia port for the detachable handheld cellular
`video camera telephone unit that when linked together oper
`ate as a single autonomous hands-free wireless video com
`munications headset capable of still image and audio-video
`capturing, recording and streaming to and from a receiver or
`group of receivers and real-time viewing and control of cap
`tured and/or received audio-video feeds via the retractable
`monocular viewfinder or other paired multimedia display
`system.
`0003. Further, the invention relates to the headset acces
`sories including an adjustable docking station for recharging
`and/or use of the headset, as a stationary wired or wireless IP
`camera, removable/rechargeable earpiece and neckpiece bat
`tery units for continuous hands-free wireless mobile headset,
`headphone and/or other ported device operations and a pair of
`multimedia Sunglasses for active binocular display and eye to
`camera automation of the headsets optical and digital Zoom,
`day and near infrared night vision camera.
`0004 Further the invention relates to device control soft
`ware that is embedded into the headset and/or downloaded to
`the headset (or other networked device) and/or executed
`remotely from an external server. The device control software
`provides a system and method for infrastructure and ad-hoc
`networking, operational behavior management, communica
`tions protocol selection, security, data and power character
`istics, modular data broadcasting, hands-free and remote sys
`tems control and autonomous, paired and/or networked
`device optimization,
`
`DESCRIPTION OF THE BACKGROUND ART
`
`Field of Invention
`0005. When wireless/cellular phone technology was ini
`tially commercialized, cellular phones were Voice-only com
`munication devices, i.e. Such devices did not have any capa
`bility beyond voice communication. These cellular phones
`were hand-held devices. A hands-free option was introduced
`
`that required plugging in a wired headphone connection
`between the phone and an earpiece and microphone. Over
`time, some new technologies evolved.
`0006 Most notably:
`0007 Bluetooth Communication Protocol for short
`range wireless communications enabling wireless
`devices to communicate with each other over short dis
`tances. With the introduction of the Bluetooth commu
`nication protocol, the wireless phones could communi
`cate with other devices over a short range. This
`advancement in technology created a new market for
`wireless accessories. The very nature of the protocol
`eliminated the need for a wired device to establish
`hands-free operation. Now, the user could use a cellular
`phone to communicate with an accessory (or any other
`device) over a wireless network, thus truly making the
`use of the device hands-free.
`0008 Digital Video Camera and Streaming: With the
`advent of digital imaging cameras could capture and
`store images and videos in a digital format. The next step
`in the evolution of the video cameras was their ability to
`stream the video over wireless networks. Modern day
`cameras also have built-in GPS capabilities.
`0009 Wearable cameras such as helmet cams began as
`bulky still image and video cameras that were often
`bolted into athletes helmets. With the onset of digital
`video recording and flash memory came a new genera
`tion of what has been referred to as lipstick or bullet
`cameras that were smaller and lighter and were either
`wired to an external digital recorder or incorporated
`Some embedded or removable flash memory storage.
`The next generation of wearable cameras introduced
`wireless data transmission such as Bluetooth for wire
`less uploading of stored still image and video files and/or
`Wireless IP Cameras that offer outgoing video stream
`ing to the Internet via a Wireless Local Area Network or
`wired or wireless video streaming and networking via an
`external digital recorder or intelligent paired computing
`and wide or local area networking device such as a Smart
`phone or personal computer.
`0010. The hands-free wireless video camera telecom
`munications headset represents a new generation of
`entirely autonomous wearable two-way and multi-feed
`hands-free wireless communications devices capable of
`sending and receiving voice data, and audio-video with
`out the need for a paired external, handheld, wired or
`wireless computing, networking or storage device.
`
`DESCRIPTION OF THE PRIOR ART
`
`Comparatively US patent 20100039493, Mobile
`(0011
`video headset Feb. 18, 2010, comprises an embodiment that
`allows hands-free imaging of the users Surroundings via a
`camera and transference of simplex (one-way) audio and
`video stream to a personal (nearby) electronic device. The
`evolution in this invention advances all communications,
`including the audio Video stream, to be duplex with a plurality
`of devices for full multimedia exchange amongst multiple
`devices. Paired or connected devices do not have to be on the
`person or nearby, instead they can be anywhere a network
`connection can be established. Additionally, other unified
`communication data (email, text message, Voice, GPS) is
`integral to the device for a rich communication platform
`amongst a group of connected devices. Also, user control
`
`38
`
`PINN-2010
`
`

`

`US 2010/0245585 A1
`
`Sep. 30, 2010
`
`capabilities (hands-free) are advanced by Voice command,
`eye tracking, motion gesture, and hand operated controls.
`0012. Other patents utilize off-board computing power to
`process data and coordinate control of a wearable (headset)
`device, this invention integrates all functionality within the
`headset enclosure.
`0013 Technology referenced in some of the prior art (ref
`erenced patents) should be considered experimental and
`largely remains in the laboratory or is prohibitively expen
`sive. Conversely, much of the technology in this invention is
`proven and available as commercial-off-the-shelf solutions
`ready for integration into a design.
`0014 Multiple prior art references incorporate large and
`heavy headset apparatus. This invention is less intrusive to the
`user's movement and other worn clothing or accessories. The
`target weight of this headset is less than 100 grams.
`
`SUMMARY OF THE INVENTION
`0015 The battery powered video camera telecommunica
`tions headset is the next innovative step in video capture and
`wearable hands-free wireless communications devices.
`Designed to capture, record, stream and display what the eyes
`see and what the ears hear, the Headset offers two-way and
`multi-feed real-time Voice, data and audio-video communi
`cations and streaming to and from multiple wireless network
`connections, or locally to persistent storage. Operating as an
`autonomous, paired or peer-to-peer networked computing
`and multimedia device the Headset offers a wide range of
`hands-free device operational controls and interfaces includ
`ing Voice command, automated eye-motion and facial recog
`nition for eye-camera control, light and motion sensor for the
`embedded day and night vision camera, and laser rangefinder
`automated optical and digital Zoom, remote paired or net
`worked device and camera control, and redundant embedded
`and removable/rechargeable and rapidly swappable battery
`power sources for uninterrupted hands-free wireless device
`operation.
`0016. The headset can operate as a paired accessory to a
`cell phone, PC, TV, video game console or other external
`wired or wireless Bluetooth, Wi-Fi or WiMax, Cellular, or
`other wired or wirelessly networked device. The video cam
`era telecommunications Headset is worn on the ear similar to
`other wireless Bluetooth and/or Wi-Fi earpiece Headsets yet
`unlike its predecessors the Headset is more than a Bluetooth
`accessory; it is a hands-free wireless GPS enabled Wide,
`Metro or Local and Personal Area Network cellular commu
`nications system capable of wholly autonomous operations.
`Incorporating an embedded optical and digital Zoom video
`and still image camera with both day and infrared night vision
`capabilities and a retractable monocular viewfinder display,
`the headset is an intelligent hands-free wireless device
`capable of simultaneously capturing, recording, streaming,
`receiving and outputting Voice, data and audio-video in real
`time and over multiple networks and pairing with one or more
`networked devices to create an ad-hoc virtual private network
`over any WAN, MAN, LAN, PAN or a combination of a
`paired, managed network, federation of autonomous net
`worked devices or other peer-to-peer networking configura
`tion.
`0017. Until now Bluetooth headsets, wearable video cam
`eras and other hands-free wireless devices have been limited
`in their capability due to one of five major constraints; power,
`wireless range, size, weight and data processing capability. In
`addition to introducing functional hardware solutions to each
`
`of these physical constraints the Headset also incorporates a
`mobile device control system that introduces a system and a
`method for modular device, group and network data, protocol
`and power management and optimization, modular data
`channeling, broadcasting and communications, coordinated
`and shared operations, security and remote systems control.
`(0018. The Gateway Operating System (GOS) Control
`Software is designed to Support numerous embodiments of
`the telecommunications headset and other unified, paired and
`networked communication devices (Headset in this inven
`tion, wireless Internet devices and stationary/wired Internet
`devices) and introduces a modular device architecture and
`management system, a model for wired and wireless device
`networking, paired, autonomous, hierarchical or other man
`aged device groups, peer to peer and Virtual Private Network
`ing (VPN) while constantly optimizing single or multiple
`networked device configurations for data, power and network
`optimization shared and/or unified operations and inter-de
`Vice and multi-device secure ad-hoc networking over any
`combination or type of wired and/or wireless network, public
`or private federation of autonomous wired or wireless
`devices.
`0019. The GOS is a modular device, data and network
`management platform and operations model is designed to
`allow for components or whole devices to be attached or
`detached and systems to be turned on, shutoff, monitored and
`constantly optimized specific to the available power, memory,
`wireless transmit power, and network bandwidth of all avail
`able networked devices and/or other user, group, network,
`event, location and/or application based device preferences.
`The GOS algorithms are consistently generating and updat
`ing optimized device operations based on automated and/or
`userspecified guidelines and priorities for each of its coupled
`systems and/or modules.
`0020. The GOS is designed to expand to include one or
`many devices in a synchronized ad-hoc or coordinated, hier
`archical, managed or other device network organizational
`model offering a standard modular device and data manage
`ment system. It is also a model for individual and group
`device power and data management and storage, protocol
`selection, transmission, broadcasting, networking, applica
`tions and systems coordination over any number of wired and
`wireless networks for optimized individual and grouped
`device operations and remote systems control.
`0021. In addition to supporting multi-device coordinated
`networking the GOS organizes systems through standardized
`APIs for interaction of system processes, organized data and
`communication protocol types and applications such as
`device, user and network identification and security, location
`and contextual data, Voice, audio and video, communications
`protocols, system controls, data management, and power
`management. The GOS identifies, quantifies, and prioritizes
`local and remote networked device operation, networks and
`applications for each of its designated system modules based
`on a set of variables such as power use, data processing speed,
`network strength, bandwidth, available data and memory
`Storage.
`0022. For example a “Location and Contextual Data Mod
`ule' may be designated to acquire all data and manage all
`tasks and processes specific to the location of the device
`and/or its relation to another device, address, position, loca
`tion, time/date, contextual event or coordinated application
`and/or the source and location of any incoming or outgoing
`data stream. All location and contextual data acquisition,
`
`39
`
`PINN-2010
`
`

`

`US 2010/0245585 A1
`
`Sep. 30, 2010
`
`processing and transmission are managed by the location and
`contextual data module. The data module will automatically
`locate, organize and prioritize all available firmware compo
`nents and or Software processes designated for the acquisi
`tion, processing and or application of location and contextual
`data. The Location and Contextual Data Module in each
`independent or networked device will independently quantify
`and prioritize all of its local firmware components and related
`Software processing systems and location and contextual data
`applications based on a universal set of variables.
`0023. Each Headset or other networked device or group of
`networked devices may have more than one method, system
`and/or set offirmware components capable of acquiring and
`utilizing the same or similar data. Each module then priori
`tizes all local or networked firmware component's for each of
`its designated tasks and related data sets in order to select the
`optimum system(s) and method for acquiring a specific data
`set and accomplish each task and/or process and which tasks
`should be acquired and/or processed and/or designated to
`each available system and/or networked device.
`0024. Each individual device then coordinates all net
`worked and independent functions for each module and
`selects which local tasks, processes, components and/or net
`works should be idled or shut down at any given moment
`based on the independent and group generated modular algo
`rithm for optimized system operations. Each device, device
`group and/or network can be pre-defined with user prefer
`ences and updated for coordinated device system settings.
`Each Module responds based on networked group defined
`standards for measuring the data, power and networking effi
`ciency and application for all designated processes, tasks,
`data sets and all available firmware and Software systems
`specific to each task. All data, System, component, device and
`network operations are then synchronized, coordinated and
`managed on a modular systems level for one or a group of
`networked devices with each module continuously updating
`its operation specific to system capabilities, optimized use
`case scenario and user priority settings for all available com
`ponents and networked devices. Each module is assigned its
`own data channel on which all module specific data streams
`are transmitted upon. Modular channels and related data
`streams can be encrypted and grouped together with other
`channel data streams and sent out via a single network port.
`0025. The Headset and GOS Control Software offers a
`modular device, data and network management, operations
`and network optimization model that can be installed as an
`embedded system downloaded and customized to an existing
`operating system as a middleware application and/or net
`worked to a device either via a networked hub or via a peer
`to-peer ad-hoc networked or managed network configuration.
`The software is configurable for all headset and other net
`worked device embodiments and applications including but
`not limited to wearable, hands-free and remote wireless sys
`tems controls.
`0026. A mash-up of a GPS enabled video camera and
`camcorder, IP camera, video VoIP phone (IP Telephony),
`Personal Media Player and mobile handset (cellphone) and a
`hands-free wireless earpiece Bluetooth Headset. As a cell
`phone the headset is a mobile, wide area networked device
`that offers one-to-one and one-to-many communication, file
`storage, audio, text, picture and video communication. As an
`IP camera phone, the headset provides real-time Voice, data
`and audio-video over a Metro or Local Area, wired or Cloud
`wireless or wired Internet link and can serve as a wireless
`
`router and hot spot for an ad-hoc off-network peer to peer
`group of devices or secure Virtual Private Network (VPN). As
`a personal media player the headset offers an entirely autono
`mous hands-free wireless Solution.
`0027. The Headset is designed as a modular device on both
`a physical, functional, and embedded system design architec
`ture. Allowing for components to be attached or detached
`specific to the desired application. A first embodiment com
`prises a one-piece GPS enabled hands-free wireless wearable
`audio-video camera headset capable of two-way, multi-feed
`and duplex networked Voice, data and audio-video commu
`nications offered in a curved or rectangular video camera
`phone (CP) Headset unit body design while a second embodi
`ment introduces two-piece detachable handheld cellular CP
`unit and a Bluetooth earpiece Headphone unit with both units
`capable of operating autonomously or, when attached as a
`single hands-free wireless telecommunications headset
`device with the earpiece Headphone Unit serving as a univer
`sal port for the handheld CP unit.
`0028. The headset supports a redundant data and power
`management and storage system designed to offer both
`embedded removable/rechargeable and rapidly swappable
`data and power storage options while offering a modular data
`management system capable of Supporting entirely standal
`one autonomous device operations, communications, auto
`mated and user control and/or securely transfer Voice, data
`and/or video interface control to an authorized external wired
`or wirelessly networked device or group of devices. Addition
`ally an embedded laser sight and range finder support auto
`mated Zoom functions and hands free control of the optical
`and digital Zoom camera with light and motion sensor and
`accelerometer to retractable monocular, view finder, data
`management and/or headset systems control partially or
`entirely to an authorized remote wired or wirelessly net
`worked device or group of devices.
`(0029. The cellular CP module and earpiece Headphone
`module which are introduced in both single one-piece
`embodiments and detachable two-piece embodiments, both
`include independent battery and power systems, independent
`flash with the CP Unit housing a removable/rechargeable
`battery and the Headphone unit housing an embedded
`rechargeable battery. The earpiece Headphone unit also has a
`dual data/power accessory port system for a removable/re
`chargeable earpiece or neckpiece battery unit both serving as
`a counter balance and Support system for the headset and/or
`Headphone units.
`0030. In both the single unit and two-piece autonomous
`CP and Headphone embodiments the system automatically
`selects from one or more of the available batteries based on
`power charge status, application and run time scenarios with
`the CP unit handling the primary processing, system and
`network drivers and the earpiece Headphone unit housing a
`microprocessor for the earpiece microphone, speaker, media
`player and user controls, Bluetooth and multimedia device
`port and connector functions. Both the CP and Headphone
`units have independent embedded and removable flash
`memory ports and independent data storage and management
`functionality allowing both the CP unit and earpiece