(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2008/0262910 A1
`
`
` ALTBERG et al. (43) Pub. Date: Oct. 23, 2008
`
`US 20080262910A1
`
`(54) METHODS AND SYSTEMS TO CONNECT
`PEOPLE VIA VIRTUAL REALITY FOR REAL
`TIME COMMUNICATIONS
`
`(75)
`
`Inventors:
`
`Ebbe ALTBERG, Mill Valley, CA
`(US); Scott FABER: San Franciscos
`CA (US); Ron HIRSON, San
`Francisco, CA (US); Ben Harris
`LYON, San Francisco, CA (US);
`Paul G. MANCA Oakland CA
`(US)' Sean VAN DER LINl)EN
`’
`Berkeley, CA (US); Virginia
`Hong-Jia YANG Foster City CA
`(US)
`’
`’
`
`Correspondence Address:
`GREENBERG TRAURIG, LLP (SV)
`IP DOCKETING
`2450 COLORADO AVENUE, SUITE 400E
`SANTA MONICA, CA 90404 (US)
`
`(73) Assignee:
`
`UTBK: INC': Dover, DE (US)
`
`(21) Appl. No.:
`
`11/737,975
`
`(22)
`
`Filed:
`
`Apr. 20, 2007
`
`Publication Classification
`
`(51)
`
`Int. Cl.
`(2006.01)
`G06Q 30/00
`(52) us. Cl. ........................................... 705/14; 715/757
`
`(57)
`
`ABSTRACT
`.
`.
`Methods and systems for connecting people for real time
`communications Via a virtual reality environment. . One
`embodiment includes: a Virtual reality server to host a Virtual
`reality world and to present, to a customer in the Virtual reality
`world, an advertisement including a reference assigned to the
`advertisement; a session border controller to interface with a
`packet switched network; and one or more telecommunica-
`tion servers coupled to the session border controller to con-
`nect the customer to an advertiser of the advertisement for
`
`real time communications in response to a request received
`Via the reference embedded in the advertisement and pre-
`sented to the customer in the Virtual reality world. In one
`embodiment, the advertiser is charged an advertisement fee
`based on connecting the customer and the advertiser for real
`time communications Via the advertisement presented in the
`virtual reality world.
`
`Media Channel A
`(e.g., Web Server)
`
`User Device A
`(e.g., Cellular Phone)
`
`'
`
`.
`(223133223;
`
`User Device E
`
`(e.g.. Newspaper)
`
`Media Channel B
`(e.g., WAP Server)
`
`Media Channel C
`(e.g., Short Messaging
`Service Center)
`
`Media Channel D
`(e.g.. Custom Server)
`
`Media Channel E
`(e.g., Cable Television)
`
`Niantic's Exhibit No. 1045
`
`Page 001
`
`Niantic's Exhibit No. 1045
`Page 001
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 1 0f 40
`
`US 2008/0262910 A1
`
`111
`
`:DDD F
`
`IG. 1
`
`DDDDDI
`
`Niantic's Exhibit No. 1045
`
`Page 002
`
`Niantic's Exhibit No. 1045
`Page 002
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 2 0f 40
`
`US 2008/0262910 A1
`
`Present the
`
`re erence
`
`_serB
`
`127
`
`Media
`
`.
`
`Provide a reference
`representing the contact
`
`Request a connection via
`the reference
`
`123
`
`Track connections made via the
`
`125
`
`reference for billing
`Connection
`I —> Database
`
`Provrder
`
`Make a connection
`between users A and B
`
`using the reference
`
`
`
`121
`
`Provide a contact for real
`time communication
`
`FIG. 2
`
`Niantic's Exhibit No. 1045
`
`Page 003
`
`Niantic's Exhibit No. 1045
`Page 003
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 3 of 40
`
`US 2008/0262910 A1
`
`141
`
`Create Ad
`
`Your ad is very important. Tell customers exactly what you‘re selling and why they should call you. Please
`review our EaiLELQaLAdfiuideiiues to ensure your ad is accepted and gets new customers calling your
`business today.
`Ad Location Info
`
`Business Name: |:| (Sorry, no phone numbers)
`
`[I Use my Account Information
`
`Address 1:
`
`Address 2:
`
`City:
`
`State:
`
`-Se|ect State-
`
`(Optional)
`
`(35 characters)
`
`Zip Code:
`
`Phone Number:
`
`Fax:
`
`Ad Marketing Message
`
`Enter the number where you'd like to receive calls
`
`-|:|
`
`-|:|
`
`Millions of people online will see your ad. So, in line 1 write a strong headline explaining what you’re
`selling. To get people calling your business, include a promotional offer in line 2. This encourages buyers
`to call you now! Please note: Line1 and Line 2 must each a complete sentence. MW
`Examples of Promotional Offers:
`- Call today and get $5 off.
`- Free consultation — limited time.
`- Call now and save 10%.
`
`You’ll be able to include more information about your offer on the business profile page. LeammoLe
`
`Marketing Message Line 2:
`
`FIG. 3
`
`Niantic's Exhibit No. 1045
`
`Page 004
`
`Niantic's Exhibit No. 1045
`Page 004
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 4 0f 40
`
`US 2008/0262910 A1
`
`
`
`163
`
`153
`
`Available to take calls (takimfllffllalll)
`
`' _
`
`Welcome Back
`eJack101
`
`
`My Availability
`
`Call Me At:
`
`
`
`
`
`161
`Work
`415-248-4000
`Mon
`
`
`Home
`415-248-4128
`
`
`
`415-248-4100
`Cell
`
`
`159 Mahangemmhmenumbet
`Thu _
`
`
`
` My Results
`
`Week Starting
`Attempted Calls
`Missed Calls
`Calls
`Call Minutes
`
`
`
`.lan_21
`15
`3
`12
`1 hour, 35 minutes
`
`
` 42 minutes
` 48 minutes
`
`
`2 0 1
`
` 1 hour, 15 minutes
`
`157
`
`See Graphs
`
`Show Details
`
`
`
`155
`
`FIG. 4
`
`Niantic's Exhibit No. 1045
`
`Page 005
`
`Niantic's Exhibit No. 1045
`Page 005
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 5 of 40
`
`US 2008/0262910 A1
`
`171
`
`Local Phone
`Numbers
`
`800-Numbers
`
`888-Numbers
`
`_
`877 Numbers
`
`866-Numbers
`
`References for Call Tracking
`
`Extensions
`
`SIP URls/
`
`addresses
`
`185
`
`187
`
`CIick-to-Assign
`References
`
`Click-to-CallbaCk
`References
`
`191
`
`Advertisement
`
`Reference
`
`1‘93
`
`Assigned
`
`189
`
`
`
`Assign (e.g., based on call volume,
`
`conversion rate, revenue potential, category,
`
`geography, demand partner, etc.)
`
`FIG. 5
`
`Niantic's Exhibit No. 1045
`
`Page 006
`
`Niantic's Exhibit No. 1045
`Page 006
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 6 0f 40
`
`US 2008/0262910 A1
`
`215
`
`Media Channel
`
`217
`
`Call the assigned
`phone number
`
`
`
`
`
`phone number
`—>
`
`<—..
`
`phone number
`
`.
`Call the advertlser’s
`phone number
`
`225
`
`FIG. 6
`
`Advertisement
`
`number
`
`209
`
`Assigned phone number
`
`
`
`i
`.
`Medla
`Channel
`
`2 3
`0
`
`i
`Advertiser's
`Phone number
`
`205
`
`Database
`
`Niantic's Exhibit No. 1045
`
`Page 007
`
`Niantic's Exhibit No. 1045
`Page 007
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 7 0f 40
`
`US 2008/0262910 A1
`
`Media Channel A
`
`(e.g., Web Server)
`
`Media Channel C
`
`(e.g., Short Messaging
`Service Center)
`
`User Device C
`
`(e.g., Computer)
`
`(e.g., Radio Station)
`
`Media Channel E
`
`(e.g., Cable Television)
`
`Media Channel G
`
`FIG. 7
`
`Niantic's Exhibit No. 1045
`
`Page 008
`
`Niantic's Exhibit No. 1045
`Page 008
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 8 of 40
`
`US 2008/0262910 A1
`
`271
`
`Telecommunication
`
`Carrier
`
`
`Packet Switched
`
`Network
`
`279
`
`Connection
`
`Server
`
`FIG. 8
`
`Niantic's Exhibit No. 1045
`
`Page 009
`
`Niantic's Exhibit No. 1045
`Page 009
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 9 of 40
`
`US 2008/0262910 A1
`
`303
`
` Packet
`
`Switched
`
`Network
`
`Connection
`Server
`
`Session Border
`Controller
`
`SIP Server
`
`SIP Server
`
`3
`
`SIP Server
`
`
`
`FIG. 9
`
`Niantic's Exhibit No. 1045
`
`Page 0010
`
`Niantic's Exhibit No. 1045
`Page 0010
`
`

`

`Request
`
`Product/Service
`
`335
`
`L-
`
`Customer’s
`
`Contact Info
`
`Communication
`
`351
`
`353
`
`Order
`
`Person
`
`Verification
`
`357
`
`359
`
`Patent Application Publication
`
`Oct. 23, 2008 Sheet 10 of 40
`
`US 2008/0262910 A1
`
`333
`
`341
`
`Advertisement
`
`Request
`
`Appointment
`
`355
`
`337
`
`345
`
`Communication
`Gateway
`
`Database
`
`331
`
`R f
`e erence
`
`.
`Advertiser’s
`
`Contact Info
`
`
`339
`
`Communication Channel
`
`361
`
`363
`
`365
`
`367
`
`369
`
`371
`
`373
`
`Phone
`
`Email
`
`Instant
`Messaging
`
`Voice
`Mail
`
`Video
`Mail
`
`SMS
`Message
`
`Web
`Mail
`
`...
`
`343
`
`FIG. 10
`
`Niantic's Exhibit No. 1045
`
`Page 001 1
`
`Niantic's Exhibit No. 1045
`Page 0011
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 11 of 40
`
`US 2008/0262910 A1
`
`3’87
`
`.
`Advertiser
`
`Charge for the advertisement
`when there is a deal
`
`391
`
`Advertiser’s
`Contact
`
`Communication
`Reference
`
`3
`
`393
`
`Advertisement
`
`
`
`
`
`
`385
`
`Connection
`Provider
`
`395
`
`397
`
`Deal Detector
`
`Handler
`
`Transaction
`
`381
`
`Customer
`
`FIG. 11
`
`Niantic's Exhibit No. 1045
`
`Page 0012
`
`Niantic's Exhibit No. 1045
`Page 0012
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 12 of 40
`
`US 2008/0262910 A1
`
`07
`
`Advertiser
`
`Charge for the advertisement
`when there is a deal
`
` 403
`
`Connection
`,
`Provrder
`
`
`
`
`Connection
`Record
`
`T
`
`Deal Detector
`
`411
`
`
`
`
`
`-ransaction_and|er
`
`
`
`
`405
`
`409
`
`FIG. 12
`
`Niantic's Exhibit No. 1045
`
`Page 0013
`
`Niantic's Exhibit No. 1045
`Page 0013
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 13 0f 40
`
`US 2008/0262910 A1
`
`421
`
`Define a Deal
`
`Help
`
`You pay for your advertisement for each deal you get. You can define what you deem as
`a deal.
`
`Deal Event:
`CI The customer talks to me for at least ‘:I minutes
`
`[I The customer agrees to pay
`
`[I The customer places an order
`
`[I The customer places a bid
`
`El |/Wesaythereisadeal bydialing thissequence: ‘>:|tln
`
`[I The customer visits my web page at this URL:|:|
`
`[I The customer presses the submit button in the above web page
`
`D The customer agrees to provide an address to me
`
`[I The customer answers the following question(s)
`
`FIG. 13
`
`Niantic's Exhibit No. 1045
`
`Page 0014
`
`Niantic's Exhibit No. 1045
`Page 0014
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 14 0f 40
`
`US 2008/0262910 A1
`
`431
`
`Your Offer of Advertisement Fee
`
`You pay for your advertisement for each deal you get from the customer’s ca|| generated from
`
`your advertisement. You can define how much you offer to pay for each deal.
`
`Advertisement Fee:
`
`[I This percentage of what the customer pays: |:| %
`
`|:| deals per month
`
`[I A lump sum of:
`
`per deal
`
`[I This percentage of what I pay the customer. |:| %
`
`El Asubscription fee of:
`
`permonth ifl/we get more than
`
`FIG. 14
`
`Niantic's Exhibit No. 1045
`
`Page 0015
`
`Niantic's Exhibit No. 1045
`Page 0015
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 15 of 40
`
`US 2008/0262910 A1
`
`441
`
`Overview| %| Call Date
`
`For Listing:
`
`All Listings
`
`Time Period: 0
`
`Month to Date
`
`0 from 10/3/2003 to
`
`Please enter date in
`11/10/2003 mmiddlyyyyiormat
`
`Calls:
`
`Charged Calls
`
`View calls
`
`Calls forAll Listings for Oct 3, 2003 — Nov 10, 2003
`
`Amount
`Next
`Amount
`Bid ID
`Call ID
`Charged Highest BidCall Date Bid
`Listing Title
`
`
`
`$15.00
`
`
`
`5717848
`
`428566
`
`Jim's Professional Plumbing
`
`Oct292:24PM $13.01
`
`5717656
`
`428566
`
`Jim‘s Professional Plumbing
`
`Oct292:14PM $14.01
`
`$15.00
`
`$13.00
`
`$14.00
`
`445
`
`447
`
`449
`
`FIG. 15
`
`Niantic's Exhibit No. 1045
`
`Page 0016
`
`Niantic's Exhibit No. 1045
`Page 0016
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 16 0f 40
`
`US 2008/0262910 A1
`
`In Increasing
`Order
`
`
`
`
`
`
`
`
`
`Competitor Bid 1
`
`°
`0
`
`Competitor Bid n
`
`Maximum Bid of the Advertisement
`
`Bid Instance
`
`507
`
`Competitor Bid n+1
`
`509
`
`FIG. 16
`
`
`
`501
`
`503
`
`505
`
`
` Highest among competitor bids that
`
`
`
`One Increment (e.g., 1 cent)
`
`are no higher than the Maximum
`Bid of the Advertisement
`
`Niantic's Exhibit No. 1045
`
`Page 0017
`
`Niantic's Exhibit No. 1045
`Page 0017
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 17 of 40
`
`US 2008/0262910 A1
`
`601
`
`
`f AdvertiserA - (866)423-9848 (Call Locally- Toll Free)
`Free delivery in San Francisco. Afull service florist since 1987.
`2625 Ocean Ave., San Francisco, CA
`
`
`
`
`Advertiser B - (866)673-1200 (Call Locally- Toll Free)
`533
`Send flowers with same day delivery from San Francisco‘s oldest florists.
`1396 California St, San Francisco, CA
`
`631
`
`
`JV Advefiiseuz- (866)654-8982 (Call Locally- Toll Free)
`
`535
`Creating smiles across America since 1956.
`1 Post St, San Francisco, CA
`
`
`
`Rank Candidates according to
`Potential Revenue for
`Presentation or Selection
`
`Advertiser
`Em
`.
`Advertiser A
`
`Advertiser B
`
`641
`
`643
`
`645
`
`Price Per Call
`613.
`
`Earn Percentage
`5145
`
`$10.00
`
`$9.00
`
`Compute.
`Potential
`Revenue
`
`Revenue Per Call
`
`$10.00 X75% = $7.50
`
`$9.00X60% = $5.40
`
`651
`
`653
`
`655
`
`Advertiser C
`
`$8.00
`
`$8.00 X75% = $6.00
`
`691
`
`Advertiser Database
`
`FIG. 17
`
`Niantic's Exhibit No. 1045
`
`Page 001 8
`
`Niantic's Exhibit No. 1045
`Page 0018
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 18 of 40
`
`US 2008/0262910 A1
`
`Advertisement for
`
`Advertiser Group T
`m
`
`Number M
`
`Phone
`
`Advertisement
`
`Delivery
`
`Connection Server at
`Phone Number M
`
`Database
`
`Advertiser
`
`Niantic's Exhibit No. 1045
`
`Page 0019
`
`Niantic's Exhibit No. 1045
`Page 0019
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 19 0f 40
`
`US 2008/0262910 A1
`
`Advertiser Geographical
`Area
`E1
`
`Phone
`Number(s)
`M
`
`Advertisement Availability
`Bid
`m
`
`m
`
`
`
`Advertiser Information m1
`
`Outgoing Phone
`Connections
`
`753
`
`Control
`Center
`
`Time Duration
`
`To
`From
`Phone Phone
`El
`75.3; E El
`
`Advertise-
`ment Bid
`75;
`
`O
`
`
`
`
`Connection Records @
`
`.
`.
`Interactive Vorce
`
`Response (IVR) System
`
`Identification (ANI) Unit
`
`Geographical Area
`Locator
`
`Automatic Number
`
`737
`
`739
`
`741
`
`
`
`Telephone
`Switching Equipment
`
`Telephone
`Receiving Equipment
`
`751
`
`Incoming Phone
`Connections
`
`Human Concrerge
`
`FIG. 19
`
`Niantic's Exhibit No. 1045
`
`Page 0020
`
`Niantic's Exhibit No. 1045
`Page 0020
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 20 0f 40
`
`US 2008/0262910 A1
`
`
`Customer Dial the
`
`Phone Number
`
`
`
`
`
`Customize Prompt to the
`Customer Based on the
`Performance of the
`Advertisement
`
`Advertiser’s
`Phone Number
`
`Geographic Area
`of Service
`
`8
`
`21
`
`23
`
`8
`
`8 5
`
`827
`
`8 9
`
`Price Bid Per Call
`
`.
`
`Advertisement
`
`Categories
`
`Database
`
`8 3
`
`8
`
`5
`
`837
`
`Recording of
`Custom Prompt
`
`Call Frequency
`
`Listing A
`
`805
`
`FIG. 20
`
`Niantic's Exhibit No. 1045
`
`Page 0021
`
`Niantic's Exhibit No. 1045
`Page 0021
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 21 0f 40
`
`US 2008/0262910 A1
`
`Present
`Advertisements
`
`841
`
`Collect Statistics
`
`Generate
`on Keywords —>
`8.4.9
`
`Advertisement
`
`Performance
`Indicators
`851
`
`
`
`
`
`Select Tracking
`Mechanisms
`fl
`
`Perform Searches
`
`Using Keywords
`E
`
`m
`
`Rank
`
`Advertisements
`
`FIG. 21
`
`Niantic's Exhibit No. 1045
`
`Page 0022
`
`Niantic's Exhibit No. 1045
`Page 0022
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 22 of 40
`
`US 2008/0262910 A1
`
`We’re going to call Bill now and tell him that you would like to talk. We’ll let him know
`
`that you’re available to start a call sometime in the time window you selected below.
`861
`
`Time window:
`
`YourPhone number.
`
`(
`
`863
`)-—-/
`
`conference last weekend.
`
`Your comments to this person
`in requesting this connection:
`
`I’m Bob Stanley. Rememberwe met at the golf
`
`FIG. 22
`
`Niantic's Exhibit No. 1045
`
`Page 0023
`
`Niantic's Exhibit No. 1045
`Page 0023
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 23 0f 40
`
`US 2008/0262910 A1
`
`QaLLeL
`
`QaJJJMILL'Ln
`
`Slams
`
`Bast
`Purchase
`
`Gamma:
`
`Hi
`
`BI
`
`k
`
`H
`
`r
`
`889
`
`885
`
`4 Hour
`
`Beta?
`871
`
`unknown
`
`3 Hour
`
`875
`
`Smith Lee
`
`1 Hour
`
`0
`
`Q
`
`$2§7
`
`877
`
`I’m Bob Stanley. Rememberwe met at E/ 881
`the golf conference last weekend.
`887 1V1“ 883
`
`879
`
`A A
`V V
`
`A A
`V V
`
`A A
`V V
`
`AK
`V 2
`
`M
`
`1 Hour
`
`531
`
`I need a quick answer.
`
`w 4Hour
`
`:2
`
`FIG. 23
`
`Niantic's Exhibit No. 1045
`
`Page 0024
`
`Niantic's Exhibit No. 1045
`Page 0024
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 24 0f 40
`
`US 2008/0262910 A1
`
`111
`
`:D F
`
`I:
`I:
`
`DDDDDI
`
`IG. 24
`
`Niantic's Exhibit No. 1045
`
`Page 0025
`
`Niantic's Exhibit No. 1045
`Page 0025
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 25 0f 40
`
`US 2008/0262910 A1
`
`911
`
`
`
`FIG. 25
`
`Niantic's Exhibit No. 1045
`
`Page 0026
`
`Niantic's Exhibit No. 1045
`Page 0026
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 26 0f 40
`
`US 2008/0262910 A1
`
`911
`
`
`
`FIG. 26
`
`Niantic's Exhibit No. 1045
`
`Page 0027
`
`Niantic's Exhibit No. 1045
`Page 0027
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 27 0f 40
`
`US 2008/0262910 A1
`
`
`
`FIG. 27
`
`Niantic's Exhibit No. 1045
`
`Page 0028
`
`Niantic's Exhibit No. 1045
`Page 0028
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 28 0f 40
`
`US 2008/0262910 A1
`
`931
`
`Advertiser:
`
`Customer: hi
`
`FIG. 28
`
`Niantic's Exhibit No. 1045
`
`Page 0029
`
`Niantic's Exhibit No. 1045
`Page 0029
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 29 0f 40
`
`US 2008/0262910 A1
`
`931
`
`you
`
`Customer: hi
`Advertiser: nice to meet
`
`FIG. 29
`
`Niantic's Exhibit No. 1045
`
`Page 0030
`
`Niantic's Exhibit No. 1045
`Page 0030
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 30 0f 40
`
`US 2008/0262910 A1
`
`111
`
`you
`
`DDDDDEE
`
`lDD
`
`FIG. 30
`
`Niantic's Exhibit No. 1045
`
`Page 0031
`
`Niantic's Exhibit No. 1045
`Page 0031
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 31 of 40
`
`US 2008/0262910 A1
`
`941
`
`Find an Advisor
`
`Search foran Advisor |:| Search
`
`943
`
`Name (Show Topic)
`
`Rating
`
`Rate
`
`Availability
`
`K 949 K
`
`947
`
`lg
`
`***t*
`(251)
`
`$1.25
`
`****fi
`(51)
`
`$1.20
`
`*tififi
`(12)
`
`$1.20
`
`Schedule
`
`K 951
`
`954
`
`Life Lessons
`
`Relationship issues?
`
`Doctor We
`
`Relationship results.
`
`M R
`
`elationship help.
`
`FIG. 31
`
`Niantic's Exhibit No. 1045
`
`Page 0032
`
`Niantic's Exhibit No. 1045
`Page 0032
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 32 0f 40
`
`US 2008/0262910 A1
`
`961
`
`Roofing blog
`
`roofing
`
`SF Roofing Experts
`800-325-4369
`
`25 years of grade "A"
`
`FIG. 32
`
`Niantic's Exhibit No. 1045
`
`Page 0033
`
`Niantic's Exhibit No. 1045
`Page 0033
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 33 of 40
`
`US 2008/0262910 A1
`
`971
`
`We’re going to call Bill now and tell him that you would like to talk. We’ll let him know
`that you’re available to start a call sometime in the time window you selected below.
`973
`
`Time window:
`
`Voice/Text Connection
`
`975
`
`0 None
`
`9 Via my phone number: (-) “—
`0 Via SIP address :I
`° VialM |:|
`
`0 Via Virtual Reality
`
`Visual Environment
`
`© Teleport me to Bill’s location
`
`0 Teleport Bill to my location
`0 Teleport us to this location: :I
`
`FIG. 33
`
`Niantic's Exhibit No. 1045
`
`Page 0034
`
`Niantic's Exhibit No. 1045
`Page 0034
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 34 0f 40
`
`US 2008/0262910 A1
`
`989
`
`Obtain the reference
`
`from virtual reality
`Browser/
`Viewer fl
`
`985
`
`
`
`
`991
`
`993
`
`995
`
`
`
`
`.
`.
`Communication
`Network
`
`VR Server(s)
`
`Database of 3D
`
`Objects
`
`Connection
`
`Provider
`
`Network for Real Time
`
`Communications
`
`983
`
`Provide the connection
`via the reference
`
`987
`
`
`
`
`Provide contact
`information
`
`Present a reference
`
`on behalf of User A
`
`FIG. 34
`
`Niantic's Exhibit No. 1045
`
`Page 0035
`
`Niantic's Exhibit No. 1045
`Page 0035
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 35 0f 40
`
`US 2008/0262910 A1
`
`1003
`
`1005
`
`Avatar
`B
`
`Call
`<—>
`
`Controller
`
`Call
`
`
`
`Interaction
`
`FIG. 35
`
`Niantic's Exhibit No. 1045
`
`Page 0036
`
`Niantic's Exhibit No. 1045
`Page 0036
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 36 0f 40
`
`US 2008/0262910 A1
`
`1003
`
`1005
`
`||
`
`Ca
`
`Interaction
`
`Avatar
`
`B
`
`
`
`1009
`
`Call
`
`1001
`
`.ontroller
`#11007
`J“
`
`Interaction
`
`FIG. 36
`
`Niantic's Exhibit No. 1045
`
`Page 0037
`
`Niantic's Exhibit No. 1045
`Page 0037
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 37 of 40
`
`US 2008/0262910 A1
`
`VR Server(s)
`
`1011
`
`1013
`
`Connection
`
`
`
`Provider
`
`1017
`
`1015
`
`User
`
`B
`
`User
`
`A
`
`FIG. 37
`
`Niantic's Exhibit No. 1045
`
`Page 0038
`
`Niantic's Exhibit No. 1045
`Page 0038
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 38 0f 40
`
`US 2008/0262910 A1
`
`Plumber Pros
`
`Reliable service for years
`
`1-800-Plumber
`
`FIG. 38
`
`Niantic's Exhibit No. 1045
`
`Page 0039
`
`Niantic's Exhibit No. 1045
`Page 0039
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 39 0f 40
`
`US 2008/0262910 A1
`
`1104
`
`
`
`
`.
`Microprocessor(s)
`
`Memory (e.g., ROM, Volatile RAM,
`Nonvolatile Memory, such as hard
`drive, flash memory)
`
`Inter-connect
`
`
`
`
`I/O
`I/O Device(s)
`
`COMFOHGNS)
`(e.g. mouse, or keyboard, or
`modem, or network interface,
`or printer, or scanner, or video
`
`Display Controller
`
`& Display Device
` camera)
`
`
`
`FIG. 39
`
`Niantic's Exhibit No. 1045
`
`Page 0040
`
`Niantic's Exhibit No. 1045
`Page 0040
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 40 0f 40
`
`US 2008/0262910 A1
`
`Assign to an advertisement a reference to be used to request for a
`connection for real time communications
`
`1201
`
`Present the advertisement including the reference to a customer in a
`virtual reality world
`
`1203
`
`Receive a request for a connection via the reference embedded in the
`advertisement presented to the customer in the virtual reality world
`
`1205
`
`Connect the customer to an advertiser of the advertisement for real
`time communications in response to the request
`
`1207
`
`of the customer and the advertiser for real time communications via the
`
`Charge the advertiser an advertisement fee based on the connecting
`
`advertisement presented in the virtual reality world
`
`1209
`
`FIG. 40
`
`Niantic's Exhibit No. 1045
`
`Page 0041
`
`Niantic's Exhibit No. 1045
`Page 0041
`
`

`

`US 2008/0262910 A1
`
`Oct. 23, 2008
`
`METHODS AND SYSTEMS TO CONNECT
`PEOPLE VIA VIRTUAL REALITY FOR REAL
`TIME COMMUNICATIONS
`
`TECHNOLOGY FIELD
`
`[0001] At least some embodiments of the disclosure relate
`to communication connections in general and more particu-
`larly but not limited to connecting people Via Virtual reality
`for real time communications.
`
`BACKGROUND
`
`[0002] Virtual reality (VR) can be used to create an illusion
`of reality or imagined reality. For example, a data processing
`system can be used to simulate a real or imaginary system and
`provide an environment for a user to interact with the simu-
`lated system. A user can perform operations on the simulated
`system, explore the simulated system and receive feedback in
`real time.
`
`[0003] A virtual reality environment may primarily provide
`visual experiences, displayed on a computer screen or
`through stereoscopic display devices, such as head-mount
`displays (HMD), liquid crystal display (LCD) shutter glasses,
`polarized glasses, anaglyph glasses, etc. A three-dimensional
`(3D) system can be simulated such that the visual experience
`of the user depends on the viewpoint of the user; and the user
`may continuously adjust his or her viewpoint to obtain a
`personal view of the simulated system in real time. Some
`virtual reality environments provide additional sensory expe-
`riences, such as sound, touch, etc., (e.g., through speakers or
`headphones for audio, haptic systems for motion or force
`feedback, etc.).
`[0004] A virtual reality environment can offer users immer-
`sion, navigation, and manipulation. A virtual reality environ-
`ment can make the users feel that they are present in the
`simulated world and their visual experience in the virtual
`world more or less matches what they expect from the simu-
`lated environment, a sensation sometime referred to as
`engagement or immersion.
`[0005] Examples of virtual reality environments include
`various interactive computer environments, such as text-ori-
`ented on-line forums, multiplayer games, and audio and
`visual simulations of a system. For example, a personal com-
`puter can be used to simulate the view of a three-dimensional
`space on a computer screen and allow the user to virtually
`walk around and visually inspect the space; and via a data
`communication network many users can be immersed in the
`same simulation, each perceiving it from a personal point of
`view.
`
`Some virtual reality worlds support a Massively
`[0006]
`Multiplayer Online Role Playing Game (MMORPG),
`in
`which a user represented by an avatar can interact with other
`users who are also represented by their corresponding ava-
`tars. Controlled by an input device such as a keyboard, an
`avatar can move in the virtual reality world and even fly
`around to explore, meet people, engage in text chat, etc. To
`simplify the navigation process, an avatar may also be tele-
`ported directly to a specific location in the virtual reality
`world. When an avatar representing a different person is in the
`view, this person/avatar can be selected to start a conversation
`(e. g., text chat).
`[0007] An avatar includes an image that represents a user.
`The appearance of an avatar may or may not resemble the
`user. An avatar may be in the shape of a human being, a
`
`cartoon character, or other objects. An avatar may be based on
`one or more photographs of the user. For example, a photo
`image of a user may be mapped to generate an avatar that
`simulate the look and feel of the user. Alternatively, an avatar
`may not have any resemblance with the actual appearance of
`the user, to allow the user a complete different virtual life in a
`virtual community.
`[0008]
`Some virtual reality worlds have a virtual currency
`to support economical activities. A residence of the virtual
`world may provide services to earn moneys in the virtual
`currency and use the virtual currency to purchase virtual
`objects. For example, residences may buy land and build their
`own objects, create and interact as if they were living another
`life. The virtual currency may or may not be exchangeable
`with any real world currency.
`[0009]
`In the real world, people can use telephone systems
`to conduct real time two-way voice communications without
`having to be at the same physical location. Traditional land-
`line based telephone systems connect one telephone set to
`another through one or more switching centers, operated by
`one or more telephone companies, over a land-line based
`telephone network which was typically a circuit switched
`network.
`
`[0010] Current telephone systems may also use a packet
`switched network for a telephone connection. A packet
`switched network is typical in a computer data environment.
`Recent developments in the field of Voice over lntemet Pro-
`tocol (VolP) allow the delivery ofvoice information using the
`Internet Protocol GP), in which voice information is pack-
`aged in a digital form of discrete packets rather than in the
`traditional
`circuit-committed protocols of
`the public
`switched telephone network (PSTN).
`[0011] Cellular communication networks allow a cellular
`phone to connect to a nearby cellular base station through an
`air interface for wireless access to a telephone network.
`Recent developments in wireless telephone systems allow not
`only voice communications but also data communications.
`For example, cellular phones can now receive and send mes-
`sages through a Short Message Service (SMS), a Multimedia
`Message Service (MMS), or data communication connec-
`tions. For example, web pages can be retrieved through wire-
`less cellular links and displayed on cellular phones. Wireless
`Application Protocol (WAP) has been developed to overcome
`the constraints of relatively slow and intermittent nature of
`wireless links to access information similar or identical to
`World Wide Web.
`
`[0012] Telephone systems are frequently used in conduct-
`ing business. Telephone numbers are typically provided in
`advertisements, web sites, directories, etc., as a type of con-
`tact information to reach businesses, experts, persons, etc.
`[0013] The lntemet provides another communication
`media that can also be used as an advertisement media to
`
`reach globally populated web users. For example, advertise-
`ments can be included in a web page that is frequently visited
`by web users. Typically, advertisements included in web
`pages contain only a limited amount of information (e.g., a
`small paragraph, an icon, etc.); and links in the advertise-
`ments are used to direct the visitors to the web sites of the
`advertisers for further detailed information. For certain
`
`the advertisers pay for the advertisements
`arrangements,
`based on the number ofvisits directed to their web sites by the
`links in the advertisements, or based on the number of pre-
`sentations of the advertisements.
`
`Niantic's Exhibit No. 1045
`
`Page 0042
`
`Niantic's Exhibit No. 1045
`Page 0042
`
`

`

`US 2008/0262910 A1
`
`Oct. 23, 2008
`
`Performance based advertising generally refers to a
`[0014]
`type of advertising in which an advertiser pays only for a
`measurable event that is a direct result of an advertisement
`
`being viewed by a consumer. For example, paid inclusion
`advertising is a form of performance-based search advertis-
`ing, in which an advertisement is included within a result
`page of a keyword search. Each selection (“click”) of the
`advertisement from the results page is the measurable event
`for which the advertiser pays. In other words, payment by the
`advertiser is on a per click basis in such paid inclusion adver-
`tising.
`
`SUMMARY OF THE DESCRIPTION
`
`[0015] Methods and systems for connecting people for real
`time communications via a virtual reality environment are
`described here. Some embodiments are summarized in this
`section.
`
`[0016] One embodiment includes: a virtual reality server to
`host a virtual reality world and to present, to a customer in the
`virtual reality world, an advertisement including a reference
`assigned to the advertisement; a session border controller to
`interface with a packet switched network; and one or more
`telecommunication servers coupled to the sessionborder con-
`troller to connect the customer to an advertiser of the adver-
`
`time communications in response to a
`tisement for real
`request received via the reference embedded in the advertise-
`ment and presented to the customer in the virtual reality
`world; where the advertiser is charged an advertisement fee
`based on connecting the customer and the advertiser for real
`time communications via the advertisement presented in the
`virtual reality world.
`[0017]
`In one embodiment, a method includes: assigning a
`reference to an advertisement, the reference to be used to
`request for a connection for real time communications; pre-
`senting, to a customer in a virtual reality world, the advertise-
`ment including the reference; receiving a request for a con-
`nection via the reference embedded in the advertisement
`
`presented to the customer in the virtual reality world; and in
`response to the request, connecting the customer to an adver-
`tiser of the advertisement for real time communications. In
`
`one embodiment, the advertiser is charged an advertisement
`fee based on the connecting ofthe customer and the advertiser
`for real time communications via the advertisement presented
`in the virtual reality world.
`[0018] The present disclosure includes methods and appa-
`ratuses which perform these methods, including data process-
`ing systems which perform these methods, and computer
`readable media which when executed on data processing
`systems cause the systems to perform these methods.
`[0019] Other features will be apparent from the accompa-
`nying drawings and from the detailed description which fol-
`lows.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0020] The disclosure is illustrated by way of example and
`not limitation in the figures of the accompanying drawings in
`which like references indicate similar elements.
`
`FIG. 1 illustrates an example of advertising a tele-
`[0021]
`phone reference in virtual reality to connect customers with
`an advertiser according to one embodiment.
`[0022]
`FIG. 2 shows a method to establish connections for
`real time communications according to one embodiment.
`
`FIG. 3 illustrates a user interface for the creation of
`[0023]
`an advertisement according to one embodiment.
`[0024]
`FIG. 4 illustrates an example of a user interface to
`manage availability for receiving phone calls according to
`one embodiment.
`
`FIG. 5 shows a diagram illustrating a method to
`[0025]
`select a type of tracking mechanism with a corresponding
`reference for embedding in an advertisement according to
`one embodiment.
`
`FIG. 6 illustrates an example oftelephone call track-
`[0026]
`ing mechanisms which can be selected according to one
`embodiment.
`
`FIG. 7 shows a diagram of a system to make and
`[0027]
`track phone connections according to one embodiment.
`[0028]
`FIG. 8 shows a system including a connection server
`configured on a packet switched network according to one
`embodiment.
`
`FIG. 9 shows a connection server according to one
`[0029]
`embodiment.
`
`FIG. 10 shows examples of delivering communica-
`[0030]
`tion leads according to some embodiments.
`[0031]
`FIG. 11 shows a pay per deal advertisement process
`according to one embodiment.
`[0032]
`FIG. 12 shows a method to track a deal resulting
`from a real time communication connection provided in
`response to an advertisement according to one embodiment.
`[0033]
`FIG. 13 shows an example of a user interface which
`allows an advertiser to define a deal for a pay per deal adver-
`tisement process according to one embodiment.
`[0034]
`FIG. 14 shows an example of a user interface which
`allows an advertiser to specify an offer of an advertisement
`fee for a pay per deal advertisement process according to one
`embodiment.
`
`FIG. 15 illustrates an example of a user interface to
`[0035]
`track call activities according to one embodiment.
`[0036]
`FIG. 16 illustrates a method to determine a bid
`instance based on a maximum bid.
`
`FIG. 17 illustrates a list sorting process to increase
`[0037]
`revenue for a media channel in a seller network according to
`one embodiment.
`
`FIG. 18 shows a diagram of a system to make offline
`[0038]
`selection of advertisers according to one embodiment.
`[0039]
`FIG. 19 shows a diagram of a telephone connection
`system for ofiline selection of advertisers according to one
`embodiment.
`
`FIG. 20 illustrates a method to prompt a customer
`[0040]
`responding to an advertisement according to one embodi-
`ment.
`
`FIG. 21 shows a method to track calls for specific
`[0041]
`keywords according to