as) United States
`a2) Patent Application Publication 10) Pub. No.: US 2008/0262910 Al
` ALTBERGetal. (43) Pub. Date: Oct. 23, 2008
`
`
`
`US 20080262910A1
`
`(54) METHODS AND SYSTEMS TO CONNECT
`PEOPLEVIA VIRTUAL REALITY FOR REAL
`TIME COMMUNICATIONS
`
`(22)
`
`Filed:
`
`Apr. 20, 2007
`
`Publication Classification
`
`(75)
`
`Inventors:
`
`Ebbe ALTBERG,Mill Valley, CA
`
`CA(US)RonHIRSON, eaneiseo,
`
`san
`,
`Ron
`;
`Francisco, CA (US); Ben Harris
`LYON,San Francisco, CA (US);
`Paul G. MANCA. Oakland. CA
`(US); Sean VAN DER LINDEN
`>
`Bekeley, CA (US); Virginia
`Hong-Tia YANG Eoster City, CA
`(US)
`;
`;
`
`Correspondence Address:
`GREENBERG TRAURIG,LLP (SV)
`IP DOCKETING
`2450 COLORADO AVENUE,SUITE 400E
`SANTA MONICA,CA 90404 (US)
`
`(73) Assignee:
`
`UTBK,INC., Dover, DE (US)
`
`(21) Appl. No.:
`
`11/737,975
`
`(51)
`
`Int. Cl.
`G0630/00
`
`(2006.01)
`
`(52) US. CM. cicecsccseessessssssssseessssssssssseees 705/14; 715/757
`
`(57)
`
`ABSTRACT
`.
`.
`Methods and systems for connecting people for real time
`communications via a virtual reality environment. One
`embodimentincludes:a virtualreality server to host a virtual
`reality world and to present, to a customerin the virtualreality
`world, an advertisement including a reference assigned to the
`advertisement; a session border controller to interface with a
`packet switched network; and one or more telecommunica-
`tion servers coupled to the session border controller to con-
`nect the customer to an advertiser of the advertisement for
`
`real time communications in response to a request received
`via the reference embedded in the advertisement and pre-
`sented to the customer in the virtual reality world. In one
`embodiment, the advertiser is charged an advertisement fee
`based on connecting the customer and the advertiser for real
`time communications via the advertisement presented in the
`virtual reality world.
`
`User Device A
`(e.g., Cellular Phone)
`
`User Device C
`(e.g., Computer)
`
`User Device E
`(e.g., Newspaper)
`
`Media Channel A
`(e.g., Web Server)
`
`Media Channel C
`(e.g., Short Messaging
`Service Center)
`
`Media Channel E
`(e.g., Cable Television)
`
`Media Channel G
`e.g., Radio Station)
`
`Phone X
`
`Communication
`Network
`257
`
`Connection
`Server
`
`Target
`Phone A
`
`Target
`Phone B
`
`Target
`
`Niantic's Exhibit No. 1045
`Page 001
`
`Niantic's Exhibit No. 1045
`Page 001
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 1 of 40
`
`US 2008/0262910 Al
`
`Co
`
`aqq
`
`c
`Oo
`oO
`qo
`
`faco
`
`co
`aq
`
`FIG. 1
`
`Niantic's Exhibit No. 1045
`Page 002
`
`Niantic's Exhibit No. 1045
`Page 002
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 2 of 40
`
`US 2008/0262910 Al
`
`131
`
`Present the
`reference
`4
`
`127
`
`Provide a reference
`;
`representing the contact
`
`Request a connection via
`the reference
`
`123
`
`Track connections madevia the
`referenceforbilling
`Connection
`i — Database
`
`Provider
`
`125
`
`Make a connection
`between users A and B
`using the reference
`
`
`
`121
`
`Provide a contactfor real
`time communication
`
`FIG. 2
`
`Niantic's Exhibit No. 1045
`Page 003
`
`Niantic's Exhibit No. 1045
`Page 003
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 3 of 40
`
`US 2008/0262910 Al
`
`Create Ad
`
`Help
`
`Your ad is very important. Tell customers exactly what you’re selling and why they should call you. Please
`
`
`review ourPayPerCallAdGuidelinesto ensure your ad is accepted and gets new customerscalling your
`business today.
`AdLocation Info
`
`Business Name:[ (Sorry, no phone numbers)
`(0 Use my AccountInformation
`
`Address2:[ (Optional)
`
`You'll be able to include more information aboutyour offer on the businessprofile page.Leammore
`
`State:
`
`Zip Code: []-
`
`Phone Number:
`
`Fax:
`
`Enter the number where you'd like to receivecalls
`
`Ad Marketing Message
`Millions of people online will see your ad. So, in line 1 write a strong headline explaining what you're
`selling. To get people calling your business, include a promotional offer in line 2. This encourages buyers
`to call you now! Please note: Line 1 and Line 2 must each a complete sentence.Lipsforsuccess
`Examples of Promotional Offers:
`- Call today and get $5off.
`- Free consultation — limited time.
`- Call now and save 10%.
`
`FIG. 3
`
`Niantic's Exhibit No. 1045
`Page 004
`
`Niantic's Exhibit No. 1045
`Page 004
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 4 of 40
`
`US 2008/0262910 Al
`
` Welcome Back
`
`eJack101
`
`
`My Availability
`
`Call Me At:
`
`
`
`161
`Work
`415-248-4000
`Mon
`
`Home
`415-248-4128
`
`
`Cell
`415-248-4100
`
`
`+595Satenet Thu |
`
`
`Available to take calls (takeme"OffCall")|
`
`
`
`
`
`
`WeekStarting Attempted Calls=Missed Calls Calls Call Minutes
`
`
`
`
`Jan24115 3 12 1 hour, 35 minutes
`
`
`42 minutes
`2
`6
`
`
`
`
`48 minutes
`0
`8
`
`1
`11
`
`
`1 hour, 15 minutes
`
`
`Show Details
`
`155
`
`
`My Results
`
`153
`
`97
`
`See Graphs
`
`FIG. 4
`
`Niantic's Exhibit No. 1045
`Page 005
`
`Niantic's Exhibit No. 1045
`Page 005
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 5 of 40
`
`US 2008/0262910 Al
`
`Referencesfor Call Tracking
`
`Local Phone
`Numbers
`
`171
`
`Extensions
`
`SIP URIs/
`addresses
`
`Click-to-Assign
`References
`
`Click-to-Callback
`References
`
`179
`
`183
`
`185
`
`187
`
`800-Numbers
`
`888-Numbers
`
`877-Numbers
`
`866-Numbers
`
`
`
`189
`
`191
`
`Advertisement
`
`Reference
`
`"8
`
`Assigned
`
`Assign (e.g., based on call volume,
`
`conversion rate, revenue potential, category,
`geography, demandpartner,etc.)
`
`FIG. 5
`
`Niantic's Exhibit No. 1045
`Page 006
`
`Niantic's Exhibit No. 1045
`Page 006
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 6 of 40
`
`US 2008/0262910 Al
`
`215
`
`Media Channel
`
`Customer
`
`Call the assigned
`phone number
`
`Advertisement
`
`Assigned phone
`number
`
`ay
`
`209
`
`
`Gh
`
`phone number
`aetl
`Connection Provider
`207
`
`+~—_ Assigned phone number
`
`
`
`phone number
`
`v
`v
`.
`Media 3 Advertiser's
`Channel
`Phone number
`
`2
`
`°
`
`Database
`
`,
`Call the advertiser's
`phone number
`
`NODOoi
`
`Advertiser
`
`201
`
`FIG. 6
`
`Niantic's Exhibit No. 1045
`Page 007
`
`Niantic's Exhibit No. 1045
`Page 007
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 7 of 40
`
`US 2008/0262910 Al
`
`Media Channel A
`(e.g., Web Server)
`
`Media Channel C
`
`(e.g., Short Messaging
`Service Center)
`
`User Device C
`(e.g., Computer)
`
`Communication
`
`Media Channel E
`(e.g., Cable Television)
`
`Media Channel G
`(e.g., Radio Station)
`
`Connection
`Server
`
`Encoded Target
`Phone Numbers
`
`FIG. 7
`
`Niantic's Exhibit No. 1045
`Page 008
`
`Niantic's Exhibit No. 1045
`Page 008
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 8 of 40
`
`US 2008/0262910 Al
`
` Callee
`Caller
`
`271
`
`Telecommunication
`Carrier
`
`Packet Switched
`Network
`
`279
`
`
`
`
`Connection
`Server
`
`FIG. 8
`
`Niantic's Exhibit No. 1045
`Page 009
`
`Niantic's Exhibit No. 1045
`Page 009
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 9 of 40
`
`US 2008/0262910 Al
`
`
`
` Packet
`
`Switched
`Network
`
`Session Border
`Controller
`
`Connection
`Server
`
`
`
`FIG. 9
`
`Niantic's Exhibit No. 1045
`Page 0010
`
`Niantic's Exhibit No. 1045
`Page 0010
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 10 0f 40
`
`US 2008/0262910 Al
`
`333
`
`Advertisement
`
`
`
`341
`
`Communication
`
`Product/Service
`Request
`
`351
`
`Order
`
`357
`
`335 ‘Lene|
`
`Customer's
`Contact Info
`
`353
`
`Person
`Verification
`
`
`
`359
`
`Appointment
`Request
`
`355
`
`:
`°
`
`Communication
`Gateway
`
`Database
`
`331
`
`Ref
`clerence
`
`Advertiser's
`Contact Info
`
`Communication Channel
`
`361
`
`363
`
`365
`
`367
`
`369
`
`371
`
`373
`
`
`
`
`
`
`
`
`
`, Web|ceeInstant Voice Video SMS
`
`
`
`343
`
`Advertiser
`
`FIG. 10
`
`Niantic's Exhibit No. 1045
`Page 0011
`
`Niantic's Exhibit No. 1045
`Page 0011
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 11 of 40
`
`US 2008/0262910 Al
`
`387
`
`Advertiser
`
`Charge for the advertisement
`when there is a deal
`
`391
`
`Advertiser's
`
`Communication
`Reference
`
`3
`
`303
`
`Provider
`Contact
`Advertisement
`
`Connection
`
`
`
`
`
`Deal Detector
`
`Transaction
`Handler
`
`381
`
`Customer
`
`FIG. 11
`
`Niantic's Exhibit No. 1045
`Page 0012
`
`Niantic's Exhibit No. 1045
`Page 0012
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 12 of 40
`
`US 2008/0262910 Al
`
`407
`
`Advertiser
`
`Chargefor the advertisement
`when thereis a deal
`
`t
`411
`
`
`Deal Detector
`
`
`Connection
`
`Record
`
`403
`
`
`
`Connection
`
`
`Provider
`
`
`401 _
`
`“
`
`409
`
`Transaction
`
`
`
`Handler
`
`FIG. 12
`
`Niantic's Exhibit No. 1045
`Page 0013
`
`Niantic's Exhibit No. 1045
`Page 0013
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 13 of 40
`
`US 2008/0262910 Al
`
`Define a Deal
`
`You pay for your advertisementfor each deal you get. You can define what you deem as
`a deal.
`
`C1 \MWesaythere is a deal by dialing this sequence:[
`
`Deal Event:
`
`CJ The customertalks to meforat least [ minutes
`CJ The customer agrees to pay
`
`CF The customer places an order
`
`CJ The customer places a bid
`(C0 The customervisits my web page at this URL:[i
`(J The customer presses the submit button in the above web page
`
`CO The customer agreesto provide an address to me
`
`(J The customer answersthefollowing question(s)
`
`Question 1:
`
`> Mor
`
`tion
`
`FIG. 13
`
`Niantic's Exhibit No. 1045
`Page 0014
`
`Niantic's Exhibit No. 1045
`Page 0014
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 14 of 40
`
`US 2008/0262910 Al
`
`Your Offer of Advertisement Fee
`
`You pay for your advertisement for each deal you get from the customer’s call generated from
`your advertisement. You can define how much you offer to pay for each deal.
`
`[ deals per month
`
`Advertisement Fee:
`
`(J This percentage of what the customer pays: [ %
`D0 Alump sum of:
`per deal
`CJ This percentage of what | pay the customer. [ %
`CD A subscription fee of:
`per monthif I/we get more than
`
`FIG. 14
`
`Niantic's Exhibit No. 1045
`Page 0015
`
`Niantic's Exhibit No. 1045
`Page 0015
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 15 of 40
`
`US 2008/0262910 Al
`
`
`
`Overview | Bids |CallDate
`
`ForListing:|AllListings=||
`
`Time Period: ©|MonthtoDate|V7
`© ‘rom [10/3/2008to
`cnr
`
`$15.00
`
`Calls for All Listings for Oct 3, 2003 — Nov 10, 2003
`
`CallID
`
`Bid ID
`
`Listing Title
`
`Call Date
`
`Next
`Amount
`Charged Highest Bid
`
`Amount
`Bid
`
`5717848
`5717656
`
`428566
`428566
`
`Jim's Professional Plumbing Oct292:24PM $13.01
`Jim's Professional Plumbing
`Oct 292:14PM $14.01
`
`$13.00
`$14.00
`
`$15.00
`
`445
`
`447
`
`449
`
`FIG. 15
`
`Niantic's Exhibit No. 1045
`Page 0016
`
`Niantic's Exhibit No. 1045
`Page 0016
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 16 of 40
`
`US 2008/0262910 Al
`
`In Increasing
`
`
`
`501
`
`
`505
`
`°
`e
`
`Competitor Bid n
`
`Maximum Bid of the Advertisement
`
`Bid Instance
`
`507
`
`Competitor Bid n+1
`
`509
`
`Order Competitor Bid 1
`
` 903
`
`
`One Increment (e.g., 1 cent) Highest among competitor bids that
`
`
`are no higher than the Maximum
`Bid of the Advertisement
`
`FIG. 16
`
`Niantic's Exhibit No. 1045
`Page 0017
`
`Niantic's Exhibit No. 1045
`Page 0017
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 17 of 40
`
`US 2008/0262910 Al
`
`601
`
`
`
`Advertiser A - (866)423-9848 (Call Locally - Toll Free)
`eit”
`Free delivery in San Francisco.Afull service florist since 1987.
`2625 Ocean Ave., San Francisco, CA
`
`
`- (866)654-8982 (Call Locally - Toll Free)
` Wid Advertiser
`635~
`Creating smiles across America since 1956.
`1 Post St., San Francisco, CA
`
`
`
`
`on
`‘ae RankCandidatesaccording to
`
`633
`
`Wid Advertiser B - (866)673-1200 (Call Locally - Toll Free)
`Send flowers with same day delivery from San Francisco's oldestflorists.
`1396 California St., San Francisco, CA
`
`Potential Revenue for
`Presentation or Selection
`
`Revenue Per Call
`Advertiser Price Per Call|Earn Percentage
`
`609
`611
`613
`615
`Compute
`Potential
`
`641
`
`643
`
`645
`
`607,
`
`Advertiser C
`
`$8.00
`
`75%
`
`Advertiser Database
`
`$10.00x75% = $7.50
`
`$9.00 «60% = $5.40
`
`$8.00 x75% = $6.00
`
`
`
`FIG. 17
`
`Niantic's Exhibit No. 1045
`Page 0018
`
`Niantic's Exhibit No. 1045
`Page 0018
`
`€
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 18 of 40
`
`US 2008/0262910 Al
`
`Advertisement for
`Advertiser Group T
`701
`
`Number M
`
`Phone
`
`Advertisement
`Delivery
`
`Database
`
`Connection Server at
`Phone Number M
`
`Advertiser
`
`Niantic's Exhibit No. 1045
`Page 0019
`
`Niantic's Exhibit No. 1045
`Page 0019
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 19 of 40
`
`US 2008/0262910 Al
`
`Advertiser|Geographical Advertisement|AvailabilityPhone
`
`
`Area
`Number(s)
`Bid
`773
`775
`fi
`
`ig
`
`
`
`Advertiser Information 770
`
`From|To |Time|Duration] Media|Advertise-
`
`Phone |Phone Channel|ment Bid
`
`
`761|763|765|767 769 762
`
`
`
`
`
`e
`
`Connection Records
`
`760
`
`:
`:
`Interactive Voice
`Response(IVR) System
`
`Identification (ANI) Unit
`
`Geographical Area
`Locator
`
`Automatic Number
`
`737
`
`739
`
`7A
`
`Outgoing Phone
`Connections
`
`Control
`Center
`
`Telephone
`Switching Equipment
`
`Telephone
`Receiving Equipment
`
`751
`
` 753
`
`Incoming Phone
`Connections
`
`Human Concierge
`
`FIG. 19
`
`Niantic's Exhibit No. 1045
`Page 0020
`
`Niantic's Exhibit No. 1045
`Page 0020
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 20 of 40
`
`US 2008/0262910 Al
`
`801
`
`Phone
`Number
`
`
`
`Customer Dial the
`Phone Number
`
`
`
`
`Advertiser's
`Phone Number
`
`Description Price Bid Per Call
`
`Customize Promptto the
`Customer Based on the
`Performanceof the
`Advertisement
`
`Geographic Area
`of Service
`
`Conversion Rate
`
`8
`
`Recording of
`Custom Prompt
`
`Call Frequency
`
`Listing A
`
`
`
`Business Name
`
`Advertisement
`Categories
`
`Database
`
`805
`
`FIG. 20
`
`Niantic's Exhibit No. 1045
`Page 0021
`
`Niantic's Exhibit No. 1045
`Page 0021
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 21 of 40
`
`US 2008/0262910 Al
`
`Present
`Advertisements
`
`847
`
`Collect Statistics
`on Keywords
`
`Generate
`
`
`849
`
`
`Advertisement
`
`Performance
`Indicators
`851
`
`Select Tracking
`Mechanisms
`845
`
`$43
`
`Perform Searches
`Using Keywords
`841
`
`Rank
`Advertisements
`
`FIG. 21
`
`Niantic's Exhibit No. 1045
`Page 0022
`
`Niantic's Exhibit No. 1045
`Page 0022
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 22 of 40
`
`US 2008/0262910 Al
`
`We're going to call Bill now and tell him that you would like to talk. We'll let him know
`that you're available to start a call sometimein the time window you selected below.
`861
`
`in requesting this connection: —|conference last weekend.
`
`Time window:
`
`Your Phone number.
`
`(
`
`863
`
`) [at] -fear7y
`
`Your comments to this person
`
`|'m Bob Stanley. Rememberwe met at the golf
`
`FIG. 22
`
`Niantic's Exhibit No. 1045
`Page 0023
`
`Niantic's Exhibit No. 1045
`Page 0023
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 23 of 40
`
`US 2008/0262910 Al
`
`Hide
`
`Block
`
`ller:
`
`889
`
`
`Purchase
`
`885
`
`Bob37 I'm Bob Stanley. Remember we met atSA7E-”~ 814 Hour 0
`
`871
`875
`gay JY SS 883
`unknown
`AX
`VW
`
`the golf conference last weekend.
`
`879
`
`
`
` 3Hour
`
`
`
`0
`
`SmithLee
`
`1 Hour
`
`$237
`
`877
`
`Tod
`
`1 Hour
`
`$37
`
`| need a quick answer.
`
`SSX
`
`4 Hour
`
`0
`
`AA
`VW
`
`AA
`VW
`
`AL
`VY
`
`eee
`
`FIG. 23
`
`Niantic's Exhibit No. 1045
`Page 0024
`
`CallerCallWithin Status Past Comment
`
`
`
`
`
`Niantic's Exhibit No. 1045
`Page 0024
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 24 of 40
`
`US 2008/0262910 Al
`
`oO
`oOo
`o
`Oo
`Oo
`Oo
`ao
`
`ao
`
`aa
`
`FIG. 24
`
`Niantic's Exhibit No. 1045
`Page 0025
`
`Niantic's Exhibit No. 1045
`Page 0025
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 25 of 40
`
`US 2008/0262910 Al
`
`
`
`FIG. 25
`
`Niantic's Exhibit No. 1045
`Page 0026
`
`Niantic's Exhibit No. 1045
`Page 0026
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 26 of 40
`
`US 2008/0262910 Al
`
`
`
`FIG. 26
`
`Niantic's Exhibit No. 1045
`Page 0027
`
`Niantic's Exhibit No. 1045
`Page 0027
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 27 of 40
`
`US 2008/0262910 Al
`
`‘SS>)
`
`TE\
`
`FIG. 27
`
`Niantic's Exhibit No. 1045
`Page 0028
`
`Niantic's Exhibit No. 1045
`Page 0028
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 28 of 40
`
`US 2008/0262910 Al
`
`Advertiser:
`
`Customer:hi
`
`FIG. 28
`
`Niantic's Exhibit No. 1045
`Page 0029
`
`Niantic's Exhibit No. 1045
`Page 0029
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 29 of 40
`
`US 2008/0262910 Al
`
`you
`
`Customer: hi
`Advertiser: nice to meet
`
`FIG. 29
`
`Niantic's Exhibit No. 1045
`Page 0030
`
`Niantic's Exhibit No. 1045
`Page 0030
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 30 of 40
`
`US 2008/0262910 Al
`
`co
`Co
`o
`Co
`Oo
`o
`Co
`
`you
`
`aq
`
`aC
`
`FIG. 30
`
`Niantic's Exhibit No. 1045
`Page 0031
`
`Niantic's Exhibit No. 1045
`Page 0031
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 31 of 40
`
`US 2008/0262910 Al
`
`Find an Advisor
`
`SearchforanAdvisor [| Search
`
`943
`
`Name (Show Topic)
`
`Rating
`
`Rate
`
`Availability
`
`951
`
`Life Lessons
`Relationship issues?
`
`Doctor We
`Relationship results.
`
`Joe Smith
`Relationship help.
`
`kkkknk
`(251)
`
`$1.25
`
`RKKKSE
`(51)
`
`$1.20
`
`$1.20
`
`KRKKAS
`(12)
`A
`
`FIG. 31
`
`Niantic's Exhibit No. 1045
`Page 0032
`
`Niantic's Exhibit No. 1045
`Page 0032
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 32 of 40
`
`US 2008/0262910 Al
`
`Roofing blog
`
`Roofing
`
`roofing
`
`SF Roofing Experts
`800-325-4369
`25 years of grade "A"
`
`FIG. 32
`
`Niantic's Exhibit No. 1045
`Page 0033
`
`Niantic's Exhibit No. 1045
`Page 0033
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 33 of 40
`
`US 2008/0262910 Al
`
`We're going to call Bill now andtell him that you would like to talk. We'll let him know
`that you're available to start a call sometimein the time window you selected below.
`973
`
`Time window:
`
`Voice/Text Connection
`
`975
`
`o None
`
`@ Via my phone number. ([415]) [731 ]-[0277]
`© Via SIP address[
`oViam[|
`o Via Virtual Reality
`
`Visual Environment
`
`© Teleport me to Bill’s location
`
`© Teleport Bill to my location
`
`© Teleport us to this location:
`
`FIG. 33
`
`Niantic's Exhibit No. 1045
`Page 0034
`
`Niantic's Exhibit No. 1045
`Page 0034
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 34 of 40
`
`US 2008/0262910 Al
`
`989
`
`Obtain the reference
`
`983
`
`Provide the connection
`via the reference
`
`985
`
`987
`
`Communication Connection
`
`Browser/
`Viewer
`
`og
`
`Network
`
`991
`
`993
`
`995
`
`from virtual reality
`
`
`
`VRServer(s) ~ KO
`
`Provider
`
`Network for Real Time
`Communications
`
`‘N eal
`
`Provide contact
`information
`
`Database of 3D
`Objects
`
`Present a reference
`on behalf of User A
`
`FIG. 34
`
`Niantic's Exhibit No. 1045
`Page 0035
`
`Niantic's Exhibit No. 1045
`Page 0035
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 35 of 40
`
`US 2008/0262910 Al
`
`1003
`
`1005
`
`fr
`Call
`Avatar
`
`——orB Controller Call
`
`
`
`1007
`
`
`
`1001
`
`Avatar
`A
`
`KO
`
`Interaction
`
`FIG. 35
`
`Niantic's Exhibit No. 1045
`Page 0036
`
`Niantic's Exhibit No. 1045
`Page 0036
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 36 of 40
`
`US 2008/0262910 Al
`
`1003
`
`1005
`
`B
`cotter
`Avatar —y,
`Interaction “1 1007
`
`1001=]ET}
`
`
`Call
`
`Interaction
`
`FIG. 36
`
`Niantic's Exhibit No. 1045
`Page 0037
`
`Niantic's Exhibit No. 1045
`Page 0037
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 37 of 40
`
`US 2008/0262910 Al
`
`VR Server(s)
`
`1011
`
`1013
`
`
`
`Connection
`Provider
`
`1017
`
`1015
`
`User
`B
`
`User
`A
`
`FIG. 37
`
`Niantic's Exhibit No. 1045
`Page 0038
`
`Niantic's Exhibit No. 1045
`Page 0038
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 38 of 40
`
`US 2008/0262910 Al
`
`Plumber Pros
`
`Reliable service for years
`
`1-800-Plumber
`
`
`
`«9
`
`FIG. 38
`
`Niantic's Exhibit No. 1045
`Page 0039
`
`Niantic's Exhibit No. 1045
`Page 0039
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 39 of 40
`
`US 2008/0262910 Al
`
`Memory (e.g., ROM, Volatile RAM,
`Nonvolatile Memory, such as hard
`
`& Display Device
`
`
`
`Controller(s)
`
`or printer, or scanner, or video Display Controller
`
`drive, flash memory)
`
`1/0 Device(s)
`(e.g. mouse, or keyboard,or
`modem, or networkinterface,
`
`camera)
`
`FIG. 39
`
`Niantic's Exhibit No. 1045
`Page 0040
`
`Niantic's Exhibit No. 1045
`Page 0040
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 40 of 40
`
`US 2008/0262910 Al
`
`Assign to an advertisementa reference to be used to request for a
`connection for real time communications
`
`1201
`
`Present the advertisementincluding the reference to a customer ina
`virtual reality world
`
`1203
`
`Receive a request for a connection via the reference embeddedin the
`advertisement presented to the customer in the virtual reality world
`
`1205
`
`Connect the customer to an advertiser of the advertisementfor real
`time communications in responseto the request
`
`Charge the advertiser an advertisement fee based on the connecting
`of the customer and the advertiser for real time communications via the
`
`advertisement presented in the virtual reality world
`
`4207
`
`4209
`
`FIG. 40
`
`Niantic's Exhibit No. 1045
`Page 0041
`
`Niantic's Exhibit No. 1045
`Page 0041
`
`

`

`US 2008/0262910 Al
`
`Oct. 23, 2008
`
`METHODS AND SYSTEMS TO CONNECT
`PEOPLEVIA VIRTUAL REALITY FOR REAL
`TIME COMMUNICATIONS
`
`TECHNOLOGY FIELD
`
`[0001] At least some embodimentsof the disclosure relate
`to communication connections in general and more particu-
`larly but not limited to connecting people via virtual reality
`for real time communications.
`
`BACKGROUND
`
`[0002] Virtual reality (VR) can be usedto create an illusion
`of reality or imaginedreality. For example, a data processing
`system can be used to simulate a real or imaginary system and
`provide an environmentfor a user to interact with the simu-
`lated system. A user can perform operations on the simulated
`system, explore the simulated system and receive feedback in
`real time.
`
`[0003] A virtual reality environment mayprimarily provide
`visual experiences, displayed on a computer screen or
`through stereoscopic display devices, such as head-mount
`displays (HMD), liquid crystal display (LCD)shutter glasses,
`polarized glasses, anaglyph glasses, etc. A three-dimensional
`(3D) system can be simulated suchthat the visual experience
`of the user depends on the viewpoint ofthe user; and the user
`may continuously adjust his or her viewpoint to obtain a
`personal view of the simulated system in real time. Some
`virtual reality environments provide additional sensory expe-
`riences, such as sound, touch,etc., (e.g., through speakers or
`headphones for audio, haptic systems for motion or force
`feedback, etc.).
`[0004] A virtual reality environmentcan offer users immer-
`sion, navigation, and manipulation.A virtualreality environ-
`ment can make the users feel that they are present in the
`simulated world and their visual experience in the virtual
`world more or less matches what they expect from the simu-
`lated environment, a sensation sometime referred to as
`engagement or immersion.
`[0005] Examples of virtual reality environments include
`various interactive computer environments, such astext-ori-
`ented on-line forums, multiplayer games, and audio and
`visual simulations of a system. For example, a personal com-
`puter can be used to simulate the view of a three-dimensional
`space on a computer screen and allow the user to virtually
`walk around and visually inspect the space; and via a data
`communication network many users can be immersedin the
`same simulation, each perceiving it from a personalpoint of
`view.
`
`Some virtual reality worlds support a Massively
`[0006]
`Multiplayer Online Role Playing Game (MMORPG),
`in
`which a user represented by an avatar can interact with other
`users whoare also represented by their corresponding ava-
`tars. Controlled by an input device such as a keyboard, an
`avatar can move in the virtual reality world and even fly
`around to explore, meet people, engage in text chat, etc. To
`simplify the navigation process, an avatar mayalso betele-
`ported directly to a specific location in the virtual reality
`world. Whenan avatarrepresenting a different person is in the
`view,this person/avatar can be selected to start a conversation
`(e.g., text chat).
`[0007] An avatar includes an imagethat represents a user.
`The appearance of an avatar may or may not resemble the
`user. An avatar may be in the shape of a human being, a
`
`cartoon character, or other objects. An avatar may be based on
`one or more photographs of the user. For example, a photo
`image of a user may be mapped to generate an avatar that
`simulate the look andfeel of the user. Alternatively, an avatar
`maynot have any resemblance with the actual appearance of
`the user, to allow the user a complete different virtual life in a
`virtual community.
`[0008]
`Somevirtual reality worlds have a virtual currency
`to support economicalactivities. A residence of the virtual
`world may provide services to earn moneys in the virtual
`currency and use the virtual currency to purchase virtual
`objects. For example, residences may buy land and buildtheir
`own objects, create and interact as if they were living another
`life. The virtual currency may or may not be exchangeable
`with any real world currency.
`[0009]
`In the real world, people can use telephone systems
`to conductreal time two-way voice communications without
`having to be at the same physical location. Traditional land-
`line based telephone systems connect one telephoneset to
`another through one or more switching centers, operated by
`one or more telephone companies, over a land-line based
`telephone network which was typically a circuit switched
`network.
`
`[0010] Current telephone systems may also use a packet
`switched network for a telephone connection. A packet
`switched networkis typical in a computer data environment.
`Recent developmentsin the field of Voice over Internet Pro-
`tocol (VoIP)allow the delivery ofvoice information using the
`Internet Protocol (IP), in which voice information is pack-
`aged in a digital form of discrete packets rather than in the
`traditional
`circuit-committed protocols of
`the public
`switched telephone network (PSTN).
`[0011] Cellular communication networks allow a cellular
`phone to connectto a nearby cellular base station through an
`air interface for wireless access to a telephone network.
`Recent developmentsin wireless telephone systemsallow not
`only voice communications but also data communications.
`For example, cellular phones can now receive and send mes-
`sages through a Short Message Service (SMS), a Multimedia
`Message Service (MMS), or data communication connec-
`tions. For example, web pages can be retrieved through wire-
`less cellular links and displayed on cellular phones. Wireless
`Application Protocol (WAP) has been developed to overcome
`the constraints of relatively slow and intermittent nature of
`wireless links to access information similar or identical to
`World Wide Web.
`
`[0012] Telephone systems are frequently used in conduct-
`ing business. Telephone numbers are typically provided in
`advertisements, web sites, directories, etc., as a type of con-
`tact information to reach businesses, experts, persons, etc.
`[0013] The Internet provides another communication
`media that can also be used as an advertisement media to
`
`reach globally populated web users. For example, advertise-
`ments can be included in a web pagethatis frequently visited
`by web users. Typically, advertisements included in web
`pages contain only a limited amount of information (e.g., a
`small paragraph, an icon, etc.); and links in the advertise-
`ments are used to direct the visitors to the web sites of the
`advertisers for further detailed information. For certain
`
`the advertisers pay for the advertisements
`arrangements,
`based on the numberofvisits directed to their web sites by the
`links in the advertisements, or based on the numberof pre-
`sentations of the advertisements.
`
`Niantic's Exhibit No. 1045
`Page 0042
`
`Niantic's Exhibit No. 1045
`Page 0042
`
`

`

`US 2008/0262910 Al
`
`Oct. 23, 2008
`
`[0016] One embodimentincludes: a virtual reality server to
`
`hostavirtual reality world andto present, to a customerin the [0030] FIG. 10 shows examples of delivering communica-
`
`virtual reality world, an advertisement including a reference
`tion leads according to some embodiments.
`assigned to the advertisement; a session border controller to
`[0031]
`FIG. 11 showsa pay per deal advertisement process
`interface with a packet switched network; and one or more
`according to one embodiment.
`telecommunication servers coupled to the session border con-
`[0032]
`FIG. 12 shows a method to track a deal resulting
`troller to connect the customer to an advertiser of the adver-
`from a real time communication connection provided in
`response to an advertisement according to one embodiment.
`[0033]
`FIG. 13 shows an example ofa userinterface which
`allows an advertiser to define a deal for a pay per deal adver-
`tisement process according to one embodiment.
`[0034]
`FIG. 14 showsan example ofa userinterface which
`allows an advertiser to specify an offer of an advertisement
`fee for a pay per deal advertisement process according to one
`embodiment.
`
`Performancebased advertising generally refers to a
`[0014]
`type of advertising in which an advertiser pays only for a
`measurable event that is a direct result of an advertisement
`being viewed by a consumer. For example, paid inclusion
`advertising is a form of performance-based search advertis-
`ing, in which an advertisement is included within a result
`page of a keyword search. Each selection (“click”) of the
`advertisement from the results page is the measurable event
`for whichthe advertiser pays. In other words, paymentby the
`advertiser is on a perclick basis in such paid inclusion adver-
`tising.
`
`SUMMARY OF THE DESCRIPTION
`
`[0015] Methods and systems for connecting people forreal
`time communications via a virtual reality environment are
`described here. Some embodiments are summarized in this
`section.
`
`time communications in response to a
`tisement for real
`request received via the reference embeddedin the advertise-
`ment and presented to the customer in the virtual reality
`world; where the advertiser is charged an advertisement fee
`based on connecting the customer andthe advertiser for real
`time communicationsvia the advertisement presented in the
`virtualreality world.
`[0017]
`In one embodiment, a methodincludes: assigning a
`reference to an advertisement, the reference to be used to
`request for a connection for real time communications; pre-
`senting, to a customerin a virtualreality world, the advertise-
`ment including the reference; receiving a request for a con-
`nection via the reference embedded in the advertisement
`
`presented to the customerin the virtualreality world; and in
`responseto the request, connecting the customerto an adver-
`tiser of the advertisement for real time communications. In
`one embodiment, the advertiser is charged an advertisement
`fee based on the connecting ofthe customerand the advertiser
`for real time communicationsvia the advertisement presented
`in the virtual reality world.
`[0018] The present disclosure includes methods and appa-
`ratuses which perform these methods, including data process-
`ing systems which perform these methods, and computer
`readable media which when executed on data processing
`systems cause the systems to perform these methods.
`[0019] Other features will be apparent from the accompa-
`nying drawings and from the detailed description whichfol-
`lows.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0020] The disclosure is illustrated by way of example and
`not limitation in the figures of the accompanying drawings in
`whichlike references indicate similar elements.
`
`FIG. 1 illustrates an example of advertising a tele-
`[0021]
`phonereference in virtual reality to connect customers with
`an advertiser according to one embodiment.
`[0022]
`FIG. 2 shows a methodto establish connections for
`real time communications according to one embodiment.
`
`FIG.3 illustrates a user interface for the creation of
`[0023]
`an advertisement according to one embodiment.
`[0024]
`FIG. 4 illustrates an example of a user interface to
`manageavailability for receiving phone calls according to
`one embodiment.
`[0025]
`FIG. 5 shows a diagram illustrating a method to
`select a type of tracking mechanism with a corresponding
`reference for embedding in an advertisement according to
`one embodiment.
`
`FIG.6illustrates an example oftelephonecall track-
`[0026]
`ing mechanisms which can be selected according to one
`embodiment.
`[0027]
`FIG. 7 shows a diagram of a system to make and
`track phone connections according to one embodiment.
`[0028]
`FIG. 8 showsasystem including a connection server
`configured on a packet switched network according to one
`embodiment.
`[0029]
`FIG. 9 shows a connection server according to one
`embodiment.
`
`FIG. 15 illustrates an exampleofa userinterface to
`[0035]
`track call activities according to one embodiment.
`[0036]
`FIG. 16 illustrates a method to determine a bid
`instance based on a maximum bid.
`
`FIG. 17 illustrates a list sorting process to increase
`[0037]
`revenue for a media channel in a seller network according to
`one embodiment.
`
`FIG. 18 shows a diagram ofa system to makeoffline
`[0038]
`selection of advertisers according to one embodiment.
`[0039]
`FIG. 19 showsa diagram of a telephone connection
`system for offline selection of advertisers according to one
`embodiment.
`
`FIG. 20 illustrates a method to prompt a customer
`[0040]
`responding to an advertisement according to one embodi-
`ment.
`
`FIG. 21 shows a method totrack calls for specific
`[0041]
`keywords according to one embodiment.
`[0042]
`FIG. 22 showsa userinterface to collect comments
`on a request for a communication connection according to
`one embodiment.
`
`FIG. 23 showsa userinterface to manage a queue of
`[0043]
`requesters of phone connectionsto a callee according to one
`embodiment