United States Patent [19J
`Heidorn et al.
`
`[54] METHOD AND SYSTEM FOR COMPUTING
`SEMANTIC LOGICAL FORMS FROM
`SYNTAX TREES
`
`[75]
`
`Inventors: George Heidorn; Karen Jensen, both
`of Bellevue, Wash.
`
`[73] Assignee: Microsoft Corporation, Redmond,
`Wash.
`
`[ *] Notice:
`
`This patent issued on a continued pros(cid:173)
`ecution application filed under 37 CFR
`1.53( d), and is subject to the twenty year
`patent term provisions of 35 U.S.C.
`154(a)(2).
`
`[21] Appl. No.: 08/674,610
`
`[22] Filed:
`
`Jun. 28, 1996
`
`[51]
`[52]
`[58]
`
`[56]
`
`•••••••••••••••••••••••••••••••••••••••••••••••••••••• G06F 17/27
`Int. Cl. 6
`U.S. Cl. ................................................. 704/9; 707/104
`Field of Search .................................. 704/9, 8, 1, 10;
`395/12; 707/100, 101, 102, 104
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,111,398
`5,146,406
`5,386,556
`5,406,480
`5,424,947
`
`5/1992 Nunberg et al. ............................ 704/9
`9 /1992 Jensen ... ... ... ... .... ... ... ... ... ... .... ... ... 704/9
`1/1995 Hedin et al. ................................ 707/4
`4/1995 Kanno ....................................... 704/10
`6/1995 Nagao et al.
`............................... 704/9
`
`FOREIGN PATENT DOCUMENTS
`
`0413132A2
`0413132A3
`
`7/1990 European Pat. Off ..
`7/1990 European Pat. Off ..
`
`I 1111111111111111 11111 111111111111111 lllll 111111111111111 111111111111111111
`US005966686A
`[11] Patent Number:
`[45] Date of Patent:
`
`5,966,686
`*Oct. 12, 1999
`
`OTHER PUBLICATIONS
`
`Geetha,T. V. and Subramanian, R.K., "Natural Language
`Representation-a Connectionist Approach", Computer and
`Communication, New Delhi, Aug. 28, 1991, vol. 3, pp.
`294-298.
`!sahara, Hitoshi and Ishizaki, Shun, "Context Analysis Sys(cid:173)
`tem for Japanese Text", 11th International Conference on
`Computational Linguistics. Proceedings of Coling
`'86,
`Bonn, West Germany, Aug. 25-29, 1986, pp. 244-246.
`Winograd, Terry,"Computer Software for Working with
`Language", Scientific American, Sep. 1984, New York,
`U.S.A., vol. 251, No. 3, pp. 90-101.
`Jensen, Karen et al., Natural Language Processing: The
`PLNLP Approcach, Kluwer Academic Publishers, Boston,
`1993.
`Garside, Roger et al., The Computational Analysis of
`English: A Corpus-Based Approach, Longman, pp. 97-109,
`1987.
`
`Primary Examiner-Joseph Thomas
`Attorney, Agent, or Firm-Seed and Berry LLP
`ABSTRACT
`
`[57]
`
`Methods and computer systems for semantically analyzing
`natural language sentences. The natural language processing
`subsystems for morphological and syntactic analysis trans(cid:173)
`form an input sentence into a syntax parse tree. Semantic
`analysis applies three sets of semantic rules to create a
`skeletal logical form graph from a syntax parse tree. Seman(cid:173)
`tic analysis then applies two additional sets of semantic rules
`to provide semantically meaningful labels for the links of the
`logical form graph, to create additional logical form graph
`nodes for missing elements, and to unify redundant ele(cid:173)
`ments. The final logical form graph represents the complete
`semantic analysis of an input sentence.
`
`9 Claims, 69 Drawing Sheets
`
`The New Semantic Subsystem
`
`Complete
`Syntactic
`Rules
`
`2502
`
`2504
`
`Generate
`Initial
`Logical
`Form
`Graph
`
`2503
`
`Complete
`Syntax
`Parse
`Tree
`
`2505
`
`Initial
`Logical
`Form
`Graph
`
`Generate
`Semantic
`Rules
`
`2506
`
`2501
`
`Complete
`Logical
`Form
`Graph
`
`2501
`
`Syntax
`Parse
`Tree
`
`Page 1 of 80
`
`GOOGLE EXHIBIT 1022
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`\0
`O'I
`
`'"""' 0 ....,
`~ ....
`'JJ. =(cid:173)~
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`!""'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`Fig.1
`
`(PRIOR ART)
`
`Rules
`
`Semantic
`
`Rules
`Syntax
`
`Rules
`
`Morphological
`
`...
`
`. ~
`
`a
`
`aph
`rm
`gical
`
`Gr
`Po
`La
`
`.. -
`
`Tree
`Syntax
`
`~
`
`...
`
`and Senses
`
`Tokens
`
`~
`
`~
`
`Te
`ct
`ut
`Inp
`
`~
`
`~
`
`v103
`
`v102
`
`v101
`
`Subsystem
`Semantical
`
`Subsystem
`Syntactical
`
`Subsystem
`Morphological
`
`Page 2 of 80
`
`

`

`U.S. Patent
`
`Oct. 12, 1999
`
`Sheet 2 of 69
`
`5,966,686
`
`the _/203
`
`/ 204
`{
`Adj_/
`{Lemma
`Bits
`
`j
`
`205
`
`"the"
`Sing Plur W a6 Det Art
`BO Def} '\..
`
`206
`
`/
`
`212
`
`Adv
`
`{Lemma
`Bits
`
`"the"
`Wa5}
`
`/207
`208
`Senses
`{Bits J
`
`Lemma
`Cat
`Infl
`Defin
`Exs
`
`210
`
`\_ {Lemma
`Cat
`Defin
`Exs
`
`Sing Plur Wa6 Closed
`Det Art Def
`"the"
`Adj
`Adj-nil
`"used when it is clearly understood who or what is meant"
`"We have a cat and a dog. The cat(= our cat) is black and the dog
`(= our dog) white."
`"the history of China(= Chinese history)"
`"The Danes that I know work very hard."
`"Take these letters to the post office (it is understood that you know
`which post office and where it is)"},
`"- 209
`
`"the"
`Adv
`"To that extent; by that much"
`"the sooner the better."} ,
`
`"- 211
`
`(more sense records) ,
`
`}
`
`person
`{
`Noun
`
`"- 213
`
`202
`
`- - . J
`
`{Lemma
`Bits
`
`Infl
`
`"person"
`Pers3 Sing Humn Mass
`Anim Count Cone C9
`Humn sr
`Noun-default}
`
`Senses
`{Lemma
`Cat
`Defin
`Exs
`
`"person"
`Noun
`"A living human being."
`"chairperson"
`"spokesperson"
`"salesperson."}
`(more sense records)
`
`}
`
`(PRIOR ART) Fig. 2
`
`Page 3 of 80
`
`

`

`U.S. Patent
`
`Oct. 12, 1999
`
`Sheet 3 of 69
`
`5,966,686
`
`{Lemma
`Bits
`
`"who"
`Pers3 Sing Plur Rel Wh
`Humn Obj Anim}
`
`Cat
`Defin
`Exs
`
`{Lemma
`Bits
`
`"who"
`Pers3 Sing Plur Rel Wh
`Closed Hunm Obj Anim
`Pron
`"(the object form of who, used esp. in writing and careful speech)"
`"With whom?"
`"The man with whom he talked."
`"You saw whom?"
`"Whom did they see?"
`"the man (whom) they saw arriving"
`"a man (whom) you may know of"}
`(more sense records)
`
`{Lemma
`Bits
`Infl
`
`{Lemma
`Bits
`
`{Lemma
`Cat
`Infl
`Defin
`
`"i"
`Pers3 Sing TakesAn
`Noun-irreg}
`
`"I"
`Sing Norn TakesAn Persl
`Hunm Anim LexCap}
`
`"i"
`Noun
`Noun-irreg
`"The ninth letter of the modem English alphabet."}
`
`"I"
`{Lemma
`Pron
`Cat
`"Used to refer to oneself as speaker or writer."}
`De fin
`(more sense records)
`
`whom
`{
`Pron
`
`Senses
`
`i
`{
`Noun
`
`Pron
`
`Senses
`
`}
`
`met
`{
`
`Verb
`
`Senses
`
`{Lemma
`Bits
`
`Infl
`
`{Lemma
`Bits
`Cat
`
`"meet"
`Sing Plur Past
`Pastpart
`Verb-meet}
`
`"meet"
`Past Pastpart
`Verb}
`
`(PRIOR ART) Fig. 3
`
`Page 4 of 80
`
`

`

`U.S. Patent
`
`Oct. 12, 1999
`
`Sheet 4 of 69
`
`5,966,686
`
`was
`{
`
`Verb
`
`Senses
`
`my
`{
`
`Adj
`
`lj
`
`Senses
`
`{Lemma
`Bits
`Infl
`
`"be"
`Pers3 Sing Past Pers 1
`Verb-be} }
`
`{Lemma
`Bits
`Cat
`(more sense records)
`
`"be"
`Past Pastpart
`Verb}
`
`{Lemma
`Bits
`
`Infl
`
`"I"
`W a5 Det Poss Pers 1 Def
`Gen AO
`Adj-none}
`
`{Lemma
`
`"my}}
`
`{Lemma
`Bits
`
`Cat
`Infl
`Defin
`Exs
`
`{Cat
`Defin
`Exs
`
`"I"
`W a5 Closed Det Poss
`Pers 1 Def Gen AO
`Adj
`Adj-none
`"belonging to me"
`"my car"
`"my mother"}
`
`Ij
`"Used as an exclamation of surprise, pleasure, or dismay"
`"Oh, my! What a tiring day!"}
`
`(more sense records)
`
`}
`
`(PRIOR ART)
`Fig. 4
`
`Page 5 of 80
`
`

`

`U.S. Patent
`
`Oct. 12, 1999
`
`Sheet 5 of 69
`
`5,966,686
`
`friend
`{
`
`Noun
`
`Verb
`
`Senses
`
`{Lemma
`Bits
`
`Infl
`Vprp
`Bitrees
`{Bits
`Vprp
`
`"friend"
`Pers3 Sing Humn Anim
`Count Cone Humn sr NO
`Wrdy
`-
`Noun-default
`(of to)
`
`Humn Count Cone
`(of) }
`
`{Bits
`Vprp
`
`Humn Count Cone
`(to) } }
`
`{Lemma
`Bits
`Infl
`
`"friend"
`Inf Plur Pres Tl
`Verb-default } }
`
`{Lemma
`Bits
`Cat
`Defin
`
`{Bits
`Lemma
`Cat
`Infl
`Defin
`
`"friend"
`HumnCone
`Noun
`"A person whom one knows, likes, and trusts."}
`
`Tl
`"friend"
`Verb
`Verb-default
`"To befriend."}
`
`(more sense records)
`
`}
`
`(PRIOR ART)
`Fig. 5
`
`Page 6 of 80
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`\0
`O'I
`0 ....,
`~ ....
`'JJ. =-~
`
`O'I
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`!""'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`(PRIOR ART)
`
`Fig. 6
`
`I
`
`"found"
`VERB3 CHARl
`CHAR
`VERB
`
`ff tt
`
`"friend"
`NOUN2
`NOUN
`
`"my"
`IJl
`IJ
`
`"my"
`ADJ3
`ADJ
`
`"was"
`VERB2
`VERB
`
`"not"
`ADJ2
`ADJ
`
`"met"
`PRON2 VERBl
`VERB
`PRON
`
`"I"
`
`"whom"
`PRONl
`PRON
`
`"The"
`"person"
`ADVl NOUNl
`NOUN
`ADV
`
`"The"
`ADJl
`ADJ
`
`1
`
`BEGIN
`Begin
`
`614
`
`613
`
`612
`
`611
`
`610
`
`609
`
`608
`
`607
`
`606
`
`605
`
`, 604
`
`, 603
`
`, 602
`
`601
`
`Page 7 of 80
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`\0
`O'I
`0 ....,
`-..J
`~ ....
`'JJ. =(cid:173)~
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`!""'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`"friend"!
`NOUN2 VERB3 CHARI
`NOUNI IVERBI ICHAR
`
`I "found"
`
`II n
`
`"my"
`IJl
`IJ
`
`"was"
`VERB2
`
`(PRIOR ART)
`
`Fig. 7
`
`"The" I \"person"!
`ADVI NOUNI
`ADV I
`INOUNI
`
`"The"
`ADJl
`
`Begin I I ADJ
`
`BEGIN
`
`!"whom"
`"my"
`PRONI
`ADJ3
`I PRON 11 PRON 11 VERB 11 ADJ 11 VERB 11 ADJ
`
`"not"
`ADJ2
`
`"met"
`PRON2 VERBI
`
`"I"
`
`ADJl ➔AJPl
`
`Rule: Adjective to Adjective Phrase
`
`Page 8 of 80
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`\0
`O'I
`0 ....,
`00
`~ ....
`'JJ. =(cid:173)~
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`!""'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`(PRIOR ART)
`
`Fig. 8
`
`n n
`
`CHARI
`CHAR
`
`"friend" I I "found"
`VERB3
`NOUN2
`VERB
`NOUN
`
`"my"
`IJ1
`IJ
`
`"my"
`ADJ3
`ADJ
`
`"was"
`VERB2
`VERB
`
`"not"
`ADJ2
`ADJ
`
`"met"
`VERBl
`VERB
`
`"I"
`
`PRON2
`PRON
`
`l"whom"
`PRONl
`PRON
`
`"The" I l"person"I
`ADVl
`INOUNl
`ADV
`NOUN
`
`"The"
`ADJl
`ADJ
`
`BEGIN
`Begin
`
`NOUNl ➔NPl
`
`Rule: Noun to Noun Phrase
`
`Page 9 of 80
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`\0
`O'I
`0 ....,
`\0
`~ ....
`'JJ. =(cid:173)~
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`!""'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`(PRIOR ART)
`
`Fig. 9
`
`ti"
`
`CHARI
`CHAR
`
`"friend" I I "found"
`NOUN2 VERB3
`NOUN! I VERB
`
`"my"
`IJl
`IJ
`
`"my"
`ADJ3
`ADJ
`
`"was"
`VERB2
`VERB
`
`"not"
`ADJ2
`ADJ
`
`"met"
`VERBl
`VERB
`
`"I"
`
`PRON2
`PRON
`
`l"whom"
`PRONl
`I PRON
`
`"person"!
`INOUNl
`NOUNI
`
`"The"
`ADVl
`ADV
`
`"The"
`ADJl
`ADJ
`
`1
`
`BEGIN
`Begin
`
`PRONl ➔NP2
`
`Rule: Pronoun to Noun Phrase
`
`Page 10 of 80
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`\0
`O'I
`0 ....,
`'"""' 0
`~ ....
`'JJ. =(cid:173)~
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`:-'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`"friend"I
`NOUN2 VERB3 CHARI
`NOUN! IVERBI !CHAR
`
`I "found"
`
`ti 11
`
`"my"
`IJl
`IJ
`
`Fig. 10
`
`(PRIOR ART)
`
`l"whom"
`"my"
`PRONl
`ADJ3
`I PRON 11 PRON 11 VERB 11 ADJ 11 VERB 11 ADJ
`
`"was"
`VERB2
`
`"not"
`ADJ2
`
`"met"
`PRON2 VERBl
`
`"I"
`
`"The" I l"person"I
`ADVl NOUNl
`ADV I INOUNI
`
`"The"
`BEGIN
`ADJl
`Begin 11 ADJ
`
`PRON2➔NP3
`
`Rule: Pronoun to Noun Phrase
`
`Page 11 of 80
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`\0
`O'I
`
`'"""' 0 ....,
`'"""'
`~ ....
`'JJ. =(cid:173)~
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`!""'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`"friend"!
`NOUN2 VERB3 CHARI
`NOUNI IVERBI ICHAR
`
`I "found"
`
`"my"
`IJl
`IJ
`
`(PRIOR ART)
`
`Fig. 11
`
`"my"
`"The" I l"person"I
`ADVl NOUNl
`ADJ3
`ADV I I NOUN I I PRON I I PRON I I VERB I I ADJ I I VERB I I ADJ
`
`"was"
`VERB2
`
`"not"
`ADJ2
`
`"met"
`PRON2 VERB 1
`
`"I"
`
`l"whom"
`PRONl
`
`"The"
`BEGIN
`ADJl
`Begin 11 ADJ
`
`VERBI ➔ VPI
`
`Rule: Verb to Verb Phrase
`
`Page 12 of 80
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`\0
`O'I
`0 ....,
`'"""' N
`~ ....
`'JJ. =(cid:173)~
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`:-'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`(PRIOR ART)
`
`Fig. 12
`
`CHARI
`CHAR
`
`"friend" I I "found"
`NOUN2 VERB3
`NOUN\ I VERB
`
`"my"
`IJ1
`IJ
`
`"my"
`ADJ3
`ADJ
`
`"was"
`VERB2
`VERB
`
`"not"
`ADJ2
`ADJ
`
`"met"
`VERBl
`VERB
`
`I
`PRON2
`
`"I"
`
`NOUN I I PRON I I PRON
`
`l"whom"I
`PRONl
`
`"person"I
`NOUNl
`
`"The"
`ADVl
`ADV
`
`"The"
`ADJl
`ADJ
`
`1
`
`BEGIN
`Begin
`
`VERB2➔VP2
`
`Rule: Verb to Verb Phrase
`
`Page 13 of 80
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`\0
`O'I
`0 ....,
`'"""' ~
`~ ....
`'JJ. =(cid:173)~
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`:-'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`(PRIOR ART)
`
`Fig. 13
`
`It II
`
`CHARI
`CHAR
`
`"friend" I I "found"
`NOUN2 VERB3
`NOUNI
`I VERB
`
`"my"
`IJl
`IJ
`
`"my"
`ADJ3
`ADJ
`
`"was"
`VERB2
`VERB
`
`"not"
`ADJ2
`ADJ
`
`l"whom"I
`I
`I I "met"
`PRONl
`PRON2 VERB 1
`IPRONI IPRONI IVERB
`
`"I"
`
`"person"I
`!NOUNl
`NOUN!
`
`"The"
`ADVl
`ADV
`
`"The"
`ADJl
`ADJ
`
`1
`
`BEGIN
`Begin
`
`ADJ3 ➔AJP2
`
`Rule: Adjective to Adjective Phrase
`
`Page 14 of 80
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`\0
`O'I
`0 ....,
`'"""'
`,i;;..
`~ ....
`'JJ. =(cid:173)~
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`:-'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`(PRIOR ART)
`
`Fig. 14
`
`""
`
`CHARI
`CHAR
`
`"friend" I I "found"
`NOUN2 VERB3
`
`NOUN! I VERB
`
`"my"
`IJl
`IJ
`
`"my"
`ADJ3
`ADJ
`
`"was"
`VERB2
`VERB
`
`"not"
`ADJ2
`ADJ
`
`"met"
`VERBl
`VERB
`
`"I"
`
`PRON2
`PRON
`
`!"whom"
`PRONl
`PRON
`
`"The" I l"person"I
`ADVl
`INOUNl
`NOUN
`ADV
`
`"The"
`ADJl
`ADJ
`
`1
`
`BEGIN
`Begin
`
`Rule: Noun to Noun Phrase
`
`Page 15 of 80
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`I
`
`(PRIOR ART)
`
`Fig. 15
`
`\0
`O'I
`0 ....,
`'"""' Ul
`~ ....
`'JJ. =-~
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`:-'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`It
`
`II
`
`CHARI
`CHAR
`
`"friend"
`"found"
`NOUN2 VERB3
`NOUN
`VERB
`
`"my"
`Ul
`IJ
`
`1504
`
`1502
`
`1501
`
`NP5
`
`1500
`
`l"whom"I I "I"
`I I "met" I I "not" I I "was" I I "my"
`PRONl
`ADJ3
`I PRON 11 PRON 11 VERB 11 ADJ 11 VERB 11 ADJ
`
`VERB2
`
`ADJ2
`
`PRON2 VERBl
`
`"The" I l"person"I
`ADVl NOUNl
`ADV I INOUNI
`
`I I "The"
`BEGIN
`ADJl
`Begin 11 ADJ
`
`1
`
`AJP2, NP4 ➔ NP5
`
`Rule: Noun Phrase with Determer
`
`Page 16 of 80
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`\0
`O'I
`0 ....,
`'"""' O'I
`~ ....
`'JJ. =-~
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`:-'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`"friend"
`NOUN2 VERB3 CHARl
`CHAR1
`NOUN
`
`It ti
`
`"found"
`
`VERB
`
`(PRIOR ART)
`
`Fig. 16
`
`"my"
`IJl
`IJ
`
`"my"
`ADJ3
`ADJ
`
`"was"
`VERB2
`VERB
`
`"not"
`ADJ2
`ADJ
`
`"met"
`VERBI
`VERB
`
`"I"
`
`PRON2
`PRON
`
`"whom"
`PRONI
`PRON
`
`"person"
`NOUNl
`NOUN
`
`"The"
`ADVl
`ADV
`
`"The"
`BEGIN
`ADJI
`Begin I I ADJ
`
`NP51
`
`1601
`
`VP2, NP5 ➔ VP3
`
`Rule: Verb Phrase with Noun Phrase as Object of Transitive Verb
`
`Page 17 of 80
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`\0
`O'I
`0 ....,
`'"""'
`-..J
`~ ....
`'JJ. =(cid:173)~
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`:-'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`(PRIOR ART)
`
`Fig. 17
`
`"friend"I
`NOUN2 VERB3 CHARI
`NOUN! IVERBI !CHAR
`
`I "found"
`
`11"
`
`"my"
`IJ1
`IJ
`
`"my"
`ADJ3
`ADJ
`
`l"whom"
`"was"
`PRONl
`VERB2
`I PRON 11 PRON 11 VERB 11 ADJ 11 VERB
`
`"met"
`PRON2 VERBl
`
`"I"
`
`"not"
`ADJ2
`
`"The" I l"person"I
`ADVl NOUNl
`ADV I INOUNI
`
`"The"
`ADJl
`
`Begin I I ADJ
`
`BEGIN
`
`1704
`
`NP5
`
`1702
`
`1701
`
`1707
`
`NP3, VPI ➔ VP4
`
`Rule: Verb Phrase with Noun Phrase as Subject
`
`Page 18 of 80
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`\0
`O'I
`0 ....,
`'"""' 00
`~ ....
`'JJ. =-~
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`:-'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`(PRIOR ART)
`
`Fig. 18
`
`""
`
`CHARI
`CHAR
`
`"found"
`VERB3
`VERB
`
`"friend"
`NOUN2
`NOUN
`
`"my"
`IJl
`IJ
`
`"my"
`ADJ3
`ADJ
`
`"was"
`VERB2
`VERB
`
`"not"
`ADJ2
`ADJ
`
`"met"
`VERBl
`VERB
`
`"I"
`
`PRON2
`PRON
`
`"whom"
`PRONl
`PRON
`
`"person"
`NOUNl
`NOUN
`
`"The"
`ADVl
`ADV
`
`"The"
`ADJl
`ADJ
`
`1
`
`BEGIN
`Begin
`
`NP5 I
`
`NP2, VP4 ➔ VP6
`
`Rule: Topicalization
`
`Page 19 of 80
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`\0
`O'I
`0 ....,
`'"""'
`\0
`~ ....
`'JJ. =-~
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`:-'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`(PRIOR ART)
`
`Fig. 19
`
`ti II
`
`CHARI
`CHAR
`
`"friend"I
`I "found"
`NOUN2 VERB3
`I VERB
`NOUN!
`
`"my"
`IJ1
`IJ
`
`"my"
`ADJ3
`ADJ
`
`"was"
`VERB2
`VERB
`
`"not"
`ADJ2
`ADJ
`
`NP5 I
`
`"person"I
`I
`I I "met"
`NOUNl
`PRON2 VERBl
`NOUN! IPRONI IPRONI !VERB
`
`l"whom"I
`PRONl
`
`"I"
`
`"The"
`ADVl
`ADV
`
`"The"
`ADJl
`ADJ
`
`1
`
`BEGIN
`Begin
`
`NPl, VP6 ➔ NP9
`
`Rule: Noun Phrase with Relative Clause
`
`Page 20 of 80
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`~ ....
`'JJ. =-~
`
`\0
`O'I
`0 ....,
`0
`N
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`:-'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`"friend"I
`NOUN2 VERB3 CHARl
`
`II U
`
`I "found"
`
`NOUN I I VERB I I CHAR
`
`(PRIOR ART)
`
`Fig. 20
`
`"my"
`IJl
`IJ
`
`"my"
`ADJ3
`ADJ
`
`"was"
`VERB2
`VERB
`
`"not"
`ADJ2
`ADJ
`
`NP51
`
`2001
`
`"met"
`PRON2 VERBl
`
`"I"
`
`"The" I l"person"I
`ADVl NOUNl
`ADV I I NOUN I I PRON I I PRON I I VERB
`
`l"whom"
`PRONl
`
`"The"
`ADJl
`ADJ
`
`BEGIN
`Begin
`
`NP9
`
`AJPl, NP9 ➔ NPl 1
`
`Rule: Noun Phrase with Determinate Quantifier
`
`Page 21 of 80
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`\0
`O'I
`
`'"""' 0 ....,
`~ ....
`'JJ. =-~
`
`N
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`:-'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`(PRIOR ART)
`
`Fig. 21
`
`"found"
`VERB3 CHARI
`CHAR
`VERB
`
`"It
`
`"friend"
`NOUN2
`NOUN
`
`"my"
`IJl
`IJ
`
`"my"
`ADJ3
`ADJ
`
`"was"
`VERB2
`VERB
`
`"not"
`ADJ2
`ADJ
`
`"met"
`VERBl
`VERB
`
`"I"
`
`PRON2
`PRON
`
`"whom"
`PRONl
`PRON
`
`"person"
`NOUNl
`NOUN
`
`"The"
`ADVl
`ADV
`
`"The"
`ADJl
`ADJ
`
`1
`
`BEGIN
`Begin
`
`INP5 I
`
`I
`
`VP41
`
`NP9
`
`NPl 1
`
`NPl 1, VP3 ➔ VP9
`
`Rule: Verb Phrase with Noun Phrase Subject
`
`Page 22 of 80
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`~ ....
`'JJ. =(cid:173)~
`
`\0
`O'I
`0 ....,
`N
`N
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`:-'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`(PRIOR ART) Fig. 22
`
`1f"
`
`CHARI
`CHAR
`
`"friend"
`"found"
`NOUN2 VERB3
`VERB
`NOUN
`
`"my"
`IJl
`IJ
`
`"my"
`ADJ3
`ADJ
`
`"was"
`VERB2
`VERB
`
`"not"
`ADJ2
`ADJ
`
`"met"
`PRON2 VERBl
`VERB
`PRON
`
`"I"
`
`"whom"
`PRONl
`PRON
`
`"The"
`"person"
`ADVl NOUNl
`NOUN
`ADV
`
`"The"
`ADJl
`ADJ
`
`\ 2203
`
`~
`
`NPS
`
`1-----1
`
`I
`
`I
`
`2201
`
`2204
`
`DECl
`
`BEGIN!, VP9, CHARI➔ DECl
`
`Rule: Declarative Sentence from Begin + Verb Phrase + "."
`
`Page 23 of 80
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`\0
`O'I
`0 ....,
`~
`N
`
`~ ....
`'JJ. =-~
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`:-'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`(PRIOR ART)
`
`Fig. 23
`
`2311
`
`" /
`"
`
`I
`
`2301
`
`Dsubj
`
`2307
`
`meet
`
`'-<
`to
`~ p.
`rn
`~_/2306
`rn
`0
`
`'
`
`2310
`
`
`-~
`
`friend
`
`2305
`
`Dnoun
`
`2309
`
`2304
`
`~_/2302
`o
`
`~
`~
`2303'\__g
`
`00
`
`be
`
`Dsubj
`
`person
`
`2308
`
`Page 24 of 80
`
`

`

`U.S. Patent
`
`Oct. 12, 1999
`
`Sheet 24 of 69
`
`5,966,686
`
`2401
`
`12402
`
`2404
`
`Input
`
`Application
`
`2405
`
`Electronic
`Dictionary
`
`Output
`
`\2403
`
`Morphological
`Subsystem
`
`Syntactic
`Subsystem
`
`2401
`
`2411
`
`2410
`
`Semantic
`Subsystem
`
`OtherNLP
`Subsystems
`
`Fig. 24
`
`Page 25 of 80
`
`

`

`0--,
`00
`0--,
`....
`0--,
`0--,
`\0
`....
`Ul
`
`~ ....
`'JJ. =-~
`
`\0
`O'I
`0 ....,
`Ul
`N
`
`\0
`\0
`'"""'
`\0
`'"""' ~N
`:-'"
`I")
`0
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`Fig. 25
`
`Graph
`Form
`Logical
`Complete
`
`..
`
`2501
`
`Semantic
`Generate
`
`Rules
`
`Graph
`Form
`Logical
`Initial
`
`"2505
`
`Generate
`
`Graph
`Form
`Logical
`Initial
`
`Complete
`
`Tree
`Parse
`Syntax
`
`1'2503
`
`2506
`
`2504
`
`2502
`
`Tree
`Parse
`Syntax
`
`Syntactic
`Complete
`
`Rules
`
`I
`
`2501
`
`The New Semantic Subsystem
`
`Page 26 of 80
`
`

`

`U.S. Patent
`
`Oct. 12, 1999
`
`Sheet 26 of 69
`
`5,966,686
`
`NSS
`
`Complete syntactic
`roles
`
`2601
`
`Generate initial
`logical form graph
`
`2602
`
`Generate semantic
`roles
`
`2603
`
`DONE
`
`Fig. 26
`
`Page 27 of 80
`
`

`

`U.S. Patent
`
`Oct. 12, 1999
`
`Sheet 27 of 69
`
`5,966,686
`
`I.
`
`2.
`
`3.
`
`4.
`
`5.
`
`6.
`
`7.
`
`8.
`
`9.
`
`10.
`
`11.
`
`12.
`
`13.
`
`14.
`
`15.
`
`16.
`
`17.
`
`PrLF _NPQuantOf: for NPs like "a number of books," makes "books" the head and "a
`number of' the modifier
`
`PrLF _PPQuantOf: same but for PPs, like "with a number of books"
`
`PrLF _notAnaphora: prepares to fill VP anaphora like "John thought he would go but Jim
`though not _____ "
`
`PrLF _ soAnaphora: prepares to fill VP anaphora like "Mary wondered if it was true but
`Jane knew so ____ _
`
`PrLF _toAnaphora: prepares to fill VP anaphora like "Chris wanted to go but Pat didn't
`want to
`
`PrLF _ You: supplies the understood "you" in commands like "(You) please close the door"
`
`PrLF How About: supplies the understood "you" in constructions like "How about (you)
`closing the door"
`
`PrLF We: supplies the understood "we/us" in constructions like "Let's (us) go to the
`movies"
`
`PrLF _I: supplies the understood "I" in, for example, "{I) thank you" or "(I) Have not yet
`received your letter"
`
`PrLF _SubjectMods: connects "we" and "all" in, e.g., "We are all reading the book";
`connects "he" and "hungry" in, e.g., "He arrived hungry"
`
`PrLF _RightShift: connects "the man" and "who was my friend" in, e.g., "The man arrived
`who was my friend"
`
`PrLF InfclPP: prepares for correct interpretation in constructions like "a person on whom
`to rely"
`
`PrLF _QuantifierEllipsis: having to do with the resolution of pronoun references
`
`PrLF _PossessivePronHead: having to do with the resolution of pronoun references
`
`PrLF _PossibleCorefsOfProns: having to do with the resolution of pronoun references
`
`PrLF _ VP Anaphora: identifies and fills missing arguments in all cases of VP anaphora,
`e.g., "Sarah likes basketball and I do too"
`
`PrLF _DistCoords: distributes elements across coordinated structures, like "They washed
`and dried the dishes"
`
`Fig. 27
`
`Page 28 of 80
`
`

`

`U.S. Patent
`
`Oct. 12, 1999
`
`Sheet 28 of 69
`
`5,966,686
`
`PrLF You
`
`If the Syntax Record
`has the attribute "Infinitive"
`and does not have the attribute "Subject"
`or
`has the attribute "Verb Phrase Invert" and does not have any of the
`attributes "Object2," "Yes/No/Question," or "Old Subordinate Clause"
`and does not meet the "There Subject Test"
`and does not have the "Coordinate Constructions" attribute
`and does not have any premodifiers with the node type "Auxiliary Phrase" or the
`attribute "Modal Verb"
`and does not have any premodifiers with the lemma "let" or the node type "Adverbial
`Phrase,"
`and does not have the node type "Abbreviated Clause," "Auxiliary Phrase,"
`"Complement Clause," "Infinitive Clause," "Noun Relative," "Past Participle
`Clause," or "Relative Clause"
`and does not have a parent with the node type "Past Participle Clause"
`and if the head of the parent has node type "Conjunction,"
`then the parent does not have a "Subject" attribute and does not have the node type
`"Auxiliary Phrase," "Complement Clause," "Infinitive," "Noun Relative," or
`"Relative Clause"
`and if there is an Auxiliary Attribute on its Head
`then for all its Premodifiers their Lemma must not be "neither" nor "so,"
`and if it has a Do Modifier,
`then it must have an Infinitive attribute and either there must not be a Modal on
`the First Verb Attribute, or the Lemma of its First Verb must be either "dare" or
`"need,"
`and it if has a Perfective attribute,
`then its Lemma must be do,
`and if it has a Verb Phrase Invert attribute,
`then either there must not be an L9 attribute
`or there must not be a Comma attribute and for all of its Premodifiers their node
`type must not be equal to "Prepositional Phrase" and for all of its Premodifiers their node type
`must either not be "Adverbial Phrase" or there must be a Comma attribute or the node type of their
`Head must be an Interjection,
`and has neither "ect" nor "ect." as its Lemma,
`and if its Lemma is "suffice,"
`then the Lemma of its Objectl cannot be "it,"
`and if its Lemma is "thank,"
`then the Lemma of its Objectl cannot be "you,"
`
`Then
`
`create a pronoun record for the lemma "you";
`make the Subject attribute of the syntax record be a copy of the pronoun record and set the
`Segtype to be "NP," set the node type to be Segtype, and set the head attribute to be the pronoun
`record;
`
`and set the premodifiers of the syntax record to be the value of the subject attribute plus all
`of the original premodifiers and set the Undersubject attribute flag.
`
`Fig. 28A
`
`Page 29 of 80
`
`

`

`U.S. Patent
`
`Oct. 12, 1999
`
`Sheet 29 of 69
`
`5,966,686
`
`Sentence represented by parse tree: "Please close the door."
`Syntax parse tree generated by syntactic subsystem:
`
`/2801
`
`CHARl
`""
`
`/2802
`
`CHARl
`""
`
`AVPl
`
`ADVl
`"please"
`
`ADJl
`"the"
`
`Rule PrLF You
`
`2803
`
`NP2
`
`PRONl
`"You"
`
`ADVl
`"please"
`
`2804
`
`ADJl
`"the"
`
`Fig. 28B
`
`Page 30 of 80
`
`

`

`U.S. Patent
`
`Oct. 12, 1999
`
`Sheet 30 of 69
`
`5,966,686
`
`1.
`
`2.
`
`3.
`
`4.
`
`5.
`
`6.
`
`7.
`
`8.
`
`9.
`
`10.
`
`11.
`
`12.
`
`13.
`
`TrLF _ LongDistl: locates NPs that are removed from their semantic heads and reattaches
`them, e.g., "Who did John say that Mary likes _(who)_?"
`
`TrLF _ LongDist2: performs the same kind of long-distance attachment for AJPs, INFCLs,
`PPs, PRPRTCLs, PTPRTCLs, SUBCLs
`
`TrLF _PhrasalVerb: defines semantic objects of certain verbs when they appear hidden
`inside PPs: "his hat" is really the semantic object of "took off' in "He took off his hat"
`
`TrLF _ ControlwNP: e.g., in "Chris told Pat what to eat," "Pat" is really the subject of "eat"
`and "what" is its object
`
`TrLF ControlwAJP: e.g., in "I find this difficult to believe," "this" is really the object of
`"believe"
`
`TrLF Forlnfcl: used in "for-to" constructions, e.g., in "For Mary to talk to John is easy,"
`"Mary" is really the subject of "talk"
`
`TrLF ForlnfclCoords: used in "for-to" constructions that have coordinated PPs
`
`TrLF _MoveProp: given our strategy for attachment, it is sometimes necessary to move
`clauses from a lower to a higher level so that the proper argument structure can be assigned
`
`TrLF _ControlatVP: e.g., in "Farmers grow food by using salt water," "farmers" is really
`the subject of "use salt water"
`
`TrLF _PropsAsArgs: some clauses (propositions) can be arguments, e.g., in "Has he to
`answer the letter?" the object of "has" is "to answer the letter"
`
`TrLF _ Extraposition: e.g., in "It makes me happy to meet you," the real subject of "makes"
`is "to meet you" -- "it" is an empty word and must drop out
`
`TrLF _FillCoords: fills in missing arguments in coordinated structures
`
`TrLF _RedefineSubject: e.g., in "What is John's address?" we interpret "John's address" as
`the logical subject even though it is not in canonical subject position
`
`Fig. 29
`
`Page 31 of 80
`
`

`

`U.S. Patent
`
`Oct. 12, 1999
`
`Sheet 31 of 69
`
`5,966,686
`
`TrLF MoveProp
`
`If the syntax Record
`has either a node type of Abbreviated Clause, Infinitive Clause, Present Participle Clause,
`Past Participle Clause
`or if it has a Gerund attribute and an Object of a Prepositional Phrase and
`if it has Premodifiers,
`then the node type of all Premodifiers must be either Auxiliary Phrase, Adverbial
`Phrase, or Prepositional Phrase,
`and the node type of the Head attribute of the Parent is not "verb"
`and this syntax record is the last of the post modifiers of its parent
`and this syntax record is not in the coordinates attribute of its parent
`and among the ancestors of the parent there is a record whose node type of the Head is
`"Verb" but none of those ancestors can have a Coordinates attribute (this record will later be
`referred to as "same ancestor")
`and there should be no For To Prepositional Phrase attribute on the parent,
`and if the node type equals Infinitive Clause,
`then there must be either no WH attribute on PP obj of the parent or the syntax
`record is not equal to the Nominal Relative of the parent,
`and if the node type is either Present Participle or Past Participle,
`then its Parent does not have an Object of a Prepositional Phrase,
`and if the node type is a Present Participle Clause,
`then there must be an 'ING' Complement on the same ancestor
`and if the node type is a Past Participle Clause,
`then there must be a VS (code from Longman's dictionary) attribute on the same
`ancestor and if there is an Xl attribute on the syntax record then there must not be
`an Object I
`and there is no B3 attribute on its parent,
`and this syntax record must follow the head of the same ancestor or there is a passive
`attribute on the same ancestor
`and if the Lemma of the Parent is 'certain'
`then the node type of the parent must not be an Adjective Phrase
`and if the Lemma of the Preposition is either "as" or "of,"
`then there must be a To Noun attribute of its Parent
`and if the Lemma of the same ancestor is either "be" or "become"
`then either the node type of the Parent must be an Adjective Phrase
`or there must be a WH attribute on the Parent
`or there must be both a To Noun attribute on parent and no There Subject
`Test on the same ancestor
`or the Lemma of the Parent must be one of the following: "delight,"
`"horror," "joy," "pleasure," "riot," "shame," "surprise," "terror,"
`
`Fig. 30A
`
`Page 32 of 80
`
`

`

`U.S. Patent
`
`Oct. 12, 1999
`
`Sheet 32 of 69
`
`5,966,686
`
`TrLF MoveProp
`
`the syntax record whose attributes will be changed is the same ancestor syntax record (see
`
`Then
`
`above);
`
`if the Parent of the syntax record has the Subject attribute and the Parent of syntax record
`also has the Object attribute,
`then delete the object attribute from the ancestor;
`if the Parent of the syntax record has the Subject attribute and the Parent of the Syntax
`Record does not also have the Object 1 attribute,
`then set the Subject attribute of same ancestor to be the syntax record;
`if the same ancestor has
`the DI (Longman code) attribute and there is an Object Complement attribute and
`no Indirect Object attribute and there is a To Infinitive on the syntax record and
`the Parent of syntax record is the Object
`and there is no WH attribute on the Parent of Syntax Record
`and either there is an Animate attribute on Parent of syntax record
`or there is a Case attribute on Parent of Syntax Record and the Lemma of
`the Parent of the syntax record is not "it"
`or there is a Human attribute on the Parent of Syntax Record
`or there is a Proper Name attribute on Parent of syntax record,
`then make the Indirect Object Attribute on same ancestor equal to that of the Parent of
`syntax record;
`if there is a To Infinitive attribute on the syntax record and no Passive attribute on same
`ancestor,
`then make the Predicate Complement attribute equal to the syntax record;
`if the Parent of syntax record is in the Propositions attribute of same ancestor,
`then take that Propositions list and replace the Parent of the syntax record with the syntax
`record itself in the propositions list;
`delete the Infinitive attribute of the Parent of the syntax record;
`delete the Alternatives attribute on the syntax record;
`reattach the syntax record to the same ancestor.
`
`Fig. 30B
`
`Page 33 of 80
`
`

`

`U.S. Patent
`
`Oct. 12, 1999
`
`Sheet 33 of 69
`
`5,966,686
`
`Sentence represented by parse tree: "I have no desire to see the movie."
`
`Syntax parse tree prior to applying rule TvLF _ MoveProp:
`
`NPl
`
`PRONl
`"I"
`
`Rule TrLF _MoveProp:
`
`NPl
`
`PRONl
`''I"
`
`/3001
`
`CHAR
`"ti
`
`ADJl
`11no"
`
`INFTOl
`
`NP3
`
`PREPI
`"to"
`
`"movie"
`
`ADJ2
`"the"
`
`3006
`
`3002
`
`/
`
`3005
`
`CHAR
`""
`
`INFTOI
`
`PREPl
`"to"
`
`ADJl
`"no"
`
`ADJ2
`"the"
`
`Fig. 30C
`
`Page 34 of 80
`
`

`

`U.S. Patent
`
`Oct. 12, 1999
`
`Sheet 34 of 69
`
`5,966,686
`
`apply_rules
`
`Input parameter 1 :
`list of nodes
`Input parameter 2:
`list of rules
`
`3101
`
`Select next node,
`starting with first node
`in input list of nodes
`
`3102
`
`Select next rule,
`starting with first rule
`in input list of rules
`
`3103
`
`3105
`
`3104
`y
`>---~ Apply rule to node
`
`y
`
`y
`
`Done
`
`Fig. 31
`
`Page 35 of 80
`
`

`

`U.S. Patent
`
`Oct. 12, 1999
`
`Sheet 35 of 69
`
`5,966,686
`
`Preliminary adjustment
`of syntax tree
`
`Main adjustment
`of syntax tree
`
`3201
`
`3202
`
`3203
`
`3204
`
`3205
`
`3206
`
`phase one
`
`Parameter 1 =
`syntax tree nodes
`
`Parameter 2 =
`1st set of
`semantic rules
`
`Call apply_ rules
`(parameter 1,
`parameter 2)
`
`Parameter 1 =
`preliminarily
`adjusted syntax
`tree nodes
`
`Parameter 2 =
`2nd set of
`semantic rules
`
`Call apply_ rules
`(parameter 1,
`parameter 2)
`
`Return
`
`Fig. 32
`
`Page 36 of 80
`
`

`

`U.S. Patent
`
`Oct. 12, 1999
`
`Sheet 36 of 69
`
`5,966,686
`
`1.
`
`2.
`
`3.
`
`Syn ToSem 1 : creates semantic nodes and a basic semantic graph in es
`
`SynToSem2: creates the top-level semantic node and graph for fitted parses
`
`SynToSem3: creates semantic nodes for a special subclass of elements in fitted parses
`
`Fig. 33
`
`Page 37 of 80
`
`

`

`U.S. Patent
`
`Oct. 12, 1999
`
`Sheet 37 of 69
`
`5,966,686
`
`If
`
`Rule SynToSeml
`
`the Syntax Record
`has a Head and
`there is no Subordinate Conjunction and
`there is no Correlative and
`there is no "It subject" and
`there is no "There subject" and
`there is no Ancestor of the Head for which it is true that that node
`is the Emphatic of its Parent and is not a fraction and the head node
`is not a verb and
`if the segment is the Relative Pronoun of its Parent,
`then there must not be a Nominal Relative on the Object of its Parent
`and for all of its Parents last records there must not be a VPDone attribute and
`if the lemma equals 'that'
`then there must not be an Extra Position on the Parent of the Parent and
`the node type is not "Auxiliary Phrase," "To Infinitive," "Determiner Phrase,"
`or "Tag" or
`there is a Possessi