AN OVERBROAD PATENT ON automatic keyword extraction - 10 minutes of your time can help narrow US patents in the future. Follow @askpatents on twitter to help.
QUESTION - Have you seen anything that was published before 7/2/2009 that discusses using word co-occurrence scores to find key phrases?
I am looking for prior art on US 8,131,735 Rapid automatic keyword extraction for information retrieval and analysis
- Publication Number: US8131735 B2
- Assignee: Battelle Memorial Institute
- Prior Art Date: Seeking prior Art predating 7/2/2009
- Link to Google Prior Art Search - "Find Prior Art"
Claim 1 requires each and every step below:
A computer-implemented method of extracting keywords from an individual document, the method comprising:
Parsing an individual document by delimiters and stop words to identify candidate keywords;
Determining co-occurrences of words within the candidate keywords;
Calculating word scores for each word within the candidate keywords based on a function of co-occurrence degree, co-occurrence frequency, or both;
Calculating a keyword score for each candidate keyword based on a function of word scores for words within the candidate keyword; and
Selecting a portion of the candidate keywords to extract as keywords based, at least in part, on the candidate keywords with highest keyword scores.
The notion of using word co-occurrence scores to find key phrases has been documented. (It seems like every information retrieval system ever built is prior art.)
For example, in this paper: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.174.8359&rep=rep1&type=pdf
We find the following quote:
Various phrase-finding and indexing methods have been proposed in the past and generally, retrieval performance conclusions on the use of phrases as indexing units were inconsistent. Salton & McGill  suggested generating statistical phrases based on word co-occurrence and then incorporating them into document representation as additional index terms.
The Salton & McGill reference is from this book, published in 1983: http://books.google.ca/books/about/Introduction_to_modern_information_retri.html?id=7f5TAAAAMAAJ&redir_esc=y