ANN Daily Crytoquote--my misspelling

[Mark Wieder]

Marielle-

Thursday, June 23, 2005, 3:08:45 AM, you wrote:

ML> If you use the url below, you will directly get to see the list of words which
ML> have a frequency of 10 or more.

ML> http://lexicall.org/repository/results.php?mtd_file=data%2F2_words%2Fenglish%2Fdb_mrc.mtd&flds%5B1%5D=WORD&minvals%5B5%5D=10&submit=Submit

ML> Make you enter it as a continuous line in your browser, the 500 words limit has
ML> been removed and will remain so for a week, so you will see the full list on
ML> your screen. Be patient - 10262 words.

Yes, but a lot of duplicates. If you filter out the dupes you end up
with 5066 words.

on RemoveDuplicates pWordList
  local tFileName
  local tWordList
  local aWords
  
  repeat for each line tLine in pWordList
    put "x" into aWords[tLine]
  end repeat
     
  put the keys of aWords into tWordList
  sort tWordList
  return tWordList
end RemoveDuplicates

-- 
-Mark Wieder
 mwieder at ahsoftware.net