Moby Project - Language

Moby Language II contains wordlists of five languages - French, German, Italian, Japanese, and Spanish:

Language Words Size (in bytes)
French 138,257 1,524,757
German 159,809 2,055,986
Italian 60,453 561,981
Japanese 115,523 934,783
Spanish 86,059 850,523
Total 560,101 5,928,030

However, some of the lists are contaminated, for example the Japanese list contains English words such as abnormal and non-words such as abcdefgh and m,./.

Read more about this topic:  Moby Project

Famous quotes containing the word language:

    “Syntax and vocabulary are overwhelming constraints—the rules that run us. Language is using us to talk—we think we’re using the language, but language is doing the thinking, we’re its slavish agents.”
    —Harry Mathews (b. 1930)

    “One can say of language that it is potentially the only human home, the only dwelling place that cannot be hostile to man.”
    —John Berger (b. 1926)

    “A language does not become fixed. The human intellect is always on the march, or, if you prefer, in movement, and languages with it.”
    —Victor Hugo (1802–1885)