Moby Project - Language

Moby Language II contains wordlists of five languages - French, German, Italian, Japanese, and Spanish:

Language Words Size (in bytes)
French 138,257 1,524,757
German 159,809 2,055,986
Italian 60,453 561,981
Japanese 115,523 934,783
Spanish 86,059 850,523
Total 560,101 5,928,030

However, some of the lists are contaminated, for example the Japanese list contains English words such as abnormal and non-words such as abcdefgh and m,./.

Read more about this topic:  Moby Project

Famous quotes containing the word language:

    There is no such thing as a language, not if a language is anything like what many philosophers and linguists have supposed. There is therefore no such thing to be learned, mastered, or born with. We must give up the idea of a clearly defined shared structure which language-users acquire and then apply to cases.
    Donald Davidson (b. 1917)

    Now stamp the Lord’s Prayer on a grain of rice,
    A Bible-leaved of all the written woods
    Strip to this tree: a rocking alphabet,
    Genesis in the root, the scarecrow word,
    And one light’s language in the book of trees.
    Dylan Thomas (1914–1953)

    Repeat thy song, till the familiar lines
    Are footpaths for the thought of Italy!
    Thy flame is blown abroad from all the heights,
    Through all the nations, and a sound is heard,
    As of a mighty wind, and men devout,
    Strangers of Rome, and the new proselytes,
    In their own language hear thy wondrous word,
    And many are amazed and many doubt.
    Henry Wadsworth Longfellow (1809–1882)