Moby Project - Language

Moby Language II contains wordlists of five languages - French, German, Italian, Japanese, and Spanish:

Language Words Size (in bytes)
French 138,257 1,524,757
German 159,809 2,055,986
Italian 60,453 561,981
Japanese 115,523 934,783
Spanish 86,059 850,523
Total 560,101 5,928,030

However, some of the lists are contaminated, for example the Japanese list contains English words such as abnormal and non-words such as abcdefgh and m,./.

Read more about this topic:  Moby Project

Famous quotes containing the word language:

    Because language is the carrier of ideas, it is easy to believe that it should be very little else than such a carrier.
    Louise Bogan (1897–1970)

    There’s language in her eye, her cheek, her lip,
    Nay, her foot speaks; her wanton spirits look out
    At every joint and motive of her body.
    William Shakespeare (1564–1616)

    The great enemy of clear language is insincerity. When there is a gap between one’s real and one’s declared aims, one turns as it were instinctively to long words and exhausted idioms, like a cuttlefish squirting out ink.
    George Orwell (1903–1950)