Collecting Web Pages for

Under-Resourced Languages

On this website you can contribute to corpus collection for under-resourced languages by simply entering a URL. The languages are chosen so that they have more than one million of speakers, but up to now there are less than one million of sentences in the Leipzig corpora collection. The URLs or domains you provide will be crawled and reviewed for text data in the respective language. After processing you will be presented with statistics for the URLs you provided. The corpora created will be free for download.

Thank you for your Support!

Step 1: Select the Language

Step 2: Insert the URLs / Upload a URL list

Step 3: Additional User Information

Your URLs have been submitted and will soon be processed. To observe the current working status you can visit: Job Liste: /jobs
You can enter your email below to automatically receive a notification when the processing finished.

Receive an email after your URLs have been successfully processed.