Pinned

1. bitextor bitextor Public

   Bitextor generates translation memories from multilingual websites

   Python 282 43

2. bicleaner bicleaner Public

   Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.

   Python 146 21

3. bifixer bifixer Public

   Tool to fix bitexts and tag near-duplicates for removal

   Python 27 3

4. biroamer biroamer Public

   Utility that will help you to ROAM (Random Omit Anonymize and Mix) your parallel corpus.

   Python 8 2

5. pdf-extract pdf-extract Public

   PDF parser and converter to HTML

   Java 80 14

6. warc2text warc2text Public

   Extracts plain text, language identification and more metadata from WARC records

   C++ 18 5