]> gitweb.fperrin.net Git - DictionaryPC.git/commit
WiktionarySplitter: Support compressed inputs.
authorReimar Döffinger <Reimar.Doeffinger@gmx.de>
Sat, 7 Oct 2017 19:48:29 +0000 (21:48 +0200)
committerReimar Döffinger <Reimar.Doeffinger@gmx.de>
Sat, 7 Oct 2017 19:48:29 +0000 (21:48 +0200)
commitee1dbfb669462305a1c07e4d804a90af79f5d39f
tree83ac25438b70290c621b57ab66a07209f8931174
parentaad37bfcc3c1a1772d5fba894d7471c2b09b64ee
WiktionarySplitter: Support compressed inputs.

Unfortunately bzip2 decompression is very slow (slower
than the XML parsing in fact), so it might make sense to
re-compress the downloaded files from bzip2 to xz.
If the decompression could be done in a separate thread,
xz compression would even provide a speedup if the files
are on a slower (non-SSD) disk.
WiktionarySplitter.sh
compile.sh
data/downloadInputs.sh
run.sh
src/com/hughes/android/dictionary/engine/WiktionarySplitter.java