Page 1 of 1

[solved]DictZip cann't deal with DSL larger than 1 G!

PostPosted: Sun Aug 05, 2012 3:38 pm
by jecuad
I happens that the in my computer the DictUI - DictZip can't deal with some large DSL files.

That to say, only problems with those DSL larger than 1 G, in the way that it converts the DSL files names into strange characters, for example, I have the file D:\en-en_x_Dictionary.1234.dsl (>1 G) to convert, after conversion, in the dz package, the directory goes like:

D:\en-en_x_Dictionary.1234.dsl.dz\?\?c+`*????(\??g+,-s.?????g-??m.m+?=-*,?Y-k)?{.!\v,????!,?E)x+l*i*+??],?>,\:,?8+,]\???D-??j\70.?e,???s,-O*A\...

And this converted files sometimes can't be recognizes by Goldendict. But to discard the posibility of bad file name, I changed the files name to a.dsl, neither works! But if I reduce the dsl file (>1 G) into a smaller like 2 M by cutting some entries, DictUI - DictZip does give correct conversion.

Anyone knows how to solve this or have some alternative to DictUI - DictZip to reduced large DSL?

My computer:Win 7
DictUI - DictZip: windows edtion version 0.1.0

Re: [help]DictZip cann't deal with DSL larger than 1 G!

PostPosted: Sun Aug 05, 2012 9:07 pm
by chulai
I'm not sure but I think the limit is between 1.8GB and 4GB. Have you tried to use the command client dictzip.exe instead of DictUI?

Which dictionary are you trying to compress that is that huge? The biggest dictionary I saw in dz format was an off-line version of Urban Dictionary and that's about 230MB. Usually the resources (images and sounds) are that big but you use zip format in that case.

Re: [help]DictZip cann't deal with DSL larger than 1 G!

PostPosted: Tue Aug 07, 2012 7:01 am
by vjjustin
He is talking about dsl files that are more than 1GB, not the compressed versions. Urban dictionary and OED 2nd edition (dsl files) both are 1.2GB size.

Re: [help]DictZip cann't deal with DSL larger than 1 G!

PostPosted: Tue Aug 07, 2012 10:57 am
by chulai
vjjustin, thanks for clarifying.
Anyhow, the answer still applies. I decompressed with 7zip Urban Dictionary (En-En).dsl.dz (230 MB (241,244,974 bytes)) to Urban Dictionary (En-En).dsl (1.16 GB (1,246,280,312 bytes)) and then I compressed it back with :

Code: Select all
c:\TEMP>dictzip.exe "Urban Dictionary (En-En).dsl"


The resulting file Urban Dictionary (En-En).dsl.dz has the exact same size as previously compressed one (i.e. 241,244,974 bytes)
And GoldenDict can index it just fine.

So, again, I would try to use dictzip instead of DictUI as it can effectively compress files larger than 1GB. On the other hand, I have had issues with DictUI before.

c:\TEMP>dictzip --version
dictzip 1.9.7


Regards,
Chulai

Re: [help]DictZip cann't deal with DSL larger than 1 G!

PostPosted: Mon Aug 19, 2013 10:55 am
by Tvangeste
Here's the native win32 version of Dictzip, built by me, based on latest official version 1.12.1:
https://github.com/Tvangeste/dictzip-win32/releases/

Sources:
https://github.com/Tvangeste/dictzip-win32

Re: [solved]DictZip cann't deal with DSL larger than 1 G!

PostPosted: Mon Mar 24, 2014 2:37 am
by the_cla5h
I have the same problem, but with a bigger file. I downloaded the 2012 version of Urban Dictionary in dsl format, its size is 2,4 GB. It works well in GoldenDict.
I tried to dzip it in Ubuntu from command line and, although the conversion seems to complete succesfully, the resulting 418MB .dz file doesn't work in GoldenDict.
Then I tried to convert it in Windows with the dictzip.exe file you linked in the previous post, but the compression doesn't start at all: the programme is closed with an error message and a 0 bytes .dz file is created.

Could you please help me or try to do this for me? The dictionary can be downloaded here: http://goo.gl/4eHFuH (don't worry, it's a 7zip compressed file of only 199MB :) )