WIN | KOI | LAT

The Art
of Lossless
Data Compression
vol. 25t

Here are the results of tests performed in August 2002 to compare
lossless compression of "plain" texts by all known good enough programs
developed for such purpose, including UHArc, PPMd, Bzip2, RAR, ACE and 7-zip.

See Archive Comparison Test by J.Gilchrist for more details:
http://compression.ca

If anybody wants to start or continue such tests,
or can suggest some other sets of texts, or other compression programs,
 (not sources or algorithm descriptions, executable programs only)
or knows we have missed something important,
 (some new fantastic technology, an algorithm or even a program capable
 of lossless compression of up to 1000:1 etc.)
please let us know immediately: artest@inbox.ru   Thank you!


[[1]] COMPRESSION QUALITY
=========================
             (see also
             [[2]] Speed
             [[3]] Details
             [[4]] Comments)

Last seventh line shows results for the sum of all 1231 texts in six sets.

Origin Entropy Durilca Compressia PPMonstr EPM   PPMN    Slim   Paq1SSE  BEE
553.31%  100%   100.06  100.45  101.76  102.57  105.51  101.71  102.72  107.19
543.05%  100%   103.57  103.68  108.50  108.01  110.03  111.16  109.65  112.67
435.56%  100%   104.58  103.74  107.96  106.88  107.05  107.18  108.02  111.37
492.76%  100%   105.47  106.15  110.61  110.32  110.13  110.90  111.77  114.63
806.27% 102.70   100%   107.91  101.67  105.66  116.95  109.37  110.90  112.44
360.54% 102.11   100%   108.90  104.66  105.39  103.20  104.25  114.17  107.39
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
468.44%  100%   102.79  105.63  107.25  107.35  107.48  107.68  110.72  111.24

 PPMd    PPMy     RK      RAR    UHArc    DC      SBC   BZip2   7-zip   pkzip
107.64  105.50  105.64  108.58  105.31  108.66  108.98  124.06  152.15  159.23
113.63  112.82  112.26  113.72  112.70  114.28  115.55  130.92  170.89  178.03
111.94  110.06  110.78  112.57  110.83  111.19  112.57  124.48  156.43  163.20
115.48  114.41  114.58  116.10  115.54  115.77  116.82  131.87  167.87  174.67
110.02  133.75  111.48  121.00  118.71  122.51  119.10  150.99  198.80  207.15
107.84  107.79  112.30  108.42  115.47  114.02  112.63  119.31  145.92  151.56
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~..~~~~~~~~~~~~~~~~~~~~~~
111.76  112.11  112.23  112.90  113.88  114.02  114.27  127.59  161.00  167.57

Results of some other programs are in full version only, TEXTS.DAT file.


[[2]] Speed
===========
Canterbury Corpus Large Set http://corpus.canterbury.ac.nz/resources/large.zip
was used for this test, and a 970MHz PC with 256Mb RAM and Windows98.

Programs,             Compression/    Overall    Average Users'   Compressed
options               Extraction,      Score         Score           Size
                        seconds     seconds, %    seconds, %       bytes ,  %
no compression            0     0     4446  559     4446  577    16005619  600
ace32 a -d4096           66     2     1124  141     1058  137     3801917  142
ace32 a -d4096 -m1       31     2     1134  143     1104  143     3965841  149
ace32 a -d4096 -m5      206     2     1249  157     1045  136     3746553  140
arh a                    38    40     1091  137     1053  137     3647067  137
arh a -2 -1              68    40     1121  141     1054  137     3647067  137
ba -k -50                35    12      964  121      929  121     3298943  124
bix a -mdg -s            92     1     1069  134      978  127     3514944  132
boa -m1                  86    88     1253  158     1168  152     3886863  146
boa -m15                139   141     1165  146     1027  133     3182739  119
boa -m15 -s             138   140     1148  144     1011  131     3132810  117
bzip2 -k                 21     6     1032  130     1011  131     3616113  136
bzip2 -k -9              20     6     1031  130     1011  131     3616113  136
Entropy   t o12          94    95     1003  126      910  118     2932445  110
Entropy   t o16          98    99     1001  126      904  117     2892711  108
Entropy   t o32         105   106     1009  127      905  118     2873677  108
Entropy   t o64         112   111     1022  128      911  118     2873318  108
compcl c -b15            37    20      904  114      868  113     3049569  114
compcl c -b15 -s         38    29      808  102      770  100     2668128  100
dc e                     13     7      903  114      890  116     3179173  119
dc e -b16300 -mt5        17     7      795  100      778  101     2773427  104
eri a                    39    17      936  118      897  116     3168414  119
eri a -m3                59    21      996  125      937  122     3295385  124
eri a -m6                59    21      989  124      931  121     3272926  123
gcac a                   26    12      980  123      954  124     3390603  127
gcac s                   26    12      981  123      955  124     3395064  127
imp98 a -mm              31     1     1175  148     1143  148     4112387  154
imp98 a -mm -2           13     5      999  126      986  128     3533761  132
imp98 a -2 -s4           13     5      999  126      986  128     3533693  132
pkzip -es                 1     1     1654  208     1652  215     5945622  223
pkzip -a                  4     1     1308  164     1304  169     4691491  176
pkzip -exx               16     1     1296  163     1280  166     4605942  173
ppmdi e -o7 -m232        11    12      904  114      893  116     3169000  119
ppmdi e -o12 -m232       25    26      915  115      891  116     3113630  117
ppmdi e -o16 -m232       27    28      916  115      890  116     3100943  116
ppmn_km e -o6 -MT1       30    30      931  117      901  117     3132278  117
ppmn_km e -o8 -MT1       64    65      993  125      929  121     3107654  116
ppmn_km e -o9            62    63      990  125      929  121     3115560  117
ppmn_km e -o9 -M:50      49    50      949  119      900  117     3058436  115
ppmonstr e -o7 -m232     64    67      974  123      911  118     3035498  114
ppmonstr e -o8 -m232     71    74      980  123      910  118     3007964  113
ppmonstr e -o64 -m232   101   103     1020  128      920  119     2937387  110
qlfc a                   22    11      973  122      952  124     3385084  127
rk -mf2                  50    20     1108  139     1058  137     3735704  140
rk -mx1                 144   143     1147  144     1004  130     3093640  116
rk -mx2                 173   173     1203  151     1032  134     3086312  116
sbc c -b63               29     9      914  115      885  115     3151930  118
sbc c -os -b63           29     9      810  102      782  101     2779632  104
szip -o4                  4    10     1027  129     1023  133     3647445  137
szip -o6                 17    14      996  125      979  127     3475264  130
szip -o8 -b41            27    17      973  122      947  123     3348344  125
zzip a                   21    11      977  123      956  124     3400243  127
zzip a -mx               22    12      973  122      952  124     3383060  127
zzip a -mx -30m          30    12      940  118      910  118     3233147  121

7za a -t7z               84     1     1112  139     1036  134     3694393  138
7za a -t7z -mx          111     1     1110  139     1010  131     3591954  134
7za a -tzip              23     2     1246  156     1225  159     4393623  164
7za a -tzip -mx          45     1     1268  159     1227  159     4401160  164
abc13 -c                 20     9      950  119      931  120     3313820  124
abc24 -c                 29    16      923  116      897  116     3159570  118
bee a -m1                72    71     1061  133      996  129     3303235  123
bee a -m2               142   137     1156  145     1027  133     3153498  118
bee a -m3               199   193     1253  157     1074  139     3100189  116
bee a -m3 -d6           175   169     1205  151     1048  136     3100537  116
bee a -m3 -s            340   356     1567  197     1261  163     3133527  117
durilca e -o10 -t2(30)   82    82      982  123      907  117     2941278  110
durilca e -o12 -t2(30)   85    85      983  123      906  117     2923546  109
durilca e -o16 -t2(30)   87    87      984  123      905  117     2912973  109
durilca e -o32 -t2(30)   90    90      988  124      907  117     2910279  109
durilca e -o128 -t2(30)  92    91      992  124      909  118     2910571  109
epm7 c012               144   142     1131  142     1001  129     3037532  113
epm7 c016               147   146     1138  143     1005  130     3038383  113
paq1                    277   275     1410  177     1161  150     3088369  115
paq1sse                 360   360     1550  194     1226  159     2988475  112
ppmy70 /o6 /m220        260   269     1454  182     1219  158     3327472  124
ppmy70 /o7 /m220        294   301     1484  186     1219  158     3199428  119
ppmy70 /o8 /m220        321   329     1514  190     1224  159     3108922  116
ppmy70 /o9 /m220        348   355     1549  194     1236  160     3046316  114
ppmy70 /o16 /m220       360   366     1810  227     1485  192     3899871  146
rar a -m1                13     1     1239  155     1227  159     4408290  165
rar a -m3                35     1     1155  145     1123  145     4026937  150
rar a -m5                24    16      920  115      898  116     3164814  118
rar a -m5 -s             24    16      922  116      900  116     3173148  118
rar a -mc16t -s          35    26      991  124      959  124     3347746  125
rar a -mc16t+ -s         35    26      991  124      959  124     3347746  125
rar a -mc16:128t -s      40    31      955  120      918  119     3180234  119
rar a -mc16:128t+ -s     40    31      955  120      918  119     3180234  119
rar32 a -mc16t -s        37    29      996  125      962  125     3347746  125
slim a -d32 -w21        555   552     1928  242     1428  185     2952807  110
slim a -d16 -w21        552   549     1922  241     1425  185     2952991  110
slim a -d8 -w21         537   534     1892  237     1408  182     2953730  110
slim a -d4 -w21         485   482     1788  224     1351  175     2954750  110
uharc a -m1 -md32768     63     5     1026  129      969  125     3446069  129
uharc a -m2 -md32768    100     5      980  123      890  115     3151572  118
uharc a -m3 -md32768    110     5      973  122      874  113     3087249  115
uharc a -mz -md32768      8     9     1084  136     1077  139     3842041  144
uharc a -mx -md32768     60    55      936  117      882  114     2953184  110
ybs -m1m                 22     8      952  119      931  120     3316356  124
ybs -m2m                 25     8      937  117      915  118     3255538  122
ybs -m4m                 28     8      919  115      894  116     3178183  119
ybs -m8m                 31     8      905  113      877  113     3116271  116
ybs -m16mu               33     9      835  105      805  104     2852642  106
ybs -m16mu -r            34     9      841  105      811  105     2874130  107
ybs_d -m16mu             34     9      836  105      805  104     2852642  106

Overall score is calculated by adding compression time, extraction time, and
time it would take to transfer the compressed file over a 28,800bps network:
(compressed_size)/3600

Average Users' score is calculated by adding (compress_time/10)+ extract_time +
time it would take to transfer the compressed file over a 28,800bps network.
Compression time is divided by 10 here, because more than 90% of people would
never compress anything during their life (with compression programs), but they
use compressed data almost _every_ time they use computers and/or Internet.
That's why compression time is not so actual for them.


[[3]] Details
=============
are no longer put to this main text
(thousands of lines reporting about 100,000 results on 1231 files in 6 sets),
but can be found in FULL version with TEXTS.DAT and *.BAT
at http://compression.ru/artest/artest25.zip
or http://artest1.tripod.com/artest25.zip


[[4]] Comments
==============
Links to download programs:
~~~~~~~~~~~~~~~~~~~~~~~~~~~
PPMD var.I,
PPmonstr v.I  :W http://compression.ru/ds/ppmdi1.rar
Durilca 0.1a  :W http://compression.ru/ds/durilca.rar
PAQ1SSE       :W http://compression.ru/so/paq1sse.zip
EPM 7         :W http://compression.ru/so/epm_7.zip
YBS 0.03f     :e http://compression.ru/ybs/ybs003fd.zip
YBS 0.03f     :W http://compression.ru/ybs/ybs003fw.zip
BEE 0.7.6     :W http://compression.ru/fa/files2/bee076d.rar
PPMN_km b4    :W http://compression.ru/ms/ppmn_km.rar
PPMY 3c+sse   :W http://compression.ru/sh/ppmy_3c_sse.rar
ERI 5.1fre    :e http://compression.ru/artest/eri51fre.zip
7-Zip 2.30b32 :W http://www.7-zip.org/dl/7z230b32.exe
WinRAR 3.20   :W http://www.rarlab.com/rar/wrar320.exe
RAR32  3.20   :e http://www.rarlab.com/rar/rarx320.exe
Bzip2 1.0.2   :W ftp://sources.redhat.com/pub/bzip2/v102/bzip2-102-x86-win32.exe
ABC 1.3       :W http://www.data-compression.info/ABC/abc_13.zip
ABC 2.4       :W http://www.data-compression.info/ABC/abc_24.zip
ACB 2.00c     :e ftp://ftp.simtel.net/pub/simtelnet/msdos/compress/acb_200c.zip
ACE 2.04      :W http://winace.host.sk/ace204.exe
ArHanGeL 1.40 :a http://geocities.com/SiliconValley/Lab/6606/arh140.zip
BA 1.01b5     :e http://hem.spray.se/mikael.lundqvist/ba101br5.zip
BOA 0.58b     :e ftp://ftp.elf.stuba.sk/pub/pc/pack/boa058.zip
Compressia 1.0b :W http://www.compressia.com/compressia.exe
DC 0.98b      :W ftp://ftp.elf.stuba.sk/pub/pc/pack/dc124.zip
GCac 0.9k     :W http://www.emit.jp/gca/gca_v09k.exe
Imp     1.1   :e http://www.technelysium.com.au/imp110d.zip
Imp-win 1.12  :W http://www.technelysium.com.au/imp112.exe
PAQ1          :W http://cs.fit.edu/~mmahoney/compression/paq1.exe
PkzipC  4.00  :W ftp://ftp.pkware.com/pkzc400s.exe
PkZip   2.50  :a ftp://ftp.simtel.net/pub/simtelnet/msdos/arcers/pk250dos.exe
QLFC 6.6W     :W http://ghido.shelter.ro/Archive/DownloadQLFC.php
RK-dos 1.04.1 :e http://rksoft.virtualave.net/downloads/rk104a1d.exe
RK     1.04.1 :W http://rksoft.virtualave.net/downloads/rk104a1w.exe
SBC_d 0.969br1 :e http://personal.inet.fi/musiikki/sjm/sbc0969b_dos.zip
SBC   0.969br1 :W http://personal.inet.fi/musiikki/sjm/sbc0969b_win32.zip
Slim b13      :W http://www.slim-fb.by.ru/files/slim0013.zip
SZip 1.12a    :W http://www.compressconsult.com/szip/szip_112a_win32.zip
UHArc 0.4b    :eW ftp://ftp.elf.stuba.sk/pub/pc/pack/uharc04.zip
ZZip 0.36c    :W http://debin.org/zzip/files/zzip-win32.zip

:a - any DOS  - DOS programs, will run under pure DOS or in a DOS box
:e - extender - DOS programs using DOS extenders like DOS/4GW or CWSDPMI
:W - windows  - Windows95/98/NT/etc programs

If direct link doesn't work-most probably newer version of the program appeared
at the same site: visit web page, or read the whole directory from ftp server
(i.e. try the same URL, but without filename).


Homepages:
~~~~~~~~~~
PPMD,PPMonstr,
Durilca    : http://compression.ru/ds
EPM        : http://compression.ru/so
YBS        : http://compression.ru/ybs
BEE        : http://compression.ru/fa
PPMN       : http://compression.ru/ms
PPMy       : http://compression.ru/sh
Eri32      : http://compression.ru/artest
  mirror   : http://artest1.tripod.com
7-Zip      : http://www.7-zip.org
RAR,WinRAR : http://www.rarlab.com
ACE,WinACE : http://www.winace.com
PkZip      : http://www.pkware.com
BZip2      : http://sources.redhat.com/bzip2
SZip       : http://www.compressconsult.com/szip
ABC        : http://www.data-compression.info
Arhangel   : http://geocities.com/SiliconValley/Lab/6606
BA         : http://hem.spray.se/mikael.lundqvist
Compressia : http://www.compressia.com
GCAC       : http://emit.jp/gca/gca.html
Imp,WinImp : http://www.technelysium.com.au/winimp.html
PAQ1       : http://cs.fit.edu/~mmahoney/compression/
RK         : http://rksoft.virtualave.net
SBC        : http://sbcarchiver.netfirms.com
QLFC       : http://ghido.shelter.ro
Slim       : http://www.slim-fb.by.ru
ZZip       : http://debin.org/zzip/
ShipInBottle: http://shipinbottle.narod.ru

What's new:
~~~~~~~~~~~
14 new programs were tested:

7-zip 2.30b32
RAR 3.20
ABC 1.3
ABC 2.4
UHArc 0.5np2
EPM 7
Slim b13
BEE 0.7.6
Durilca 0.1a
PPMy 3c+sse
PAQ 1
PAQ 1SSE
YBS 0.03f
Compressia 1.0b

Latest beta versions of DC, Entropy, UHArc were available
from authors by e-mail request:
Entropy: artest@inbox.ru
DC: EdgarBinder@t-online.de
UHArc: Uwe.Herklotz@gmx.de

Results of many other programs are in full version only, TEXTS.DAT file.

The set of Russian texts is at http://arte.nm.ru/m120


WARNINGS:
~~~~~~~~~
BA 1.00beta5 can't correctly decompress shaks12.txt and set used for speed
measurements.

DC 0.99.158b failed to decompress 1DFRE10.dc , ANDES10.dc , and BTI0110.dc,
saying "Corrupted block" (while t(est) command writes "Test successful").

Problems in all other compressors were not found.

ESP, Rkive and many other programs are not tested any more,
their results and links can be found in previous volumes of ARTest.

The LATEST RELEASE, and all previous volumes can be found
at http://compression.ru/artest/


Send your suggestions, comments to artest@inbox.ru
With best kind regards,
A.Ratushnyak

Back to main ARTest page