WIN | KOI | LAT

The Art
of Lossless
Data Compression
vol. 26t

Here are the results of tests performed in December 2003 to compare
lossless compression of "plain" texts by all known good enough programs
developed for such purpose, including UHArc, PPMd, Bzip2, RAR, ACE and 7-zip.

See Archive Comparison Test by J.Gilchrist for more details:
http://compression.ca

If anybody wants to start or continue such tests,
or can suggest some other sets of texts, or other compression programs,
 (not sources or algorithm descriptions, executable programs only)
or knows we have missed something important,
 (some new fantastic technology, an algorithm or even a program capable
 of lossless compression of up to 1000:1 etc.)
please let us know immediately: artest@inbox.ru   Thank you!


[[1]] COMPRESSION QUALITY
=========================
             (see also
             [[2]] Speed
             [[3]] Details
             [[4]] Comments)

Last seventh line shows results for the sum of all 1231 texts in six sets.

Origin DURILCA Entropy   Slim    RKC     EPM  Compressia PAQ6  PPMonstr  PPMN 
555.90% 100.04  100.47  100.13   100%   101.76  100.92  101.06  102.24  106.01
567.66%  100%   104.53  108.58  104.13  110.79  108.38  110.82  113.42  115.01
455.43%  100%   104.56  108.09  106.31  109.96  108.47  110.10  112.89  111.94
513.18%  100%   104.14  109.85  107.26  112.58  110.55  113.25  115.19  114.70
799.24% 100.41  101.80  108.25  124.62  102.27  106.97  102.55   100%   115.93
432.59%  100%   122.52  122.68  127.29  123.95  130.67  124.45  125.58  123.82
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
506.08%  100%   108.04  111.99  112.20  113.73  114.12  114.19  115.87  116.11

 ASH     BEE      PPMd    RAR    UHArc    DC     SBC    BZip2   7-zip   pkzip 
101.08  107.67  108.14  109.58  105.80  109.17  109.49  124.64  152.86  159.97
113.49  117.44  118.78  120.19  117.81  119.46  120.79  136.85  178.63  186.09
112.30  116.43  117.05  117.39  115.89  116.26  117.70  130.16  163.57  170.65
114.86  119.36  120.27  120.44  120.33  120.57  121.66  137.33  174.83  181.91
110.63  111.40  109.06  110.11  117.68  121.44  118.06  149.67  197.06  205.34
126.87  128.81  129.39  130.16  138.55  136.80  135.14  143.16  175.08  181.85
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~..~~~~~~~~~~~~~~~~~~~~~~
116.43  120.13  120.75  121.21  123.03  123.18  123.45  137.84  173.93  181.03

Results of many other programs are in full version only, TEXTS.DAT file.


[[2]] Speed
===========
Canterbury Corpus Large Set http://corpus.canterbury.ac.nz/resources/large.zip
was used for this test, and a 970MHz PC with 256Mb RAM and Windows98.

Programs,             Compression/    Overall    Average Users'   Compressed
options               Extraction,      Score         Score           Size
                        seconds     seconds, %    seconds, %       bytes ,  %
no compression            0     0     4446  559     4446  577    16005619  600
7za a -t7z               88     1     1104  138     1024  133     3650998  138
7za a -t7z -mx          154     1      982  123      843  109     2975903  113
7za a -tzip              23     0     1244  156     1223  158     4393623  167
7za a -tzip -mx          44     0     1268  159     1227  159     4401160  167
ash04a /o6 /m230        110   114     1100  138     1001  130     3154310  119
ash04a /o9 /m230        164   170     1130  142      982  127     2863384  108
ash04a /o16 /m230       221   210     1524  191     1324  171     3932449  149
ash04a /o6 /m230 /s16   117   121     1113  140     1007  130     3146157  119
ash04a /o9 /m230 /s16   172   177     1142  143      987  128     2855460  108
ash04a /o16 /m230 /s16  235   224     1541  193     1329  172     3895407  148
bee a -m1                70    71     1049  132      986  128     3268345  124
bee a -m2               144   148     1167  146     1037  134     3147914  119
bee a -m3               201   204     1267  159     1085  140     3099133  117
durilca e -o8 -t2(31)    77    77      964  121      895  116     2915855  110
durilca e -o9 -t2(31)    80    80      969  121      897  116     2911029  110
durilca e -o10 -t2(31)   82    83      970  122      896  116     2899602  110
durilca e -o12 -t2(31)   83    85      970  122      895  116     2886375  109
durilca e -o16 -t2(31)   85    86      972  122      895  116     2880306  109
durilca e -o32 -t2(31)   87    88      975  122      896  116     2878335  109
durilca e -o64 -t2(31)   88    89      977  122      898  116     2878490  109
durilca e -o128 -t2(31)  88    90      978  123      898  116     2878614  109
epm9 c008               117   116     1034  130      929  120     2882720  109
epm9 c012               142   142     1119  140      991  128     3007492  114
epm9 c016               147   147     1138  143     1006  130     3040288  115
grzipii e                16    10      908  114      893  115     3170895  120
paq6v2a                 388   387     1597  200     1247  161     2957673  112
paq6v2a -6             2551  2710     6002  754     3706  481     2664718  101
rar a -m1                13     1     1239  155     1227  159     4408290  167
rar a -m2                21     1     1169  147     1150  149     4131324  157
rar a -m3                36     1     1156  145     1123  145     4026937  153
rar a -m4                19    11      914  114      896  116     3178761  120
rar a -m5                25    16      920  115      898  116     3164814  120
rar a -m5 -s             25    16      923  116      900  116     3173148  120
rar a -mc16t -s          35    26      992  124      960  124     3347746  127
rar a -mc16t+ -s         35    26      992  124      960  124     3347746  127
rar a -mc16:128t -s      40    31      955  120      919  119     3180234  120
rar a -mc16:128t+ -s     40    31      955  120      919  119     3180234  120
rar32 a -mc16t -s        37    28      996  125      962  124     3347746  127
rkc -mf -M230M -o8       94     6     1083  136      998  129     3537812  134
rkc -mx -M230M -o8      120   130     1019  128      911  118     2766843  105
rkc -mxx -M230M -o8     276   276     1320  166     1071  139     2763319  105
rkc -mxx -M230M -o12    297   297     1334  167     1067  138     2663521  101
rkc -mxx -M230M -o16    318   312     1361  171     1074  139     2630041  100
rkc -mxx -M230M -ft     316   316     1367  172     1082  140     2645990  100
rkc -mf -M230M -td+      94     6     1083  136      998  129     3537812  134
rkc -mx -M230M -td+     144   156     1032  129      902  117     2633402  100
rkc -mxx -M230M -td+    305   311     1346  169     1072  139     2630041  100
slim a -d32 -w21        581   650     2034  255     1511  196     2890141  109
slim a -d16 -w21        577   648     2029  255     1509  195     2890280  109
slim a -d8 -w21         566   626     1995  250     1486  192     2891166  109
slim a -d4 -w21         521   583     1908  239     1439  186     2892897  109
uhbc e                   40    31      951  119      914  118     3164344  120
//previous
ace32 a -d4096           66     2     1124  141     1058  137     3801917  142
ace32 a -d4096 -m1       31     2     1134  143     1104  143     3965841  149
ace32 a -d4096 -m5      206     2     1249  157     1045  136     3746553  140
arh a                    38    40     1091  137     1053  137     3647067  137
arh a -2 -1              68    40     1121  141     1054  137     3647067  137
ba -k -50                35    12      964  121      929  121     3298943  124
bix a -mdg -s            92     1     1069  134      978  127     3514944  132
boa -m1                  86    88     1253  158     1168  152     3886863  146
boa -m15                139   141     1165  146     1027  133     3182739  119
boa -m15 -s             138   140     1148  144     1011  131     3132810  117
bzip2 -k                 21     6     1032  130     1011  131     3616113  136
bzip2 -k -9              20     6     1031  130     1011  131     3616113  136
Entropy   t o12          94    95     1003  126      910  118     2932445  110
Entropy   t o16          98    99     1001  126      904  117     2892711  108
Entropy   t o32         105   106     1009  127      905  118     2873677  108
Entropy   t o64         112   111     1022  128      911  118     2873318  108
compcl c -b15            37    20      904  114      868  113     3049569  114
compcl c -b15 -s         38    29      808  102      770  100     2668128  100
dc e                     13     7      903  114      890  116     3179173  119
dc e -b16300 -mt5        17     7      795  100      778  101     2773427  104
eri a                    39    17      936  118      897  116     3168414  119
eri a -m3                59    21      996  125      937  122     3295385  124
eri a -m6                59    21      989  124      931  121     3272926  123
gcac a                   26    12      980  123      954  124     3390603  127
gcac s                   26    12      981  123      955  124     3395064  127
imp98 a -mm              31     1     1175  148     1143  148     4112387  154
imp98 a -mm -2           13     5      999  126      986  128     3533761  132
imp98 a -2 -s4           13     5      999  126      986  128     3533693  132
pkzip -es                 1     1     1654  208     1652  215     5945622  223
pkzip -a                  4     1     1308  164     1304  169     4691491  176
pkzip -exx               16     1     1296  163     1280  166     4605942  173
ppmdi e -o7 -m232        11    12      904  114      893  116     3169000  119
ppmdi e -o12 -m232       25    26      915  115      891  116     3113630  117
ppmdi e -o16 -m232       27    28      916  115      890  116     3100943  116
ppmn_km e -o6 -MT1       30    30      931  117      901  117     3132278  117
ppmn_km e -o8 -MT1       64    65      993  125      929  121     3107654  116
ppmn_km e -o9            62    63      990  125      929  121     3115560  117
ppmn_km e -o9 -M:50      49    50      949  119      900  117     3058436  115
ppmonstr e -o7 -m232     64    67      974  123      911  118     3035498  114
ppmonstr e -o8 -m232     71    74      980  123      910  118     3007964  113
ppmonstr e -o64 -m232   101   103     1020  128      920  119     2937387  110
qlfc a                   22    11      973  122      952  124     3385084  127
rk -mf2                  50    20     1108  139     1058  137     3735704  140
rk -mx1                 144   143     1147  144     1004  130     3093640  116
rk -mx2                 173   173     1203  151     1032  134     3086312  116
sbc c -b63               29     9      914  115      885  115     3151930  118
sbc c -os -b63           29     9      810  102      782  101     2779632  104
szip -o4                  4    10     1027  129     1023  133     3647445  137
szip -o6                 17    14      996  125      979  127     3475264  130
szip -o8 -b41            27    17      973  122      947  123     3348344  125
zzip a                   21    11      977  123      956  124     3400243  127
zzip a -mx               22    12      973  122      952  124     3383060  127
zzip a -mx -30m          30    12      940  118      910  118     3233147  121
abc13 -c                 20     9      950  119      931  120     3313820  124
abc24 -c                 29    16      923  116      897  116     3159570  118
uharc a -m1 -md32768     63     5     1026  129      969  125     3446069  129
uharc a -m2 -md32768    100     5      980  123      890  115     3151572  118
uharc a -m3 -md32768    110     5      973  122      874  113     3087249  115
uharc a -mz -md32768      8     9     1084  136     1077  139     3842041  144
uharc a -mx -md32768     60    55      936  117      882  114     2953184  110
ybs -m1m                 22     8      952  119      931  120     3316356  124
ybs -m2m                 25     8      937  117      915  118     3255538  122
ybs -m4m                 28     8      919  115      894  116     3178183  119
ybs -m8m                 31     8      905  113      877  113     3116271  116
ybs -m16mu               33     9      835  105      805  104     2852642  106
ybs -m16mu -r            34     9      841  105      811  105     2874130  107
ybs_d -m16mu             34     9      836  105      805  104     2852642  106

Overall score is calculated by adding compression time, extraction time, and
time it would take to transfer the compressed file over a 28,800bps network:
(compressed_size)/3600

Average Users' score is calculated by adding (compress_time/10)+ extract_time +
time it would take to transfer the compressed file over a 28,800bps network.
Compression time is divided by 10 here, because more than 90% of people would
never compress anything during their life (with compression programs), but they
use compressed data almost _every_ time they use computers and/or Internet.
That's why compression time is not so actual for them.


[[3]] Details
=============
are no longer put to this main text
(thousands of lines reporting about 60,000 results on 1231 files in 6 sets),
but can be found in FULL version with TEXTS.DAT and *.BAT
at http://compression.ru/artest/artest26.zip
or http://artest1.tripod.com/artest26.zip


[[4]] Comments
==============
Links to download programs
and Homepages
are now in links.htm file

What's new:
~~~~~~~~~~~
12 new programs were tested:

ASH 04a
7-zip 3.13
RAR 3.30b5
UHBC 1.0
EPM 9
Slim 0.021a
BEE 0.7.7
Durilca 0.3a
PAQ 6v2
RKC 1.02
GRZipII 0.2.3
BWIC

Latest beta versions of DC, Entropy, UHArc were available
from authors by e-mail request:
Entropy: artest@inbox.ru
DC: EdgarBinder@t-online.de
UHArc: Uwe.Herklotz@gmx.de

Results of many other programs are in full version only, TEXTS.DAT file.

The set of Russian texts was at http://arte.nm.ru, but now only artest@inbox.ru


WARNINGS:
~~~~~~~~~
Beta versions of RKC, EPM and BWIC fail to compress and/or decompress many
files. Authors are notified.
ASH 04a can fail to decompress some large files if it lacks memory.

BA 1.00beta5 can't correctly decompress shaks12.txt and set used for speed
measurements.

DC 0.99.158b failed to decompress 1DFRE10.dc , ANDES10.dc , and BTI0110.dc,
saying "Corrupted block" (while t(est) command writes "Test successful").

Problems in all other compressors were not found.

ESP, Rkive and many other programs are not tested any more,
their results and links can be found in previous volumes of ARTest.

The LATEST RELEASE, and all previous volumes can be found
at http://compression.ru/artest/


Send your suggestions, comments to artest@inbox.ru
With best kind regards,
A.Ratushnyak

Back to main ARTest page