The Art of Lossless Data Compression vol. 24b

Here are the results of tests performed in August 2002 to compare lossless compression of "binary" files by all known good enough programs developed for such purpose, including RK, DC, YBS, Bzip2, RAR, ACE and 7-zip. See Archive Comparison Test by J.Gilchrist for more details: http://compression.ca If anybody wants to start or continue such tests, or can suggest some other sets of files, or other compression programs, (not sources or algorithm descriptions, executable programs only) or knows we have missed something important, (some new fantastic technology, an algorithm or even a program capable of lossless compression of up to 1000:1 etc.) please let us know immediately: artest@inbox.ru Thank you! [[1]] COMPRESSION QUALITY ========================= (see also [[2]] Speed [[3]] Details [[4]] Comments) Last eleventh line shows results for the sum of all 5960 files in ten sets. Original Entropy UHARC PPMonstr RK 7-zip 777 Slim RAR PPMN 257.68% 100% 104.66 101.56 107.16 108.53 109.54 109.25 110.08 109.78 264.52% 100% 102.93 104.25 104.57 104.38 101.98 108.26 109.44 107.91 187.28% 100% 101.06 102.09 103.24 103.26 102.83 104.39 106.01 103.61 346.78% 100% 102.29 113.32 117.47 116.52 121.33 120.26 113.30 125.70 179.82% 100.86 103.11 112.05 111.76 114.98 115.23 108.61 108.24 115.96 393.85% 100% 102.06 101.25 101.74 108.34 109.35 115.75 117.06 117.56 198.15% 100% 103.32 103.66 104.55 103.53 105.74 106.01 108.97 105.68 268.20% 100% 100.24 100.31 101.15 102.28 104.42 109.55 107.13 110.68 237.23% 100% 103.15 103.90 104.30 104.87 104.73 106.60 108.08 105.73 371.66% 100% 106.00 102.67 105.32 107.69 111.36 114.84 118.66 115.55 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 246.50% 100% 102.51 103.77 105.26 106.18 106.83 108.47 109.25 109.31 SBC Compressia ACE BEE PPMd ERI IMP DC BZip2 Pkzip 113.67 111.16 112.74 111.58 112.21 116.94 118.71 114.17 121.17 125.37 111.05 117.82 110.39 111.72 113.25 116.72 112.32 120.04 124.14 131.99 106.33 106.03 106.26 106.92 108.11 109.71 107.52 111.40 113.64 112.97 115.05 120.78 127.34 121.74 125.41 120.90 123.25 122.64 138.61 155.89 100% 108.56 107.23 117.45 119.50 104.06 119.90 110.52 120.53 127.93 122.77 120.73 120.28 118.04 118.01 127.87 126.85 122.09 131.89 133.52 107.57 105.30 109.95 108.16 110.25 111.05 111.00 112.32 117.13 119.63 109.91 111.50 108.71 113.43 114.34 113.03 119.90 113.97 122.04 125.31 109.40 108.77 108.98 109.87 111.51 112.15 110.19 114.30 118.39 119.62 118.57 113.26 119.61 116.93 119.56 126.73 126.36 127.45 135.84 140.91 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 109.83 110.68 110.89 111.68 113.18 113.94 114.83 115.22 121.24 124.95 [[2]] Speed =========== 4th set, all from ftp://ftp.simtel.net/pub/simtelnet/win95/graphics/sface10.zip was used for this test, and a 970MHz PC with 256Mb RAM and Windows98. Programs, Compression/ Overall Average Users' Compressed options Extraction, Score Score Size seconds seconds, % seconds, % bytes , % no compression 0 0 7613 392 7613 419 27408516 422 777 a -mg 727 401 3792 195 3072 169 9586586 148 777 a -mg -mu32 735 405 3804 196 3076 169 9588918 148 7za a -t7z 70 4 2783 143 2714 149 9752090 150 7za a -t7z -mx 127 4 2616 135 2491 137 8948766 138 7za a -tzip 23 2 3388 174 3365 185 12104526 186 7za a -tzip -mx 56 2 3409 175 3353 184 12062635 186 acb B 412 414 3723 191 3315 182 10426759 161 acb b 581 583 4013 206 3438 189 10254633 158 ace32 a -d4096 57 3 2600 134 2543 140 9141767 141 ace32 a -d4096 -m1 48 3 2604 134 2557 141 9190071 142 ace32 a -d4096 -m5 62 3 2610 134 2548 140 9158751 141 arh a -2 -mm 197 184 3213 165 3018 166 10196406 157 arh a -1 -mm 28 6 2986 154 2958 163 10625915 164 arh a -2 -1 304 203 3676 189 3375 186 11408516 176 ba -k -50 47 25 3016 155 2970 163 10601804 163 ba -k 38 23 2974 153 2936 161 10487070 162 ba -k -10 38 23 2937 151 2899 159 10353984 160 bee a -m1 209 202 3298 170 3090 170 10390747 160 bee a -m2 374 367 3422 176 3052 168 9651819 149 bee a -m3 -s 649 697 3971 204 3328 183 9450207 146 bix a 68 4 3020 155 2953 162 10612578 164 bix a -mdg 74 2 2999 154 2926 161 10524303 162 bix a -mdg -s 99 2 2822 145 2723 150 9792685 151 boa -m1 236 227 3624 186 3390 186 11379129 175 boa -m15 690 616 4186 215 3503 193 10368786 160 boa -m15 -s 696 617 4191 216 3502 193 10359887 160 bzip2 -k 33 10 3130 161 3098 170 11112953 171 bzip2 -k -5 31 10 3132 161 3101 171 11126137 171 bzip2 -k -9 33 10 3130 161 3098 170 11112953 171 ery-e b o12 261 275 2745 141 2487 137 7953204 123 ery-e b o16 260 278 2740 141 2483 137 7928059 122 ery-e b o32 270 287 2753 142 2486 137 7907407 122 ery-e b o64 301 307 2804 144 2506 138 7903715 122 compcl c -b15 51 42 2744 141 2694 148 9544827 147 compcl c -b15 -s 51 42 2743 141 2693 148 9540017 147 dc e 108 14 2797 144 2690 148 9630736 148 dc e -b16300 131 14 2337 120 2207 121 7888232 122 dc e -b16300 -mb5 130 14 2335 120 2207 121 7888421 122 eri a 55 31 2782 143 2727 150 9706022 150 eri a -m3 85 38 2777 143 2693 148 9555684 147 eri a -m6 86 38 2785 143 2700 149 9582523 148 gcac a 44 17 2898 149 2854 157 10212208 157 gcac s 45 18 2935 151 2890 159 10337588 159 imp98 a -mm 33 1 2749 141 2716 149 9770169 151 imp98 a -mm -m3 53 1 2757 142 2705 149 9730287 150 imp98 a -mm -s4 34 4 2753 142 2720 150 9775588 151 pkzip -es 3 1 3952 203 3949 217 14212209 219 pkzip -a 6 1 3437 177 3431 189 12347196 190 pkzip -exx 7 1 3431 176 3423 188 12320267 190 ppmdi e -o12 -m232 53 57 2868 148 2816 155 9930336 153 ppmdi e -o16 -m232 55 58 2866 147 2812 155 9911769 153 ppmn_km e -o6 -M:50 217 219 3150 162 2935 161 9772905 151 ppmn_km e -o7 -M:50 237 239 3188 164 2953 162 9760047 150 ppmn_km e -o8 -M:50 245 246 3183 164 2941 162 9692957 149 ppmn_km e -o9 -M:50 245 246 3185 164 2943 162 9697928 149 ppmonstr e -o12 -m250 276 288 3063 158 2790 153 8996048 139 ppmonstr e -o16 -m250 279 301 3073 158 2797 154 8974666 138 ppmonstr e -o128 -m250 644 703 3834 197 3196 176 8954077 138 ppmy /o6 /m220 2874 2746 8698 447 5852 322 11078479 171 ppmy /o7 /m220 2619 2647 8549 440 5956 328 11819257 182 ppmy /o8 /m220 2572 2598 8596 442 6050 333 12335730 190 qlfc a 31 19 3019 155 2988 164 10689214 165 rar a -m5 -s 73 5 2373 122 2301 127 8260230 127 rar a -mc16:128t -s 49 6 2354 121 2305 127 8275443 127 rar a -mc16:128t+ -s 68 47 2399 123 2332 128 8222366 127 rk -mf3 128 73 2815 145 2688 148 9410064 145 rk -mx1 498 499 3672 189 3179 175 9627044 148 rk -mx3 844 845 4074 210 3238 178 8584928 132 sbc c -m3 64 21 2181 112 2118 116 7548923 116 sbc c -m3 -b63 74 21 2192 113 2119 117 7548878 116 sbc c -ad -b63 59 26 2193 113 2134 117 7587006 117 slim a -d32 -w22 1940 1954 6487 334 4567 251 9336416 144 slim a -d16 -w22 1936 1972 6500 334 4584 252 9333547 144 slim a -d8 -w22 1948 2017 6556 337 4627 254 9328191 144 slim a -d4 -w22 1923 1922 6435 331 4531 249 9322631 144 szip -o4 15 20 3163 163 3149 173 11262438 174 szip -o8 -b41 53 24 3042 156 2989 164 10671420 164 ufa a -mg 234 39 3023 155 2792 154 9900254 153 ufa a -mg -mu32 242 43 3036 156 2796 154 9902586 153 ufa a -mg -s 352 25 3164 163 2815 155 10030871 155 uharc a -m1 -md32768 103 14 1944 100 1842 101 6577686 101 uharc a -m2 -md32768 128 14 1954 100 1827 100 6522084 100 uharc a -m3 -md32768 143 14 1960 101 1818 100 6490844 100 uharc a -mz -md32768 23 25 2638 136 2616 144 9325552 144 uharc a -mx -md32768 160 136 2138 110 1979 109 6626726 102 ybs -m15mu 49 17 2693 139 2644 145 9457129 146 ybs -m15mu -r 52 17 2690 138 2639 145 9436857 145 zzip a -a 38 20 2946 152 2909 160 10398266 160 zzip a -mx -mm 40 22 2814 145 2774 153 9907114 153 zzip a -mx -30m 43 23 2976 153 2934 161 10478036 161 Overall score is calculated by adding compression time, extraction time, and time it would take to transfer the compressed file over a 28,800bps network: (compressed_size)/3600 Average Users' score is calculated by adding (compress_time/10)+ extract_time + time it would take to transfer the compressed file over a 28,800bps network. Compression time is divided by 10 here, because more than 90% of people would never compress anything during their life (with compression programs), but they use compressed data almost _every_ time they use computers and/or Internet. That's why compression time is not so actual for them. [[3]] Details ============= are no longer put to this main text (6290 lines reporting 238840 results on 5960 files in 10 sets), but can be found in FULL version with BINARIES.DAT and *.BAT at http://geocities.com/SiliconValley/Bay/1995/artest24.zip or http://artest1.tripod.com/artest24.zip [[4]] Comments ============== Links to download programs: ~~~~~~~~~~~~~~~~~~~~~~~~~~~ ACE 2.04 :W http://winace.host.sk/ace204.exe 593K ERI 5.1fre :e http://geocities.com/eri32/eri51fre.zip 89K GCac 0.9k :W http://www.emit.jp/gca/gca_v09k.exe 295K UHArc 0.4b :eW ftp://ftp.elf.stuba.sk/pub/pc/pack/uharc04.zip 220K QLFC 6.6W :W http://ghido.shelter.ro/DownloadQLFC.php 49K ZZip 0.36c :W http://www.via.ecp.fr/~damien/downloads/zzip-win32.zip 35K PPMD var.I, PPmonstr v.I :W ftp://ftp.elf.stuba.sk/pub/pc/pack/ppmdi1.rar 73K PkzipC 4.00 :W ftp://ftp.pkware.com/pkzc400s.exe 3470K PkZip 2.50 :a ftp://ftp.simtel.net/pub/simtelnet/msdos/arcers/pk250dos.exe 202K RK-dos 1.04.1 :e http://rksoft.virtualave.net/downloads/rk104a1d.exe 461K RK 1.04.1 :W http://rksoft.virtualave.net/downloads/rk104a1w.exe 380K BA 1.01b5 :e http://hem.spray.se/mikael.lundqvist/ba101br5.zip 61K BIX 1.00b7 :W http://www.7-zip.org/dl/ufa/bix100b7.zip 89K 777 0.04b1 :W http://www.7-zip.org/dl/ufa/777004b1.zip 72K UFA 0.04b1 :W http://www.7-zip.org/dl/ufa/ufa004b1.zip 64K ArHanGeL 1.40 :a http://geocities.com/SiliconValley/Lab/6606/arh140.zip 50K Imp 1.1 :e http://www.technelysium.com.au/imp110d.zip 266K Imp-win 1.12 :W http://www.technelysium.com.au/imp112.exe 122K ACB 2.00c :e ftp://ftp.simtel.net/pub/simtelnet/msdos/compress/acb_200c.zip 42K BOA 0.58b :e ftp://ftp.elf.stuba.sk/pub/pc/pack/boa058.zip 74K DC 0.98b :W ftp://ftp.elf.stuba.sk/pub/pc/pack/dc124.zip 55K SZip 1.12a :W http://www.compressconsult.com/szip/szip_112a_win32.zip 71K YBS 0.03e :e http://compression.graphicon.ru/ybs/ybs003ed.zip 56K YBS 0.03e :W http://compression.graphicon.ru/ybs/ybs003ew.zip 44K Slim b10 :W http://slim-fb.by.ru/slim0010.zip 22K Bzip2 1.0.2 :W ftp://sources.redhat.com/pub/bzip2/v102/bzip2-102-x86-win32.exe Compressia 0.98b :W http://www.compressia.com/compcl.exe SBC_d 0.969br1 :e http://personal.inet.fi/musiikki/sjm/sbc0969b_dos.zip SBC 0.969br1 :W http://personal.inet.fi/musiikki/sjm/sbc0969b_win32.zip BEE 0.6.3 :W http://compression.graphicon.ru/fa/files2/bee063.rar PPMN_km b4 :W http://compression.graphicon.ru/ms/ppmn_km.rar PPMY 0.3c :W http://compression.graphicon.ru/sh/ppmy_3c.rar 7-Zip 2.30b23 :W http://belnet.dl.sourceforge.net/sevenzip/7z230b23.exe WinRAR 3.00 :W http://www.rarlab.com/rar/wrar300.exe RAR32 3.00 :e http://www.rarlab.com/rar/rarx300.exe :a - any DOS - DOS programs, will run under pure DOS or in a DOS box :e - extender - DOS programs using DOS extenders like DOS/4GW or CWSDPMI :W - windows - Windows95/98/NT/etc programs If direct link doesn't work-most probably newer version of the program appeared at the same site: visit web page, or read the whole directory from ftp server (i.e. try the same URL, but without filename). Homepages: ~~~~~~~~~~ Arhangel : http://geocities.com/SiliconValley/Lab/6606 BA : http://hem.spray.se/mikael.lundqvist Eri32 : http://geocities.com/eri32 mirror : http://artest1.tripod.com RK : http://rksoft.virtualave.net Imp,WinImp : http://www.technelysium.com.au/winimp.html ACE,WinACE : http://www.winace.com PkZip : http://www.pkware.com RAR,WinRAR : http://www.rarlab.com BZip2 : http://sources.redhat.com/bzip2 SZip : http://www.compressconsult.com/szip PPMN : http://compression.graphicon.ru/ms YBS : http://compression.graphicon.ru/ybs SBC : http://sbcarchiver.netfirms.com QLFC : http://ghido.shelter.ro GCAC : http://emit.jp/gca/gca.html PPMy : http://www.pilabs.org.ua/sh ZZip : ? http://www.zzip.f2s.com Compressia : http://www.compressia.com/ Slim : http://slim-fb.by.ru/ Ufa,777, BIX,7-Zip : http://www.7-zip.org What's new: ~~~~~~~~~~~ 12 new programs were tested: PPMd v.I PPMonstr v.I 7-zip 2.30b22 RAR 3.00 BZip2 1.0.2 PPMN_km b4 SBC 0.969b r1 Entropy 0.7 Compressia 0.98b Bee 0.6.3 u1 PPMy 0.3c Slim aug17 7-zip, RAR and BZip2 perform exactly as their previous versions tested in March or earlier. Latest beta versions of Entropy, Slim, DC were available from authors by e-mail request: Entropy: artest@inbox.ru Slim: grayw@secom.lg.ua DC: EdgarBinder@t-online.de Results of BOA, ZZip, GCAC, YBS, BA, Arhangel, SZip, QLFC, PPMy, 7-zip with .zip format are in full version only, BINARIES.DAT file. FULL version contains all *.BAT and *.DAT files you'll need to build 10 directories with 5960 files (artest24.zip\COOK_SET\*.*) and to repeat all our tests (BINS.BAT, BINARIES.DAT). Some old or less efficient programs will not be included next time: 777, UFA, BIX, ACB, BA, PPMy. WARNINGS: ~~~~~~~~~ BA 1.00beta5 can't losslessly decompress many files: CUN5IF~1.bin, CUN6IF~1 etc It types nothing like "CRC fails". DC 0.99.158b fails to decompress HLPCOPY..bin, but only if you compress with "-mb5" switch and [] filename like "any.dc5". Says nothing like "CRC fails". Problems in all other compressors were not found. The LATEST RELEASE, and all previous versions of these tests can be found at http://geocities.com/SiliconValley/Bay/1995/ and http://artest1.tripod.com/ Send your suggestions, comments to artest@inbox.ru With best kind regards, A.Ratushnyak Back to main ARTest page