The Art of Lossless Data Compression vol. 26b

Here are the results of tests performed in December 2003 to compare lossless compression of "binary" files by all known good enough programs developed for such purpose, including UHArc, PPMd, Bzip2, RAR, ACE and 7-zip. See Archive Comparison Test by J.Gilchrist for more details: http://compression.ca If anybody wants to start or continue such tests, or can suggest some other sets of files, or other compression programs, (not sources or algorithm descriptions, executable programs only) or knows we have missed something important, (some new fantastic technology, an algorithm or even a program capable of lossless compression of up to 1000:1 etc.) please let us know immediately: artest@inbox.ru Thank you! [[1]] COMPRESSION QUALITY ========================= (see also [[2]] Speed [[3]] Details [[4]] Comments) Last eleventh line shows results for the sum of all 5960 files in ten sets. Origin PAQ6 DURILCA Slim Entropy UHArc Compressia PPMonstr RK 7-zip 277.57% 100% 107.52 105.05 107.87 110.34 112.89 109.40 115.43 116.84 282.61% 103.69 100% 100.40 106.85 107.59 107.00 111.37 111.71 111.49 194.75% 101.05 100% 101.16 104.00 103.67 104.57 106.16 107.35 107.39 380.63% 110.61 100% 107.93 109.76 109.25 115.18 124.38 128.93 127.91 186.22% 105.45 104.23 100% 104.45 106.01 109.66 116.04 115.74 118.99 438.28% 100% 113.36 123.00 111.51 110.40 118.53 112.67 113.22 120.51 212.37% 105.06 100.24 100% 107.18 108.81 105.47 111.09 112.05 110.98 298.93% 100% 111.78 106.59 111.49 109.19 114.79 111.81 112.74 114.12 245.18% 101.92 100.12 100% 103.41 104.86 105.01 107.39 107.80 108.37 410.77% 100% 107.62 107.78 110.52 113.58 106.39 113.48 116.40 119.11 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 256.80% 100% 100.89 101.06 104.18 104.80 105.96 108.11 109.66 110.62 ASH RAR PPMN_km SBC BEE ACE PPMd BZip2 7-zip pkzip 115.87 118.62 118.25 122.44 118.69 121.44 120.87 130.52 132.74 135.05 116.00 117.05 115.28 118.64 118.33 117.93 120.99 132.63 138.91 141.01 108.89 110.27 107.75 110.57 110.73 110.50 112.42 118.17 116.13 117.48 129.44 124.38 137.97 126.28 131.83 139.77 137.65 152.14 167.53 171.11 121.08 112.10 120.09 103.56 121.48 111.05 123.75 124.82 131.22 132.48 123.79 130.32 130.82 136.62 128.57 133.85 131.33 146.77 145.14 148.58 113.65 116.81 113.26 115.29 115.21 117.84 118.16 125.53 126.47 128.21 121.45 119.40 123.36 122.51 125.12 121.17 127.44 136.02 135.87 139.67 110.71 111.75 109.27 113.06 112.71 112.63 115.24 122.36 122.22 123.63 123.02 131.32 127.71 131.05 127.40 132.20 132.14 150.14 150.27 155.74 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~..~~~~~~~~~~~~~~~~~~~~~~ 113.08 113.87 113.88 114.42 115.36 115.52 117.90 126.31 128.00 130.18 Results of many other programs are in full version only, BINARIES.DAT file. [[2]] Speed =========== 4th set, all from ftp://ftp.simtel.net/pub/simtelnet/win95/graphics/sface10.zip was used for this test, and a 970MHz PC with 256Mb RAM and Windows98. Programs, Compression/ Overall Average Users' Compressed options Extraction, Score Score Size seconds seconds, % seconds, % bytes , % no compression 0 0 7613 391 7613 415 27408516 424 7za a -t7z 74 4 2684 138 2617 142 9381020 145 7za a -t7z -mx 111 4 2225 114 2125 116 7594105 117 7za a -tzip 23 1 3387 174 3366 183 12104526 187 7za a -tzip -mx 54 1 3407 175 3358 183 12062635 186 ash04a /o6 /m230 576 575 3691 189 3172 173 9140632 141 ash04a /o9 /m230 673 619 4032 207 3425 187 9860022 152 ash04a /o16 /m230 685 645 4260 219 3643 198 10543230 163 ash04a /o6 /m230 /s16 657 651 3830 197 3238 176 9075968 140 ash04a /o9 /m230 /s16 803 730 4237 217 3514 191 9730972 150 ash04a /o16 /m230 /s16 810 775 4472 230 3742 204 10387749 160 bee a -m1 187 184 3246 167 3078 168 10350726 160 bee a -m2 338 340 3331 171 3027 165 9552914 148 bee a -m3 454 464 3555 182 3146 171 9494000 147 bee a -m3 -s 667 684 3921 201 3320 181 9249655 143 durilca e -o8 -t3 214 213 2538 130 2345 128 7597450 117 durilca e -o9 -t3 216 216 2522 129 2327 127 7523916 116 durilca e -o10 -t3 218 219 2507 128 2310 126 7448698 115 durilca e -o12 -t3 221 222 2490 128 2291 125 7368195 114 durilca e -o16 -t3 226 227 2479 127 2276 124 7295306 113 durilca e -o32 -t3 239 241 2494 128 2278 124 7244957 112 durilca e -o64 -t3 374 326 2711 139 2374 129 7236704 112 durilca e -o128 -t3 489 486 2987 153 2547 139 7242413 112 epm9 c008 536 539 3483 179 3000 163 8669314 134 epm9 c012 554 557 3539 182 3040 166 8739027 135 epm9 c016 560 563 3554 182 3050 166 8750216 135 grzipii e 36 25 2831 145 2798 152 9968577 154 paq6v2a 692 689 3881 199 3258 177 8999841 139 paq6v2a -6 1241 1496 4605 236 3488 190 6725123 104 rar a -m1 35 3 3150 162 3118 170 11203280 173 rar a -m2 38 2 3134 161 3100 169 11139927 172 rar a -m3 37 3 2538 130 2504 136 8991000 139 rar a -m4 42 3 2535 130 2497 136 8962479 138 rar a -m5 47 4 2539 130 2497 136 8957658 138 rar a -m5 -s 73 4 2373 122 2307 126 8266028 128 rar a -mc16t -s 49 5 2357 121 2313 126 8292616 128 rar a -mc16t+ -s 59 39 2478 127 2425 132 8568202 132 rar a -mc16:128t -s 49 5 2354 121 2310 126 8281923 128 rar a -mc16:128t+ -s 68 47 2400 123 2338 127 8223372 127 rar32 a -mc16t -s 51 3 2355 121 2309 126 8283248 128 rkc -mf -M230M -o8 150 17 2899 149 2764 150 9833956 152 rkc -mf -M230M -fe 150 17 2899 149 2764 150 9833956 152 slim a -d32 -w21 1928 1990 6079 312 4343 237 7774896 120 slim a -d16 -w21 1928 1985 6073 312 4338 236 7775197 120 slim a -d8 -w21 1908 1979 6047 311 4330 236 7776164 120 slim a -d4 -w21 1902 1955 6019 309 4306 235 7779001 120 uhbc e 100 75 2932 150 2841 155 9920824 153 //previous ace a -d4096 -m5 61 3 2608 134 2548 139 9158631 141 ace32 a 52 3 2921 150 2869 156 10315479 159 ace32 a -d4096 56 3 2599 133 2543 138 9141767 141 ace32 a -d4096 -s- 58 3 2927 150 2868 156 10313247 159 ace32 a -d4096 -m1 47 3 2604 133 2556 139 9190071 142 ace32 a -d4096 -m5 62 3 2609 134 2548 139 9158751 141 arh a 257 262 3694 189 3438 187 11425040 177 arh a -2 -mm 197 183 3213 165 3018 164 10196406 157 arh a -1 -mm 28 6 2986 153 2958 161 10625915 164 arh a -2 -1 304 202 3675 189 3374 184 11408516 176 ba -k -50 46 24 3016 155 2969 162 10601804 164 ba -k 37 22 2973 152 2936 160 10487070 162 ba -k -m 40 23 3174 163 3134 171 11197676 173 ba -k -10 38 22 2936 151 2899 158 10353984 160 boa -m1 236 226 3623 186 3389 185 11379129 176 boa -m7 547 485 3938 202 3396 185 10458903 162 boa -m15 690 615 4185 215 3502 191 10368786 160 boa -m15 -s 696 617 4191 215 3501 191 10359887 160 bzip2 -k 33 10 3130 161 3097 169 11112953 172 bzip2 -k -s 29 9 3177 163 3148 171 11299261 175 bzip2 -k -1 29 8 3262 167 3232 176 11604881 179 bzip2 -k -5 31 10 3131 161 3100 169 11126137 172 bzip2 -k -9 33 10 3130 161 3097 169 11112953 172 Entropy b o12 260 274 2744 141 2486 135 7953204 123 Entropy b o16 259 277 2739 140 2482 135 7928059 122 Entropy b o32 269 286 2752 141 2485 135 7907407 122 Entropy b o64 300 307 2803 144 2505 136 7903715 122 compcl c -b15 50 42 2744 141 2693 147 9544827 147 compcl c -b15 -s 50 42 2742 141 2692 147 9540017 147 dc e 107 13 2796 143 2690 146 9630736 149 dc e -fb 129 13 3090 158 2962 161 10610515 164 dc e -b16300 131 14 2336 120 2206 120 7888232 122 dc e -b16300 -mb5 129 14 2335 120 2206 120 7888421 122 eri a 55 30 2781 143 2727 148 9706022 150 eri a -m3 85 38 2777 142 2693 147 9555684 148 eri a -m6 85 37 2785 143 2700 147 9582523 148 gcac a 44 16 2897 149 2853 155 10212208 158 gcac s 45 18 2935 150 2890 157 10337588 160 imp98 a -mm 33 1 2748 141 2715 148 9770169 151 imp98 a -mm -m3 52 1 2757 141 2704 147 9730287 150 imp98 a -mm -2 22 7 2968 152 2945 160 10577128 163 imp98 a -mm -s4 33 3 2753 141 2719 148 9775588 151 imp98 a -2 -s4 28 4 2910 149 2882 157 10359249 160 pkzip -es 2 1 3951 203 3949 215 14212209 220 pkzip -a 6 1 3436 176 3430 187 12347196 191 pkzip -exx 7 1 3430 176 3423 186 12320267 190 ppmdi e -o6 -m232 48 51 2941 151 2893 158 10230866 158 ppmdi e -o9 -m232 51 54 2878 148 2827 154 9980158 154 ppmdi e -o12 -m232 53 56 2868 147 2815 153 9930336 153 ppmdi e -o16 -m232 54 58 2865 147 2811 153 9911769 153 ppmn_km e -o6 -M:50 217 218 3150 162 2935 160 9772905 151 ppmn_km e -o7 -M:50 237 239 3187 163 2952 161 9760047 151 ppmn_km e -o8 -M:50 244 246 3183 163 2941 160 9692957 150 ppmn_km e -o9 -M:50 244 246 3184 163 2942 160 9697928 150 ppmn_km e -o9 208 210 3275 168 3068 167 10282808 159 ppmonstr e -o6 -m250 266 289 3123 160 2859 156 9244450 143 ppmonstr e -o9 -m250 272 295 3080 158 2810 153 9046654 140 ppmonstr e -o12 -m250 275 288 3063 157 2789 152 8996048 139 ppmonstr e -o16 -m250 278 300 3072 158 2796 152 8974666 139 ppmonstr e -o32 -m250 287 309 3085 158 2800 152 8958755 138 ppmonstr e -o128 -m250 643 702 3833 197 3196 174 8954077 138 qlfc a 31 18 3019 155 2988 163 10689214 165 rk -mf1 33 26 3101 159 3067 167 10946156 169 rk -mf2 90 70 3025 155 2935 160 10310256 159 rk -mf3 127 73 2814 144 2688 146 9410064 145 rk -mx1 498 499 3671 188 3178 173 9627044 149 rk -mx2 652 655 3924 201 3277 179 9415540 145 rk -mx3 844 845 4074 209 3238 176 8584928 133 sbc c -m3 -b63 73 21 2191 112 2118 115 7548878 116 sbc c -b63 51 17 2421 124 2370 129 8470431 131 sbc c -ad -b63 59 25 2192 112 2134 116 7587006 117 sbc c -os -b63 51 18 2510 129 2459 134 8785324 136 sbc_d c -os -b63 52 18 2512 129 2459 134 8785324 136 szip -v0 36 21 3133 161 3097 169 11073758 171 szip -o4 14 19 3162 162 3148 171 11262438 174 szip -o6 36 21 3133 161 3097 169 11073758 171 szip -o8 48 22 3127 160 3078 168 11000643 170 szip -o8 -b41 53 23 3041 156 2988 163 10671420 165 zzip a 37 22 3054 157 3017 164 10781084 167 zzip a -a 37 20 2946 151 2908 158 10398266 161 zzip a -mx 38 22 2996 154 2957 161 10567860 163 zzip a -mx -mm 39 21 2813 144 2774 151 9907114 153 zzip a -mx -30m 43 22 2976 153 2933 160 10478036 162 abc13 -c 38 18 2995 154 2960 161 10577286 163 abc24 -c 58 44 2978 153 2925 159 10351462 160 uharc a -m1 -md32768 103 14 1944 100 1851 101 6577659 101 uharc a -m2 -md32768 127 13 1953 100 1838 100 6522057 101 uharc a -m3 -md32768 142 13 1959 100 1831 100 6490817 100 uharc a -mz -md32768 22 25 2627 135 2607 142 9287969 143 uharc a -mx -md32768 180 155 2129 109 1966 107 6454087 100 ybs -m1m 35 16 3088 158 3056 166 10931948 169 ybs -m4m 41 16 3010 154 2972 162 10626638 164 ybs -m16mu 51 17 2654 136 2608 142 9308860 144 ybs -m15mu 49 18 2692 138 2647 144 9448445 146 ybs -m15mu -r 50 17 2686 138 2641 144 9428317 146 ybs_d -m15mu 53 22 2700 138 2652 144 9448445 146 Overall score is calculated by adding compression time, extraction time, and time it would take to transfer the compressed file over a 28,800bps network: (compressed_size)/3600 Average Users' score is calculated by adding (compress_time/10)+ extract_time + time it would take to transfer the compressed file over a 28,800bps network. Compression time is divided by 10 here, because more than 90% of people would never compress anything during their life (with compression programs), but they use compressed data almost _every_ time they use computers and/or Internet. That's why compression time is not so actual for them. [[3]] Details ============= are no longer put to this main text (thousands of lines reporting 200,000+ results on 5960 files in 10 sets), but can be found in FULL version with BINARIES.DAT and *.BAT at http://compression.ru/artest/artest26.zip or http://artest1.tripod.com/artest26.zip [[4]] Comments ============== Links to download programs and Homepages are now in links.htm file What's new: ~~~~~~~~~~~ 12 new programs were tested: ASH 04a 7-zip 3.13 RAR 3.30b5 UHBC 1.0 EPM 9 Slim 0.021a BEE 0.7.7 Durilca 0.3a PAQ 6v2 RKC 1.02 GRZipII 0.2.3 BWIC As beta versions of RKC, EPM and BWIC fail to compress and/or decompress many text files, they were not tested on all binary files. Latest beta versions of DC, Entropy, UHArc were available from authors by e-mail request: Entropy: artest@inbox.ru DC: EdgarBinder@t-online.de UHArc: Uwe.Herklotz@gmx.de Results of many other programs are in full version only, BINARIES.DAT file. FULL version contains all *.BAT and *.DAT files you'll need to build 10 directories with 5960 files (artest26.zip\COOK_SET\*.*) and to repeat all tests (BINS.BAT, BINARIES.DAT). WARNINGS: ~~~~~~~~~ Beta versions of RKC, EPM and BWIC fail to compress and/or decompress many files. Authors are notified. ASH 04a can fail to decompress some large files if it lacks memory. BA 1.00beta5 can't losslessly decompress many files: CUN5IF~1.bin, CUN6IF~1 etc It types nothing like "CRC fails". DC 0.99.158b fails to decompress HLPCOPY..bin, but only if you compress with "-mb5" switch and [] filename like "any.dc5". Says nothing like "CRC fails". Problems in all other compressors were not found. ESP, Rkive and many other programs are not tested any more, their results and links can be found in previous volumes of ARTest. The LATEST RELEASE, and all previous volumes can be found at http://compression.ru/artest/ Send your suggestions, comments to artest@inbox.ru With best kind regards, A.Ratushnyak Back to main ARTest page