[bgr]zip timings
Posted by Ian Holsman
Jeremy Zawodny compared some timings of bzip2, gzip, and rzip to compress his mail folder (which I'm assuming is 90% text)
I thought I would do it on one of our largish indexes (which we have to copy around to different places several times a day) and see if it would help.
it's original size is 1.1G and is mainly binary data. Machine stats: OS: RH ES3.0 2x 2.4 P-IV xeons with hyperthreading Mem: 6G
| command | compress (r/u/s) | decompress (r/u/s) | new size | ratio | ||||
|---|---|---|---|---|---|---|---|---|
| gzip | 2m3 | 1m58 | 0m5 | 0m33 | 0m18 | 0m7 | 566m | 47% |
| gzip -9 | 3m45 | 3m39 | 0m5 | 0m35 | 0m17 | 0m8 | 563m | 47% |
| bzip2 -9 | 11m16 | 11m9 | 0m5 | 4m38 | 4m24 | 0m13 | 538m | 45% |
| rzip | 9m6 | 8m47 | 0m19 | 5m3 | 3m27 | 1m35 | 474m | 39% |
basic summary: when you have a 1G card in machines don't even bother compressing it, unless you have to distribute it to >20 machines.. and if so.. any of these will do ;( If you have to use a slower link, then I still think any of these will do.
on the plus side.. I watched The Adventures of Seinfeld & Superman while waiting for the tests to run.. very funny.. the macromedia streaming via flash is a VERY cool idea and seem to work quite well.