Jerome Benoit, on 2019-06-22: > How can we check that a compressed file is rsyncable ? > > In fact I would like to know if tarball compress with plzip > are rsyncable ? Good Day, If by "rsyncable", you mean "can be transferred by rsync", then yes, like most files. :) If you wonder if the delta-transfer algorithm will be in use, although I have not tested directly plzip, chances are the compression will not enable it. If you wish to assess the efficiency of the delta-transfer, use the option "--stats". At first transfer of the current source code of rsync, repacked: $ rsync --stats -a rsync-3.1.3.tar.xz 192.168.1.101: Number of files: 1 (reg: 1) Number of created files: 1 (reg: 1) Number of deleted files: 0 Number of regular files transferred: 1 Total file size: 676,984 bytes Total transferred file size: 676,984 bytes Literal data: 676,984 bytes Matched data: 0 bytes File list size: 0 File list generation time: 0.001 seconds File list transfer time: 0.000 seconds Total bytes sent: 677,262 Total bytes received: 35 >>>>>> sent 677,262 bytes received 35 bytes 43,696.58 bytes/sec total size is 676,984 speedup is 1.00 Then I add an empty "toto" file, repack, and see changes: $ rsync --stats -a rsync-3.1.3.tar.xz 192.168.1.101: Number of files: 1 (reg: 1) Number of created files: 0 Number of deleted files: 0 Number of regular files transferred: 1 Total file size: 677,000 bytes Total transferred file size: 677,000 bytes >>>>>> Literal data: 677,000 bytes >>>>>> Matched data: 0 bytes File list size: 0 File list generation time: 0.001 seconds File list transfer time: 0.000 seconds Total bytes sent: 677,278 Total bytes received: 5,015 >>>>>> sent 677,278 bytes received 5,015 bytes 454,862.00 bytes/sec total size is 677,000 speedup is 0.99 In the case of tar archive compressed with XZ's LZMA2, the delta transfer is not in use, the whole file is resent. (The bandwidth increase here is most likely related to the drive spinup time at first transfer, the target was a low end laptop.) When delta transfer is in use, given a file with the following properties at first transfer : $ rsync --stats -aSH rsync_3.1.3-6.dsc 192.168.1.101: Number of files: 1 (reg: 1) Number of created files: 1 (reg: 1) Number of deleted files: 0 Number of regular files transferred: 1 Total file size: 1,877 bytes Total transferred file size: 1,877 bytes Literal data: 1,877 bytes Matched data: 0 bytes File list size: 0 File list generation time: 0.001 seconds File list transfer time: 0.000 seconds Total bytes sent: 1,993 Total bytes received: 35 >>>>>> sent 1,993 bytes received 35 bytes 1,352.00 bytes/sec total size is 1,877 speedup is 0.93 append a line with "toto" at the end of file, resend, and you should see a non-zero value for matched data: $ rsync --stats -aSH rsync_3.1.3-6.dsc 192.168.1.101: Number of files: 1 (reg: 1) Number of created files: 0 Number of deleted files: 0 Number of regular files transferred: 1 Total file size: 1,884 bytes Total transferred file size: 1,884 bytes >>>>>> Literal data: 484 bytes >>>>>> Matched data: 1,400 bytes File list size: 0 File list generation time: 0.001 seconds File list transfer time: 0.000 seconds Total bytes sent: 613 Total bytes received: 53 >>>>>> sent 613 bytes received 53 bytes 1,332.00 bytes/sec total size is 1,884 speedup is 2.83 See what it gives when you test transfers of you plzip archives. Happy hacking, -- Étienne Mollier <etienne.mollier@mailoo.org> 59DA 56FE FFF3 882D
Attachment:
signature.asc
Description: OpenPGP digital signature