How can I copy files to an external drive and verify their integrity in OS X?

344

Solution 1

rsync

Note that rsync always verifies that each transferred file was correctly reconstructed on the receiving side by checking its whole-file checksum...

Solution 2

We use ShotPut Pro for this exact task - it copies media from SxS (and other) HD camera media, puts it into more than one place at a time if you want, and verifies the data.

It's made the process of keeping on top of footage so much easier for us.

If it's for cameras, then this is the best bet I think. If it's for copying other data, I'm not sure (I found this question while trying to find a decent filemanager for OS X!)

ShotPut Pro™ for Macintosh is an automated copy utility application for HD video and photo files. ShotPut Pro is the industry de-facto standard offloading application for professionals. The simple user interface and robust copy speeds make it indispensable for todays tapeless HD workflows.

Security Verify file-by-file sizes, MD5 or CRC checksums, or byte-to-byte comparisons of your media copies to ensure they exactly match the originals.

enter image description here

Solution 3

Rsync only verifies that the transfer was done correctly. In the case of a local copy there is no transfer over the network, so nothing is verified. The actual file-writes would not be considerer transfer. The other poster noted this when he compared the times vs using cp. You must re-read the file from the disk. The fastest way to do this is CRC (less CPU intensive).

crc32 * > ~/Desktop/crc1.txt
crc32 * > ~/Desktop/crc2.txt

then run crc32 on those files and you will see if the copy was exact.

See the quote from the other answer at http://manpages.ubuntu.com/manpages/lucid/man1/rsync.1.html.

Share:
344

Related videos on Youtube

gcerkez
Author by

gcerkez

Updated on September 17, 2022

Comments

  • gcerkez
    gcerkez about 1 year

    I am having an issue when I do a maven clean install on my mule 3.4 project. It will generate the following directory structure inside the deployable zip:

    ZIPFile.zip
        ->mule-app.properties
        ->mule-deploy.properties
        ->project.xml
        ->classes->mule-app.properties
        ->classes->mule-deploy.properties
        ->lib->various libraries
    

    As you can see, the archive will end up with multiple mule-*.properties which causes confusion on the deployment server. Has anyone else had this problem when creating the deployable archive and how did you fix it? Thanks

  • Filipe Dias
    Filipe Dias almost 13 years
    I'd like a GUI for this (so I can delegate). I see there are multiple ones. Which is the best?
  • Ignacio Vazquez-Abrams
    Ignacio Vazquez-Abrams almost 13 years
    Not a clue. I don't actually run OS X (and I've never used a GUI for rsync).
  • gcerkez
    gcerkez over 9 years
    Thank you, that indeed was the problem.
  • user329023
    user329023 over 9 years
    This is not correct or rather taken out of context. Rsync only verifies that the transfer was done correctly. In the case of a local copy there is no transfer over the network, so the actual file-writes are not verified.