How do I queue multiple files for copying on a Mac?

Question

When I copy multiple files on a Mac, the system tries to copy them all at the same time. The problem is two-fold.

First of all, when you select multiple files and copy them, they all go into one process with an "all or nothing" approach not unlike ACID in databases. Often this is not desireable.

Further, when you add other copy-processes, the system tries to copy everything at the same time.

For example, I decide to copy a large file A, then later I decide to copy a large file B as well. This results in two parallel copy operations, regardless if one of the "large files" also is a selection of many files.

I do not like this for several reasons:

• When several copy processes run at once, it seems to bogs down other processes.
• Also, when several files are copied at the same time, the copy process itself seems to go much slower.
• And lastly, if the process is aborted, none of the files reach its destination.
• When adding a file to the queue, it will also start copying at once, and bogging down the process even further.
• This is a real problem when copying to other machines or drives on the (local) net.

Result: The file A, which I wanted to transfer and use first, takes much longer to arrive than needed, and when copying from a central HD on the LAN, I cannot use the first file until all the other files also have arrived.

Thus... How do I queue multiple files for copying on a Mac? To clarify: Regardless of many files are chosen, or they are added one by one, I want them all put into a queue that only copies one file at a time, until the queue is done.

Answers in Bash and especially Perl are also welcome!

Solution 1

UltraCopier

UltraCopier is a free and cross-platform copy utility that is currently in development, so it's not that neat and polished yet. Once you install it, it sits in your menu bar.

It manages a copy list that allows you to queue copy or move jobs, which are then sequentially processed. You can also define the copy process priority as well as the block size of the transfer.

With the new version you can group with similar source and/or destination, or just always or never.

Solution 2

Here is a bash solution:

cp file1 dest1; cp file2 dest2

Repeat this for how ever many files you want to copy. Just keep adding semicolons and cp commands.

You could also do

cp file1 dest1 && cp file2 dest2

In this example, the file will only be copied if the one before it copied successfully.

For a folder, you can do something like this:

for x in folder/*; do echo "Copying $x"; cp "$x" destdir; done

Solution 3

Path Finder 6 looks easier to navigate than ultracopier and definitely creates a clear cue, plus it has way more options. There's also a 30 day trial for it.

But I'm using this professionally so I say totally worth it.

File Operations in Path Finder 6 (YouTube video)

Solution 4

In addition to some of the other copy managers in this thread, you might want to look at ForkLift: http://www.binarynights.com/forklift/

Pros:

• Turn queuing on / off,
• FTP + SFTP + Amazon S3 + WEBDav,
• Bunch of handy sync tools geared towards developers.

Cons:

• Paid (though at the time of writing there is a special on the App Store but...),
• App Store version is missing features (oh sandbox).

Solution 5

The Finder alternative Path Finder includes a copy queue functionality since version 6.

File Transfer Queue

Access current file operations from either a toolbar item or a separate unified window.

View more solutions

Comments

[Kebman]

But when you try to copy an entire folder this way, it is treated as one process again, which isn't desirable. I also want each file in the folder queued.

[slhck]

Be aware of files with spaces and globbing characters with the for approach. I'd probably do it with a find -print0 piped into xargs -0 to be safe.

[Kebman]

Nice! Using! Works perfect! Actually looked up XCode, Cocoa and Objective C contemplating writing my own app.

[Kebman]

I was looking for a free solution, but Path Finder is known to be a good app. In fact I think it's a shame that Finder is so simplistic that you need a third party app if you want to do any anything half-advanced.

[Kebman]

I don't want to plan. I just want to queue up files and have them moved one by one without thinking. Creating aliases is superfluous if you already use a script. Also, if I knew how to make a script, I'd already have made it. Do you have an example of a script that supports file queuing?

[Ramkam]

Put source pathes and target pathes in a "queue.txt" text file, separated by a delimiter, like a pipe |. Example of a line /foo/bar/source|/target. Then cat queue.txt | while read l; do src="$(echo "$l" | awk -F"|" '{print $1}')"; dst="$(echo "$l" | awk -F"|" '{print $2}')"; echo "Copying from $src TO $dst"; cp -r "$src" "$dst"; done. That's a very crude example. I wouldn't advise you gamble on scripts just like that, there's ton of pitfalls. Anyway if you ever try, start by reading this : devblog.virtage.com/2013/01/…

[Greenonline]

The link has died or moved, would it be this article, Rsync – To Slash or Not To Slash??