Re: rsync keeps writing files over

2016-06-02 Thread Steven Levine
In , on 06/02/16 at 10:42 PM, "McDowell, Blake" said: Hi Blake, >The storage is just an regular HDD in a mac pro tower. I can t imagine >why it wouldn t handle timestamps. Also of note - this problem doesn t >exist for every file, just the vast majority. So, that just makes it more >confusing

Re: rsync keeps writing files over

2016-06-02 Thread Kevin Korb
Rsync only cares about the modification time. The ls command usually abbreviates the timestamp so it is better to use the stat command on one of the problem files to see the full thing. On 06/02/2016 06:42 PM, McDowell, Blake wrote: > Cool Thanks! > > Specifically, the timestamps on both and m

Re: rsync keeps writing files over

2016-06-02 Thread McDowell, Blake
Cool Thanks! Specifically, the timestamps on both and match for "ls -l" but do not match for "ls -lu" or "ls -lc” The storage is just an regular HDD in a mac pro tower. I can’t imagine why it wouldn’t handle timestamps. Also of note - this problem doesn’t exist for every file, just the vast maj

Re: rsync keeps writing files over

2016-06-02 Thread Kevin Korb
The man page has a section on what all the itemize-changes flags do. There is a --ignore-times but the result is what you have now, re-copy everything even if the timestamp matches. The best you can really do with storage that can't handle timestamps is to use --update. But if you do that you ne

Re: rsync keeps writing files over

2016-06-02 Thread McDowell, Blake
OK. Thanks. Where can I find information regarding how to interpret —itemize-changes? The timestamps aren’t changing, so the target must not be storing them, which I have no idea why. The directory I’m writing to is 777. What is the flag to tell rsync to ignore the timestamps? Thanks, Blake On

Re: rsync keeps writing files over

2016-06-02 Thread Kevin Korb
It is saying the timestamp is wrong and that it is copying the file and changing the timestamp. If it does that every time then either the timestamps are changing on the source or the target isn't storing them. On 06/02/2016 06:13 PM, McDowell, Blake wrote: > Thanks Kevin! I¹m unclear how to read

Re: rsync keeps writing files over

2016-06-02 Thread McDowell, Blake
Thanks Kevin! I¹m unclear how to read the ‹itemize-changes output. Can you provide some insight? This is a local transfer from an external drive to an internal drive all attached to one computer. rsync -aPh --itemize-changes -n /Volumes/shuttle_05/2012_79_1_14_1__1199_Workprint /Volumes/3TB_LTO/

rsync keeps writing files over

2016-06-02 Thread McDowell, Blake
Hi, At my work we use rsync to move files between drives and to LTO among other things. I'm having an issue using rsync to move material between and external drive and an internal drive. We run "rsync -avvPh " and most of the files keep writing every time I run this. It appears that the modi

Re: rsync keeps writing files over

2016-06-02 Thread Kevin Korb
Instead of the second -v (or even the first) add --itemize-changes. It will tell you why each file is being copied. If the file timestamps are not correct then perhaps the underlying storage doesn't allow arbitrary mtime changes. On 06/02/2016 05:23 PM, McDowell, Blake wrote: > Hi, > > > > A

Rsync unexpectedly removing ALL files

2016-06-02 Thread Koehn, Troy N.
I am using rsync with --files-from option with a file named 'rsync.in' that contains 37K+ directories that are queried from a database. One of the directories looked like this: /home/usr/directory/./ I know the directory should NOT end with a './' but this was stored in the database that way b

Re: Delete remote folder

2016-06-02 Thread Steven Levine
In <20160602082722.8F11829233B7@macserver.private>, on 06/02/16 at 10:27 AM, Fabian Cenedese said: Hi Fabian, >rsync -a --delete empty_local_folder remote_folder_to_delete >to get rid of the contents. However the folder itself still remains. So >after a while I'd have a lot of empty folders.

Re: Delete remote folder

2016-06-02 Thread Fabian Cenedese
At 13:22 02.06.2016, you wrote: >Content-Transfer-Encoding: 7bit > >Fabian Cenedese wrote: > >> This script is bash and also uses the "remote shell hacks" using SSH. >> As I want to run it also from Windows I'm looking for a rsync solution. > >Assuming you have control of the server, can you do a

Re: Delete remote folder

2016-06-02 Thread Simon Hobson
Fabian Cenedese wrote: > This script is bash and also uses the "remote shell hacks" using SSH. > As I want to run it also from Windows I'm looking for a rsync solution. Assuming you have control of the server, can you do a bit of semaphore ? Eg, do your backup with rsync, then when it's complet

Re: Delete remote folder

2016-06-02 Thread Simon Hobson
Fabian Cenedese wrote: > Are there pure rsync ways to solve these two problems? Short answer - no I don't think there is. My feeling is that rsync (at least, rsync on it's own) isn't the right tool for the job. One think I would comment on though is that, IMO, making backup policies under the

Re: Delete remote folder

2016-06-02 Thread Fabian Cenedese
At 10:52 02.06.2016, Hans-Christian Jehg wrote: >Content-Transfer-Encoding: 7bit > >Try having a look at this, for inspiration. > >It does require the capability of hard-links on the remote end though... and >it does not resolve your "delete target directory" either, but it might save >you some f

Re: Delete remote folder

2016-06-02 Thread Hans-Christian Jehg
Try having a look at this, for inspiration. It does require the capability of hard-links on the remote end though... and it does not resolve your "delete target directory" either, but it might save you some fiddeling around :-) https://blog.interlinked.org/tutorials/rsync_time_machine.html H

Delete remote folder

2016-06-02 Thread Fabian Cenedese
Hi I'm trying to build a backup system based on rsync. It should work with different destinations (local, share, remote etc) that's why I'm looking for ways how every operation can be controlled from the client side. I want to create full backups and incremental backups. For the incremental backu