Re: [lftp] Possible Bug in lftp mirror using mirror:sort-by option

2014-12-02 Thread akshay gupta
Are these feature present in LFTP implementation timeline? By when will they be implemented? ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Re: [lftp] Possible Bug in lftp mirror using mirror:sort-by option

2014-11-18 Thread Achim Gratz
akshay gupta writes: > We are in desperate need of this feature as without this feature we > can only ensure file order within a folder. There is a huge dependency > on file order for some of our hadoop oozie jobs. By when can we expect > this feature to come in lftp? What I do at the moment is wr

Re: [lftp] Possible Bug in lftp mirror using mirror:sort-by option

2014-11-17 Thread akshay gupta
We are in desperate need of this feature as without this feature we can only ensure file order within a folder. There is a huge dependency on file order for some of our hadoop oozie jobs. By when can we expect this feature to come in lftp? On Wed, Nov 12, 2014 at 1:54 PM, Alexander Lukyanov wro

Re: [lftp] Possible Bug in lftp mirror using mirror:sort-by option

2014-11-12 Thread Alexander Lukyanov
I think it is possible and the amount of programming work is moderate. The recursive model of mirror will stay but the file transfers will be deferred and done on the top level when recursive directory traversal is finished. 2014-11-12 8:32 GMT+03:00 akshay gupta : > Hi Alexander, > > Are there a

Re: [lftp] Possible Bug in lftp mirror using mirror:sort-by option

2014-11-11 Thread akshay gupta
Hi Alexander, Are there any plans for redesigning LFTP Mirror algorithm to build the whole recursive list first. How much change would that require if we go that path? Thanks, Akshay On Thu, Oct 30, 2014 at 4:44 PM, akshay gupta wrote: > lftp have options like --depth-first and --no-recursion

Re: [lftp] Possible Bug in lftp mirror using mirror:sort-by option

2014-10-30 Thread akshay gupta
lftp have options like --depth-first and --no-recursion I think it will make sense to have an option like " --iterative" for iterative file transfer. This option will fetch the full file list and then fetch them iteratively. On Wed, Oct 29, 2014 at 2:29 PM, akshay gupta wrote: > I think the fun

Re: [lftp] Possible Bug in lftp mirror using mirror:sort-by option

2014-10-29 Thread akshay gupta
I think the functionality of mirror:sort-by option implies that the order is for all the files irrespective of the directory structure. Or may be it should support both the options and it would be configuration defined which one to use. On Wed, Oct 29, 2014 at 2:09 PM, Alexander Lukyanov wrote:

Re: [lftp] Possible Bug in lftp mirror using mirror:sort-by option

2014-10-29 Thread Alexander Lukyanov
Mirror in lftp works directory by directory. It does not build full list of files first, so it cannot sort the whole list. Maybe the mirror algorithm should be redesigned to build the whole recursive list first. What do you think? 2014-10-29 10:07 GMT+03:00 akshay gupta : > Hi, > > I am trying to

[lftp] Possible Bug in lftp mirror using mirror:sort-by option

2014-10-29 Thread akshay gupta
Hi, I am trying to mirror files using mirror:sort-by option set to 'date-desc'. My file structure is like this $ ls -l -R total 3191264 drwxr-xr-x 3 vikasgoyal biadmin 102 Oct 22 12:35 1 -rw-r--r-- 1 vikasgoyal biadmin 0 Aug 1 01:00 tmp.txt -rw-r--r-- 1 vikasgoyal biadmi