Discussion:
mirror with transfers ordered by date
Carlos Colombo
2014-06-30 22:12:16 UTC
Permalink
Hi,
How can I use lftp to mirror a site doing transfers of older files prior
to newer files.

I looked up the mirror:sort, but it is not usefull for this.
I am thinking on writing a script to queue individual transfers using
the output from "crls --sort=date" command ?

Any ideas?
I would also like to do n transfers in parallel.

Thanks
Alexander V. Lukyanov
2014-07-09 07:05:53 UTC
Permalink
Post by Carlos Colombo
Hi,
How can I use lftp to mirror a site doing transfers of older files prior
to newer files.
It is not possible now. Mirror sorts the files by name.
Post by Carlos Colombo
I am thinking on writing a script to queue individual transfers using
the output from "crls --sort=date" command ?
Any ideas?
I would also like to do n transfers in parallel.
cmd:parallel setting can be helpful here.
--
Alexander.
Alexander V. Lukyanov
2014-07-10 08:06:41 UTC
Permalink
Post by Alexander V. Lukyanov
Post by Carlos Colombo
Hi,
How can I use lftp to mirror a site doing transfers of older files prior
to newer files.
It is not possible now. Mirror sorts the files by name.
I have implemented mirror:sort-by setting. You can try it by fetching development
sources from git repository:

git clone git://github.com/lavv17/lftp.git

--
Alexander.
Carlos Colombo
2014-07-14 21:49:18 UTC
Permalink
Awesome!
Thanks.

I am having some difficulties to compile on cygwin, though.
I did:

git clone git://git.savannah.gnu.org/gnulib
export PATH=$PATH:/home/carlosc/gnulib
git clone git://github.com/lavv17/lftp.git
cd lftp
./autogen.sh

Last Friday I was getting:

./configure: line 48074: syntax error near unexpected token `LIBGNUTLS,'
./configure: line 48074: ` PKG_CHECK_MODULES(LIBGNUTLS, gnutls >=
1.0.0,'

Today I am getting:

./configure: line 19758: gl_INIT: command not found
./configure: line 19761: syntax error near unexpected token `wcwidth'
./configure: line 19761: ` gl_LIBOBJ(wcwidth)'

Any ideas?
Post by Alexander V. Lukyanov
Post by Alexander V. Lukyanov
Post by Carlos Colombo
Hi,
How can I use lftp to mirror a site doing transfers of older files prior
to newer files.
It is not possible now. Mirror sorts the files by name.
I have implemented mirror:sort-by setting. You can try it by fetching development
git clone git://github.com/lavv17/lftp.git
--
Alexander.
Loading...