Strange behaviour of use-mlsd

[Martynas Brijunas]

Hello,

We are running a project where we have to keep 2 Windows fileservers in
sync over FTP. The file servers have over a million files and hundreds of
thousands of folders. On the receiving end we have Filezilla FTP server. On
the source there is LFTP 4.4.7 Cygwin.

The whole mirroring operation takes many hours. I was looking into ways in
speeding it up. First, I tried "sync-mode no" but that did not work at all.
Then I tried "use-mdtm no" which works fine and makes an improvement in
speed. Third, I tried "use-mlsd yes" which worked quite fast, but gave me
strange results. I use "--only-missing" switch, but LFTP was trying to send
some files that already existed on the destination. I tried with a
different FTP server (Apache FTP server 1.0.6) but got similar results. It
would try to resend the same files over and over again.

I read that "--depth-first" may improve the speed as well.

Please could someone advise me on the best approach to synchronising very
complex and deep directory trees. Thank you.

[Alexander V. Lukyanov]

Post by Martynas Brijunas
strange results. I use "--only-missing" switch, but LFTP was trying to send
some files that already existed on the destination. I tried with a
different FTP server (Apache FTP server 1.0.6) but got similar results. It
would try to resend the same files over and over again.

Do file names include semicolon (;) ? If so, I have found a bug in MLSD
list parsing which happens when file name includes a semicolon.

--
Alexander.