Error reading source directory: 425 Can't open data connection for transfer of

What is the problem you are having with rclone?

Intermittent error while copying data "error reading source directory: 425 Can't open data connection for transfer of "

What is your rclone version (output from rclone version)

rclone v1.51.0

Which OS you are using and how many bits (eg Windows 7, 64 bit)

  • os/arch: linux/amd64
  • go version: go1.13.7

Which cloud storage system are you using? (eg Google Drive)

AWS

The command you were trying to run (eg rclone copy /tmp remote:tmp)

./rclone copy --error-on-no-transfer --config=config.conf -v source:/ s3_destination

The rclone config contents with secrets removed.

[conf-s3]
type = s3
env_auth = true
region = region
location_constraint = region

[ftp_site]
type = ftp
host = host_ip
user = user
pass = paswd
port = fixed_port_no

Serverside FTP settings

timeout settings
connections timeout:3600
no transfer timeout:1800
login timeout:600
Use passive mode

A log from the command with the -vv flag

2021/01/19 04:01:02 ERROR : 2011/12: error reading source directory: 425 Can't open data connection for transfer of "/2011/12"
2021/01/19 04:01:02 ERROR : 2016/06/20160607: error reading source directory: 425 Can't open data connection for transfer of "/2016/06/20160607"
2021/01/19 04:01:02 ERROR : 2018/11: error reading source directory: 425 Can't open data connection for transfer of "/2018/11"
2021/01/19 04:01:02 ERROR : 2011/06/20110609: error reading source directory: 425 Can't open data connection for transfer of "/2011/06/20110609"
2021/01/19 04:01:15 INFO  : 
Transferred:   	         0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                 4 (retrying may help)
Checks:              1808 / 1808, 100%
Elapsed time:         0.0s

2021/01/19 04:02:15 INFO  : 
Transferred:   	         0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                 4 (retrying may help)
Checks:              2604 / 2604, 100%
Elapsed time:         0.0s

2021/01/19 04:02:54 ERROR : 2013/03/20130318: error reading source directory: 425 Can't open data connection for transfer of "/2013/03/20130318"
2021/01/19 04:03:09 ERROR : 2006/11/20061110: error reading source directory: 425 Can't open data connection for transfer of "/2006/11/20061110"
2021/01/19 04:03:09 ERROR : 2006/12/20061211: error reading source directory: 425 Can't open data connection for transfer of "/2006/12/20061211"
2021/01/19 04:03:09 ERROR : 2010/10/20101014: error reading source directory: 425 Can't open data connection for transfer of "/2010/10/20101014"
2021/01/19 04:03:09 ERROR : 2010/07/20100712: error reading source directory: 425 Can't open data connection for transfer of "/2010/07/20100712"
2021/01/19 04:03:15 INFO  : 
Transferred:   	         0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                 9 (retrying may help)
Checks:              3042 / 3042, 100%
Elapsed time:         0.0s

2021/01/19 04:03:46 ERROR : 2020/10/20201015: error reading source directory: 425 Can't open data connection for transfer of "/2020/10/20201015"
2021/01/19 04:03:46 ERROR : 2019/07/20190710: error reading source directory: 425 Can't open data connection for transfer of "/2019/07/20190710"
2021/01/19 04:04:15 INFO  : 
Transferred:   	         0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                11 (retrying may help)
Checks:              3594 / 3594, 100%
Elapsed time:         0.0s

2021/01/19 04:04:32 ERROR : 2009/04/20090417: error reading source directory: 425 Can't open data connection for transfer of "/2009/04/20090417"
2021/01/19 04:05:15 INFO  : 
Transferred:   	         0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                12 (retrying may help)
Checks:              4416 / 4416, 100%
Elapsed time:         0.0s

2021/01/19 04:05:43 ERROR : 2013/03/20130325: error reading source directory: 425 Can't open data connection for transfer of "/2013/03/20130325"
2021/01/19 04:06:15 INFO  : 
Transferred:   	         0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                13 (retrying may help)
Checks:              5026 / 5026, 100%
Elapsed time:         0.0s

2021/01/19 04:06:25 ERROR : 2012/03/20120327: error reading source directory: 425 Can't open data connection for transfer of "/2012/03/20120327"
2021/01/19 04:06:57 ERROR : 2006/08/20060824: error reading source directory: 425 Can't open data connection for transfer of "/2006/08/20060824"
2021/01/19 04:07:03 ERROR : 2006/07/20060727: error reading source directory: 425 Can't open data connection for transfer of "/2006/07/20060727"
2021/01/19 04:07:15 INFO  : 
Transferred:   	         0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                16 (retrying may help)
Checks:              5518 / 5518, 100%
Elapsed time:         0.0s

You have an old version of rclone, can you please update it.

Can you please run the command with -vv and share the output after you update it?

Thanks for looking, here it is

2021/01/19 12:59:39 DEBUG : 2010/04/20100401/file1.csv: Sizes identical
2021/01/19 12:59:39 DEBUG : 2010/04/20100401/file1.csv: Unchanged skipping
2021/01/19 12:59:39 DEBUG : 2009/09/20090901/file2.csv: Sizes identical
2021/01/19 12:59:39 DEBUG : 2009/09/20090901/file2.csv: Unchanged skipping
2021/01/19 12:59:39 DEBUG : 2009/09/20090901/file1.csv: Sizes identical
2021/01/19 12:59:39 DEBUG : 2009/09/20090901/file1.csv: Unchanged skipping
2021/01/19 12:59:40 DEBUG : 2018/04/20180402/file2.csv: Sizes identical
2021/01/19 12:59:40 DEBUG : 2018/04/20180402/file2.csv: Unchanged skipping
2021/01/19 12:59:40 DEBUG : 2018/04/20180402/file1.csv: Sizes identical
2021/01/19 12:59:40 DEBUG : 2018/04/20180402/file1.csv: Unchanged skipping
2021/01/19 12:59:49 INFO  : 
Transferred:   	         0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                 6 (retrying may help)
Checks:               362 / 362, 100%
Elapsed time:         0.0s

2021/01/19 12:59:51 ERROR : 2017/04/20170406: error reading source directory: 425 Can't open data connection for transfer of "/2017/04/20170406"
2021/01/19 12:59:54 ERROR : 2009/08/20090804: error reading source directory: 425 Can't open data connection for transfer of "/2009/08/20090804"
2021/01/19 12:59:54 ERROR : 2017/02/20170208: error reading source directory: 425 Can't open data connection for transfer of "/2017/02/20170208"
2021/01/19 12:59:54 DEBUG : 2014/01/20140108/file2.csv: Sizes identical
2021/01/19 12:59:54 DEBUG : 2014/01/20140108/file2.csv: Unchanged skipping
2021/01/19 12:59:54 DEBUG : 2014/01/20140108/file1.csv: Sizes identical
2021/01/19 12:59:54 DEBUG : 2014/01/20140108/file1.csv: Unchanged skipping
2021/01/19 12:59:54 DEBUG : 2011/03/20110301/file2.csv: Sizes identical

About the version comment, it will take a long/tedious change request to do an upgrade so I would request help keeping on the same version. It's served us very well till now except this new issue.

It's long and tedious to dig through an old version to discover an already fixed bug as well. Good luck.

This is something to do with the passive port range for FTP being blocked I think.

You might find this thread helpful

Thank you Nick for the guidance and link. Let me check this with server side vendor.

1 Like

This was finally resolved after the vendor gave us a new FTP server in a region much closer than the earlier.

1 Like

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.