RClone test failing on local

Help and Support
1

What is the problem you are having with rclone?

RClone tests failing when running on local machine

What is your rclone version (output from rclone version)

v1.53.2

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Ubuntu 18.04.5 LTS

The command you were trying to run (eg rclone copy /tmp remote:tmp)

go test ./... -v

A log from the command with the -vv flag

Why are integration tests even running without explicitly defining a test remote for them?

2

You'll get the docker based ones which don't need explicit config.

If you want to avoid this then use the technique used in make quicktest
quicktest:

    RCLONE_CONFIG="/notfound" go test

It looks like if you kill off the proftpd container then the tests will work.

3

@ncw The traceback I pasted was from a local run. In another environment, the tests fail with different errors. For eg:

2020-11-20T15:40:55.721  --- FAIL: TestIntegration (0.00s)
2020-11-20T15:40:55.721      fstests.go:357: Using remote "TestFTPProftpd:"
2020-11-20T15:40:55.721      fstests.go:367: 
2020-11-20T15:40:55.721          	Error Trace:	fstests.go:367
2020-11-20T15:40:55.721          	            				ftp_test.go:14
2020-11-20T15:40:55.721          	Error:      	Received unexpected error:
2020-11-20T15:40:55.721          	            	exec: "C:\\Jenkins\\workspace\\CMM_Agent_EMT-5647\\rclone\\fstest\\testserver\\init.d\\TestFTPProftpd": file does not exist
2020-11-20T15:40:55.721          	            	failed to run C:\Jenkins\workspace\CMM_Agent_EMT-5647\rclone\fstest\testserver\init.d\TestFTPProftpd start
2020-11-20T15:40:55.721          	            	
2020-11-20T15:40:55.721          	            	github.com/rclone/rclone/fstest/testserver.run
2020-11-20T15:40:55.721          	            		C:/Jenkins/workspace/CMM_Agent_EMT-5647/rclone/fstest/testserver/testserver.go:55
2020-11-20T15:40:55.721          	            	github.com/rclone/rclone/fstest/testserver.start
2020-11-20T15:40:55.721          	            		C:/Jenkins/workspace/CMM_Agent_EMT-5647/rclone/fstest/testserver/testserver.go:77
2020-11-20T15:40:55.721          	            	github.com/rclone/rclone/fstest/testserver.Start
2020-11-20T15:40:55.721          	            		C:/Jenkins/workspace/CMM_Agent_EMT-5647/rclone/fstest/testserver/testserver.go:153
2020-11-20T15:40:55.721          	            	github.com/rclone/rclone/fstest/fstests.Run
2020-11-20T15:40:55.721          	            		C:/Jenkins/workspace/CMM_Agent_EMT-5647/rclone/fstest/fstests/fstests.go:366
2020-11-20T15:40:55.721          	            	github.com/rclone/rclone/backend/ftp_test.TestIntegration
2020-11-20T15:40:55.721          	            		C:/Jenkins/workspace/CMM_Agent_EMT-5647/rclone/backend/ftp/ftp_test.go:14
2020-11-20T15:40:55.721          	            	testing.tRunner
2020-11-20T15:40:55.721          	            		c:/go/src/testing/testing.go:909
2020-11-20T15:40:55.721          	            	runtime.goexit
2020-11-20T15:40:55.721          	            		c:/go/src/runtime/asm_amd64.s:1357
2020-11-20T15:40:55.721          	Test:       	TestIntegration

(This is not the only error)

With v1.50.2, no test was failing, while with v1.53.2, a lot of tests are failing. Did something change between these two versions w.r.t. tests that could have triggered this? How do they pass in RClone CI, and is there some additional configuration that we can do (except skipping them the way you suggested). Since I did not need to skip them earlier, I feel a little apprehensive why should I have to skip now. The RClone documentation on testing has always seemed very insufficient.

4

The errors you posted are from a Windows machine and I don't think the machinery used to start the docker containers will work there as it is written in bash.

Which tests do you want to run? Tests for all of rclone? In which case the recommended thing to run is make quicktest

Or are you trying to run FTP tests in particular? If so you need to set up an FTP server for rclone to talk to and pass it in as go test -v -remote MyTestFTPServer:

5

Thank you @ncw. make quicktest works.