Page 1 of 1

Serious degradation in performance for Copy function

Posted: Wed Mar 02, 2016 4:34 pm
by bgoodwin
Lately we have seen a serious degradation in our COPY file performance from the local server to a Network Share set up as a resource. The file is created from a SQL database query and then copied to the network share. Here is a sample of our job log from last week...
02/23/2016 03:05:55 AM INFO Query completed successfully and the rowset 'data' was created
02/23/2016 03:05:55 AM INFO Finished sub-task 'query'
02/23/2016 03:05:55 AM INFO Finished task 'sql 1.0 (Connect to PPHS-DR)'
02/23/2016 03:05:55 AM INFO Executing task 'writeCSV 1.0 (Convert to text file)'
02/23/2016 03:07:31 AM INFO 134,724 record(s) were written from rowset '${data}' to 'D:\GoAnywhere\userdata\documents\Revenue_Cycle\Accounts_FE_BE_Meditech.txt' (81,168,559 bytes)
02/23/2016 03:07:31 AM INFO Finished task 'writeCSV 1.0 (Convert to text file)'
02/23/2016 03:07:31 AM INFO Executing task 'copy 1.0 (Copy to huron-cdisql)'
02/23/2016 03:07:38 AM INFO File 'D:\GoAnywhere\userdata\documents\Revenue_Cycle\Accounts_FE_BE_Meditech.txt' (81,168,559 bytes) was successfully copied to 'resource:smb://HURON-CDISQL-DAILYDATAFILES/Accounts_FE_BE_Meditech.txt' (81,168,559 bytes)
02/23/2016 03:07:38 AM INFO 1 file(s) copied successfully
02/23/2016 03:07:38 AM INFO Finished task 'copy 1.0 (Copy to huron-cdisql)'
And now here is the same job running this week:
03/02/2016 03:07:10 AM INFO Query completed successfully and the rowset 'data' was created
03/02/2016 03:07:10 AM INFO Finished sub-task 'query'
03/02/2016 03:07:10 AM INFO Finished task 'sql 1.0 (Connect to PPHS-DR)'
03/02/2016 03:07:10 AM INFO Executing task 'writeCSV 1.0 (Convert to text file)'
03/02/2016 03:10:15 AM INFO 139,794 record(s) were written from rowset '${data}' to 'D:\GoAnywhere\userdata\documents\Revenue_Cycle\Accounts_FE_BE_Meditech.txt' (84,154,810 bytes)
03/02/2016 03:10:15 AM INFO Finished task 'writeCSV 1.0 (Convert to text file)'
03/02/2016 03:10:15 AM INFO Executing task 'copy 1.0 (Copy to huron-cdisql)'
03/02/2016 05:02:48 AM INFO File 'D:\GoAnywhere\userdata\documents\Revenue_Cycle\Accounts_FE_BE_Meditech.txt' (84,154,810 bytes) was successfully copied to 'resource:smb://HURON-CDISQL-DAILYDATAFILES/Accounts_FE_BE_Meditech.txt' (84,154,810 bytes)
03/02/2016 05:02:48 AM INFO 1 file(s) copied successfully
03/02/2016 05:02:48 AM INFO Finished task 'copy 1.0 (Copy to huron-cdisql)'
It is now taking 2 hours just to simply copy this file. If we manually copy the file (copy/paste) from the server to the network share, it is instant. This is not the case anymore in GoAnywhere. Anyone else encountered this issue?

Thanks.

Re: Serious degradation in performance for Copy function

Posted: Fri Apr 15, 2016 11:28 am
by Support_Rick
William,

If you can, try utilizing the UNC Addressing and I think this will work much faster and smoother for you.

Keep us posted and let us know how that works...

Re: Serious degradation in performance for Copy function

Posted: Fri Apr 15, 2016 11:51 am
by bgoodwin
Hi Rick,

Thanks for the follow-up. Yes, I had to revert to UNC \\server\share in order to get files copied faster. I had our network techs look into the issue, as far as hardware and networking are concerned, and we couldn't determine the issue. Perhaps this is an issue with GoAnywhere and SMB1.0 & SMB2.0? Again, we're not sure what the underlying problem is, but copying files via other methods (copy/paste, powershell, etc.) worked without issue.

I have not tried this with 5.2.3 yet.

Thanks!