Serious degradation in performance for Copy function
Posted: Wed Mar 02, 2016 4:34 pm
Lately we have seen a serious degradation in our COPY file performance from the local server to a Network Share set up as a resource. The file is created from a SQL database query and then copied to the network share. Here is a sample of our job log from last week...
Thanks.
02/23/2016 03:05:55 AM INFO Query completed successfully and the rowset 'data' was createdAnd now here is the same job running this week:
02/23/2016 03:05:55 AM INFO Finished sub-task 'query'
02/23/2016 03:05:55 AM INFO Finished task 'sql 1.0 (Connect to PPHS-DR)'
02/23/2016 03:05:55 AM INFO Executing task 'writeCSV 1.0 (Convert to text file)'
02/23/2016 03:07:31 AM INFO 134,724 record(s) were written from rowset '${data}' to 'D:\GoAnywhere\userdata\documents\Revenue_Cycle\Accounts_FE_BE_Meditech.txt' (81,168,559 bytes)
02/23/2016 03:07:31 AM INFO Finished task 'writeCSV 1.0 (Convert to text file)'
02/23/2016 03:07:31 AM INFO Executing task 'copy 1.0 (Copy to huron-cdisql)'
02/23/2016 03:07:38 AM INFO File 'D:\GoAnywhere\userdata\documents\Revenue_Cycle\Accounts_FE_BE_Meditech.txt' (81,168,559 bytes) was successfully copied to 'resource:smb://HURON-CDISQL-DAILYDATAFILES/Accounts_FE_BE_Meditech.txt' (81,168,559 bytes)
02/23/2016 03:07:38 AM INFO 1 file(s) copied successfully
02/23/2016 03:07:38 AM INFO Finished task 'copy 1.0 (Copy to huron-cdisql)'
03/02/2016 03:07:10 AM INFO Query completed successfully and the rowset 'data' was createdIt is now taking 2 hours just to simply copy this file. If we manually copy the file (copy/paste) from the server to the network share, it is instant. This is not the case anymore in GoAnywhere. Anyone else encountered this issue?
03/02/2016 03:07:10 AM INFO Finished sub-task 'query'
03/02/2016 03:07:10 AM INFO Finished task 'sql 1.0 (Connect to PPHS-DR)'
03/02/2016 03:07:10 AM INFO Executing task 'writeCSV 1.0 (Convert to text file)'
03/02/2016 03:10:15 AM INFO 139,794 record(s) were written from rowset '${data}' to 'D:\GoAnywhere\userdata\documents\Revenue_Cycle\Accounts_FE_BE_Meditech.txt' (84,154,810 bytes)
03/02/2016 03:10:15 AM INFO Finished task 'writeCSV 1.0 (Convert to text file)'
03/02/2016 03:10:15 AM INFO Executing task 'copy 1.0 (Copy to huron-cdisql)'
03/02/2016 05:02:48 AM INFO File 'D:\GoAnywhere\userdata\documents\Revenue_Cycle\Accounts_FE_BE_Meditech.txt' (84,154,810 bytes) was successfully copied to 'resource:smb://HURON-CDISQL-DAILYDATAFILES/Accounts_FE_BE_Meditech.txt' (84,154,810 bytes)
03/02/2016 05:02:48 AM INFO 1 file(s) copied successfully
03/02/2016 05:02:48 AM INFO Finished task 'copy 1.0 (Copy to huron-cdisql)'
Thanks.