Page 1 of 1

Listing files with åäö/ÅÄÖ

Posted: Tue Jan 24, 2017 9:41 am
by Markus_a
Hi,

We have a problem running jobs when filenames with åäö is being used.

When renaming a file the log says that the file where renamed to åäö.txt, but when the file is listed again it's shown as ???.txt.

Looking in to the config files we can see that it's set to utf-8 in all the places we have found, and there for should support Nordic letters.

We can create a file on the host system called åäö.txt, but then it's not listen at all when connecting trough any of the ftp-services, and when using the file selector inside a project of GAW it's shown as ������.txt.

We are running GAW MFT 5.2.5.
The host system is Ubunut 14.04.

Any tips or pointers for us to solve the issue?
Please let me know if more info would be needed.

Best regards,
Markus Åkerlund

Re: Listing files with åäö/ÅÄÖ

Posted: Tue Jan 24, 2017 5:16 pm
by Support_Dan
Markus,

Can you provide/attach the entire Project XML as well as the log file to this thread so that we can get a look at exactly what is going on? Thanks.

Re: Listing files with åäö/ÅÄÖ

Posted: Wed Jan 25, 2017 3:17 am
by Markus_a
Hi, thank you for answering.
Sure, I'll post one simple project that is failing.
Code: Select all
<project name="test" mainModule="Main" version="2.0" logLevel="verbose">

	<module name="Main">

		<copy sourceFile="/data/goanywhere/domains/resurs/webdocs/Markus_a_test/test.txt" destFile="/data/goanywhere/domains/resurs/webdocs/Markus_a_test/archive/åäö.txt" whenFileExists="overwrite" version="1.0" />

	</module>

</project>
Code: Select all
joblog:
2017-01-25 9:09:13            INFO      Start Date and Time: 2017-01-25 9:09:13
2017-01-25 9:09:13            INFO      Job Number: 1000000002754 
2017-01-25 9:09:13            INFO      Project Name: /Markus_a/test
2017-01-25 9:09:13            INFO      Submitted By: markus_a
2017-01-25 9:09:13            INFO      Submitted From: Administrator UI
2017-01-25 9:09:13            INFO      GoAnywhere 5.2.5 running on Linux 3.13.0-106-generic (amd64)
2017-01-25 9:09:13            INFO      Executing project 'test' 
2017-01-25 9:09:13            INFO      Project location: /data/goanywhere/domains/resurs/projects/Markus_a/test.xml
2017-01-25 9:09:13            INFO      Executing module 'Main'
2017-01-25 9:09:13            INFO      Executing task 'copy 1.0'
2017-01-25 9:09:13            INFO      File '/data/goanywhere/domains/resurs/webdocs/Markus_a_test/test.txt' (0 bytes) was successfully copied to '/data/goanywhere/domains/resurs/webdocs/Markus_a_test/archive/åäö.txt' (0 bytes)
2017-01-25 9:09:13            INFO      1 file(s) copied successfully
2017-01-25 9:09:13            INFO      Finished task 'copy 1.0'
2017-01-25 9:09:13            INFO      Finished module 'Main'
2017-01-25 9:09:13            INFO      Finished project 'test'
2017-01-25 9:09:13            INFO      End Date and Time: 2017-01-25 9:09:13
Then when I look what file where created, it's called "???.txt"
-
We have also noticed that when sending emails from GoAnyWhere projects sometimes nordic letters gets replaced with ?-marks or a square, we have been working around this issue and adjusting the text, each email we are sending is configured to use UTF-8 both for subject and message, if this will help you troubleshoot the issue.

Br,
Markus

Re: Listing files with åäö/ÅÄÖ

Posted: Wed Jan 25, 2017 10:44 am
by Support_Dan
Markus,

Thanks for the attached info. My apologies, but can you set your log level on the above project you attached to debug and then run again and paste those results? This can be set within the specific project under 'Control | Log Level'. Thanks.

Re: Listing files with åäö/ÅÄÖ

Posted: Thu Jan 26, 2017 3:55 am
by Markus_a
Hi, again.

We upgraded our installation to 5.4.1 and now it's working, so might have been an issue with the previous version.

Thanks for your help and time.

/Markus

Re: Listing files with åäö/ÅÄÖ

Posted: Thu Jan 26, 2017 6:56 am
by Markus_a
Hi, apparently there is still a problem when we are passing on åäö as a variable name from AS400 system, but other that that it's working.

Project:
Code: Select all
<project name="test" mainModule="Main" version="2.0" logLevel="verbose">
	<variable name="fileName" value="" />

	<module name="Main" logLevel="debug">
		<if condition="${IsEmpty(fileName)}">

			<setVariable name="fileName" value="filename_åäö" version="2.0" />

		</if>

		<copy sourceFile="/data/goanywhere/domains/resurs/webdocs/Markus_a_test/test.txt" destFile="/data/goanywhere/domains/resurs/webdocs/Markus_a_test/archive/${fileName}" whenFileExists="overwrite" version="1.0" />


		<copy sourceFile="/data/goanywhere/domains/resurs/webdocs/Markus_a_test/test.txt" destFile="/data/goanywhere/domains/resurs/webdocs/Markus_a_test/archive/åäöÅÄÖ.txt" whenFileExists="overwrite" version="1.0" />


		<createFileList fileListVariable="test" version="1.0">
			<fileset dir="/data/goanywhere/domains/resurs/webdocs/Markus_a_test/archive/" recursive="false">
				<wildcardFilter>
					<include pattern="*" caseSensitive="false" />
				</wildcardFilter>
			</fileset>
		</createFileList>


		<print label="Filename" version="1.0">
			<![CDATA[${test}]]>
		</print>

	</module>

</project>
--------------------------------------------------
Code: Select all
Running the job without passing:
2017-01-26 12:51:05           INFO      Start Date and Time: 2017-01-26 12:51:05
2017-01-26 12:51:05           INFO      Job Number: 1000000002777 
2017-01-26 12:51:05           INFO      Project Name: /test
2017-01-26 12:51:05           INFO      Submitted By: markus_a
2017-01-26 12:51:05           INFO      Submitted From: Administrator UI
2017-01-26 12:51:05           INFO      GoAnywhere 5.4.1 running on Linux 3.13.0-106-generic (amd64)
2017-01-26 12:51:05           INFO      Executing project 'test' 
2017-01-26 12:51:05           INFO      Project location: /data/goanywhere/domains/resurs/projects/test.xml
2017-01-26 12:51:05           INFO      Executing module 'Main'
2017-01-26 12:51:05           INFO      Entering if block as the condition "${IsEmpty(fileName)}" was met
2017-01-26 12:51:05           INFO      Executing task 'setVariable 2.0'
2017-01-26 12:51:05           WARN      Variable 'fileName' was replaced with 'filename_åäö'.
2017-01-26 12:51:05           INFO      Finished task 'setVariable 2.0'
2017-01-26 12:51:05           INFO      Finished if block
2017-01-26 12:51:05           INFO      Executing task 'copy 1.0'
2017-01-26 12:51:05           INFO      File '/data/goanywhere/domains/resurs/webdocs/Markus_a_test/test.txt' (768 bytes) was successfully copied to '/data/goanywhere/domains/resurs/webdocs/Markus_a_test/archive/filename_åäö' (768 bytes)
2017-01-26 12:51:05           INFO      1 file(s) copied successfully
2017-01-26 12:51:05           INFO      Finished task 'copy 1.0'
2017-01-26 12:51:05           INFO      Executing task 'copy 1.0'
2017-01-26 12:51:05           INFO      File '/data/goanywhere/domains/resurs/webdocs/Markus_a_test/test.txt' (768 bytes) was successfully copied to '/data/goanywhere/domains/resurs/webdocs/Markus_a_test/archive/åäöÅÄÖ.txt' (768 bytes)
2017-01-26 12:51:05           INFO      1 file(s) copied successfully
2017-01-26 12:51:05           INFO      Finished task 'copy 1.0'
2017-01-26 12:51:05           INFO      Executing task 'createFileList 1.0'
2017-01-26 12:51:05           INFO      File List variable 'test' was created containing 2 file(s)
2017-01-26 12:51:05           INFO      Finished task 'createFileList 1.0'
2017-01-26 12:51:05           INFO      Executing task 'print 1.0 (Filename)'
2017-01-26 12:51:05           INFO      /data/goanywhere/domains/resurs/webdocs/Markus_a_test/archive/filename_åäö
                                        /data/goanywhere/domains/resurs/webdocs/Markus_a_test/archive/åäöÅÄÖ.txt
2017-01-26 12:51:05           INFO      Finished task 'print 1.0 (Filename)'
2017-01-26 12:51:05           INFO      Finished module 'Main'
2017-01-26 12:51:05           INFO      Finished project 'test'
2017-01-26 12:51:05           INFO      End Date and Time: 2017-01-26 12:51:05

------------------------------------------------------
Running the jobb with passing from ibm:
2017-01-26 12:55:17           INFO      Start Date and Time: 2017-01-26 12:55:17
2017-01-26 12:55:17           INFO      Job Number: 1000000002778 
2017-01-26 12:55:17           INFO      Project Name: /test
2017-01-26 12:55:17           INFO      Submitted By: RBPPE_GA
2017-01-26 12:55:17           INFO      Submitted From: API-RunProject
2017-01-26 12:55:17           INFO      GoAnywhere 5.4.1 running on Linux 3.13.0-106-generic (amd64)
2017-01-26 12:55:17           INFO      Overriding variable 'fileName' with value 'filename_���'
2017-01-26 12:55:17           INFO      Executing project 'test' 
2017-01-26 12:55:17           INFO      Project location: /data/goanywhere/domains/resurs/projects/test.xml
2017-01-26 12:55:17           INFO      Executing module 'Main'
2017-01-26 12:55:17           INFO      Skipping if block as the condition "${IsEmpty(fileName)}" was not met
2017-01-26 12:55:17           INFO      Executing task 'copy 1.0'
2017-01-26 12:55:17           INFO      File '/data/goanywhere/domains/resurs/webdocs/Markus_a_test/test.txt' (768 bytes) was successfully copied to '/data/goanywhere/domains/resurs/webdocs/Markus_a_test/archive/filename_���' (768 bytes)
2017-01-26 12:55:17           INFO      1 file(s) copied successfully
2017-01-26 12:55:17           INFO      Finished task 'copy 1.0'
2017-01-26 12:55:17           INFO      Executing task 'copy 1.0'
2017-01-26 12:55:17           INFO      File '/data/goanywhere/domains/resurs/webdocs/Markus_a_test/test.txt' (768 bytes) was successfully copied to '/data/goanywhere/domains/resurs/webdocs/Markus_a_test/archive/åäöÅÄÖ.txt' (768 bytes)
2017-01-26 12:55:17           INFO      1 file(s) copied successfully
2017-01-26 12:55:17           INFO      Finished task 'copy 1.0'
2017-01-26 12:55:17           INFO      Executing task 'createFileList 1.0'
2017-01-26 12:55:17           INFO      File List variable 'test' was created containing 2 file(s)
2017-01-26 12:55:17           INFO      Finished task 'createFileList 1.0'
2017-01-26 12:55:17           INFO      Executing task 'print 1.0 (Filename)'
2017-01-26 12:55:17           INFO      /data/goanywhere/domains/resurs/webdocs/Markus_a_test/archive/filename_���
                                        /data/goanywhere/domains/resurs/webdocs/Markus_a_test/archive/åäöÅÄÖ.txt
2017-01-26 12:55:17           INFO      Finished task 'print 1.0 (Filename)'
2017-01-26 12:55:17           INFO      Finished module 'Main'
2017-01-26 12:55:17           INFO      Finished project 'test'
2017-01-26 12:55:17           INFO      End Date and Time: 2017-01-26 12:55:17
These are log level "Debug".

Thanks.