Page 1 of 1

Convert to excel 2.0 hangs on conversion (125k rows)

Posted: Mon Apr 15, 2013 4:48 pm
by bothunbr
Hello,

The convert to excel function hangs when I try to convert anything with over 125k rows. Each row has 30 columns. During the conversion we get ultra high CPU and memory usage on the server. I have cranked up max heap to 10g on the 64bit JVM and this process seems to want to use every bit of it.


4/15/13 9:43:09 AM INFO Executing task 'writeExcel 2.0'
4/15/13 9:48:17 AM INFO Finished task 'writeExcel 2.0'
4/15/13 9:48:17 AM ERROR GC overhead limit exceeded
4/15/13 9:48:17 AM INFO Finished project 'Objective2'
4/15/13 9:48:17 AM ERROR GC overhead limit exceeded
com.linoma.dpa.runtime.JobFailedException: GC overhead limit exceeded
at com.linoma.dpa.runtime.Job.run(Unknown Source)
at com.linoma.dpa.runtime.Runtime.executeProject(Unknown Source)
at com.linoma.dpa.j2ee.forms.ConfigureProjectComponentForm.executeProject(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)



I know, who wants a 125k row excel file anyway. I was just testing the limits of the system and excel should be able to do 1 million rows. The conversion process seems a bit slow even on a smaller file. Maybe I need to tweak something in my JVM?

Re: Convert to excel 2.0 hangs on conversion (125k rows)

Posted: Thu May 16, 2013 8:46 am
by monahanks
We have a similar issue writing to Excel 2007 - error about heap storage or some such thing, and running a long time. Switching back to excel 2003 runs fine and quick. Wish I could answer your post.

Re: Convert to excel 2.0 hangs on conversion (125k rows)

Posted: Fri May 24, 2013 1:14 pm
by Support_Rick
--bothunbr--

The writeExecl task is a very memory intensive task. It does (and will) take some tweaking on your Java Memory to get something that large to work since it has to load the file into memory to get it to process.

Creating a CSV would be a cleaner (and quicker) alternative and still give you the Spreadsheet entries that you could save into 2003/2007 or later formats.

Re: Convert to excel 2.0 hangs on conversion (125k rows)

Posted: Fri May 09, 2014 1:29 am
by Baldwinlee
Yes, the issuse that heap storage or some such thing, and running a long time will occur sometimes, and I have met such problem several times. I am not clear that if we change Excel 2007 or exce 2010 to excel 2003, the excel converter will works much better. Can anyone give more useful advice if I still use excel 2007 or any later version.