I have been experimenting with ways to get data out of my system and one of the users preferred formats is in XML. Running .printXML(); works fine on small data sets - but with 1k plus records the build time is unacceptable, and since the file is built all in memory, with 10k+ records eventually we get an ‘out of memory’ error and the process stops.
Is there a technique to break up the file size in to manageable chunks and then re-connect them, or even spool the output to file rather than hold it in memory?
Have you considered using Jasper Reports to print to an xml file?
Jasper Reports is able to handle large data sets.
If the enhancement that Jeff Bader has submitted to the Google Code group then the Servoy Jasper reports plugin may also handle tens of thousands of pages.