Bug 62496 - Memory leak when saving large ods file to xlsx format
Summary: Memory leak when saving large ods file to xlsx format
Status: NEW
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: Spreadsheet (show other bugs)
Version: 4.0.1.2 release
Hardware: x86-64 (AMD64) Linux (All)
: high major
Assignee: Not Assigned
QA Contact:
URL:
Whiteboard: perf
Keywords:
Depends on:
Blocks:
 
Reported: 2013-03-18 22:03 UTC by Clemens Eisserer
Modified: 2014-03-20 15:26 UTC (History)
2 users (show)

See Also:
i915 platform:
i915 features:


Attachments

Description Clemens Eisserer 2013-03-18 22:03:37 UTC
1. When saving the very large spreadsheet at https://mega.co.nz/#!5d0j3b6A!chMGwxtsd3qKHPPkWKOrDlryAFtaZrI91dUiuQ3Jva4 to xsls-format, calc consumes about 3.8 GB of memory. When closing the document and working with an empty writer document, memory consumption only decreases to about 3GB.

2. Close the LibreOffice instance which was used for step 1. When opening the xsls-file generated in step 1 with a fresh libreoffice instance, calc consumes about 1.3GB of memory (which is ok). When saving the file again to xsls, memory consumtion grows to 6.8 GB. After closing the document and working a bit with writer, it stays at 5GB.

Beside the really huge memory consumption, the memory used for both steps should be freed. Instead, memory consumption only decreases slightly when closing the calc window which contains the large spreadsheet.
Comment 1 Clemens Eisserer 2013-03-18 23:27:47 UTC
Excel-2010 just needs 300mb of RAM after loading+saving the document generated by LibreOffice.
Comment 2 Joel Madero 2013-04-23 16:36:51 UTC
Markus - I'll test this one when I'm at home but I thought it might be a good test case for you (150 megs...pretty hefty file). Might have some cool stuff going on that can be used to track down performance issues.
Comment 3 Markus Mohrhard 2013-04-24 10:15:47 UTC
OK, I'll add it to my list. But mainly the memory consumption after closing Calc. That the current OOXML filters are not very efficient is known and has to wait for something like the orcus implementation.
Comment 4 Joel Madero 2013-06-02 06:18:05 UTC
Sorry for the delay - so I confirmed enough to mark this as NEW and confirm that it's a good test case to improve our filters.

IMO there are 2 problems that highlight everything else.

1. Opening the ODS itself takes up nearly 3 gigs - seems excessive for a 150 meg file

2. The memory is never freed up


because of point #2, I can't confirm the save to XLS as I only have 4 gigs of RAM and 1 gig of SWAP.

Markus - do you have a system with insane amount of RAM (8+ gigs?) to confirm behavior in point 1 & 2 about saving to xlsx - first time only being 1ish gigs but then after it just eating RAM alive?


Use of freedesktop.org services, including Bugzilla, is subject to our Code of Conduct. How we collect and use information is described in our Privacy Policy.