Bug 39540 - EDITING Improve performance for insert big tables
Summary: EDITING Improve performance for insert big tables
Status: RESOLVED INVALID
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: Writer (show other bugs)
Version:
(earliest affected)
3.4.2 RC2
Hardware: All Windows (All)
: low enhancement
Assignee: Not Assigned
URL:
Whiteboard:
Keywords: perf
: 45714 (view as bug list)
Depends on:
Blocks:
 
Reported: 2011-07-26 02:01 UTC by pierre.forges
Modified: 2015-12-15 11:05 UTC (History)
3 users (show)

See Also:
Crash report or crash signature:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description pierre.forges 2011-07-26 02:01:05 UTC
Hi everyone,

I need to create in a Writer document a huge table.
Don't ask me why.

I have almost done the job by creating the following table:
Number of Columns: 6. Number of Rows: around 10,900

What I need is, a table with around 13 000 rows and 6 columns.

When it comes to add one more row to the 10 900 existing ones, my PC freezes and its CPU goes crazy. I let my PC "work" all night long. Still "working" the next day. 

I've got a PC with enough RAM to handle such a problem. I did set up the Tools > Options > OpenOffice.org > Memory to 256 Mo and 10 Mo per Object. Still not working.

Question: is there a solution to increase the maximum number of cells authorized in tables on writer documents?

Thanks for your help.
Comment 1 Rainer Bielefeld Retired 2011-07-26 03:13:39 UTC
Currently I can't see a downmarket need for tables with tenthousands of rows. 

GUI will not allow to insert such big tables.

But indeed, performance becomes bad for very big tables. I tried on 64 bit AMD Phenom II X4 955 Processor 3.2 GHz, 4GB RAM, 
Graphic Card: NVIDIA GeForce GT 430
with Master "LibO-dev 3.4.5  – WIN7  Home Premium  (64bit) English UI 
[(Build ID:d337f79-a24c961-2865670-9752b71-7f8fd43
	2fdd60d-fd28b6a-fd7bf20-aa369cb-28da3fb
	6a9633a-931d089-ecd263f-c9b55e9-b31b807
	82ff335-599f7e9-bc6a545-1926fdf)]"

and tables with 1 column rows. 

Insert  4000 rows table goes quick, you see several pages added per second
Insert  8000 rows table: it takes some seconds for each new page
Insert 12000 rows table: LibO seems to stop responding from time to time, it takes SEVERAL seconds for each new page

@reporter:
Why?   ;-)

This is the bug tracking system, not a helpdesk. May I ask you to read  hints on <http://wiki.documentfoundation.org/BugReport> carefully?
Comment 2 pierre.forges 2011-07-26 03:46:12 UTC
/Comment #1 from Rainer Bielefeld<LibreOffice@bielefeldundbuss.de>  2011-07-26 03:13:39 PDT ---
Currently I can't see a downmarket need for tables with tenthousands of rows.

GUI will not allow to insert such big tables./



So, the conclusion is that:
- "Huge" tables cannot be handled right now by Writer
- Nothing will be done to correct this problem since it concerns a tiny 
amount of people

As far as I am concerned, "Huge" means table with 6 columns and around 
10 900 rows.

I've got one table of that size, and it's not possible to add one more row.

Best regards,

Pierre Forges





Le 26/07/2011 12:13, "> bugzilla-daemon@freedesktop.org (par Internet, 
dépôt www-data@freedesktop.org)" a écrit :
> https://bugs.freedesktop.org/show_bug.cgi?id=39540
>
> Rainer Bielefeld<LibreOffice@bielefeldundbuss.de>  changed:
>
>             What    |Removed                     |Added
> ----------------------------------------------------------------------------
>              Summary|Max number of cells in      |EDITING Improve performance
>                     |tables                      |for insert big tables
>              Version|unspecified                 |LibO 3.4.2 RC2
>    Status Whiteboard|                            |perf
>             Severity|blocker                     |enhancement
>             Priority|medium                      |low
>                   CC|                            |LibreOffice@bielefeldundbus
>                     |                            |s.de
>
> --- Comment #1 from Rainer Bielefeld<LibreOffice@bielefeldundbuss.de>  2011-07-26 03:13:39 PDT ---
> Currently I can't see a downmarket need for tables with tenthousands of rows.
>
> GUI will not allow to insert such big tables.
>
> But indeed, performance becomes bad for very big tables. I tried on 64 bit AMD
> Phenom II X4 955 Processor 3.2 GHz, 4GB RAM,
> Graphic Card: NVIDIA GeForce GT 430
> with Master "LibO-dev 3.4.5  – WIN7  Home Premium  (64bit) English UI
> [(Build ID:d337f79-a24c961-2865670-9752b71-7f8fd43
>      2fdd60d-fd28b6a-fd7bf20-aa369cb-28da3fb
>      6a9633a-931d089-ecd263f-c9b55e9-b31b807
>      82ff335-599f7e9-bc6a545-1926fdf)]"
>
> and tables with 1 column rows.
>
> Insert  4000 rows table goes quick, you see several pages added per second
> Insert  8000 rows table: it takes some seconds for each new page
> Insert 12000 rows table: LibO seems to stop responding from time to time, it
> takes SEVERAL seconds for each new page
>
> @reporter:
> Why?   ;-)
>
> This is the bug tracking system, not a helpdesk. May I ask you to read  hints
> on<http://wiki.documentfoundation.org/BugReport>  carefully?
>
Comment 3 Rainer Bielefeld Retired 2011-07-26 05:21:19 UTC
I got my 12000 rows table after 1/2 hour, when I then tried to add 5 columns, LibO stopped to respond, now after 2 hours without any visible progress I lost patience and killed the process.

@pierre.forges:
Please stop your useless citing!
The simple truth is: I believe we could improve performance here immediately, but can you do a well-considered proposal (respecting other interests) what other bugfixes we should shift? The human resources are limited.
Comment 4 Rainer Bielefeld Retired 2011-07-26 05:37:23 UTC
BTW, I checked MS WORD 2010, it filled 255 pages with 1 column table within 15 seconds on an other PC.

Table with 16000 rows also was no problem (315 pages)

6 columns table with 13000 rows took something << 5 minutes to fill 255 pages, when I add more rows WORD is a little slow, but you still can work with it.
Comment 5 pierre.forges 2011-07-26 05:38:08 UTC
Well, to answer your question, I am unable to tell you what are the 
other bugfixes you should shift.


Le 26/07/2011 14:21, "> bugzilla-daemon@freedesktop.org (par Internet, 
dépôt www-data@freedesktop.org)" a écrit :
> https://bugs.freedesktop.org/show_bug.cgi?id=39540
>
> --- Comment #3 from Rainer Bielefeld<LibreOffice@bielefeldundbuss.de>  2011-07-26 05:21:19 PDT ---
> I got my 12000 rows table after 1/2 hour, when I then tried to add 5 columns,
> LibO stopped to respond, now after 2 hours without any visible progress I lost
> patience and killed the process.
>
> @pierre.forges:
> Please stop your useless citing!
> The simple truth is: I believe we could improve performance here immediately,
> but can you do a well-considered proposal (respecting other interests) what
> other bugfixes we should shift? The human resources are limited.
>
Comment 6 pierre.forges 2011-07-26 05:41:57 UTC
Is your table empty?

I've got 735 pages with some 10,900 rows and 6 columns.

Le 26/07/2011 14:37, "> bugzilla-daemon@freedesktop.org (par Internet, 
dépôt www-data@freedesktop.org)" a écrit :
> https://bugs.freedesktop.org/show_bug.cgi?id=39540
>
> --- Comment #4 from Rainer Bielefeld<LibreOffice@bielefeldundbuss.de>  2011-07-26 05:37:23 PDT ---
> BTW, I checked MS WORD 2010, it filled 255 pages with 1 column table within 15
> seconds on an other PC.
>
> Table with 16000 rows also was no problem (315 pages)
>
> 6 columns table with 13000 rows took something<<  5 minutes to fill 255 pages,
> when I add more rows WORD is a little slow, but you still can work with it.
>
Comment 7 Rainer Bielefeld Retired 2011-07-26 06:21:38 UTC
(In reply to comment #6)
> Is your table empty?

Yes, for a first quick test I only wanted to see whether that will work at all, with table contents things will not become more easy.

Currently the GUI limits 6 column tables to 2.730 rows, what seems to be wise for current performance. 

For your needs currently you will have to use other products (OOo isn't faster) or to find a different way how to proceed (DDE link to spreadsheet ...).
Comment 8 pierre.forges 2011-07-26 06:28:45 UTC
All right then


Le 26/07/2011 15:21, "> bugzilla-daemon@freedesktop.org (par Internet, 
dépôt www-data@freedesktop.org)" a écrit :
> https://bugs.freedesktop.org/show_bug.cgi?id=39540
>
> --- Comment #7 from Rainer Bielefeld<LibreOffice@bielefeldundbuss.de>  2011-07-26 06:21:38 PDT ---
> (In reply to comment #6)
>> Is your table empty?
> Yes, for a first quick test I only wanted to see whether that will work at all,
> with table contents things will not become more easy.
>
> Currently the GUI limits 6 column tables to 2.730 rows, what seems to be wise
> for current performance.
>
> For your needs currently you will have to use other products (OOo isn't faster)
> or to find a different way how to proceed (DDE link to spreadsheet ...).
>
Comment 9 Björn Michaelsen 2011-12-23 12:25:12 UTC
[This is an automated message.]
This bug was filed before the changes to Bugzilla on 2011-10-16. Thus it
started right out as NEW without ever being explicitly confirmed. The bug is
changed to state NEEDINFO for this reason. To move this bug from NEEDINFO back
to NEW please check if the bug still persists with the 3.5.0 beta1 or beta2 prereleases.
Details on how to test the 3.5.0 beta1 can be found at:
http://wiki.documentfoundation.org/QA/BugHunting_Session_3.5.0.-1

more detail on this bulk operation: http://nabble.documentfoundation.org/RFC-Operation-Spamzilla-tp3607474p3607474.html
Comment 10 sasha.libreoffice 2012-03-01 03:41:01 UTC
Thanks for bugreport
Please, verify: in last version of LibreOffice still reproducible?
Comment 11 Rainer Bielefeld Retired 2012-03-26 05:53:57 UTC
*** Bug 45714 has been marked as a duplicate of this bug. ***
Comment 12 Florian Reisinger 2012-08-14 14:00:42 UTC
Dear bug submitter!

Due to the fact, that there are a lot of NEEDINFO bugs with no answer within the last six months, we close all of these bugs.

To keep this message short, more infos are available @ https://wiki.documentfoundation.org/QA/NeedinfoClosure#Statement

Thanks for understanding and hopefully updating your bug, so that everything is prepared for developers to fix your problem.

Yours!

Florian
Comment 13 Florian Reisinger 2012-08-14 14:01:50 UTC
Dear bug submitter!

Due to the fact, that there are a lot of NEEDINFO bugs with no answer within the last six months, we close all of these bugs.

To keep this message short, more infos are available @ https://wiki.documentfoundation.org/QA/NeedinfoClosure#Statement

Thanks for understanding and hopefully updating your bug, so that everything is prepared for developers to fix your problem.

Yours!

Florian
Comment 14 Florian Reisinger 2012-08-14 14:06:32 UTC
Dear bug submitter!

Due to the fact, that there are a lot of NEEDINFO bugs with no answer within the last six months, we close all of these bugs.

To keep this message short, more infos are available @ https://wiki.documentfoundation.org/QA/NeedinfoClosure#Statement

Thanks for understanding and hopefully updating your bug, so that everything is prepared for developers to fix your problem.

Yours!

Florian
Comment 15 Florian Reisinger 2012-08-14 14:08:34 UTC
Dear bug submitter!

Due to the fact, that there are a lot of NEEDINFO bugs with no answer within the last six months, we close all of these bugs.

To keep this message short, more infos are available @ https://wiki.documentfoundation.org/QA/NeedinfoClosure#Statement

Thanks for understanding and hopefully updating your bug, so that everything is prepared for developers to fix your problem.

Yours!

Florian
Comment 16 Christopher Yeleighton 2013-12-30 13:49:51 UTC
As of version 4.1.3.2, the steps of Bug 45714 do not cause LibreOffice Writer to hang any more, so things must have improved a lot.
Comment 17 Robinson Tryon (qubit) 2015-12-15 11:05:11 UTC
Migrating Whiteboard tags to Keywords: (perf)
[NinjaEdit]