Bug 105514

Summary: MemoryError when using 'summary html' option
Product: piglit Reporter: Clayton Craft <clayton.a.craft>
Component: infrastructureAssignee: Dylan Baker <baker.dylan.c>
Status: RESOLVED INVALID QA Contact: Piglit Mailing List <piglit>
Severity: normal    
Priority: medium    
Version: unspecified   
Hardware: Other   
OS: All   
Whiteboard:
i915 platform: i915 features:

Description Clayton Craft 2018-03-14 23:30:21 UTC
Piglit seems to run out of memory and crash when processing (summary html) the xml files from a build in the mesa CI.



$ piglit summary html summary/sanity xml/*.xml                                                             i 
Traceback (most recent call last):                                                                                                   
  File "/tmp/build_root/m64/bin/piglit", line 178, in <module>                                                                       
    main()                                                                                                                           
  File "/tmp/build_root/m64/bin/piglit", line 174, in main                                                                           
    sys.exit(runner(args))                                                                                                           
  File "/tmp/build_root/m64/lib/piglit/framework/exceptions.py", line 51, in _inner                                                  
    func(*args, **kwargs)                                                                                                            
  File "/tmp/build_root/m64/lib/piglit/framework/programs/summary.py", line 119, in html                                             
    summary.html(args.resultsFiles, args.summaryDir, args.exclude_details)                                                           
  File "/tmp/build_root/m64/lib/piglit/framework/summary/html_.py", line 179, in html                                                
    _make_comparison_pages(results, destination, exclude)
  File "/tmp/build_root/m64/lib/piglit/framework/summary/html_.py", line 149, in _make_comparison_pages
    exclude=exclude))
  File "/usr/lib/python3.6/site-packages/mako/template.py", line 462, in render
    return runtime._render(self, self.callable_, args, data)
  File "/usr/lib/python3.6/site-packages/mako/runtime.py", line 839, in _render
    return context._pop_buffer().getvalue()
  File "/usr/lib/python3.6/site-packages/mako/util.py", line 158, in getvalue
    self.errors)
MemoryError
Comment 1 Dylan Baker 2018-03-15 17:27:08 UTC
How many XML files is that and how large are they? If you're throwing 1,000,000 results or so at it I would say you've just hit the limit of what the current HTML renderer can do.
Comment 2 Dylan Baker 2018-03-15 17:28:22 UTC
To be clearer, the HTML view was designed for A/B style comparison (or A/B/C). It's not really meant to view 10 different platforms at a time.
Comment 3 Adam Jackson 2019-03-06 15:29:15 UTC
(In reply to Dylan Baker from comment #2)
> To be clearer, the HTML view was designed for A/B style comparison (or
> A/B/C). It's not really meant to view 10 different platforms at a time.

Closing on this basis. Reducing memory usage would still be lovely, but please file issues in gitlab with specifics.

Use of freedesktop.org services, including Bugzilla, is subject to our Code of Conduct. How we collect and use information is described in our Privacy Policy.