Automated performance benchmarks for geometry nodes/modifiers #92969

New Issue

Hans Goudey · 2021-11-09T19:22:40+01:00

Hans Goudey commented

2021-11-09 19:22:40 +01:00

We should have a way to make sure we avoid performance regressions, and a simpler way to test performance improvements for further work

There is now a system for automated performance benchmarks:

A similar system shouldn't be too hard for modifiers. It should measure the time that the modifier stack takes to run.

We could add many of the files created for Nodevember to have an initial set of "real world" files.

We should have a way to make sure we avoid performance regressions, and a simpler way to test performance improvements for further work There is now a system for automated performance benchmarks: - https://wiki.blender.org/wiki/Tools/Tests/Performance - https://developer.blender.org/diffusion/B/browse/master/tests/performance/tests/animation.py A similar system shouldn't be too hard for modifiers. It should measure the time that the modifier stack takes to run. We could add many of the files created for Nodevember to have an initial set of "real world" files.

Hans Goudey commented

2021-11-09 19:22:40 +01:00

Changed status from 'Needs Triage' to: 'Confirmed'

Hans Goudey commented

2021-11-09 19:22:40 +01:00

Added subscriber: @HooglyBoogly

Paul Larson commented

2021-11-11 02:43:36 +01:00

Added subscriber: @GeorgiaPacific

Iliya Katushenock commented

2022-02-04 21:29:48 +01:00

Added subscriber: @mod_moder

Garek commented

2022-02-05 08:10:33 +01:00

Added subscriber: @Garek

Iliya Katushenock commented

2022-09-10 02:00:07 +02:00

I can give the same way to this:
Addon for automated testing of groups of nodes and modifiers

Right now there is no way for this to evaluate the execution time from the api
For modifiers, there is no infrastructure to record the running time and output it to the api
For automation, at least the ability to set constant fields according to a template is required in order to find out the influence of the field. I think this will be the only option.
Also, for groups, this would require not only the upper speed measurement, but also the calculation of the operating time of all nodes.
There is a reason for this - the execution times of nodes do not add up correctly, like the time of parallel processes
So, for a more reliable result, a separate output would be preferable

I also think that if this addon would create output in the form of text, then it would be more convenient to make charts and tables.
Also, this is a smaller codebase for c++
And such a tool can be used by users
But since the evaluator is being updated now, the structure for logging (new) GeoTreeLog is also changing.
I think when this is completed, it will be possible to pay attention to accessing node logging from the api.
But I'm not sure about modifiers.

I can give the same way to this: Addon for automated testing of groups of nodes and modifiers - Right now there is no way for this to evaluate the execution time from the api - For modifiers, there is no infrastructure to record the running time and output it to the api - For automation, at least the ability to set constant fields according to a template is required in order to find out the influence of the field. I think this will be the only option. Also, for groups, this would require not only the upper speed measurement, but also the calculation of the operating time of all nodes. There is a reason for this - the execution times of nodes do not add up correctly, like the time of parallel processes So, for a more reliable result, a separate output would be preferable I also think that if this addon would create output in the form of text, then it would be more convenient to make charts and tables. Also, this is a smaller codebase for c++ And such a tool can be used by users But since the evaluator is being updated now, the structure for logging (new) `GeoTreeLog` is also changing. I think when this is completed, it will be possible to pay attention to accessing node logging from the api. But I'm not sure about modifiers.

blender-admin commented

2022-11-27 00:15:55 +01:00

This issue was referenced by 3a41e0f611

This issue was referenced by 3a41e0f611bd8a64df9ce4b93386569d8f0cb498

Sign in to join this conversation.

No Label

Download

What's New

Blender Studio

Manual

Developers Blog

Documentation

Benchmark

Blender Conference

Development Fund

One-time Donations

Automated performance benchmarks for geometry nodes/modifiers #92969