Page MenuHome

Cycles slowdown and disk reading issues with large textures
Needs Triage, NormalPublic

Description

System Information
Operating system: Void Linux (Kernel 5.7.15)
System Specs: AMD TR 3990X, 256GB RAM, AMD Radeon 5700XT

Blender Version
Broken: 2.83, 2.90, 2.91

Short description of error
When rendering with large (6K+) textures some file formats cause Cycles to slow down during rendering. Tested on CPU.

Exact steps for others to reproduce the error

In the below example I started with a fresh scene to test the different formats and their impact on render time.
In a simple scene with small textures <= 4K, there doesn't seem to be much of an impact.
However, when using larger textures (6-8K+) Cycles can sometimes hangs after "Updating shaders", when loading the textures, for an extended time.

The scene below just has Suzanne with a material that has three 8K textures.
When using TGA (the fastest in testing) vs JPG, the scene with targas starts rendering instantly and the scene with jpegs hangs for about 10 seconds after "Updating Shaders"
Other scenes start rendering and hang when the render tiles hit an object with large textures on it.

JPG seems to be the most affected, but I've also seen similar behavior with PNG and TIF files, it's hard to pin down what problematic about specific files and causes this behavior. There's a lot of disk reading happening, even though it pulls more data than the actual size of the textures.

On some scenes, I've seen slowdowns of multiple minutes, both in the viewport render preview and when rendering a frame. Anytime Cycles has to load the textures basically.
Switching color profiles in the image texture settings is also very slow with these jpegs. Packing the textures doesn't alleviate the problem.

Here's another scene that's just that same asset with three 8K textures again and here you can really see the difference in performance.

Just to eliminate any potential system variables, I tested the same file on a Windows machine with an Intel processor and witnessed the same behavior.

One thing I did notice is that Blender is pinned at 100% cpu usage the entire time and it's constantly reading from the disk, even though it seems to read way more data than the actual size of the file. For the jpegs in the example, that's three full minutes of high cpu use and roughly 10-20MB/s reads from the disk, even though the textures only total roughly 115MB for the tree example.

I'm more than happy to share the pine tree file, just not publicly as it contains some assets that I purchased and I want to respect the license.

Event Timeline

Is this a regression from some specific Blender version?

I did some quick testing in 2.82 and 2.81 and the behavior seems present there as well. I can have a look at 2.79 once I have some time to see it the problem exists there as well.

Just had some time to check 2.80 and 2.79b to compare and it looks like this behavior goes pretty far back.

2.80:

2.79b:

Just had some time to check 2.80 and 2.79b to compare and it looks like this behavior goes pretty far back.

Thanks for info. Can you upload example file that can be accessed publicly? Or is it as simple as just plug few 8K textures to shader and render?

I could have a look at this, as in at least confirm issue and do some profiling to see where is the bottleneck in my case, but my HW is like pentium 386 compared to yours :)

No problem, here's a link to the files: https://cloud.mantissa.xyz/index.php/s/PmfJLaNHqzewPwr (1.7GB)
If you want the tree scene as well, I'll have to share it directly, as it has assets I can't link publicly.

You can just turn each collection on and off to test the different textures.