Page MenuHome

Crash on render on some of the frames
Confirmed, NormalPublicBUG

Description

System Information
Operating system: Linux-4.4.0-154-generic-x86_64-with-debian-stretch-sid 64 Bits
8x Tesla V100 SXM2 NVLINK Accelerator Cards
Dual XEON Scalable 4208 CPUs
192 GB RAM

Blender Version
Broken: version: 2.82 (sub 7), branch: master, commit date: 2020-03-10 13:39, hash: rB89cff6537d13
I also tested recent 2.83 build

Short description of error
Blender crash when it renders scene frames from 346-639, the rest of the frames are fine.
It crashes for CPU anf GPU as well.

In order to render above frames I workaround the assert:

--- a/intern/cycles/kernel/kernel_compat_cpu.h
+++ b/intern/cycles/kernel/kernel_compat_cpu.h
@@ -74,8 +74,10 @@ CCL_NAMESPACE_BEGIN
 template<typename T> struct texture {
   ccl_always_inline const T &fetch(int index)
   {
-    kernel_assert(index >= 0 && index < width);
-    return data[index];
+    //kernel_assert(index >= 0 && index < width);
+    if (index < 0) return data[0];
+    else if (index >= width) return data[width];{F8410049}
+    else return data[index];
   }
 #if defined(__KERNEL_AVX__) || defined(__KERNEL_AVX2__)
   /* Reads 256 bytes but indexes in blocks of 128 bytes to maintain

The scene is complex and I couldn't make it very simply and narrow the problem.
Please find the scene attached.

Exact steps for others to reproduce the error

  1. Open Blender 2.82
  2. Open attached scene
  3. Set frame 346, start render (F12)
  4. After one minute or so it will crash

Event Timeline

Richard Antalik (ISS) changed the task status from Needs Triage to Needs Information from User.Tue, Mar 17, 7:50 PM

@Marcin (marcin20) can you simplify this file as much as possible so it is easier to investigate the issue?

@Marcin (marcin20) can you simplify this file as much as possible so it is easier to investigate the issue?

I tried to make it simple but everytime I remove or disable from rendering any object the rendering works. The issue seems to be related to complexity of the scene somehow.

Richard Antalik (ISS) changed the task status from Needs Information from User to Confirmed.Wed, Mar 18, 4:39 PM
Richard Antalik (ISS) added a project: Cycles.

It looks like out of memory issue, I tried to render frame 346 and had to restart my PC. Can not say for sure though.
Even if we will able to fix crash, the frame may still not be able to render on your machine, so only way seems to be somehow optimizing your scene or upgrading hardware.

It looks like out of memory issue, I tried to render frame 346 and had to restart my PC. Can not say for sure though.
Even if we will able to fix crash, the frame may still not be able to render on your machine, so only way seems to be somehow optimizing your scene or upgrading hardware.

We used one of our bigger system with the following specs:

8x Tesla V100 SXM2 NVLINK Accelerator Cards
Dual XEON Scalable 4208 CPUs
192 GB RAM

I don't think so there is so huge difference between frame 345 and 346.

Is there anything I can provide, additional data, call stacks and help you to fix the issue.
I monitor the memory when I was rendering on CPU and never cross the 45GB along with system components, XWindows, and other software.

Is there anything I can provide, additional data, call stacks and help you to fix the issue.

Thanks for aditional info, I guess that call stack may help

Is there anything I can provide, additional data, call stacks and help you to fix the issue.

Thanks for aditional info, I guess that call stack may help

I can also prepare for you a system (via ssh) with all necessary software and blender, please let me know if this can help too.

Brecht Van Lommel (brecht) changed the subtype of this task from "Report" to "Bug".Fri, Mar 20, 2:36 PM