Illegal address in CUDA queue copy_from_device. #97633

New Issue

Peter · 2022-04-26T19:24:10+02:00

Peter commented

2022-04-26 19:24:10 +02:00

System Information
Operating system: Windows 10 Pro
Graphics card: RTX 2080 Ti
CPU: i9 9900K
RAM: 32 GB DDR4 3600 MT/s CL 16

Blender Version
Broken: All that I have tried. Currently using 3.1.
Worked: None.

Short description of error
During rendering of animation it randomly gets this CUDA address error. I then have to restart Blender for it to work again. This stops the render and also messes with the viewport too.

Exact steps for others to reproduce the error
Start rendering. Random error somewhere.
GrievousGround.blend

I will also add that the computer is completely stable in all other applications and games. CPU temperatures max out at around 65 C and GPU temperatures max out at about 40 C as the whole system is liquid cooled.

**System Information** Operating system: Windows 10 Pro Graphics card: RTX 2080 Ti CPU: i9 9900K RAM: 32 GB DDR4 3600 MT/s CL 16 **Blender Version** Broken: All that I have tried. Currently using 3.1. Worked: None. **Short description of error** During rendering of animation it randomly gets this CUDA address error. I then have to restart Blender for it to work again. This stops the render and also messes with the viewport too. **Exact steps for others to reproduce the error** Start rendering. Random error somewhere. [GrievousGround.blend](https://archive.blender.org/developer/F13030302/GrievousGround.blend) I will also add that the computer is completely stable in all other applications and games. CPU temperatures max out at around 65 C and GPU temperatures max out at about 40 C as the whole system is liquid cooled.

Peter commented

2022-04-26 19:24:10 +02:00

Added subscriber: @Peter-Gerace

Thomas Dinges commented

2022-04-26 20:40:17 +02:00

Added subscriber: @ThomasDinges

Thomas Dinges commented

2022-04-26 20:40:17 +02:00

Changed status from 'Needs Triage' to: 'Needs User Info'

Thomas Dinges commented

2022-04-26 20:40:17 +02:00

Are you rendering with CUDA or Optix? Are you on the latest NVIDIA driver?

Peter commented

2022-04-26 22:17:22 +02:00

I am using Optix. I am on the latest NVIDIA driver.

Pratik Borhade commented

2022-04-27 05:40:00 +02:00

Added subscriber: @PratikPB2123

Pratik Borhade commented

2022-04-27 05:40:00 +02:00

Hi, can you share the complete error message?
Also attach system info file: {nav Help > Save System Info}
Do you have this issue only with the attached file?

Hi, can you share the complete error message? Also attach system info file: {nav Help > Save System Info} Do you have this issue only with the attached file?

Peter commented

2022-05-18 20:49:50 +02:00

In #97633#1347244, @PratikPB2123 wrote:
Hi, can you share the complete error message?
Also attach system info file: {nav Help > Save System Info}
Do you have this issue only with the attached file?

Sorry about the delay. I didn’t see this message. But I had the issue yesterday with another Blend file. Can I still retrieve the error message or log? Or would I have to wait for the error to happen again? I will attach the system info file later today when I am back at my workstation.

> In #97633#1347244, @PratikPB2123 wrote: > Hi, can you share the complete error message? > Also attach system info file: {nav Help > Save System Info} > Do you have this issue only with the attached file? Sorry about the delay. I didn’t see this message. But I had the issue yesterday with another Blend file. Can I still retrieve the error message or log? Or would I have to wait for the error to happen again? I will attach the system info file later today when I am back at my workstation.

Pratik Borhade commented

2022-05-19 04:25:58 +02:00

Hi, if error occurred at the time of rendering,, I don't think retrieving that error message is possible after closing the blender.

Start rendering. Random error somewhere.

Are you able to repro this error frequently or sometimes only?
Please download and test again in latest builds from buildbot: https://builder.blender.org/download/daily
Is your GPU overclocked? If so, try running it at stock speed.

Hi, if error occurred at the time of rendering,, I don't think retrieving that error message is possible after closing the blender. > Start rendering. Random error somewhere. - Are you able to repro this error frequently or sometimes only? - Please download and test again in latest builds from buildbot: https://builder.blender.org/download/daily - Is your GPU overclocked? If so, try running it at stock speed.

Peter commented

2022-05-20 00:09:33 +02:00

So I just got a CUDA illegal address error again right now. It says "Failed to create CUDA context (Illegal address)". Do you need more to the error message than that? I'm not sure where to find that. But I will also include my system info txt file here. And these CUDA address errors occur somewhat frequently for me and across multiple different blend files now.

system-info.txt

So I just got a CUDA illegal address error again right now. It says "Failed to create CUDA context (Illegal address)". Do you need more to the error message than that? I'm not sure where to find that. But I will also include my system info txt file here. And these CUDA address errors occur somewhat frequently for me and across multiple different blend files now. [system-info.txt](https://archive.blender.org/developer/F13091811/system-info.txt)

Pratik Borhade commented

2022-05-27 15:58:15 +02:00

They are likely to get printed in console

-Please download and test again in latest builds from buildbot: https://builder.blender.org/download/daily
-Is your GPU overclocked? If so, try running it at stock speed.

Have you checked this?

They are likely to get printed in console > -Please download and test again in latest builds from buildbot: https://builder.blender.org/download/daily > -Is your GPU overclocked? If so, try running it at stock speed. Have you checked this?

Peter commented

2022-06-03 23:04:08 +02:00

GPU is not overclocked. I will try again with a daily build of Blender. I just had this happen again on frame 2 of a 460 frame 4K 60 FPS render I left running overnight. When I went to check on it in the morning I was very disappointed to see that it stopped at only frame 2. This time it said "Illegal address in CUDA queue copy_from_device (integrator_shade_surface integrator_sorted_paths_array prefix_sum)".

Pratik Borhade commented

2022-06-06 03:56:32 +02:00

Changed status from 'Needs User Info' to: 'Needs Triage'

Pratik Borhade commented

2022-06-06 04:02:32 +02:00

Issue appears to be same as reported in #98348 (GPU rendering error: Illegal Address in CUDA queue copy_from_device)
I'll merge them.

Issue appears to be same as reported in #98348 (GPU rendering error: Illegal Address in CUDA queue copy_from_device) I'll merge them.

Pratik Borhade commented

2022-06-06 04:02:44 +02:00

Closed as duplicate of #98348

Pratik Borhade closed this issue

2022-06-06 04:02:44 +02:00

Peter commented

2022-07-30 08:10:52 +02:00

I wanted to come back to this ticket and share what I did to solve my issue and to get flawless renders that can run for days without a single crash so others that find it in the future might find a solution. So basically Blender was causing GPU instability at the default clock speeds. I installed MSI Afterburner and made a separate profile for my Blender renders. For gaming and all other software, I actually applied a nice overclock to 2025 MHz GPU core and 7400 MHz to memory on my 2080 Ti. This runs at 1025 mV. Then I have a sperate profile I enable during my Blender renders. This profile is set to 1675 MHz GPU and 7000 MHz memory at 1040 mV (more voltage combined with lower clocks for more stability). When rendering using this more-stable-than-stock-settings profile, I have no more issues. I've tested it with consecutive days-long 4K 60 FPS animation renders. Hopefully this helps others with similar issues.

Germano Cavalcante referenced this issue

2023-08-18 20:36:21 +02:00

Vector displacement suspected to cause geometry artefact and CUDA error #111277

Sign in to join this conversation.

No Label

Download

What's New

Blender Studio

Manual

Developers Blog

Documentation

Benchmark

Blender Conference

Development Fund

One-time Donations

Illegal address in CUDA queue copy_from_device. #97633