Enable HIP on older devices #96740

New Issue

Brian Savery (AMD) · 2022-03-23T20:53:38+01:00

2022-03-23 20:53:38 +01:00

Status: In Development

Description
Big picture: Enabling HIP on more devices than just RDNA / RDNA2
Many users are on older GPUs (such as Vega based cards). To be transparent, on Windows the HIP driver side has only commited to support RDNA2 on windows. However, we enabled RDNA cards well and users are using them.

This task is to explore enabling more cards.

Vega II (Radeon 7)
Vega based GPUS (Wx9100, Vega64 etc)
Vega based APUS

Relevant links:

https://llvm.org/docs/AMDGPUUsage.html

**Status:** In Development --- **Description** **Big picture:** Enabling HIP on more devices than just RDNA / RDNA2 Many users are on older GPUs (such as Vega based cards). To be transparent, on Windows the HIP driver side has only commited to support RDNA2 on windows. However, we enabled RDNA cards well and users are using them. This task is to explore enabling more cards. * Vega II (Radeon 7) * Vega based GPUS (Wx9100, Vega64 etc) * Vega based APUS **Relevant links**: * https://llvm.org/docs/AMDGPUUsage.html

Brian Savery (AMD) commented

2022-03-23 20:53:38 +01:00

Added subscribers: @BrianSavery, @george-4, @Yuro, @BlenderUser700, @mkaito, @Takuro-Shoji, @Obsyden, @CadenMitchell-3, @ThomasDinges, @Maxzor-1, @Garek, @dvi, @Baardaap, @Jonas-Hagberth, @Maxzor, @not_a_boring_name, @Hannah-Umit, @iain.hogg, @Luciddream, @Caden-Mitchell, @hahnzhu, @LouisLithium, @Th3ho0d, @itf, @Alirion-2, @dmlr7, @Zeenus, @ephraimpauli, @brunnerh, @SomeAB, @Prodeous, @Pliou, @MikePan, @FogLizard, @leesonw, @Low_Polygon42, @s12a, @Diogo_Valadares, @Chou-Vieux, @pikhosh, @FreeCX, @AndreaMonzini, @LahceneB, @2905710881, @Sayak-Biswas, @pauanyu_blender, @easythrees, @2046411367, @julian8bruns, @AndyCuccaro, @Stat_Headcrabed, @Alaska, @GeorgiaPacific, @SteffenD, @Raimund58, @brecht

Brian Savery (AMD) self-assigned this 2022-03-23 20:58:49 +01:00

Hannah Ümit commented

2022-03-23 21:04:59 +01:00

I have an RX480 8G. Is there a specific driver version that would be preferred for debugging with polaris hardware? Maybe that could help speeding that side of things up in terms of development.

Brian Savery (AMD) commented

2022-03-23 21:56:55 +01:00

In #96740#1328856, @Hannah-Umit wrote:
I have an RX480 8G. Is there a specific driver version that would be preferred for debugging with polaris hardware? Maybe that could help speeding that side of things up in terms of development.

I uploaded a patch here: https://developer.blender.org/D14432
If you take a look here: https://llvm.org/docs/AMDGPUUsage.html you'd set your device type to 'polaris10'. However the HIP compiler will return "unknown architecture" for that so it looks like that can't be supported unfortunately. Sorry :(

> In #96740#1328856, @Hannah-Umit wrote: > I have an RX480 8G. Is there a specific driver version that would be preferred for debugging with polaris hardware? Maybe that could help speeding that side of things up in terms of development. I uploaded a patch here: https://developer.blender.org/D14432 If you take a look here: https://llvm.org/docs/AMDGPUUsage.html you'd set your device type to 'polaris10'. However the HIP compiler will return "unknown architecture" for that so it looks like that can't be supported unfortunately. Sorry :(

Hannah Ümit commented

2022-03-23 22:22:40 +01:00

Removed subscriber: @Hannah-Umit

Alaska commented

2022-03-24 00:19:25 +01:00

Changed status from 'Needs Triage' to: 'Confirmed'

Alaska commented

2022-03-24 00:51:18 +01:00

Out of curiosity, are the driver requirements for Vega different from RDNA2?
For example, RDNA2 GPUs supports HIP in Cycles if running driver version AMD Radeon Software 21.12.1 or AMD Radeon PRO Software 21.Q4 and newer on Windows. Does Vega have the same requirements? Or does it require a more recent GPU driver?

Out of curiosity, are the driver requirements for Vega different from RDNA2? For example, RDNA2 GPUs supports HIP in Cycles if running driver version `AMD Radeon Software 21.12.1` or `AMD Radeon PRO Software 21.Q4` and newer on Windows. Does Vega have the same requirements? Or does it require a more recent GPU driver?

blender-admin commented

2022-03-24 01:07:49 +01:00

This issue was referenced by c46e58817c

This issue was referenced by c46e58817cd72d1481967d32e3c6f47f42933d39

Ahmad Bilal commented

2022-03-24 08:13:56 +01:00

Just tested it with 24th March Build, with an Asus RX Vega64, with driver version 22.3.1 (17th March) on Windows 10 20H2 build . At the very least it detects the card itself. So first step seems okay.

After that I tested eevee, the basic cube on a plane with a single point light scene works fine there.

But as soon as I switch to cycles, things get broken, blender itself doesn't crash, but the whole PC freezes up. CPU/RAM usage in Windows Task Manager is not that high, but GPU usage might be touching 100% if I checked with a proper GPU profiler like MSI Afterburner or Asus GPUtweaktown. At last, doing a 'End Task' to close blender forcefully, restored the PC to its normal state. Here is a screenshot of the broken scene:

Edit 1: I forgot to mention, that I did get a error message when I tested it first time (above), but couldn't save/collect a screenshot of the exact error message.

Now I just tested it again, with same scene, and it works fine the second time.

Will test a bit more, and report back later.

![Screenshot 2022-03-24 123339.png](https://archive.blender.org/developer/F12942258/Screenshot_2022-03-24_123339.png) Just tested it with 24th March Build, with an Asus RX Vega64, with driver version 22.3.1 (17th March) on Windows 10 20H2 build . At the very least it detects the card itself. So first step seems okay. After that I tested eevee, the basic cube on a plane with a single point light scene works fine there. But as soon as I switch to cycles, things get broken, blender itself doesn't crash, but the whole PC freezes up. CPU/RAM usage in Windows Task Manager is not that high, but GPU usage might be touching 100% if I checked with a proper GPU profiler like MSI Afterburner or Asus GPUtweaktown. At last, doing a 'End Task' to close blender forcefully, restored the PC to its normal state. Here is a screenshot of the broken scene: ![Screenshot 2022-03-24 123940.png](https://archive.blender.org/developer/F12942266/Screenshot_2022-03-24_123940.png) Edit 1: I forgot to mention, that I did get a error message when I tested it first time (above), but couldn't save/collect a screenshot of the exact error message. Now I just tested it again, with same scene, and it works fine the second time. ![Screenshot 2022-03-24 125642.png](https://archive.blender.org/developer/F12942277/Screenshot_2022-03-24_125642.png) Will test a bit more, and report back later.

Alaska commented

2022-03-24 09:54:42 +01:00

@SomeAB , if you experience bugs while using Blender, please make a bug report for it. This can be done by selecting from the top of Blender {nav Help > Report a bug}

In #96740#1329021, @SomeAB wrote:

Edit 1: I forgot to mention, that I did get a error message when I tested it first time (above), but couldn't save/collect a screenshot of the exact error message.

Now I just tested it again, with same scene, and it works fine the second time.

In the screenshot you provided, the the GPU doesn't appear to be in use. As such you might not be experiencing this same issue. Please try re-enabling your GPU and see if that helps you reproduce the error for when you make your bug report.

@SomeAB , if you experience bugs while using Blender, please make a bug report for it. This can be done by selecting from the top of Blender {nav Help > Report a bug} > In #96740#1329021, @SomeAB wrote: > > Edit 1: I forgot to mention, that I did get a error message when I tested it first time (above), but couldn't save/collect a screenshot of the exact error message. > > Now I just tested it again, with same scene, and it works fine the second time. ![Screenshot 2022-03-24 125642.png](https://archive.blender.org/developer/F12942277/Screenshot_2022-03-24_125642.png) In the screenshot you provided, the the GPU doesn't appear to be in use. As such you might not be experiencing this same issue. Please try re-enabling your GPU and see if that helps you reproduce the error for when you make your bug report.

nyanmisaka commented

2022-03-24 11:00:16 +01:00

Added subscriber: @nyanmisaka

nyanmisaka commented

2022-03-24 11:00:16 +01:00

I've just tried to render the 3.0 demo using blender-3.2.0-alpha+master.98d4872d7f42-windows.amd64-release with RX Vega 64 on Windows 10 21H2.

Every time after I click Render -> Render(Image|Animation) it triggers a TDR and reset the Radeon software 22.3.1 WHQL (even though OC is not enabled).

The EXCEPTION_ACCESS_VIOLATION(amdhip64.dll) error can be observed in the debug log.

blender_debug_output.txt

blender_system_info.txt

This is the last screenshot I can find before system freezing. Hope it helps.

Edit: retried with iGPU disabled in BIOS but the issue still exists.

I've just tried to render the [3.0 demo ](https://cloud.blender.org/p/gallery/617933e9b7b35ce1e1c01066) using `blender-3.2.0-alpha+master.98d4872d7f42-windows.amd64-release` with RX Vega 64 on Windows 10 21H2. Every time after I click Render -> Render(Image|Animation) it triggers a TDR and reset the Radeon software 22.3.1 WHQL (even though OC is not enabled). The EXCEPTION_ACCESS_VIOLATION(amdhip64.dll) error can be observed in the debug log. [blender_debug_output.txt](https://archive.blender.org/developer/F12942456/blender_debug_output.txt) [blender_system_info.txt](https://archive.blender.org/developer/F12942455/blender_system_info.txt) This is the last screenshot I can find before system freezing. Hope it helps. ![vega64-hip.png](https://archive.blender.org/developer/F12942427/vega64-hip.png) Edit: retried with iGPU disabled in BIOS but the issue still exists.

Brian Savery (AMD) commented

2022-03-24 19:36:22 +01:00

In #96740#1329087, @Alaska wrote:
@SomeAB , if you experience bugs while using Blender, please make a bug report for it. This can be done by selecting from the top of Blender {nav Help > Report a bug}

In #96740#1329021, @SomeAB wrote:

Edit 1: I forgot to mention, that I did get a error message when I tested it first time (above), but couldn't save/collect a screenshot of the exact error message.

Now I just tested it again, with same scene, and it works fine the second time.

In the screenshot you provided, the the GPU doesn't appear to be in use. As such you might not be experiencing this same issue. Please try re-enabling your GPU and see if that helps you reproduce the error for when you make your bug report.

How can you tell this. Does the GPU Compute selection get greyed out if there is some issue?

> In #96740#1329087, @Alaska wrote: > @SomeAB , if you experience bugs while using Blender, please make a bug report for it. This can be done by selecting from the top of Blender {nav Help > Report a bug} > > >> In #96740#1329021, @SomeAB wrote: >> >> Edit 1: I forgot to mention, that I did get a error message when I tested it first time (above), but couldn't save/collect a screenshot of the exact error message. >> >> Now I just tested it again, with same scene, and it works fine the second time. ![Screenshot 2022-03-24 125642.png](https://archive.blender.org/developer/F12942277/Screenshot_2022-03-24_125642.png) > > In the screenshot you provided, the the GPU doesn't appear to be in use. As such you might not be experiencing this same issue. Please try re-enabling your GPU and see if that helps you reproduce the error for when you make your bug report. How can you tell this. Does the GPU Compute selection get greyed out if there is some issue?

Matthew commented

2022-03-25 00:30:13 +01:00

Added subscriber: @idkartist3d

Alaska commented

2022-03-25 00:42:06 +01:00

In #96740#1329579, @BrianSavery wrote:
How can you tell this. Does the GPU Compute selection get greyed out if there is some issue?

The GPU Compute section in the UI is greyed out if a GPU hasn't been selected in Cycles preferences. As such, I said "the the GPU doesn't appear to be in use" as it is greyed out. And I suggested "Please try re-enabling your GPU and see if that helps you reproduce the error"

> In #96740#1329579, @BrianSavery wrote: > How can you tell this. Does the GPU Compute selection get greyed out if there is some issue? The `GPU Compute` section in the UI is greyed out if a GPU hasn't been selected in Cycles preferences. As such, I said "the the GPU doesn't appear to be in use" as it is greyed out. And I suggested "Please try re-enabling your GPU and see if that helps you reproduce the error"

Matthew commented

2022-03-25 02:03:17 +01:00

I'm having similar issues, so I created the bug report here - @SomeAB , feel free to toss in your screenshot/debug log/etc there as well.

Extremely excited that progress is being made with this, I hope my report helps even if a little!

I'm having similar issues, so I created the bug report [here ](https://developer.blender.org/T96770) - @SomeAB , feel free to toss in your screenshot/debug log/etc there as well. Extremely excited that progress is being made with this, I hope my report helps even if a little!

Mike Pan commented

2022-03-25 03:09:39 +01:00

Removed subscriber: @MikePan

Ahmad Bilal commented

2022-03-26 19:15:38 +01:00

@Alaska I was able to reproduce the error, and I made sure that GPU was enabled properly this time, here is the screenshot.

Edit 1: Adding the gpu_debug file
blender_system_info.txt
blender_debug_output.txt

Sometimes I get 2 errors, sometimes 1 error message on lower bar/scriptingconsole, and once it didn't give me any error, but rendering is similarly broken, in all 3-4 attempts.

@Alaska I was able to reproduce the error, and I made sure that GPU was enabled properly this time, here is the screenshot. ![Screenshot 2022-03-26 234347.png](https://archive.blender.org/developer/F12948422/Screenshot_2022-03-26_234347.png) Edit 1: Adding the gpu_debug file [blender_system_info.txt](https://archive.blender.org/developer/F12948435/blender_system_info.txt) [blender_debug_output.txt](https://archive.blender.org/developer/F12948434/blender_debug_output.txt) Sometimes I get 2 errors, sometimes 1 error message on lower bar/scriptingconsole, and once it didn't give me any error, but rendering is similarly broken, in all 3-4 attempts.

topsun commented

2022-03-27 09:52:00 +02:00

Added subscriber: @Top_Sun

topsun commented

2022-03-27 09:52:00 +02:00

can the Polaris rx 560 be supported? if you need any help testing the gpu, i can help because i own one.

Aldo Bleeker commented

2022-03-28 21:35:08 +02:00

Added subscriber: @Aldo-Bleeker

Aldo Bleeker commented

2022-03-28 21:35:08 +02:00

System Information
Operating system: Windows-10-10.0.22000-SP0 64 Bits
Graphics card: Radeon RX Vega ATI Technologies Inc. 4.5.14800 Core Profile Context 22.3.2 30.0.15019.1005

Blender Version
Broken: version: 3.2.0 Alpha, branch: master, commit date: 2022-03-27 11:25, hash: e2e4c1daaa
Worked: N/A

Short description of error
Enabling HIP running on a Vega 64 Blender crashes, and the display goes black.

Exact steps for others to reproduce the error
Looks like the same issue.
Starting rendering with HIP enabled on a Vega 64, running AMD Adrenalin 22.3.2 crashes Blender, and then the display goes black for a second or two. It looks like the graphics driver has crashed, because the display discovers, and an AMD window pops up offering to report the issue. I have enclosed the crash log.

crash.txt

**System Information** Operating system: Windows-10-10.0.22000-SP0 64 Bits Graphics card: Radeon RX Vega ATI Technologies Inc. 4.5.14800 Core Profile Context 22.3.2 30.0.15019.1005 **Blender Version** Broken: version: 3.2.0 Alpha, branch: master, commit date: 2022-03-27 11:25, hash: `e2e4c1daaa` Worked: N/A **Short description of error** Enabling HIP running on a Vega 64 Blender crashes, and the display goes black. **Exact steps for others to reproduce the error** Looks like the same issue. Starting rendering with HIP enabled on a Vega 64, running AMD Adrenalin 22.3.2 crashes Blender, and then the display goes black for a second or two. It looks like the graphics driver has crashed, because the display discovers, and an AMD window pops up offering to report the issue. I have enclosed the crash log. [crash.txt](https://archive.blender.org/developer/F12952753/crash.txt)

Ben Ehrengruber commented

2022-04-01 13:11:57 +02:00

Added subscriber: @Ben-Ehrengruber

Noah Prezant commented

2022-04-28 07:13:04 +02:00

Added subscriber: @Noah-Prezant

kayfee commented

2022-05-29 14:27:11 +02:00

Added subscriber: @kayfee

kayfee commented

2022-05-29 14:27:11 +02:00

So, NO support for polaris cards ,
after so many days of expectation ! :(

So, NO support for polaris cards , after so many days of expectation ! :(

Alexey commented

2022-06-13 14:14:33 +02:00

Removed subscriber: @FreeCX

denielton commented

2022-06-19 23:14:16 +02:00

Added subscriber: @dntn3d

denielton commented

2022-06-19 23:14:16 +02:00

In #96740#1366146, @kayfee wrote:
So, NO support for polaris cards,

Wait, so does that mean there will be NO support for polaris cards? Were we just left behind with Blender version 2.93 forever?

> In #96740#1366146, @kayfee wrote: > So, NO support for polaris cards, Wait, so does that mean there will be NO support for polaris cards? Were we just left behind with Blender version 2.93 forever?

Ben Ehrengruber commented

2022-06-20 09:22:12 +02:00

Removed subscriber: @Ben-Ehrengruber

Neil McNair commented

2022-06-23 17:29:24 +02:00

Added subscriber: @Neil-McNair

blender-admin commented

2022-06-28 16:55:27 +02:00

This issue was referenced by abfa09752f

This issue was referenced by abfa09752f5c4d1fa2ae9df5e4ee0c9d77b50f3e

Nikolai Nikolaevskii commented

2022-07-06 19:07:05 +02:00

Added subscriber: @Svyatko

Nikolai Nikolaevskii commented

2022-07-06 19:07:05 +02:00

In #96740#1376621, @dntn3d wrote:

In #96740#1366146, @kayfee wrote:
So, NO support for polaris cards,

Wait, so does that mean there will be NO support for polaris cards? Were we just left behind with Blender version 2.93 forever?

It is possible to enable HIP support for Polaris (GCN4) for Linux (and for Windows, too).
IMHO it is possible to use HIP with GCN2 - GCN4. IDK about GCN1.

Needed patches:

For Blender - change https:*developer.blender.org/D15242 and https:*developer.blender.org/rBabfa09752f5c4d1fa2ae9df5e4ee0c9d77b50f3e to enable older GPUs (and older HIP?).
For HIP: HIP is not supporting pre-GCN5 GPUs by default since ROCm 4.5 (phased out by AMD, code is still in place).

We can get working ROCm for pre-GCN5 GPUs (and HIP as a part of it) with changing compile flags.
https://github.com/RadeonOpenCompute/ROCm/issues/1608
https://github.com/RadeonOpenCompute/ROCm/issues/1659
https://github.com/rocm-arch/rocm-arch/issues/741

ILL Arch Linux already provides ROCm with needed patches.

Maybe with AMD OpenCL drivers and installed unpatched HIP from AMD user will get working Blender - this case needs tests.

Or, maybe, we can use HIP (ROCm) older than 4.5 (4.3 and older).

AFAIU HIP translates CUDA code to feed AMD GPUs. Do user needs HIP being installed to run Blender? Is it possible to include translated CUDA code into Blender code?

I could test it, but I have neither GCN2 - GCN4 hardware, nor finances for this.

> In #96740#1376621, @dntn3d wrote: >> In #96740#1366146, @kayfee wrote: >> So, NO support for polaris cards, > > Wait, so does that mean there will be NO support for polaris cards? Were we just left behind with Blender version 2.93 forever? It is possible to enable HIP support for Polaris (GCN4) for Linux (and for Windows, too). IMHO it is possible to use HIP with GCN2 - GCN4. IDK about GCN1. Needed patches: 1. For Blender - change https:*developer.blender.org/D15242 and https:*developer.blender.org/rBabfa09752f5c4d1fa2ae9df5e4ee0c9d77b50f3e to enable older GPUs (and older HIP?). 2. For HIP: HIP is not supporting pre-GCN5 GPUs by default since ROCm 4.5 (phased out by AMD, code is still in place). We can get working ROCm for pre-GCN5 GPUs (and HIP as a part of it) with changing compile flags. https://github.com/RadeonOpenCompute/ROCm/issues/1608 https://github.com/RadeonOpenCompute/ROCm/issues/1659 https://github.com/rocm-arch/rocm-arch/issues/741 ILL Arch Linux already provides ROCm with needed patches. Maybe with AMD OpenCL drivers and installed unpatched HIP from AMD user will get working Blender - this case needs tests. Or, maybe, we can use HIP (ROCm) older than 4.5 (4.3 and older). AFAIU HIP translates CUDA code to feed AMD GPUs. Do user needs HIP being installed to run Blender? Is it possible to include translated CUDA code into Blender code? I could test it, but I have neither GCN2 - GCN4 hardware, nor finances for this.

Wong Di commented

2022-07-08 03:54:51 +02:00

Added subscriber: @wongdi

Wong Di commented

2022-07-08 05:43:42 +02:00

Hi
I have compiled this function locally,can pass the test on my WX8200.
Is it possible to add High Bandwidth Cache (HBC) Controller support for Vega10 and Vega20 HBM2 memory.

Maybe this can be solved😁

Hi I have compiled this function locally,can pass the test on my WX8200. Is it possible to add High Bandwidth Cache (HBC) Controller support for Vega10 and Vega20 HBM2 memory. ![微信图片_20220708205928.png](https://archive.blender.org/developer/F13272882/微信图片_20220708205928.png) Maybe this can be solved😁

Martijn Versteegh commented

2022-07-08 21:17:50 +02:00

Removed subscriber: @Baardaap

kayfee commented

2022-07-09 15:36:00 +02:00

This comment was removed by @kayfee

*This comment was removed by @kayfee*

Thomas Dinges commented

2022-07-09 18:43:43 +02:00

Please keep this task clean and for developers working on HIP.

User comments can be made on devtalk https://devtalk.blender.org/t/cycles-amd-hip-device-feedback/21400
If you think you encounter a bug, please file a proper bug report.

Every further off-topic comment in here will be removed.

Please keep this task clean and for developers working on HIP. * User comments can be made on devtalk https://devtalk.blender.org/t/cycles-amd-hip-device-feedback/21400 * If you think you encounter a bug, please file a proper bug report. Every further off-topic comment in here will be removed.

Ward Nakchbandi commented

2022-08-18 21:19:14 +02:00

Added subscribers: @Hannah-Umit, @CosmoHQ

Ward Nakchbandi commented

2022-08-18 21:19:14 +02:00

{F13401521}>>! In #96740#1328856, @Hannah-Umit wrote:

I have an RX480 8G. Is there a specific driver version that would be preferred for debugging with polaris hardware? Maybe that could help speeding that side of things up in terms of development.

I'm on Nobara linux , i tried to compile blender with gfx803 (RX 470/480/570/580/590) enablement patches , and it kinda worked

see this and the comment for more info :

https://www.reddit.com/r/blender/comments/wrrq6l/so_close_yet_so_far/

{[F13401521](https://archive.blender.org/developer/F13401521/Screenshot_from_2022-08-18_22-00-24.png)}>>! In #96740#1328856, @Hannah-Umit wrote: > I have an RX480 8G. Is there a specific driver version that would be preferred for debugging with polaris hardware? Maybe that could help speeding that side of things up in terms of development. I'm on Nobara linux , i tried to compile blender with gfx803 (RX 470/480/570/580/590) enablement patches , and it kinda worked see this and the comment for more info : https://www.reddit.com/r/blender/comments/wrrq6l/so_close_yet_so_far/

Nitin Sharma commented

2022-09-08 11:05:42 +02:00

Added subscriber: @finalflasher

Rafael Ristovski commented

2022-09-30 00:17:44 +02:00

Added subscriber: @RafaelRistovski

Nikolai Nikolaevskii commented

2022-11-22 20:18:32 +01:00

I've created instructions for installing OpenCL drivers for AMD hardware: https://en.opensuse.org/AMD_OpenCL

Marcus H commented

2023-01-07 23:49:20 +01:00

Added subscriber: @Cosmocrat

Philipp Oeser removed the

Download

What's New

Blender Studio

Manual

Developers Blog

Documentation

Benchmark

Blender Conference

Development Fund

One-time Donations

Enable HIP on older devices #96740