Support for UDIM textures and tiled images #55435

New Issue

Lukas Stockner · 2018-06-11T11:16:14+02:00

Lukas Stockner commented

2018-06-11 11:16:14 +02:00

This is the design task for supporting tiled images (and therefore UDIM textures) in Blender.

Basics

Essentially, a tiled image consists of multiple files, where each file covers one unit square in the UV space.
Currently, the layout is hardcoded to ten tiles per row which is the standard for UDIM textures.

UDIM refers to a naming scheme for these tiles - tile (x, y) is assigned the number 1001 + 10*y + x. Most of Blender doesn't need to care about this, it's only really relevant for loading/saving files and displaying them in the UI.

Implementation

Fundamentally, tiled textures are similar to image sequences - they consist of a number of image files and buffers. Therefore, the core implementation is handled like image sequences which allows to reuse the existing image cache. This is done by adding a new source type, IMA_SRC_TILED, which specifies that the image consists of multiple tiles.

The ImageUser now contains a tile index that is used when acquiring the ImBuf, and the Image contains the number of tiles.

Tasks

Generally, the remaining work is to update all the areas that access images in Blender and handle the tiles correctly. These areas can be roughly split into "using images" and "editing images" - for example, support in the Viewport, Eevee and Cycles are essential for using tiles textures, while support in texture painting and baking is only needed for editing and/or creating them.

Since the main motivation for UDIM support is the ability to use textures generated with external tools, the "using images" part has priority.

ToDos

Basics

~~Support in the core~~ (9220f3b64f)
~~Detecting UDIMs automatically when opening them~~ (a5732a1de4)
~~Adding or removing tiles~~ (d3d0c8febc)
~~Creating tiled images from Blender~~ (b91706368f)
~~Saving tiled images~~ (9fc9376004)
Packing/Unpacking tiled images

Image Editor

~~Showing all tiles in the Image Editor~~ (89c0dc4ebd)
~~Supporting Image Editor operators like color sampling~~ (5c62468e4b)
~~Labeling/Naming tiles~~ (4875f41ea6)
Optionally showing a tile grid even without a loaded image for laying out UVs
~~Texture painting support~~ (cc4defac04)
Maybe support drawing across tile borders
Better UI

3D texture painting

~~Support for drawing on tiled images~~ (bc05599bd0)
Maybe support drawing across tile borders

Cycles

~~Support tiled images as Cycles textures in SVM mode~~ (62550b490a)
Support tiled images as Cycles textures in OSL mode
Support baking to tiled images

Eevee

~~Support tiled images as textures~~ (94d0cbf127)

Known bugs

Occasional crashes in the painting undo code (only in release builds, debug builds are stable)
Wrong painting radius when painting on tiles with different size and/or aspect ratio

More coming

This is the design task for supporting tiled images (and therefore UDIM textures) in Blender. ## Basics Essentially, a tiled image consists of multiple files, where each file covers one unit square in the UV space. Currently, the layout is hardcoded to ten tiles per row which is the standard for UDIM textures. UDIM refers to a naming scheme for these tiles - tile (x, y) is assigned the number 1001 + 10*y + x. Most of Blender doesn't need to care about this, it's only really relevant for loading/saving files and displaying them in the UI. ## Implementation Fundamentally, tiled textures are similar to image sequences - they consist of a number of image files and buffers. Therefore, the core implementation is handled like image sequences which allows to reuse the existing image cache. This is done by adding a new source type, `IMA_SRC_TILED`, which specifies that the image consists of multiple tiles. The ImageUser now contains a tile index that is used when acquiring the ImBuf, and the Image contains the number of tiles. ## Tasks Generally, the remaining work is to update all the areas that access images in Blender and handle the tiles correctly. These areas can be roughly split into "using images" and "editing images" - for example, support in the Viewport, Eevee and Cycles are essential for using tiles textures, while support in texture painting and baking is only needed for editing and/or creating them. Since the main motivation for UDIM support is the ability to use textures generated with external tools, the "using images" part has priority. ## ToDos **Basics** - ~~Support in the core~~ (9220f3b64f) - ~~Detecting UDIMs automatically when opening them~~ (a5732a1de4) - ~~Adding or removing tiles~~ (d3d0c8febc) - ~~Creating tiled images from Blender~~ (b91706368f) - ~~Saving tiled images~~ (9fc9376004) - Packing/Unpacking tiled images **Image Editor** - ~~Showing all tiles in the Image Editor~~ (89c0dc4ebd) - ~~Supporting Image Editor operators like color sampling~~ (5c62468e4b) - ~~Labeling/Naming tiles~~ (4875f41ea6) - Optionally showing a tile grid even without a loaded image for laying out UVs - ~~Texture painting support~~ (cc4defac04) - Maybe support drawing across tile borders - Better UI **3D texture painting** - ~~Support for drawing on tiled images~~ (bc05599bd0) - Maybe support drawing across tile borders **Cycles** - ~~Support tiled images as Cycles textures in SVM mode~~ (62550b490a) - Support tiled images as Cycles textures in OSL mode - Support baking to tiled images **Eevee** - ~~Support tiled images as textures~~ (94d0cbf127) **Known bugs** - Occasional crashes in the painting undo code (only in release builds, debug builds are stable) - Wrong painting radius when painting on tiles with different size and/or aspect ratio **More coming**

Lukas Stockner commented

2018-06-11 11:16:15 +02:00

Added subscriber: @LukasStockner

Lukas Stockner self-assigned this 2018-06-11 11:16:26 +02:00

Brecht Van Lommel commented

2018-06-11 13:05:50 +02:00

Added subscriber: @brecht

Brecht Van Lommel commented

2018-06-11 13:05:50 +02:00

Sounds good to me, I don't have any objections to the design.

Steffen Dünner commented

2018-06-11 14:48:28 +02:00

Added subscriber: @SteffenD

Ronny G commented

2018-06-12 19:09:03 +02:00

Added subscriber: @nudelZ

Petter Lundh commented

2019-02-03 08:37:34 +01:00

Added subscriber: @PetterLundh

Chingiz Jumagulov commented

2019-03-27 09:47:57 +01:00

Added subscriber: @MeshVoid

Chingiz Jumagulov commented

2019-08-01 08:30:49 +02:00

Will UDIM support make it's way to 2.81? Pretty please... =))

Andrew Stanley commented

2019-08-05 12:27:10 +02:00

Added subscriber: @andrewstanleyart

juan gargallo commented

2019-08-22 12:52:50 +02:00

Added subscriber: @txo

wahhaj commented

2019-09-10 15:22:19 +02:00

Added subscriber: @wahajsheikh007

wahhaj commented

2019-09-10 15:25:32 +02:00

Removed subscriber: @wahajsheikh007

wahhaj commented

2019-09-14 13:19:09 +02:00

wll udims be added to 2.81?

Maaslandmods commented

2019-10-24 17:15:33 +02:00

Added subscriber: @Maaslandmods

lvxejay commented

2019-10-25 02:34:12 +02:00

Added subscriber: @lvxejay

lvxejay commented

2019-10-25 02:34:12 +02:00

Seems like quite a few of the required items for this are done. The last big item left looks to be:

Packing/Unpacking tiled images

Otherwise improved UI, painting/drawing across boundaries, and the Cycles specific stuff can always be handled down the road. It would be great if this was rolled into the current Blender 2.82 alpha builds...

Seems like quite a few of the required items for this are done. The last big item left looks to be: Packing/Unpacking tiled images Otherwise improved UI, painting/drawing across boundaries, and the Cycles specific stuff can always be handled down the road. It would be great if this was rolled into the current Blender 2.82 alpha builds...

Vlad Kuzmin commented

2019-10-25 11:24:27 +02:00

Added subscriber: @ssh4

Vlad Kuzmin commented

2019-10-25 11:24:27 +02:00

Please do not forget about UV projection mapping! How it will working with UDIM meshes.

In our upcoming free "Camera Projection Painter" addon. This feature will key feature to switch big 3D scanning studios from Mari or Mudbox to a Blender.

Please do not forget about UV projection mapping! How it will working with UDIM meshes. In our upcoming free "Camera Projection Painter" addon. This feature will key feature to switch big 3D scanning studios from Mari or Mudbox to a Blender.

juan gargallo commented

2019-10-25 14:45:32 +02:00

I would say that painting across tile borders is one of the main reasons UDIM is interesting to me when texturing (and one of the biggest pains to work around when it is not supported, like in Substance Painter).
So I would consider it a core feature of the UDIM workflow regarding texture painting,and ask developers to (please) do not treat it as a "maybe".

I would say that painting across tile borders is one of the main reasons UDIM is interesting to me when texturing (and one of the biggest pains to work around when it is not supported, like in Substance Painter). So I would consider it a core feature of the UDIM workflow regarding texture painting,and ask developers to (please) do not treat it as a "maybe".

Maaslandmods commented

2019-10-25 14:51:41 +02:00

Is it possible to lock a material to a specific tile?
So when changes are made to the model, and the model is unwrapped for the second time the uv of that material stays to the same tile

If I am not clear please ask =-)

Is it possible to lock a material to a specific tile? So when changes are made to the model, and the model is unwrapped for the second time the uv of that material stays to the same tile If I am not clear please ask =-)

Yury Ziankouski commented

2019-11-04 22:45:56 +01:00

Added subscriber: @YuryZiankouvki