Gohstneuromancy #79224

New Issue

Mario · 2020-07-24T11:48:43+02:00

Mario commented

2020-07-24 11:48:43 +02:00

NSColor(displayP3Red: 1.0, green: 0.0, blue: 0.0, alpha: 1.0)  
UIColor(displayP3Red: 1.0, green: 0.0, blue: 0.0, alpha: 1.0)

NSColor(red: 1.1, green: -.25, blue: 0.0, alpha: 1.0)  
UIColor(red: 1.1, green: -.25, blue: 0.0, alpha:
Drawing with Wide Color
// Cocoa
import Cocoa
let size = (width: 250, height: 250)
let image = (size: size, flipped: false) { drawRect -> Bool in
let rects = drawRect.divide(drawRect.size.width/2, fromEdge: .minXEdge) (displayP3Red: 1.0, green: 0.0, blue: 0.0, alpha: 1.0).set()

NSBezierPath
CGSize
NSImage
NSColor
(rect: rects.slice).fill()
(red: 1.0, green: 0.0, blue: 0.0, alpha: 1.0).set() (rect: rects.remainder).fill()
true
NSColor
NSBezierPath
return

// Drawing with Wide Color

![EA350B42-6CDA-41CE-AD89-5FE95B1A788C.png](https://archive.blender.org/developer/F8717753/EA350B42-6CDA-41CE-AD89-5FE95B1A788C.png) NSColor(displayP3Red: 1.0, green: 0.0, blue: 0.0, alpha: 1.0)   UIColor(displayP3Red: 1.0, green: 0.0, blue: 0.0, alpha: 1.0) NSColor(red: 1.1, green: -.25, blue: 0.0, alpha: 1.0)   UIColor(red: 1.1, green: -.25, blue: 0.0, alpha: Drawing with Wide Color // Cocoa import Cocoa let size = (width: 250, height: 250) let image = (size: size, flipped: false) { drawRect -> Bool in let rects = drawRect.divide(drawRect.size.width/2, fromEdge: .minXEdge) (displayP3Red: 1.0, green: 0.0, blue: 0.0, alpha: 1.0).set() ``` } ``` NSBezierPath CGSize NSImage NSColor (rect: rects.slice).fill() (red: 1.0, green: 0.0, blue: 0.0, alpha: 1.0).set() (rect: rects.remainder).fill() true NSColor NSBezierPath return ``` // Drawing with Wide Color

WK Bong was assigned by Mario

2020-07-24 11:48:43 +02:00

Mario commented

2020-07-24 11:48:43 +02:00

Changed status from 'Needs Triage' to: 'Confirmed'

Mario commented

2020-07-24 11:48:43 +02:00

Added subscriber: @Merdeeb

Mario commented

2020-07-24 11:55:07 +02:00

: 1.0, blue: 0.75, alpha: 1) Display P3 let colorB = NSColor(srgbRed: 0.5, green: 1.0, blue: 0.75, alpha: 1) sRGB

Metal Shading Language shader modifier linear extended sRGB components for sRGB(0.5, 1.0, 0.75) _surface.diffuse.rgb += float3(0.235514164, 1.03112769, 0.523271978)

: 1.0, blue: 0.75, alpha: 1) *Display [P3](https://archive.blender.org/developer/P3.txt) let colorB = NSColor(srgbRed: 0.5, green: 1.0, blue: 0.75, alpha: 1)* sRGB *Metal Shading Language shader modifier* linear extended sRGB components for sRGB(0.5, 1.0, 0.75) _surface.diffuse.rgb += float3(0.235514164, 1.03112769, 0.523271978)

Mario commented

2020-07-24 12:00:54 +02:00

Graphics and Games

WWDC16

Advances in SceneKit Rendering
Session 609
Amaury Balliet SceneKit Engineer Jean-Baptiste Bégué SceneKit Engineer Sébastien Métrot SceneKit Engineer Nick Porcino Model I/O Engineer
© 2016 Apple Inc. All rights reserved. Redistribution or public display not permitted without written permission from Apple.

Agenda
SceneKit in a Nutshell Rendering Advances Demo
Behind the Demo Camera Effects Model I/O

SceneKit
In a nutshell
Amaury Balliet SceneKit Engineer

SceneKit

Thank you!

1408 x 792

SceneKit
watchOS 3
SceneKit is now available everywhere
Great opportunity to make attractive apps New interactions with content on your wrist

 Game Technologies for Apple Watch

Mission
Friday 3:00PM

SceneKit
watchOS 3
SceneKit is now available everywhere
Great opportunity to make attractive apps New interactions with content on your wrist

 Game Technologies for Apple Watch

Mission
Friday 3:00PM

SceneKit
What’s New in SceneKit What’s New in SceneKit Enhancements to SceneKit
WWDC 2013 WWDC 2014 WWDC 2015

Advances in SceneKit Rendering

Physically based rendering

Physically based rendering in the hands of everyone.

Advances in SceneKit Rendering
Biggest leap forward since SceneKit’s introduction
Latest advances in 3D graphics
Modern technologies
Accurate rendering
Physically based materials and lighting
•
•

Accurate Rendering

Linear Rendering and Color Management
Linear rendering

Linear Rendering and Color Management
Shading in gamma space

 Texture

Shading
Texture or Framebuffer

Linear Rendering and Color Management
Shading in linear space

Gamma Decoding

Gamma Encoding

 Texture

Shading
Texture or Framebuffer

Linear Rendering and Color Management
Shading in gamma space

Linear Rendering and Color Management
Shading in linear space

Linear Rendering and Color Management
Linear rendering

Linear Rendering and Color Management
Linear rendering
Essential for physically based shading
Being linear is necessary to get the math right Benefits to all other lighting models

Linear Rendering and Color Management
Color management
Cross-framework effort for color accuracy Fully embraced by SceneKit

Linear Rendering and Color Management
Color management for textures
Automatic color management for images
Textures that represent raw data are supposed to be sRGB
Have a look at texture sets and asset catalogs

 Working with Wide Color

Mission
Thursday 1:40PM

Linear Rendering and Color Management
Color management for color objects
Automatic color management for color objects
Color components previously assumed to be sRGB
Be careful with programmatically-generated color objects

Linear Rendering and Color Management
Color management for color objects

Display P3 ```
 sRGB  (0.5, 1.0, 0.75) (0.5, 1.0, 0.75)
 let colorA = NSColor(displayP3Red: 0.5, green: 1.0, blue: 0.75, alpha: 1) *Display [P3](https://archive.blender.org/developer/P3.txt) let colorB = NSColor(srgbRed: 0.5, green: 1.0, blue: 0.75, alpha: 1)* sRGB

 Linear Rendering and Color Management
Color management for color objects
 
 Linear Rendering and Color Management
Color management for color objects
Automatic color management for color objects
Color components previously assumed to be sRGB
Be careful with programmatically-generated color objects Be careful with shader modifiers
 *Metal Shading Language shader modifier* linear extended sRGB components for sRGB(0.5, 1.0, 0.75) _surface.diffuse.rgb += float3(0.235514164, 1.03112769, 0.523271978)

 Linear Rendering and Color Management
Backward compatibility
No performance cost
Enabled when building against the new SDKs Dramatic visual impact for older scenes

 Linear Rendering and Color Management
Backward compatibility
 
 Linear Rendering and Color Management
Backward compatibility
 
 Linear Rendering and Color Management
Backward compatibility
 
 Linear Rendering and Color Management
Backward compatibility
No performance cost
Enabled when building against the new SDKs Dramatic visual impact for older scenes Global option to opt-out
 // Info.plist
<key>SCNDisableLinearSpaceRendering</key>
<true/>

 Wide Gamut Content

 Wide Gamut Content
Transparent support for wide gamut images and color
Full support of wide gamut displays • 9.7‐inch iPad Pro
iMac with Retina display
•

 Wide Gamut Content
Caveats
Increased memory usage Global option to opt-out
 // Info.plist
<key>SCNDisableWideGamut</key>
<true/>

 Wide Gamut Content
“Color Gamut Showcase” sample code
 
 Wide Gamut Content
Working with Wide Color
Mission Thursday 1:40PM

 Advances in SceneKit Rendering
Biggest leap forward since SceneKit’s introduction
Latest advances in 3D graphics
Modern technologies
Accurate rendering
Physically based materials and lighting
•
•

 Physically Based Rendering

 
 
 Physically Based Rendering

 Physically Based Rendering

 Physically Based Rendering

 Physically Based Rendering
Bidirectional reflectance distribution function
 Lo(v)=∫ f(l,v)Li(l)⟨n⋅l⟩dl Ω
 f(l, v) = fd(l, v) + fr(l, v)
 cdiff D(h) G(l, v) F(l, v) fd(l,v)= π fr(l,v)= 4⟨n⋅l⟩⟨n⋅v⟩
 
 Physically Based Rendering
Relies on intuitive physical material properties Adopted and loved by artists
High-level and easy-to-use API

 
 
 Physically Based Rendering
Physically based materials Physically based lights

 Physically Based Materials

 Physically Based Materials

 Physically Based Materials

 Physically Based Materials
Diffuse Reflection
Specular Reflection

 Physically Based Materials
Diffuse reflection

 Physically Based Materials
Diffuse reflection
 
 Physically Based Materials
Specular reflection

 Physically Based Materials
Specular reflection
 
 Physically Based Materials
Specular reflection

 Physically Based Materials
Reflectance

Physically Based Materials

Reflectance

    Plastic Aluminum Gold


 Physically Based Materials
Metalness
NEW

public class SCNMaterial {
public var metalness: SCNMaterialProperty { get }

}

 Physically Based Materials
Metal versus dielectric
Metal
High reflectance
Absorb light
Dielectric
Low reflectance
Absorb and scatter light

 Physically Based Materials
Metal versus dielectric
Metal
Bright specular reflection
No diffuse reflection
Dielectric
Specular reflection at grazing angles
Mainly diffuse reflection

 Physically Based Materials
Metal versus dielectric
Metal
Reflectance at 0° diffuse map
—
Dielectric
Reflectance at 0° constant
Object albedo diffuse map

 Physically Based Materials
Metal versus dielectric

public class SCNMaterial {
public var diffuse: SCNMaterialProperty { get }

}

 Physically Based Materials
Roughness

 Physically Based Materials
Roughness

 Physically Based Materials
Roughness
NEW

public class SCNMaterial {
public var roughness: SCNMaterialProperty { get }

}

 Physically Based Materials
Material API
Three fundamental properties
Albedo or reflectance at 0° Metalness
Roughness
•
•
•
 public class SCNMaterial {

public var diffuse: SCNMaterialProperty { get }
public var metalness: SCNMaterialProperty { get }
public var roughness: SCNMaterialProperty { get }

}

 Physically Based Materials
Material API
New physically based lighting model
diffuse , metalness , and roughness maps

let material = SCNMaterial() material.lightingModelName = .physicallyBased material.diffuse.contents = "albedo.png" material.metalness.contents = "metalness.png" material.roughness.contents = "roughness.png"

diffuse map

diffuse map, roughness map

diffuse map, roughness map, metalness map

diffuse map

diffuse map, metalness map

diffuse map, metalness map, roughness map


 Physically Based Materials
Material API
Use grayscale images for metalness , roughness , and ambientOcclusion Use scalars for constant values
NEW

material.metalness.contents = "metalness.png" material.roughness.contents = NSNumber(value: 0.5)


 Physically Based Materials

 Physically Based Rendering
Physically based materials Physically based lights

 Physically Based Lights

 Physically Based Lights
Image based lighting Light probes
Point lights

 Physically Based Lights
Image based lighting
Light probes Point lights

 Physically Based Lights
Image based lighting

 Physically Based Lights
Image based lighting

 Physically Based Lights
Image based lighting

 Physically Based Lights
Image based lighting
Cube map captures the environment
Lighting information is derived from cube map Image based lighting can be used alone
Not mandatory to add lights in the scene

 Physically Based Lights
Image based lighting
A single change affects the whole scene
NEW

let scene = SCNScene() scene.lightingEnvironment.contents = "outside.exr"


 Physically Based Lights
Image based lighting
A single change affects the whole scene Works great with the background property
NEW

let scene = SCNScene()

scene.lightingEnvironment.contents = "outside.exr" scene.background.contents = scene.lightingEnvironment.contents

 
 Physically Based Lights
Image based lighting: Caveats
Captures the distant environment
Does not account for obstacles in the scene Not suited for occluded objects

 Physically Based Lights
Image based lighting
Light probes
Point lights

 Physically Based Lights
Light probes

 Physically Based Lights
Light probes

 Physically Based Lights
Light probes
A special kind of light
Captures the local diffuse lighting Account for obstacles in the scene Lightweight
Efficient

 Physically Based Lights
Light probes
A special kind of light: SCNLightType.probe
NEW

let light = SCNLight() light.type = .probe


 Physically Based Lights
Light probes
Can be placed programmatically or in Xcode Static lighting information must be baked
NEW

public class SCNRenderer {

public func updateProbes(_ probes: [SCNNode], atTime time: CFTimeInterval)
}

 Physically Based Lights
Image based lighting Light probes
Point lights

 Physically Based Lights
Point lights
Work with physically based materials, too
Updated to be configured with real-world properties
 public let SCNLightTypeOmni: String        // Omnidirectional light
public let SCNLightTypeDirectional: String // Directional light
public let SCNLightTypeSpot: String        // Spot light

 Physically Based Lights
Point lights: Intensity
Expressed in lumens (lm)
NEW

let light = SCNLight()

light.intensity = 1500 // defaults to 1000 lm

 Physically Based Lights
Point lights: Temperature
Expressed in Kelvin (K) Modulates the light’s color
NEW

let light = SCNLight() light.temperature = 5000

 800K 10,000K

 Physically Based Lights
Photometric lights
New kind of point light
NEW

public let SCNLightTypeOmni: String // Omnidirectional light

public let SCNLightTypeDirectional: String // Directional light
public let SCNLightTypeSpot: String        // Spot light
public let SCNLightTypeIES: String         // IES light

 Physically Based Lights
Photometric lights
New kind of point light
NEW
 public let SCNLightTypeOmni: String        // Omnidirectional light
public let SCNLightTypeDirectional: String // Directional light
public let SCNLightTypeSpot: String        // Spot light
 public let SCNLightTypeIES: String         // IES light

 Physically Based Lights
Photometric lights
New kind of point light Modeled after real-world lights Custom attenuation shape

 Physically Based Lights
Photometric lights
Spot IES

 Physically Based Lights
Photometric lights
Spot IES

 Physically Based Lights
Photometric lights
New kind of point light Modeled after real-world lights Custom attenuation shape
NEW

let light = SCNLight()

light.type = .IES
light.iesProfileURL = Bundle.main().urlForResource("spot", withExtension: "ies")

 Physically Based Rendering
Recap
Physically based materials
Advanced lighting
• Image based lighting
Light probes Point lights
•
•

 Demo
Jean-Baptiste Bégué SceneKit Engineer Sébastien Métrot SceneKit Engineer

 Physically Based Rendering in Practice
Bob the Badger
Sébastien Métrot SceneKit Engineer

 The demo

 The demo
is a sample code!

 Pre-Production
Drafts

 Pre-Production
Drafts

 Production
Modeling

 Workflow
Our artist exported models and PBR materials as DAE files
Custom tool written in SceneKit
• Import DAE file
Convert units to meters
Add light probes along the track
•
•

 Lighting
Image based lighting
Light coming from the environment Great for outdoor scenes Reflections
Works with regular lights, too

 Lighting
Image based lighting
Light coming from the environment Great for outdoor scenes Reflections
Works with regular lights, too
Background Image
 
 Lighting
Image based lighting
Light coming from the environment Great for outdoor scenes Reflections
Works with regular lights, too
Background Image
Lighting Environment

 Lighting
Light probes
Custom tool adds light probes along a path They can be placed and computed in Xcode Essential for the inside
May be optional for an outside-only scene
 
 Lighting
Light probes
Custom tool adds light probes along a path They can be placed and computed in Xcode Essential for the inside
May be optional for an outside-only scene
 
 Lighting
Light maps
For the inside
Overrides IBL except for the specular component
 let material = SCNMaterial() material.selfIllumination.contents = "selfIllum.exr"

 Lighting
Normal maps
Normal maps add detail to the models
 let material = SCNMaterial() material.normal.contents = "normal.png"

 Lighting
Ambient occlusion maps
Ambient occlusion maps make global illumination more realistic
 let material = SCNMaterial() material.ambientOcclusion.contents = "ao.png"

 Lighting
Point lights
One global dynamic light high above   the scene
• Create shadows
Improve global lighting
 •

 Materials
100% physically based materials!

 Materials

 Materials

Diffuse Normal Metalness Roughness

 Physically Based Rendering
Summary
Physically based shading
SceneKit APIs for materials and lights Xcode integration
Showcase demo and sample code

 HDR Camera and Effects

 HDR Camera
HDR is short for High Dynamic Range
Float components
Low dynamic range: 8 bits per components HDR extends that range
Tone mapped to LDR screens

HDR domain

Screen (LDR)

 HDR Camera
Needed for High Dynamic Range contents
Can also be used with normal contents but realistic light ranges
NEW

let camera = SCNCamera() camera.wantsHDR = true


 HDR Camera
Tone mapping
Converts from HDR to LDR
Automatic eye adaptation
Configurable (gray point, white point, min/max exposure)
NEW

camera.wantsExposureAdaptation = true camera.averageGray = 0.5 camera.whitePoint = 0.5 camera.exposureOffset = 2.5 camera.minimumExposure = -20.0 camera.maximumExposure = 10.0


 HDR Camera
Default exposure
 
 HDR Camera
Under exposure
 
 HDR Camera
Over exposure
 
 Effects
Bloom
High-intensity lights and reflections bleeding on the surrounding pixels
Simulates the effect of being blinded by looking at a bright light
NEW

camera.bloomThreshold = 0.5 camera.bloomIntensity = 1.5 camera.bloomBlurRadius = 2.5


 Effects
Bloom
 
 Effects
Bloom
 
 Effects
Motion blur
Smoothens camera movements
Some objects can be excluded from the motion blur
camera.motionBlurIntensity = 0.2
NEW

 Effects
Motion blur
 
 Effects
Motion blur
Use movability hint to exclude nodes from the motion blur
character.movabilityHint = .movable
NEW

 Effects
Motion blur: Movability hint
 
 Effects
Vignetting
Simulates the round shading aberrations of real camera lenses
NEW

camera.vignettingPower = 0.2 camera.vignettingIntensity = 1.2


 Effects
Vignetting
 
 Effects
Vignetting
 
 Effects
Color fringe
Simulates the chromatic aberrations happening in real lenses
NEW

camera.colorFringeStrength = 0.2 camera.colorFringeIntensity = 0.8


 Effects
Color fringe
 
 Effects
Color fringe

 Effects
Color correction
Saturation
Easy black and white look Overblown colors
Contrast
More intense look
NEW
 •
•
•
 camera.saturation = 0.0 camera.contrast = 2.0

 Effects
Default
 
 Effects
Desaturate
 
 Effects
Saturate
 
 Effects
Contrast
 
 Effects
Color grading
Changes the mood of the rendering by applying a color profile
3D color cube
Lookup table
Stored as a strip of square images:
NEW
 •
•
•

camera.colorGrading = "colorProfile.png"


 Effects
Color grading
 
 Effects
Color grading
 
 HDR and Camera effects
Summary
Brand new HDR cameras and effects
• Configurable tone mapping and exposure
Bloom
• Motion blur
Vignetting
Color fringe
• Saturation and contrast
Color grading
•
•
•
•

 I/O Improvements Nick Porcino Model I/O Engineer

 Primitives
Polygons
Easier to use
Automatic triangulation
Allow for much better subdivision Opt-in when importing files
let loadingOptions = [.preserveOriginalTopology: true]
NEW

 Subdivision Surfaces
OpenSubdiv 3
Faster
Better results
Triangles
Quads

 Model I/O

 Model I/O
3D data interchange
3D data interchange
Between apps Between frameworks Standard file formats
•
•
•

 Model I/O
 
 Model I/O
A new open standard
Years of practical production technologies Data types specialized for scenes
File layering enables concurrent workflows
 
 Universal Scene Description
Layers
 
 Universal Scene Description
Classes
 
 Universal Scene Description
Classes

 Universal Scene Description
Variations

 Universal Scene Description
Capabilities

 Universal Scene Description
Capabilities

 Universal Scene Description
Workflow
Integration across the system

 Universal Scene Description
Model I/O
 
 Universal Scene Description
Finder
 
 Universal Scene Description
Preview
 
 Universal Scene Description
Xcode

 Universal Scene Description
SceneKit
 
 Universal Scene Description
SceneKit
 
 Universal Scene Description
Workflow
Plugins
Seamless movement of 3D data
• Between people
Content creation programs Apps
Plugins and open source information are available from http://openusd.org

![61B76D6A-BAB1-4DCA-8C05-8BE234F13239.jpeg](https://archive.blender.org/developer/F8717760/61B76D6A-BAB1-4DCA-8C05-8BE234F13239.jpeg) Graphics and Games # WWDC16 Advances in SceneKit Rendering Session 609 Amaury Balliet SceneKit Engineer Jean-Baptiste Bégué SceneKit Engineer Sébastien Métrot SceneKit Engineer Nick Porcino Model I/O Engineer © 2016 Apple Inc. All rights reserved. Redistribution or public display not permitted without written permission from Apple. Agenda SceneKit in a Nutshell Rendering Advances Demo Behind the Demo Camera Effects Model I/O SceneKit In a nutshell Amaury Balliet SceneKit Engineer SceneKit SceneKit SceneKit SceneKit SceneKit Thank you! ``` ``` 1408 x 792 ``` ``` SceneKit watchOS 3 SceneKit is now available everywhere Great opportunity to make attractive apps New interactions with content on your wrist ``` ``` SceneKit watchOS 3 SceneKit is now available everywhere Great opportunity to make attractive apps New interactions with content on your wrist ``` Game Technologies for Apple Watch ``` Mission Friday 3:00PM SceneKit watchOS 3 SceneKit is now available everywhere Great opportunity to make attractive apps New interactions with content on your wrist ``` Game Technologies for Apple Watch ``` Mission Friday 3:00PM SceneKit What’s New in SceneKit What’s New in SceneKit Enhancements to SceneKit WWDC 2013 WWDC 2014 WWDC 2015 ``` ``` Advances in SceneKit Rendering Physically based rendering Physically based rendering in the hands of everyone. Advances in SceneKit Rendering Biggest leap forward since SceneKit’s introduction Latest advances in 3D graphics Modern technologies Accurate rendering Physically based materials and lighting • • Accurate Rendering Linear Rendering and Color Management Linear rendering Linear Rendering and Color Management Linear rendering Linear Rendering and Color Management Linear rendering ``` ``` Linear Rendering and Color Management Linear rendering Linear Rendering and Color Management Linear rendering ``` ``` Linear Rendering and Color Management Shading in gamma space ``` Texture ``` Shading Texture or Framebuffer ``` ``` Linear Rendering and Color Management Shading in linear space ``` Gamma Decoding ``` Gamma Encoding ``` Texture ``` Shading Texture or Framebuffer ``` ``` Linear Rendering and Color Management Shading in gamma space Linear Rendering and Color Management Shading in linear space Linear Rendering and Color Management Linear rendering ``` ``` Linear Rendering and Color Management Linear rendering Essential for physically based shading Being linear is necessary to get the math right Benefits to all other lighting models Linear Rendering and Color Management Color management Cross-framework effort for color accuracy Fully embraced by SceneKit Linear Rendering and Color Management Color management for textures Automatic color management for images Textures that represent raw data are supposed to be sRGB Have a look at texture sets and asset catalogs Linear Rendering and Color Management Color management for textures Automatic color management for images Textures that represent raw data are supposed to be sRGB Have a look at texture sets and asset catalogs ``` ``` Linear Rendering and Color Management Color management for textures Automatic color management for images Textures that represent raw data are supposed to be sRGB Have a look at texture sets and asset catalogs ``` Working with Wide Color ``` Mission Thursday 1:40PM Linear Rendering and Color Management Color management for color objects Automatic color management for color objects Color components previously assumed to be sRGB Be careful with programmatically-generated color objects Linear Rendering and Color Management Color management for color objects ``` Display P3 ``` sRGB  (0.5, 1.0, 0.75) (0.5, 1.0, 0.75) let colorA = NSColor(displayP3Red: 0.5, green: 1.0, blue: 0.75, alpha: 1) *Display [P3](https://archive.blender.org/developer/P3.txt) let colorB = NSColor(srgbRed: 0.5, green: 1.0, blue: 0.75, alpha: 1)* sRGB Linear Rendering and Color Management Color management for color objects Linear Rendering and Color Management Color management for color objects Automatic color management for color objects Color components previously assumed to be sRGB Be careful with programmatically-generated color objects Be careful with shader modifiers *Metal Shading Language shader modifier* linear extended sRGB components for sRGB(0.5, 1.0, 0.75) _surface.diffuse.rgb += float3(0.235514164, 1.03112769, 0.523271978) Linear Rendering and Color Management Backward compatibility No performance cost Enabled when building against the new SDKs Dramatic visual impact for older scenes Linear Rendering and Color Management Backward compatibility Linear Rendering and Color Management Backward compatibility Linear Rendering and Color Management Backward compatibility Linear Rendering and Color Management Backward compatibility No performance cost Enabled when building against the new SDKs Dramatic visual impact for older scenes Global option to opt-out // Info.plist <key>SCNDisableLinearSpaceRendering</key> <true/> Wide Gamut Content ``` ``` Wide Gamut Content Transparent support for wide gamut images and color Full support of wide gamut displays • 9.7‐inch iPad Pro iMac with Retina display • Wide Gamut Content Caveats Increased memory usage Global option to opt-out // Info.plist <key>SCNDisableWideGamut</key> <true/> Wide Gamut Content “Color Gamut Showcase” sample code Wide Gamut Content Working with Wide Color Mission Thursday 1:40PM ``` ``` Advances in SceneKit Rendering Biggest leap forward since SceneKit’s introduction Latest advances in 3D graphics Modern technologies Accurate rendering Physically based materials and lighting • • Physically Based Rendering Physically Based Rendering ``` ``` Physically Based Rendering ``` ``` Physically Based Rendering ``` ``` Physically Based Rendering Bidirectional reflectance distribution function Lo(v)=∫ f(l,v)Li(l)⟨n⋅l⟩dl Ω f(l, v) = fd(l, v) + fr(l, v) cdiff D(h) G(l, v) F(l, v) fd(l,v)= π fr(l,v)= 4⟨n⋅l⟩⟨n⋅v⟩ Physically Based Rendering Relies on intuitive physical material properties Adopted and loved by artists High-level and easy-to-use API Physically Based Rendering Physically based materials Physically based lights Physically Based Materials Physically Based Materials ``` ``` Physically Based Materials ``` ``` Physically Based Materials Diffuse Reflection Specular Reflection ``` ``` Physically Based Materials Diffuse reflection ``` ``` Physically Based Materials Diffuse reflection Physically Based Materials Specular reflection ``` ``` Physically Based Materials Specular reflection Physically Based Materials Specular reflection ``` ``` Physically Based Materials Reflectance ``` Physically Based Materials ``` Reflectance ``` Plastic Aluminum Gold ``` Physically Based Materials Metalness NEW ``` public class SCNMaterial { public var metalness: SCNMaterialProperty { get } ``` } Physically Based Materials Metal versus dielectric Metal High reflectance Absorb light Dielectric Low reflectance Absorb and scatter light ``` ``` Physically Based Materials Metal versus dielectric Metal Bright specular reflection No diffuse reflection Dielectric Specular reflection at grazing angles Mainly diffuse reflection ``` ``` Physically Based Materials Metal versus dielectric Metal Reflectance at 0° diffuse map — Dielectric Reflectance at 0° constant Object albedo diffuse map ``` ``` Physically Based Materials Metal versus dielectric ``` public class SCNMaterial { public var diffuse: SCNMaterialProperty { get } ``` } Physically Based Materials Roughness ``` ``` Physically Based Materials Roughness ``` ``` Physically Based Materials Roughness NEW ``` public class SCNMaterial { public var roughness: SCNMaterialProperty { get } ``` } Physically Based Materials Material API Three fundamental properties Albedo or reflectance at 0° Metalness Roughness • • • public class SCNMaterial { ``` public var diffuse: SCNMaterialProperty { get } public var metalness: SCNMaterialProperty { get } public var roughness: SCNMaterialProperty { get } ``` } Physically Based Materials Material API New physically based lighting model diffuse , metalness , and roughness maps ``` let material = SCNMaterial() material.lightingModelName = .physicallyBased material.diffuse.contents = "albedo.png" material.metalness.contents = "metalness.png" material.roughness.contents = "roughness.png" ``` ``` diffuse map ``` ``` diffuse map, roughness map ``` ``` diffuse map, roughness map, metalness map ``` ``` diffuse map ``` ``` diffuse map, metalness map ``` ``` diffuse map, metalness map, roughness map ``` Physically Based Materials Material API Use grayscale images for metalness , roughness , and ambientOcclusion Use scalars for constant values NEW ``` material.metalness.contents = "metalness.png" material.roughness.contents = NSNumber(value: 0.5) ``` Physically Based Materials Physically Based Rendering Physically based materials Physically based lights Physically Based Lights Physically Based Lights Image based lighting Light probes Point lights Physically Based Lights Image based lighting Light probes Point lights Physically Based Lights Image based lighting ``` ``` Physically Based Lights Image based lighting ``` ``` Physically Based Lights Image based lighting ``` ``` Physically Based Lights Image based lighting Cube map captures the environment Lighting information is derived from cube map Image based lighting can be used alone Not mandatory to add lights in the scene Physically Based Lights Image based lighting A single change affects the whole scene NEW ``` let scene = SCNScene() scene.lightingEnvironment.contents = "outside.exr" ``` Physically Based Lights Image based lighting A single change affects the whole scene Works great with the background property NEW ``` let scene = SCNScene() ``` scene.lightingEnvironment.contents = "outside.exr" scene.background.contents = scene.lightingEnvironment.contents ``` ``` Physically Based Lights Image based lighting: Caveats Captures the distant environment Does not account for obstacles in the scene Not suited for occluded objects Physically Based Lights Image based lighting Light probes Point lights Physically Based Lights Light probes ``` ``` Physically Based Lights Light probes ``` ``` Physically Based Lights Light probes A special kind of light Captures the local diffuse lighting Account for obstacles in the scene Lightweight Efficient Physically Based Lights Light probes A special kind of light: SCNLightType.probe NEW ``` let light = SCNLight() light.type = .probe ``` Physically Based Lights Light probes Can be placed programmatically or in Xcode Static lighting information must be baked NEW ``` public class SCNRenderer { ``` public func updateProbes(_ probes: [SCNNode], atTime time: CFTimeInterval) } Physically Based Lights Image based lighting Light probes Point lights Physically Based Lights Point lights Work with physically based materials, too Updated to be configured with real-world properties public let SCNLightTypeOmni: String // Omnidirectional light public let SCNLightTypeDirectional: String // Directional light public let SCNLightTypeSpot: String // Spot light Physically Based Lights Point lights: Intensity Expressed in lumens (lm) NEW ``` let light = SCNLight() ``` light.intensity = 1500 // defaults to 1000 lm Physically Based Lights Point lights: Temperature Expressed in Kelvin (K) Modulates the light’s color NEW ``` let light = SCNLight() light.temperature = 5000 ``` 800K 10,000K Physically Based Lights Photometric lights New kind of point light NEW ``` public let SCNLightTypeOmni: String // Omnidirectional light ``` public let SCNLightTypeDirectional: String // Directional light public let SCNLightTypeSpot: String // Spot light public let SCNLightTypeIES: String // IES light Physically Based Lights Photometric lights New kind of point light NEW public let SCNLightTypeOmni: String // Omnidirectional light public let SCNLightTypeDirectional: String // Directional light public let SCNLightTypeSpot: String // Spot light public let SCNLightTypeIES: String // IES light ``` ``` Physically Based Lights Photometric lights New kind of point light Modeled after real-world lights Custom attenuation shape Physically Based Lights Photometric lights Spot IES Physically Based Lights Photometric lights Spot IES Physically Based Lights Photometric lights New kind of point light Modeled after real-world lights Custom attenuation shape NEW ``` let light = SCNLight() ``` light.type = .IES light.iesProfileURL = Bundle.main().urlForResource("spot", withExtension: "ies") Physically Based Rendering Recap Physically based materials Advanced lighting • Image based lighting Light probes Point lights • • Demo Jean-Baptiste Bégué SceneKit Engineer Sébastien Métrot SceneKit Engineer Physically Based Rendering in Practice Bob the Badger Sébastien Métrot SceneKit Engineer The demo The demo is a sample code! Pre-Production Drafts ``` ``` Pre-Production Drafts ``` ``` Production Modeling ``` ``` Workflow Our artist exported models and PBR materials as DAE files Custom tool written in SceneKit • Import DAE file Convert units to meters Add light probes along the track • • Lighting Image based lighting Light coming from the environment Great for outdoor scenes Reflections Works with regular lights, too Lighting Image based lighting Light coming from the environment Great for outdoor scenes Reflections Works with regular lights, too Background Image Lighting Image based lighting Light coming from the environment Great for outdoor scenes Reflections Works with regular lights, too Background Image Lighting Environment ``` ``` Lighting Light probes Custom tool adds light probes along a path They can be placed and computed in Xcode Essential for the inside May be optional for an outside-only scene Lighting Light probes Custom tool adds light probes along a path They can be placed and computed in Xcode Essential for the inside May be optional for an outside-only scene Lighting Light maps For the inside Overrides IBL except for the specular component let material = SCNMaterial() material.selfIllumination.contents = "selfIllum.exr" Lighting Normal maps Normal maps add detail to the models let material = SCNMaterial() material.normal.contents = "normal.png" Lighting Ambient occlusion maps Ambient occlusion maps make global illumination more realistic let material = SCNMaterial() material.ambientOcclusion.contents = "ao.png" Lighting Point lights One global dynamic light high above   the scene • Create shadows Improve global lighting • Materials 100% physically based materials! ``` ``` Materials ``` ``` Materials ``` Diffuse Normal Metalness Roughness ``` Physically Based Rendering Summary Physically based shading SceneKit APIs for materials and lights Xcode integration Showcase demo and sample code HDR Camera and Effects HDR Camera HDR is short for High Dynamic Range Float components Low dynamic range: 8 bits per components HDR extends that range Tone mapped to LDR screens ``` HDR domain ``` Screen (LDR) HDR Camera Needed for High Dynamic Range contents Can also be used with normal contents but realistic light ranges NEW ``` let camera = SCNCamera() camera.wantsHDR = true ``` HDR Camera Tone mapping Converts from HDR to LDR Automatic eye adaptation Configurable (gray point, white point, min/max exposure) NEW ``` camera.wantsExposureAdaptation = true camera.averageGray = 0.5 camera.whitePoint = 0.5 camera.exposureOffset = 2.5 camera.minimumExposure = -20.0 camera.maximumExposure = 10.0 ``` HDR Camera Default exposure HDR Camera Under exposure HDR Camera Over exposure Effects Bloom High-intensity lights and reflections bleeding on the surrounding pixels Simulates the effect of being blinded by looking at a bright light NEW ``` camera.bloomThreshold = 0.5 camera.bloomIntensity = 1.5 camera.bloomBlurRadius = 2.5 ``` Effects Bloom Effects Bloom Effects Motion blur Smoothens camera movements Some objects can be excluded from the motion blur camera.motionBlurIntensity = 0.2 NEW ``` ``` Effects Motion blur Effects Motion blur Use movability hint to exclude nodes from the motion blur character.movabilityHint = .movable NEW ``` ``` Effects Motion blur: Movability hint Effects Vignetting Simulates the round shading aberrations of real camera lenses NEW ``` camera.vignettingPower = 0.2 camera.vignettingIntensity = 1.2 ``` Effects Vignetting Effects Vignetting Effects Color fringe Simulates the chromatic aberrations happening in real lenses NEW ``` camera.colorFringeStrength = 0.2 camera.colorFringeIntensity = 0.8 ``` Effects Color fringe Effects Color fringe ``` ``` Effects Color correction Saturation Easy black and white look Overblown colors Contrast More intense look NEW • • • camera.saturation = 0.0 camera.contrast = 2.0 Effects Default Effects Desaturate Effects Saturate Effects Contrast Effects Color grading Changes the mood of the rendering by applying a color profile 3D color cube Lookup table Stored as a strip of square images: NEW • • • ``` camera.colorGrading = "colorProfile.png" ``` Effects Color grading Effects Color grading HDR and Camera effects Summary Brand new HDR cameras and effects • Configurable tone mapping and exposure Bloom • Motion blur Vignetting Color fringe • Saturation and contrast Color grading • • • • I/O Improvements Nick Porcino Model I/O Engineer Primitives Polygons Easier to use Automatic triangulation Allow for much better subdivision Opt-in when importing files let loadingOptions = [.preserveOriginalTopology: true] NEW ``` ``` Subdivision Surfaces OpenSubdiv 3 Faster Better results Triangles Quads ``` ``` Model I/O Model I/O 3D data interchange 3D data interchange Between apps Between frameworks Standard file formats • • • Model I/O Model I/O A new open standard Years of practical production technologies Data types specialized for scenes File layering enables concurrent workflows Universal Scene Description Layers Universal Scene Description Classes Universal Scene Description Classes ``` ``` Universal Scene Description Variations ``` ``` Universal Scene Description Capabilities ``` ``` Universal Scene Description Capabilities ``` ``` Universal Scene Description Workflow Integration across the system Universal Scene Description Model I/O Universal Scene Description Finder Universal Scene Description Preview Universal Scene Description Xcode Universal Scene Description SceneKit Universal Scene Description SceneKit Universal Scene Description Workflow Plugins Seamless movement of 3D data • Between people Content creation programs Apps Plugins and open source information are available from http://openusd.org ```

Robert Guetzkow commented

2020-07-24 12:02:07 +02:00

Added subscriber: @rjg

Robert Guetzkow commented

2020-07-24 12:02:07 +02:00

Changed status from 'Confirmed' to: 'Archived'

Robert Guetzkow closed this issue

2020-07-24 12:02:07 +02:00

Robert Guetzkow commented

2020-07-24 12:02:07 +02:00

I'm not sure if this is supposed to be a patch or a bug report, either way this is not valid report or patch.

If you want to submit a patch, please follow the instructions provided in Blender's Wiki about "Patches and Diffs" .

In case you believe that you've found a bug, please read this guide and submit a new report through*Help > Report a bug// in Blender. Be sure to provide system information (operating system, GPU, driver version), Blender version, a short and precise description of the issue, step by step instructions to reproduce it and, if relevant, a .blend file that showcases the problem.

If you don't want to report a bug, but need help using Blender, please post a question on [Blender's StackExchange ]], https:*blenderartists.org/ , on the https:*blender.chat/home or one of the other [ https:*www.blender.org/community/ | community websites . The bug tracker is not meant for user support.

I'm not sure if this is supposed to be a patch or a bug report, either way this is not valid report or patch. If you want to submit a patch, please follow the instructions provided in Blender's Wiki about ["Patches and Diffs" ](https://wiki.blender.org/wiki/Tools/Patches). In case you believe that you've found a bug, please read [this guide ](https:*blender.stackexchange.com/questions/1377/best-place-to-put-bug-reports/173685#173685) and submit a new report through*Help > Report a bug// in Blender. Be sure to provide **system information (operating system, GPU, driver version)**, **Blender version**, a **short and precise description of the issue**, step by step **instructions to reproduce it** and, if relevant, **a .blend file that showcases the problem**. If you don't want to report a bug, but need help using Blender, please post a question on [Blender's StackExchange ]], [[ https:*blenderartists.org/ | blenderartists.org ]], on the [[ https:*blender.chat/home | support channel of Blender's chat ]] or one of the other [[ https:*www.blender.org/community/ | community websites ](https:*blender.stackexchange.com/). The bug tracker is not meant for user support.

Robert Guetzkow commented

2020-07-24 12:03:40 +02:00

Also please note that files can be attached by clicking on the upload button as shown in the screenshot below. Please don't post code or log files as a wall of text.

Also please note that files can be attached by clicking on the upload button as shown in the screenshot below. Please don't post code or log files as a wall of text. ![2019_12_04_upload_icon_developer_blender_org.png](https://archive.blender.org/developer/F8190038/2019_12_04_upload_icon_developer_blender_org.png)

WK Bong was unassigned by Robert Guetzkow

2020-07-24 12:09:18 +02:00

Robert Guetzkow commented

2020-07-24 12:09:18 +02:00

Added subscriber: @WeeKwongBong

WK Bong commented

2020-08-02 19:41:58 +02:00

this is spam btw

Sign in to join this conversation.

No Label

Download

What's New

Blender Studio

Manual

Developers Blog

Documentation

Benchmark

Blender Conference

Development Fund

One-time Donations

Gohstneuromancy #79224

WWDC16