CUDA error: Launch failed in cuCtxSynchronize(), line 1372 (SOLUTION: Changing some registry parameters. See the thread for solution details.)
Closed, ArchivedPublic

Description

Hello.

My name is Christoph Werner. I am an experienced artist from germany and work since 1991 in the game industry. So I am familiar with bug posts etc. I hope this is the right place to post my cycles bug. If no, sorry please. In this case tell where I have to place my infos to get help.

My graphic card: GeForce GTX 1080 Ti, 11 GBytes RAM
NVidia Driver version: 388.59
Computer main memory: 16 GBytes.
CPU: i7-3770
Up to date Windows 10 Version 64 Bit.

Short bug description:
I am not able to render my scene in blender 2.79. Below you see the cycles debug infos I get.
If you need the scene to make own tests, plase drop me a message.

Read prefs: C:\Users\[my_username]\AppData\Roaming\Blender Foundation\Blender\2.79\config\userpref.blend
AL lib: (EE) UpdateDeviceParams: Failed to set 48000hz, got 44100hz instead
found bundled python: C:\Program Files\Blender Foundation\Blender\2.79\python
Registered Animation Nodes with 409 modules.
measureit: Imported multifiles
Unable to delete file
Read blend: D:\Privat\blender\Wohnzimmer\wohnzimmer_05.blend
DAG zero... not allowed to happen!
CUDA error: Launch failed in cuCtxSynchronize(), line 1372

Refer to the Cycles GPU rendering documentation for possible solutions:
https://docs.blender.org/manual/en/dev/render/cycles/gpu_rendering.html

CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.data_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 591

Details

Type
Bug
Christoph Werner (Taros) updated the task description. (Show Details)
Christoph Werner (Taros) updated the task description. (Show Details)

Hi Christoph,

you should also attach the "wohnzimmer_05.blend" file to this ticket. Makes it easier to test the scene.

P.S.: Nice to see an old fellow Softimage user here in friendly Blender land. :)

Hi Steffen.

Really nice to meet you here. I hope we have a talk sometime.
Maybe you have a moment to check my problem?

Bug status:

  • Updated my nvidia drivers to version 388.71.

Result: No changes, same error.

How to reproduce:

  • Open the scene
  • Set the texture pathes eventually (Textures are included)
  • Press render, use GPU rendering.

The error should appear after 2 Minutes (Depending of your GPU).

Minimum requirements: GPU with 6 GBytes of ram.

Thank you for your efforts.

Chris

Additionally I've added my scene here. Please do not share it and use it for test purposes only.

(EDIT: I have removed the file meantime because the task was closed. If you are interested to get the scene contact me or visit my website: www.christoph-werner.de. I plan to publish a short article to describe my experience with this project.)

Could just be a gpu driver timeout, there have been some improvements in this area since 2.79, can you try a 2.79 build from https://builder.blender.org/download/ to see if that's any better for you?

Hi LazyDodo.

I tried this version: blender-2.79-b0d61ea-win64-vc14.zip

My testscene with 100 samples rendered well. I will try a full samples rendering now (1400 samples).

Thank you for your comment.

I give you feedback, if the full version works.

Best wishes
Chris

@LazyDodo (LazyDodo):
No. Unfortunately an error after 8 Minutes at 1400 samples in "blender-2.79-b0d61ea-win64-vc14":

Traceback (most recent call last):
  File "C:\Users\Christoph Werner\AppData\Roaming\Blender Foundation\Blender\2.79\scripts\startup\arebus\__init__.py", line 23, in <module>
    from . import farm
ImportError: bad magic number in 'arebus.farm': b'\x17\r\r\n'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\Christoph Werner\AppData\Roaming\Blender Foundation\Blender\2.79\scripts\startup\arebus\__init__.py", line 26, in <module>
    from . import farm_old
ImportError: bad magic number in 'arebus.farm_old': b'l\x0c\r\n'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\Christoph Werner\AppData\Roaming\Blender Foundation\Blender\2.79\scripts\startup\arebus\__init__.py", line 29, in <module>
    from . import farm_old2
ImportError: bad magic number in 'arebus.farm_old2': b'\x9e\x0c\r\n'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\Christoph Werner\AppData\Roaming\Blender Foundation\Blender\2.79\scripts\startup\arebus\__init__.py", line 32, in <module>
    from . import farm_old3
ImportError: bad magic number in 'arebus.farm_old3': b'\xee\x0c\r\n'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\temp\blender-2.79.0-git.b0d61ea-windows64\2.79\scripts\modules\bpy\utils\__init__.py", line 94, in _test_import
    mod = __import__(module_name)
  File "C:\Users\Christoph Werner\AppData\Roaming\Blender Foundation\Blender\2.79\scripts\startup\arebus\__init__.py", line 34, in <module>
    from . import farm_old4
ImportError: bad magic number in 'arebus.farm_old4': b'\x16\r\r\n'
Registered Animation Nodes with 409 modules.
Can't load Blend4Web binary module, the cause can be tmp directory, which doesn't allow execution. Try to change it in 'Blender User Preferences' ('Temp' field on the 'File' tab.
B4W binary error: exception text: 'DLL load failed: Das angegebene Modul wurde nicht gefunden.'
search for unknown operator 'OBJECT_OT_b4w_normal_scale', 'OBJECT_OT_b4w_normal_scale'
search for unknown operator 'OBJECT_OT_b4w_normal_rotate', 'OBJECT_OT_b4w_normal_rotate'
search for unknown operator 'NODE_OT_b4w_logic_node_mute_toggle', 'NODE_OT_b4w_logic_node_mute_toggle'
search for unknown operator 'OBJECT_OT_b4w_normal_scale', 'OBJECT_OT_b4w_normal_scale'
search for unknown operator 'OBJECT_OT_b4w_normal_rotate', 'OBJECT_OT_b4w_normal_rotate'
search for unknown operator 'NODE_OT_b4w_logic_node_mute_toggle', 'NODE_OT_b4w_logic_node_mute_toggle'
Traceback (most recent call last):
  File "D:\temp\blender-2.79.0-git.b0d61ea-windows64\2.79\scripts\modules\bpy_types.py", line 673, in draw_ls
    func(self, context)
  File "C:\Users\Christoph Werner\AppData\Roaming\Blender Foundation\Blender\2.79\scripts\addons\blend4web\render_engine.py", line 708, in B4W_Splash
    icon_value=custom_icons["b4w_icon"].icon_id)
KeyError: 'b4w_icon'
Read blend: D:\Privat\blender\Wohnzimmer\wohnzimmer_test.blend
Read blend: D:\Privat\blender\Wohnzimmer\wohnzimmer_05.blend
CUDA error: Launch failed in cuCtxSynchronize(), line 1515

Refer to the Cycles GPU rendering documentation for possible solutions:
https://docs.blender.org/manual/en/dev/render/cycles/gpu_rendering.html

CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
Error: CUDA error: Launch failed in cuCtxSynchronize(), line 1515

Couple of things you could still try

  1. check your event log for this event(or similar events)
  1. Try a smaller tile size (16x16 will give acceptable results with these newer builds)

Hi LazyDodo.

Thank you for your answer. I have checked the first point of your list.
I get the event error as soon as cycles interrups. Tested it today morning at 700 samples.

I get the following event error log:

- System 
  - Provider 
   [ Name]  Display 
   - EventID 4101 
   [ Qualifiers]  0 
    Level 3 
    Task 0 
    Keywords 0x80000000000000 
   - TimeCreated 
   [ SystemTime]  2017-12-21T09:07:19.044757900Z 
    EventRecordID 805 
    Channel System 
    Computer [#mycomputername]
    Security 
 - EventData 
   nvlddmkm

About rendering in smaller tile size:
If I set the size down to 16 pixels, then my GPU render time increases from 45 minutes up to around 12 hours... This is "a bit" too long and I need the pc for my work today. :)
So I will start the render test with 16 px tile size today evening.

If you have other ideas for faster tests, please drop me a line.

Thank you
Chris

Hi guys.

I could not wait and started to render by using a 16 px tile size using this build: blender-2.79-b0d61ea-win64-vc14.

Results:

  1. Info: For any reason the overall render times are mutch faster in the new version. Not 12 hours at 16 px tile size as I mentioned. Much faster! Around 30 minutes at 500 samples f.e.
  2. Result: The image renders completely at 250 samples.
  3. Result: The image does not render at 500 samples or more (After 250 samples I started directly a test with 500 samples).
  4. I get the 4101 event error always when cycles interrupts or blender crashes.

EDIT: Rendered on CPU only in 4 hours. Used v. 2.79-b0d61ea-win64-vc14.
When I use GPU&CPU from new version it begins fast, but crashes too with the same timeout error.

I do not have any ideas now how to render the whole scene on my graphics card with a good sample size. I guess I will render it partially and patch the results in photoshop together until the error will be fixed.
Or I will use a render farm to render it on cpu. Needs a lot of time.

Do you have any ideas how to solve this or should I wait for a new release?

Thank you
Chris

Following the cycles log at 500 samples:

Read prefs: C:\Users\Christoph Werner\AppData\Roaming\Blender Foundation\Blender\2.79\config\userpref.blend
AL lib: (EE) UpdateDeviceParams: Failed to set 48000hz, got 44100hz instead
found bundled python: D:\temp\blender-2.79.0-git.b0d61ea-windows64\2.79\python
Traceback (most recent call last):
  File "C:\Users\Christoph Werner\AppData\Roaming\Blender Foundation\Blender\2.79\scripts\startup\arebus\__init__.py", line 23, in <module>
    from . import farm
ImportError: bad magic number in 'arebus.farm': b'\x17\r\r\n'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\Christoph Werner\AppData\Roaming\Blender Foundation\Blender\2.79\scripts\startup\arebus\__init__.py", line 26, in <module>
    from . import farm_old
ImportError: bad magic number in 'arebus.farm_old': b'l\x0c\r\n'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\Christoph Werner\AppData\Roaming\Blender Foundation\Blender\2.79\scripts\startup\arebus\__init__.py", line 29, in <module>
    from . import farm_old2
ImportError: bad magic number in 'arebus.farm_old2': b'\x9e\x0c\r\n'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\Christoph Werner\AppData\Roaming\Blender Foundation\Blender\2.79\scripts\startup\arebus\__init__.py", line 32, in <module>
    from . import farm_old3
ImportError: bad magic number in 'arebus.farm_old3': b'\xee\x0c\r\n'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\temp\blender-2.79.0-git.b0d61ea-windows64\2.79\scripts\modules\bpy\utils\__init__.py", line 94, in _test_import
    mod = __import__(module_name)
  File "C:\Users\Christoph Werner\AppData\Roaming\Blender Foundation\Blender\2.79\scripts\startup\arebus\__init__.py", line 34, in <module>
    from . import farm_old4
ImportError: bad magic number in 'arebus.farm_old4': b'\x16\r\r\n'
Registered Animation Nodes with 409 modules.
Can't load Blend4Web binary module, the cause can be tmp directory, which doesn't allow execution. Try to change it in 'Blender User Preferences' ('Temp' field on the 'File' tab.
B4W binary error: exception text: 'DLL load failed: Das angegebene Modul wurde nicht gefunden.'
search for unknown operator 'OBJECT_OT_b4w_normal_scale', 'OBJECT_OT_b4w_normal_scale'
search for unknown operator 'OBJECT_OT_b4w_normal_rotate', 'OBJECT_OT_b4w_normal_rotate'
search for unknown operator 'NODE_OT_b4w_logic_node_mute_toggle', 'NODE_OT_b4w_logic_node_mute_toggle'
search for unknown operator 'OBJECT_OT_b4w_normal_scale', 'OBJECT_OT_b4w_normal_scale'
search for unknown operator 'OBJECT_OT_b4w_normal_rotate', 'OBJECT_OT_b4w_normal_rotate'
search for unknown operator 'NODE_OT_b4w_logic_node_mute_toggle', 'NODE_OT_b4w_logic_node_mute_toggle'
Traceback (most recent call last):
  File "D:\temp\blender-2.79.0-git.b0d61ea-windows64\2.79\scripts\modules\bpy_types.py", line 673, in draw_ls
    func(self, context)
  File "C:\Users\Christoph Werner\AppData\Roaming\Blender Foundation\Blender\2.79\scripts\addons\blend4web\render_engine.py", line 708, in B4W_Splash
    icon_value=custom_icons["b4w_icon"].icon_id)
KeyError: 'b4w_icon'
Read blend: D:\Privat\blender\Wohnzimmer\wohnzimmer_test.blend
CUDA error: Launch failed in cuCtxSynchronize(), line 1515

Refer to the Cycles GPU rendering documentation for possible solutions:
https://docs.blender.org/manual/en/dev/render/cycles/gpu_rendering.html

CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuLaunchKernel(cuPathTrace, num_blocks, 1, 1, num_threads_per_block, 1, 1, 0, 0, args, 0), line 1513
CUDA error: Launch failed in cuCtxSynchronize(), line 1515
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
CUDA error: Launch failed in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemcpyHtoD(cuda_device_ptr(mem.device_pointer), mem.host_pointer, mem.memory_size()), line 655
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637
CUDA error: Launch failed in cuMemAlloc(&device_pointer, size + padding), line 637

Hi guys.

The event error 4101 still exist in blender-2.79.0-git.c66983c-windows64 (Todays nightly build).

Tried a render test with GPU&CPU together. It was much more stable than with the version some days ago and rendered for a very long time.
But 8 minutes before rendering was about to be finished blender crashed completely.

The scene needs currently more about 4 hours on a CPU. A GPU version would need about 40 minutes. This is a real argument...

Hope there will be a solution sometime. Can this be solved by the cycles developers or is this a problem that can only be solved by nvidia driver updates or windows?

Best wishes
Chris

You can possibly bypass the Operating System killing the driver by increasing the timeout from 2 seconds to something higher using these registry keys however you do this at your own risk.

Hi LazyDodo.

Thank you for the hint. I have already read about it but hoped to not to need to change the registry settings. I do not like such manually tweaks actually.

Is there no hope this issue can be solved in the native cycles code sometime?

Merry Christmas
Chris

Brecht Van Lommel (brecht) triaged this task as Normal priority.Dec 24 2017, 4:13 PM

I'll investigate to confirm if this is the driver timeout or something else. We have plans to solve the timeout problem, but it's a big project and unsure yet when somehow will have time to work on it.

The simple workaround in this scene may be to reduce the max bounces from 24 to something a bit lower.

Trying to render with VS2015 builds, I get a similar error (not sure why it's not the same):

I1224 20:29:53.745999  2900 device_cuda.cpp:629] Buffer allocate: RenderBuffers, 524,288 bytes. (512.00K)
I1224 20:29:53.745999  2900 device_cuda.cpp:629] Buffer allocate: work_tiles, 40 bytes. (40)
CUDA error: Illegal address in cuCtxSynchronize(), line 1515

Refer to the Cycles GPU rendering documentation for possible solutions:
https://docs.blender.org/manual/en/dev/render/cycles/gpu_rendering.html

CUDA error: Illegal address in cuMemcpyDtoH((uchar*)mem.host_pointer + offset, (CUdeviceptr)(mem.device_pointer + offset), size), line 720
CUDA error: Illegal address in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664
I1224 20:29:53.745999  2900 device_cuda.cpp:629] Buffer allocate: RenderBuffers, 524,288 bytes. (512.00K)

...

CUDA error: Illegal address in cuMemFree(cuda_device_ptr(mem.device_pointer)), line 664

But using VS2013 builds, it renders without problem. @Christoph Werner (Taros), can you try with VS2013 (without the -vc14) builds ?

note that I rendered at 1000spp with 64x64 tiles on a 1080Ti too. Windows 7, latest master and driver 388.31

Hello together.

I had some time to follow your hints and check the rendering.

Results:
@LazyDodo (LazyDodo): I have set the TdrDelay in the registry to a value of 16 seconds. Cycles rendered then completely. No crashes.
I tried first values of 4, then 8 seconds. Both did not work. So I set the delay to 16 seconds and all worked fine.

Attached you will find the cycles debug log for a full rendered 4K version of the current scene version I use. I have added some particles and objects in the meantime.

@Brecht Van Lommel (brecht): Looks like it is a timeout problem. See my info to LazyDodo above.
Reducing the bounces does not help here. As you see the max bounces is not really needed, because all other values like diffuse, glossy or transparency are all set to a value below 12.
I have tried already a max value of 7 earlier, but the error still appear. A max value below 24 and much more less does not solve the problem in my scene.

@mathieu menuet (bliblubli): I get the same error too, when using the daily builds. It was the same error line: 1515 etc.
I will try a VS2013 build later and give you feedback asap. Of course I will reset the TdrDelay back to 2 seconds before starting the test.

@mathieu menuet (bliblubli) : Tested a render with todays version blender-2.79.0-git.c66983c-windows64. I hope it is one the compiled with vc13.

Result:
Cycles interrupted the rendering after about 1:30 minutes. (In a first test blender crashed before).

  • Tiles size was set to 16 pixels.
  • Render mode: GPU only.

Error with the following log:

I'm not at home at the moment so I can't help with testing stuff, but the TdrDelay issue affects almost any application using CUDA. Allegorithmic Substance Designer and Painter now even display warnings if they find default values in the registry and strongly advise you to change the settings accordingly.
Here's a helpful article on that https://support.allegorithmic.com/documentation/display/SPDOC/GPU+drivers+crash+with+long+computations

This is really interesting. Thank you Steffen.

@Brecht Van Lommel (brecht): Looks like it is a timeout problem. See my info to LazyDodo above.

But then, I can't understand why I don't get that crash using 2013 builds. I did no modification to registry. I have the exact same card. "Only" difference is the OS.

@Brecht Van Lommel (brecht): Looks like it is a timeout problem. See my info to LazyDodo above.

But then, I can't understand why I don't get that crash using 2013 builds. I did no modification to registry. I have the exact same card. "Only" difference is the OS.

Good question. I guess, the OS could be possibly the reason for it. Maybe there is a different TdrDelay time set or win 7 handles this topic different by default. It is just an idea.

By the way: You mentioned you rendered the scene with a sample amount of 1000. Did you made the same test with 1400 samples too? The sample amount has an influence too.

For me (win 10 pro) the currrent solution is to set the TdrDelay time to a value of 16 seconds. Allegorithmic recomment even a value of 60 seconds for their tools.

@Christoph Werner (Taros) you said 500 samples at 16x16 was already triggering the bug. A 1000 spp render at 64x64 with same GPU takes about 8 times longer to render. But I'll try at 1400spp. IIRC @Brecht Van Lommel (brecht) said that this timeout bug was not happening for all users somehow?

By the way, to avoid user fiddle with their registry, we could just send less sample to the GPU at once for CUDA. OpenCL can take anything because their is no such timeout, but for CUDA I don't see an easy solution here to send the right amount of samples to GPU.

  • A static approach based on the number of CUDA cores wouldn't adapt to scene complexity, so we would have to be very conservative.
  • A dynamic solution, for example if you take the mean samples/sec of n last tiles as reference, may lead to very high render time if rendering starts with sky and then go from full sky tile to 10%sky with fur behind a tree with transparency, translucency, etc. wich may render 100 or even 1000x slower than pure sky, triggering the timeout.

@Christoph Werner (Taros) you said 500 samples at 16x16 was already triggering the bug. A 1000 spp render at 64x64 with same GPU takes about 8 times longer to render. But I'll try at 1400spp. IIRC @Brecht Van Lommel (brecht) said that this timeout bug was not happening for all users somehow?

Of course, you are right. My fault, sorry. So you don't need to test it with 1400, if you do not have time.

The bug seem to really appear only for some users or individual scenes. The point is: It seem to be dependent of the scene content too. Example: I have already finished a complex charakter project before, with the same graphic card and all worked fine there. Then I began to create this indoor scene, we are talking about here. All was fine for a amount of time. But after some days of work the bug has appeared suddenly. Could it be a question of complexity too? I am not a coder, so my questions are just ideas.

Another question:
Is it possible somehow to render a scene on a nvidia card by using OpenCL and not CUDA for GPU?

Best wishes
Chris

Could it be a question of complexity too?

Yes it is, although what is difficult for a GPU may be easier for another one, so there is no universal definition of complexity for all GPUs. See http://download.blender.org/institute/benchmark171221/latest_snapshot.html and this selection:


For Classroom, all GPU render about as fast, while for Koro, the Vega and TitanV are much faster

Another question:
Is it possible somehow to render a scene on a nvidia card by using OpenCL and not CUDA for GPU?

It is, but only the TitanV seem to really perform well with OpenCL, the other ones are much much faster with CUDA in Cycles at least.

Brecht Van Lommel (brecht) closed this task as Archived.EditedSat, Dec 30, 12:31 AM

I've confirmed that the timeout is indeed the issue, so this is a known issue with a workaround.

OpenCL (and OpenGL and DirectX) have the same timeout issue by the way on NVIDIA cards, it has nothing to do with CUDA specifically. The solution is clear, we need to implement an optimized split kernel for NVIDIA cards, it will just take time to get there.

Christoph Werner (Taros) renamed this task from CUDA error: Launch failed in cuCtxSynchronize(), line 1372 to CUDA error: Launch failed in cuCtxSynchronize(), line 1372 (SOLUTION: Changing some registry parameters. See the thread for solution details.).Sat, Dec 30, 3:51 PM