‹ BackHN Continuity

Thread

OpenDLSS: A Vulkan Reimplementation of Nvidia's DLSS 5 Neural Rendering Network

277 points · 126 comments · sagacity

  1. Lerc · · focus · HN ↗
    I'm rather surprised that it doesn't take the z-buffer as an input. I would have thought that would have provided useful information, it's one of the more useful forms of contolnet.
    1. rcarmo · · focus · HN ↗
      The official one seems to do, as well as other info from the engine (I think remember their mentioning LOD/UV map hints in one of the public demos, or articles, a few months back--or it might have been an Unreal Engine podcast)
      1. cubefox · · focus · HN ↗
        The Nvidia video presentation on DLSS 5 says that the model was only trained with various G-buffers as input (including the depth buffer) but during inference, the model only uses the rendered frame. As well as the previous rendered frame reprojected via motion vectors, if I understand correctly, likely to improve temporal stability.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.