Machine Learning with ONNX in Houdini 20

comments 6
Free Tutorials

With Houdini 20 we got our first official machine learning node from SideFX. While we previously had example scene files that did machine learing related stuff or plugins like mlops, this is the first machine learning tool that you get just by installing Houdini. So we should take a look at what it does and what we can use it for!

Links mentioned in the video:
MNIST and Style Transfer
MIDAS Depth Estimation


Download Project File

Liked it? Take a second to support Christopher Kopic on Patreon!
Become a patron at Patreon!

6 Comments

  1. So how did you guys do the mushroom in the title picture of the class? Is that using ONNX?

    • Hey! You can take a look at the scene file for a breakdown of this. The mushroom model is a free 3d scan from aixterior. The “hologram points” on the right are created by projecting a 224×244 grid of points onto that scan, grabbing color info from it’s texture and running that through the style transfer model.

      • Suriya Murthy

        Which style transfer model are you using there?

        • It’s still one of the ready-to-use models from the repo. I think either “Udnie” or “Rain Princess”. I’d simply choose the one that works best for the picture I’m loading in. If you dig a bit deeper in this repo, you’ll also find fairly good instructions on how to train your own models and export them as ONNX files.

  2. are there any onnx of higher resolution like at least 1000×1000 for image manipulation

Leave a Reply