Since NVIDIA owns huggingface now and huggingface has the excellent Candle [1] crate for inference on Rust, this seems like a good step towards nice native Rust kernels.
Integration with candle is already available! <a href="https://github.com/huggingface/candle/pull/3934/" rel="nofollow">https://github.com/huggingface/candle/pull/3934/
dllu · · focus · HN ↗
[1] <a href="https://github.com/huggingface/candle" rel="nofollow">https://github.com/huggingface/candle
melihelibol · · focus · HN ↗