How do you use this model locally, similarly to using `llama-server -m <model>`?(I mean: outside direct or substantial use of Python, and running the Neural Network in the most efficient way.)
Probably ComfyUI is one of the easiest way to get started with local image/video models. Or perhaps vLLM, if they have support for it already, would be something like `vllm serve <model> --omni --port 9080`
mdp2021 · · focus · HN ↗
(I mean: outside direct or substantial use of Python, and running the Neural Network in the most efficient way.)
embedding-shape · · focus · HN ↗