‹ BackHN Continuity

Thread

Why Linux is picking up at a rapid pace for AI usage?

5 points · 7 comments · keshwanianup

  1. roscas · · focus · HN ↗
    You say 'picking up' like anyone would ever use Windows to run hermes or even an AI model.
    1. keshwanianup · · focus · HN ↗
      Why not? There are plenty running on Windows.
      1. verdverm · · focus · HN ↗
        windows is not the ideal os for developers, prefer using one close to your cloud environments, don't shrug off the additional complexity of wsl, it's not the same

        windows cannot be made as safe either, simple things like running agents as their own user rather than your user

        1. the__alchemist · · focus · HN ↗
          Nothing I program is OS-specific, and all the software I use is cross-platform. So, I'm not sure what "not ideal for developers" means in this context. I'm curious what workflows you're using where the OS makes a difference. One area I can think of is GUI programs where you're targeting OS-specific APIs, for the best performance.

          Regarding ML/AI or other computational programming: My thought is: Does this have an nvidia GPU with an up-to-date driver so my CUDA kernels work and What SIMD width is the CPU? Can I run 512-bit SIMD like AVX-512 for 16 x f32 computations at once? The OS doesn't matter here as long as it provides threads, a scheduler, and an allocator, which all the major ones do. And that my toolchain can compile for it.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.