Civilizational intelligence infrastructure must remain free to study, build, deploy, and run, not rented from closed institutions.
    • ZephyrXero@lemmy.worldEnglish
      41·
      2 months ago

      I got Qwen 3.5:9b running on my 8GB GPU the other day, and it still has some room left over

      • mabeledo@lemmy.worldEnglish
        2·
        2 months ago

        I was talking about combined system RAM. People often overestimate what the average system specs are.

        • ZephyrXero@lemmy.worldEnglish
          41·
          2 months ago

          If the model dumps over to system ram it gets super slow, you ideally want it to fit completely in your VRAM