• BlackLaZoR@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    5 hours ago

    RX Vega 56 8GB HBM2, 64GB RAM

    That’s poor but not horrible. LMStudio has Vulkan compute backend option that works on almost any card. You can also do partial GPU/RAM split giving you total of 72GB and increased performance vs CPU only.

    • eleitl@lemmy.zip
      link
      fedilink
      English
      arrow-up
      1
      ·
      5 hours ago

      Hmm, have to try it sometime when the hot phase at work is over. Thanks!