• Kbobabob@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    16 hours ago

    There are open-source LLMs you can run on your own computer if you have a powerful GPU.

    What defines powerful? What if you don’t have the necessary hardware?

    • llama@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      2
      ·
      14 hours ago

      You can check Hugging Face’s website for specific requirements. I will warn you that lot of home machines don’t fit the minimum requirements for a lot of models available there. There is TinyLlama and it can run on most underpowered machines, but its functionalities are very limited and it would lack a lot as an everyday AI Chatbot. You can check my other comment too for other options.