• eleitl@lemmy.zip
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 month ago

    Self-hosted LLMs are neat and private, if you (already) have the hardware/budget and some cheap (solar PV) surplus juice to drive it.

    • mojofrododojo@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      oh so yours is trained on ethical sources? you compensated the creators for their work and did so with their consent to machine training?

      • eleitl@lemmy.zip
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        30 days ago

        What the fuck are ethical sources? Where is compensation and consent when I unapologetically use pirate archives of books and papers? You people crack me up.

        • mojofrododojo@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 month ago

          the fact that you have no idea what I’m talking about either means you’re full of shit, or cartoonishly stupid and evil.

          Probably both

          • eleitl@lemmy.zip
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            1
            ·
            1 month ago

            The fact that you immediately descend into ad hominems indicates that you’re a just another troll that should be posting from hexbear.

            • mojofrododojo@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              ·
              1 month ago

              you’re simply used to llm sycophancy, not talking to actual people.

              you really not understanding training on sources compensated for their content is hilariously stupid

              • eleitl@lemmy.zip
                link
                fedilink
                English
                arrow-up
                2
                arrow-down
                1
                ·
                30 days ago

                You’re not understanding what standing on the shoulders of giants means. Locally hosted open weights models are free/libre and puts you in control of your data. Since we’re talking about hilariously stupid.

      • eleitl@lemmy.zip
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        30 days ago

        Someone mentioned that, but it doesn’t have to be off-grid. My 2 kWp system is grid-tied and if I would start running a local LLM it would be an incentive to add another couple.

        • scarabic@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          29 days ago

          It may sound odd but I’ve heard people bring up the above point a few times. “AI isn’t bad - if you run it on a sustainable off-grid system it’s perfectly fine.”

          But I have NOT encountered people actually doing this even once, let alone a few times. That’s why I was asking.

          Anything that wastes energy can be recast as harmless if you put it on an imaginary sustainable setup but that just seems like fantasizing.

          • eleitl@lemmy.zip
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            1
            ·
            29 days ago

            Renewable infra isn’t sustainable, since it can’t be built with renewable energy alone. As such it’s just a fossil multiplier. I make about 2/3rd of my own net power, since my electricity meter is old enough to run backwards. I can’t install more orelse my meter would read negative. I intend to run a Qwen model that fits my 8 GB HBM Radeon card as an experiment during the day, starting end of this month.

            If this works I consider running something hotter, and double my PV capacity. Adding AC or an EV would be another option. None of this is sustainable, but not exactly a fantasy.