services.tabby.enable = true;
services.tabby.acceleration = "cuda";

? Could be another way.

Quite some AI questions coming up in selfhosted in the last few days…

Here’s some more communities I’m subscribed to:

• [email protected]
• [email protected]
• [email protected]

And a few inactive ones on lemmy.intai.tech

I’m using koboldcpp and ollama. KoboldCpp is really awesome. In terms of hardware it’s an old PC with lots of RAM but no graphics card, so it’s quite slow for me. I occasionally rent a cloud GPU instance on runpod.io Not doing anything fancy, mainly role play, recreational stuff and I occasionally ask it to give me creative ideas for something, translate something or re-word or draft an unimportant text / email.

Have tried coding, summarizing and other stuff, but the performance of current AI isn’t enough for my everyday tasks.

Can we get a bit more info? Does it run locally? What specs does it need? Which technology does it use, something open-ended like Whisper? Or something faster with a prefefined set of sentences like VOSK? Which TTS engine does it use? Does it do other languages than just English?

Do these private computers run a properly licensed version of Windows? What’s the cost for a license? Same as in other countries?

And another thing I wodered: Is there more Linux expertise available than in other countries? I guess the average person from India isn’t in IT. But there’s lots of IT, lots of companies from my country have outsourced parts of their IT. I occasionally watch tutorial videos or university lectures on Youtube either in english with a heavy accent or for domestic use and not in english. Some of them discuss some crazy niche Linux topics or software development, which is also oftentimes deployed on Linux infrastructure. Or is it just because India is a big country and it’s just a matter of scale that I get to see some videos from over there?

I think with the ‘32’ in your error message, the issue is probably running old 32bit software on a modern 64bit system?

Have you enabled multilib?

There is a bit more info on that on the Steam page in the arch wiki.

Thx for explaining. I’m not sure if I’m willing to do the same trade-offs. Supposedly their WAF is very good and quite some people use it. Probably for a good reason… It just comes at a hefty price. I’m doing selfhosting to emancipate myself, stay independent and in control. I’m not sure if becoming dependant on a single large company and terminating my encryption on their servers that do arbitrary magic and whatever with my packets is something that aligns with my goals. (Or ethics, since I think the internet is to connect people on a level playing field. And that’s no longer the case once many people transfer control to a single entity.) But I don’t see a way around that. Afaik you have to choose between one or the other. Are there competitors to cloudflare that handle things differently? Maybe provide people with the WAF and databases to run on their own hardware, let them stay in control and just offer to tunnel their encrypted data with a configurable firewall?

Edit: Just found modsecurity.org while looking that up. But I guess a good and quick database of bad actors’ IPs is another thing that would be needed for an alternative solution.

Why do so many people tunnel their personal data through cloudflare anyways? No port forwarding possible? Or afraid of DDoS attacks? Or am I missing something?

Mmh. If you like Machine Learning / AI / Stable Diffusion you’re kinda screwed. Hope AMD ups their game regarding this.

uninstall grub

You might want to google a complete guide. “how to remove grub”, “restore windows bootmanager” or something like this. Things are a bit different depending on your setup (uefi, do you want do clean the efi partition, do you need help deleting the other partitions…)

i have used the old way before:

bootrec.exe /fixmbr
bootrec.exe /fixboot
bootrec.exe /rebuildbcd

but google it yourself. it isn’t difficult and my windows knowledge is a bit rusty.

Linux, Mint at least, feels incomplete, sort of like a tech demo

I can tell you, this feeling won’t go away. I have the same feeling with windows or macos. You just had one glimpse at something that looked strange to your eyes and you then chose to believe in your prejudices. This is not Mint’s fault. Like I use windows and ask myself how people work with that. Well, gaming and updating my old TomTom gps is kind of okay, that’s what i use windows for. But how do you for example rename 350 photos from your camera after you found out you forgot to set the date and now all filenames are off (or from 1970)? How do you develop stuff? Do you really download gigabytes of some colourful IDE from the internet just to execute a simple ‘make’ command? How do you set up a webserver for your aunt’s etsy shop and install php and a database?

You’re alright not wanting to try linux or not liking it. But to give it a chance, you need to open up the package manager and see it has like 10.000s of packages of different software waiting for you. After first installation it’s kind of bare. You’re right. Thats intentional to make it slim, fast and customizable.

HDDs are slow

Put your system on SSD together with things you need available, and your other data that won’t fit gets stored on the HDD. That way your computer is fast and the data that isn’t accessed that often (or gets cached anyways) is stored on the cheap additional storage.

concept of having to compile something // simply download an installer

I’m sorry. You’re applying windows concepts to something where they do not apply, and this is making you fail. People from the linux community dedicate their time to make most of the software available in the package manager. Tailor it to work well with the rest of Mint etc… 99% of everyday software is available like this. This is your installer! If you chose to circumvent this, download random stuff from the internet and try to compile it yourself… You’re allowed to do it, but you’re on your own. It’s not an iPhone where there’s no alternative to the store. But… You actively chose to do something difficult, that beginners aren’t supposed to do and it’s not how it’s supposed to work. I use linux exclusively every day and also develop stuff with it. I rarely compile or download something myself.

future once Windows has devolved to the point of being garbage

There won’t be such a point in time. They feed you the changes in very small steps that are barely noticable. It’s like with that mean story with the frog and the boiling water.

(With that said… We’re all aware you’re posting this on the linux community and opinions might be a bit … biased … )