Skip Navigation
InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)EM
Posts 3
Comments 58

Self hosting LLMs on a remote VPS

Hi all, I'd like to hear some suggestions on self hosting LLMs on a remote server, and accessing said LLM via a client app or a convenient website. Either hear about your setups or products you got good impression on.

I've hosted Ollama before but I don't think it's intented for remote use. On the other hand I'm not really an expert and maybe there's other things to do like add-ons.

Thanks in advance!

13
Let's discuss: Opeth - The Last Will and Testament
  • I just finished listening to it. It's a bit cryptic to me at first. But it's not unexpected when it comes to prog music.

    So I expect my second and third listens to be more enjoyable (and fourth even more and so on).

    I did enjoy this first listen nonetheless. had some really good parts, like this flute solo in one of the §. also gonna be hard remembering them just by number.

    I do feel what someone else said (rigatti@lemmy.world) , that there's none of this repetitiveness that got me to like Opeth in the beginning, with their Morningrise album.

  • Help Needed: Transferring Content to Oracle Cloud VPS
  • let's say I have found a new show I wanna watch, and host in my Jellyfin server. Let's say I found a good magnet link. I don't have it anywhere yet, so I'd prefer to download it directly to the server.

    and not to my computer and then send to the server.

  • Why don't I show up in shodan?
  • if you'll have more connections or mentions on other IPs or websites, that'll grow the chances of them scanning your IP too.

    You should read about how their crawler decide what to crawl and when*. After all, there's 4 Billion IPv4 addresses, and much more IPv6 (tho I don't know how much of them are used), and they don't just randomly spin up numbers to scan.

    • I once read an article explaining how they did this, can't find it now. I'll send it if I do find it.
  • something to replace chat with self in WhatsApp/Telegram

    So I'm using a lot the option to chat myself in apps like WhatsApp or Telegram. But I don't wanna put my trust in them.

    I tried about using NextCloud (I have an instance) Talk, but I'm not satisfied: the app won't load if I have no internet connection.

    What I am actually looking for:

    • something with cross client sync that sync is ideally on my server
    • simple to use like sending message to self but with good search options, maybe even tagging
    • ability to send images, files etc
    • caches offline on clients

    thanks.

    P.S. wasn't really sure what tag to use here. Help seems like I'd use when I have an issue with an existing project. but I'm looking for a new one so I used this.

    thanks!

    16