• gandalf_der_12te
    3·
    1 个月前

    i think termux is probably already the best way to go, it ensures linux-like flexibility, i guess. but yeah, properly wiring it up, with a nice Graphical User Interface, would be nice, i guess.

    Edit: now that i think about it, i guess running it on some server that you rent, is maybe better, because then you can access that chat log from everywhere, and also, it doesn’t drain your battery so much. But then, you need to rent a server, so, idk.

    Edit again: Actually, somebody should hook up the DeepSeek chatbot to Matrix chat, so you can message it directly through your favorite messaging protocol/app.

    edit again: (one hour later) i tried setting up deepseek 8b model on my rented server, but it doesn’t have enough RAM. i tried adding swap space, but it doesn’t let me. I figured out that you can’t easily add swap space in a container. somehow, there seems to be a reason to that. too tired to explore further. whatever.

    • Smorty [she/her]
      2·
      1 个月前

      big sad :(

      wish it would be nice and easi to do stuff like this - yea hosting it somewhere is probably best for ur moni and phone.

      • gandalf_der_12te
        1·
        1 个月前

        actually i think it kinda is nice and easy to do, i’m just too lazy/cheap to rent a server with 8GB of RAM, even though it would only cost $15/month or sth.

        • Smorty [she/her]
          2·
          1 个月前

          it would also be super slow, u usually want a GPU for LLM inference… but u already know this, u are Gandald der zwölfte after all <3

              • gandalf_der_12te
                1·
                1 个月前

                o.O du verarscht mich jetzt oder? noch so’n cutie das aus deutschland stammt. Ich wohne in Wien ;-)

                • Smorty [she/her]
                  1·
                  30 天前

                  heyyyyyy… maybe don use this aggressive word… maybemaybs… - i jus don like it for som reason…

                  also, nuuuuu don just say cutie like that!!! >~< That’s like - im used to reading it in English but not in german…

                  also also, who else did u find here who u would call that word an who is also from the grrrmn land?

                  • gandalf_der_12te
                    1·
                    27 天前

                    “silberzunge” miss brainfart z.b.

                    bist du nicht eh in mia’s gruppenchat? dann kennst du sie ja