It's still in development. It often says the opposite from what is expected. Try Retoor1b chatbot at https://llm.molodetz.nl

This was result after building bot + chat website from scratch including training with embeddings. Design is generated by GPT, I tried my own but all ugly.

It's quite cool huh? Ask it to write some code for you. It's absolutely terrible. If it's down, try again in 5 minutes. I'm still working on it.

What's the result? I finally have a toolkit to make good/serious bots. Code could be bit better, but that's for other day.

Stack: self written webserver (and yes, you can post a gb to it or ddos it. Not sure if it survives the first one. I should limit requests to one mb anyway. Http headers may officially not be more than 4096 in total) since I know http protocol from my head anyway. Python websockets module. Asyncio, chromadb.

It could have xss issues. Don't care.

Let me know what you think

I will not miss you bitch. See screenshot. I received new hardware. I will use a laptop with good specs as server. My dad bought it from his previous employer because he went for retirement. It has an ultrabook-grade 11th gen processor and he only bought it for 350,- euro. His former employer was a school, they don't give a fuck about money like a commercial company would do in such case. It's originally bought with tax money anyway.

https://llm.molodetz.nl is currently online but not for long, i hope to have smth running at end of the weekend. Probably a 7b model. I have plans with it that require some performance so I won't use the heavy ones.

Retoor1b currently is 0.5b or 1.5b. I forgot. The models with lower parameter count are a bit more naive and trainable like a kid. They're also not very biased yet. So, that will be my main new challenge. How to make a chat bot unethically human. No political correctness under this roof.

Would be nice if i could make it a bit like bratgpt. Sounds like a joke, but that model is expensive as fuck. You'll be shocked. But i would like to implement some sarcasm in it. A bit unpredictable. But normally such configuration escalates into very weird behavior.

My 'server' has a freaking 4K screen and i'm working on a decade old laptop. But seriously, the keyboard of the new one sucks. Nothing beats a x270. * tik tik tik * rakketakketak *. My previous x270 missed four keys. The three x270's i had, all had familiar experience but still different. The other two would never lose a key I guess. I configured the new 'server' that it safes battery, configured for mostly on AC.

I'm living on limited amount of cash (and will work again when i will run out). That's why i normally don't spend money myself on such things. So i'm now very happy. Fuck, this was about to be rant about how much my AI sucks but it ended in happy stuff. Oh well...

If you're still reading, you're the best!

Edit:
Images uploading broke again. Here is link: https://devrant.molodetz.nl/llm.png