I tried it out a while ago because I saw that beta was released on Reddit.
It's just a package with everything from llamacpp to SDF, embeddings, and the CompVis OpenWebUI service, Hermes, etc.,
The web dashboard is also quite smooth, so I tried switching from Lemonade once, but um... there were bugs...
I updated it a few times, but the chronic problems weren't fixed, so I put it down for now and am using Lemonade again.
The good thing is that comfyui is integrated, so when you run comfy, inference stops and it connects, which is nice
It's easy to access, but because it tries to do too much,
systemd services get tangled up, and since llamacpp is also pushed with ROCmFPX, there was a conflict today, making it impossible to load the models;
I've installed and uninstalled it at least 10 times. I guess I'll give up for now and use Lemonade.
Are there any other good ones that you use?
▶ Original source: https://hal0.dev/
