azl@lemmy.sdf.orgto3DPrinting@lemmy.world•3D-Printed replacement case for external modemEnglish
5·
8 months agoNice. Might come in handy for others considering how common that USR modem design was. I would have liked to see a power-on shot to see how well the PETG lights worked.
You would need to run the LLM on the system that has the GPU (your main PC). The front-end (typically a WebUI) could run in a docker container and make API calls to your LLM system. Unfortunately that requires the model to always be loaded in the VRAM on your main PC, severely reducing what you can do with that computer, GPU-wise.