|
- Ollama is making entry into the LLM world so simple that even school . . .
Ollama is a frontend written with Golang on top of llama cpp It hide the configurations and command lines operations as a trade for simplicity
- How does Ollama handle not having enough Vram? : r ollama - Reddit
How does Ollama handle not having enough Vram? I have been running phi3:3 8b on my GTX 1650 4GB and it's been great I was just wondering if I were to use a more complex model, let's say Llama3:7b, how will Ollama handle having only 4GB of VRAM available? Will it revert back to CPU usage and use my system memory (RAM)
- Request for Stop command for Ollama Server : r ollama - Reddit
Ok so ollama doesn't Have a stop or exit command We have to manually kill the process And this is not very useful especially because the server respawns immediately So there should be a stop command as well Edit: yes I know and use these commands But these are all system commands which vary from OS to OS I am talking about a single command
- How to resume downloading models ? : r ollama - Reddit
I've had a few fail mid download I just went to openweb's settings and typed in the model to redownload and it always started back up right where it initially failed Happened at least 3 times to me Running multiple models in a docker container on a 2014 office PC with integrated graphics and only 8gb ram Crazy enough I can run any model under 7b params relatively smooth
- Ollama Hallucinations for Simple Questions : r ollama - Reddit
Recently I installed Ollama and started to test its chatting skills Unfortunately, so far, the results were very strange Basically, I'm getting too…
- Dockerized Ollama doesnt use GPU even though its available
[SOLVED] - see update comment Hi :) Ollama was using the GPU when i initially set it up (this was quite a few months ago), but recently i noticed the inference speed was low so I started to troubleshoot I've already checked the GitHub and people are suggesting to make sure the GPU actually is available You can see from the screenshot it is however all the models load on 100% CPU and i don't
- How can I generate images with ollama? : r ollama - Reddit
Ollama doesn't yet support stable text-to-image, If you are using Mac you can either use diffuser or diffustionbee
- r ollama on Reddit: Does anyone know how to change where your models . . .
I recently got ollama up and running, only thing is I want to change where my models are located as I have 2 SSDs and they're currently stored on the smaller one running the OS (currently Ubuntu 22 04 if that helps at all) Naturally I'd like to move them to my bigger storage SSD I've tried a symlink but didn't work If anyone has any suggestions they would be greatly appreciated
|
|
|