copy and paste this google map to your website or blog!
Press copy button and paste into your blog or website.
(Please switch to 'HTML' mode when posting into your blog. Examples: WordPress Example, Blogger Example)
A website to check which LLMs you can run : r LocalLLaMA - Reddit I can run the 30B models in system RAM using llama cpp ooba, but I do need to compile my own llama cpp with the right settings Also - you would want to take into account that llama cpp can fit parts of a model into the GPU depending on how much VRAM you have For me that's what really gets the fastest speeds, even on my 5700XT Great start though!
How well can 3060 GPU run AI models? : r LocalLLaMA - Reddit With my setup, intel i7, rtx 3060, linux, llama c++ I can achieve about ~50 tokens s with 7B q4 gguf models I can go up to 12-14k context size until vram is completely filled, the speed will go down to about 25-30 tokens per second As for 13b models you would expect approximately half speeds, means ~25 tokens second for initial output
Games that can run well on Intel uhd 620 : r lowendgaming - Reddit This I hope will be a community effort, with everyone sharing their experience and ultimately creating a list of games that can run well on this and any similar hardware Hardware: intel 8th gen 8145U , 12 gigs of ram , Intel uhd 620 graphics Games that run well in my experience: Torchlight 2 Burnout paradise ultimate box Warcraft 3 (old one) Don't Starve Don't Starve together Terraria GTA San
Intel UHD 630 as a gaming GPU - Can you play games on this? In general, what can you expect from UHD 630? There are numerous games which refuse to start on Intel's integrated graphics even with sufficient performance In many cases, they can be persuaded to run using various methods Two examples off the top of my head are Witcher 1 and Fallout 3
Whats the highest Console a RG35XX can run? : r ANBERNIC - Reddit Whats the highest Console a RG35XX can run? Just got the RG35XX and wanted to look at downloading my own games Can the RG35XX play stuff like N64, NDS, Dreamcast, or maybe even higher? I know Gamecube and PS2 is far fetched so just seeing what else is to offer TIA!
Is there ANY way I can run Fortnite on linux? - Reddit 3- Steam link, you'll need a second computer that can run the game 4- Give up, dual boot, accept the defeat 5- Ask daddy Epic Games to make the game linux compatible 6- Buy lots of dinamite, enough to be a threat to the company, and place them on their servers 7- Take a nap and dream about playing the game Reply reply luciferin •
How large models can I run with 128GB RAM? : r LocalLLaMA - Reddit I can run 8B 13B-models without issues Can I run larger models if I upgrade to 128GB? I would want to avoid buying more RAM unless it has any effect Appreciate any suggestions I have googled and most sites discuss VRAM but as I understand that is not really correct any more with things like llama cpp, quantized models, etc
What are the current best LLMs that can run on 24gb (rtx4090)? What are the current best LLMs that can run on 24gb (rtx4090)? Mixtral 8x7b, Llama3 7b? Is oobabooga text gen web ui still the best gui? Have there been any optimizations to run 70b models on 24gb vram? I also have 128gb ram Is running 70b possible on that kind of setup or it is slow? Share Add a Comment Sort by: Best Open comment sort options
What is the best model I can currently run with an RTX 3080 . . . - Reddit Hello everyone! what is currently the best model I can run with an RTX3080 and around 32 GB of ddr4 ram I really wanted to try out the mistralai but I realized you need around 100 GB of Vram which unfortunately I don't have My use case is history, learning new things, coding, and language learning (specifically Greek) If you have any recommendations please let me know Also in the future do
How reliable is Can you run it? : r lowendgaming - Reddit Can play almost all games, albeit on low-to-moderate settings for the more-demanding ones Can I Run It? has consistently told me that I can't play games Heck, in my anticipated hype for "Stellaris," I tried running the program and it told me that I wouldn't be able to, for one reason or another