Traveshamockery t1_jd8s4zo wrote on March 22, 2023 at 5:26 PM

Reply to comment by elehman839 in Persuasive piece by Robert Wright. Worrying about the rapid advancement of AI no longer makes you a kook. by OpenlyFallible

>But when decent AI can run on personally-owned hardware, I think we're almost certain to see horrific stuff like this.

As of March 13th, a Stanford team claims to run a ChatGPT 3.5-esque model called Alpaca 7B which runs on a $600 home computer.

https://crfm.stanford.edu/2023/03/13/alpaca.html

Then on March 18th, someone claims to get Alpaca 7B running on their Google Pixel phone.

https://twitter.com/rupeshsreeraman/status/1637124688290742276

blueSGL t1_jdafkx8 wrote on March 22, 2023 at 11:55 PM

https://github.com/ggerganov/llama.cpp [CPU loading with comparatively low memory requirements (LLaMA 7b running on phones and Raspberry Pi 4) - no fancy front end yet]

https://github.com/oobabooga/text-generation-webui [GPU loading with a nice front end with multiple chat and memory options]

/r/LocalLLaMA