What. The. ***k. [less than 1B parameter model outperforms GPT 3.5 in science multiple choice questions]ToHallowMySleep t1_j9jvphi wrote
Reply to comment by Ylsid in What. The. ***k. [less than 1B parameter model outperforms GPT 3.5 in science multiple choice questions] by Destiny_Knight
It already runs happily on last-gen hardware. I've been running it on my 10GB 3080.
walkarund t1_j9k92lw wrote
It doesn't even have to be last-gen. It works well on my 4gb GTX 970 with 8gb of ram, it is very impressive how optimized it is
Ylsid t1_j9jzigu wrote
Stable diffusion works on my 6gb 2060RTX, but I am quite sure GPT3 wouldn't
ToHallowMySleep t1_j9jzzar wrote
maybe a 5090. ;)
Ylsid t1_j9k00fw wrote
An a100 sure! If you got three!
Viewing a single comment thread. View all comments