Viewing a single comment thread. View all comments

light24bulbs t1_jdsapie wrote on March 26, 2023 at 8:15 PM

Reply to comment by frequenttimetraveler in [D] Do we really need 100B+ parameters in a large language model? by Vegetable-Skill-9700

My mistake, correct you are:

https://www.beren.io/2022-08-06-The-scale-of-the-brain-vs-machine-learning/

This post recons we using 800b parameters for language processing.