-_1_2_3_- t1_je8p5xx wrote on March 30, 2023 at 5:49 AM

Reply to comment by dreaming_geometry in [R] LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention by floppy_llama

They are using gpt-4 to accelerate their work

idontcareaboutthenam t1_je8rz5a wrote on March 30, 2023 at 6:24 AM

Can you elaborate?

drizel t1_je8v9cj wrote on March 30, 2023 at 7:08 AM

GPT-4 can parse millions of papers and help uncover new optimizations or other improvements much faster than without it. Not only that but you can brainstorm ideas with it.

Swolnerman t1_jead4wo wrote on March 30, 2023 at 4:01 PM

How can it do that with a context window of 32k?

On top of that, I don’t think gpt4 can make informed decisions on picking between academic research papers as of yet