Viewing a single comment thread. View all comments

TFenrir t1_j57vzlc wrote

Reply to comment by Fmeson in Google to relax AI safety rules to compete with OpenAI by Surur

Not only has Google managed it, they have most likely the best models in the world. PaLM is already the benchmark for basically all LLM tests, and it's even been fine tuned - for example medPaLM recently was shown in a paper that puts its diagnostic skills a hairsbreadth away from marching a clinician.

I think I just assume that everyone already... Knows this, at least in this sub, but Google is far and away the technical leader in this, not even when including DeepMind.

10

GoldenRain t1_j59lupa wrote

Should be mentioned that OpenAI using Google tech, without it they wouldnt exist.

1

visarga t1_j59trj8 wrote

Makes no difference who invented it, the inventors don't work at Google anymore.

1

visarga t1_j59tlpa wrote

> PaLM is already the benchmark for basically all LLM tests

I also made a time machine but nobody can see it. You got to trust me. My work is the benchmark in time travel, though.

1

TFenrir t1_j5a38bv wrote

Just because I don't physically have access to these models, doesn't mean they don't exist. Google regularly works with other institutions when running research with PaLM and their other advancements, and people frequently duplicate their findings.

Additionally, we have access to things like Flan-T5, tiny models fine tuned with their latest work that are about as powerful as gpt3, 5b vs 170b parameters.

3

visarga t1_j5luwtn wrote

I know Flan-T5, it is probably the best small model, but it only gets good scores for extractive and classification tasks, not for creative writing.

1