Viewing a single comment thread. View all comments

Nukemouse t1_jdcftfv wrote

Couldn't you just have it tell you how confident it is. Like put a little bar next to the output that the more full it is the more confident etc it is to warn users.

10

Veleric t1_jdck1ks wrote

I've seen this done before but I'd like to see more research on the effectiveness of it.

8

galactic-arachnid t1_jddnkm3 wrote

I believe you’re talking about logprobs, and there is an enormous amount of literature on them

1

SgathTriallair t1_jdeen5z wrote

The effectiveness is more about seeing if the AI says it is 40% certain does that make people trust it or not.

1

__ingeniare__ OP t1_jdck0lh wrote

Yes you could, the specific implementation is irrelevant, the big thing is that it can estimate the confidence at all

3