That's the thing though, that is the fundamental limit of these kind of natural language AIs. They learn by volume.

Chat GPT writes really good cover letters for Job applicants for example. Because there are tons of cover letter examples out there for it to ingest and learn exactly what it is that makes a good one.

And that means two important things.

1. They cant teach themselves anything.
2. For anything obscure enough that sufficient volume and variety of material doesn't exist they aren't that great.