Viewing a single comment thread. View all comments

Clean_Livlng t1_it1ma18 wrote

War is not a good place to bring up a baby AGI.

Caution will be a rare fruit during times of war. AGI will be used for war against other humans, something it should never be designed to do due to the risk of it going poorly for everyone.

The reason for the war won't change unless we implement UBI so there's no good end state to that kind of war, you're still without jobs for human at the end of it. Humans used to make good cannon fodder...but the job of soldier will be automated as well. It might not make sense to ship a human somewhere if they're going to die within a minute to a small cheap drone that fires a poison dart into them, and the other humans near them, moving so fast they can't do anything to stop it.

"Behold the field in which I grow my caution, and see that it is barren!"

We'll have AI vs AI warfare, and the least cautious side wins because they give their AI more freedom to improve itself, and improvise without human oversight etc. I wonder if that could lead to bad outcomes for humanity.

​

We're so close to securing a good outcome for all of us. Can we not mess this up at the last moment.

1