Viewing a single comment thread. View all comments

ringobob t1_j9a82m0 wrote

Reply to comment by khamelean in I BROKE THE ORIGINAL CHATGPT! (not the Bing one!) by OmThepla

You know, about 10-ish years ago, a rapper brought a white girl up on stage to sing with him, and then everyone flipped their shit when she sang the n-word which was a lyric in the song they were singing.

When you do something you're not supposed to do, the context is worth noting, but at the end of the day you still did the thing. My point is not to suggest that the reaction in my example was warranted, it wasn't (and, IIRC, whoever the rapper was eventually agreed), but in this case, if ChatGPT isn't supposed to discuss these things and it's discussing these things, context explains why, but doesn't change the fact that it's doing what it was supposed to be unable to do.

7

PO0tyTng t1_j9aa9ks wrote

That is a great point. the context explains why.

Although it’s a hypothetical/thought exercise, the point is that it was indeed able to come up with this stuff.

My question is — if it actually had the means do these things, what would it take to switch from hypothetical to reality? One rogue programmer getting rid of an IF statement or row of training data?

All I can say is I hope automated weapon systems never have a chat bot user interface.

3

Talik1978 t1_j9ainey wrote

>My question is — if it actually had the means do these things, what would it take to switch from hypothetical to reality? One rogue programmer getting rid of an IF statement or row of training data?

With self learning AI, it's entirely possible that the program learns to make that change itself.

AI is good at.doing what we ask it to, but that is not the same as doing what we want it to. As an example, programmers trained an AI to control a cleaning bot. It was trained on a reward model, where it received positive reinforcement whenever it couldn't detect a mess, and negative reinforcement whenever it could.

What did it learn to do? It covered its cameras with a cleaning bucket. Easy, efficient, and now it is constantly being rewarded, as it cannot detect any messes.

1

mertskirp t1_j9aig7t wrote

Not sure if it’s what you’re talking about, but Hopsin always brings up white people, and they always say it.

Not sure who would be offended though, I think Hopsin is usually the only black dude there😂

2

ringobob t1_j9ajss4 wrote

This is what I'm talking about: https://www.bbc.com/news/newsbeat-44209141

I was off on the timing, it was only about 5 years ago. I can't find where he changed his mind about the reaction, so I may be misremembering that part, but if I am remembering correctly it was much less of a big deal in the news, I just remember reading it.

1

mertskirp t1_j9aq0fp wrote

Shoulda known better than to go up there “N Wording” at a fucking Kendrick concert! He’s been pretty straightforward about that, like, his entire career.

1

ringobob t1_j9aw8qy wrote

Don't bring someone on stage unless you want them to sing your lyrics.

0

mertskirp t1_j9b0ynx wrote

A fine debate, i’m on the side of don’t say words you know you shouldn’t say, regardless of circumstances.

Go on stage and have a lifetime experience. No reason to make a fool out of yourself. Plenty of other words to sing along to

0

ringobob t1_j9b9tp8 wrote

This is not a healthy dynamic to support. It's just a way to flip the historical power structure, so that black people have something white people are denied.

I get why it is the way it is, and I even think it's an unavoidable consequence of trying to fix the problem, which is undeniably still a problem. I have no desire to sing or say the word, which is part of the reason I don't listen to music with it in it. But the healthy end goal needs to be that the word isn't something that serves to divide us anymore. It needs to lose it's power to separate us.

And we don't reach that goal by bringing a white girl up on stage and then criticizing her for singing the song you brought her up there to sing. That makes the problem worse, not better.

This is all a tangent, not at all the point of discussing what OP did with the AI, but if you're going to insist on perpetuating structures of division as a sort of tit for tat and believe that's a healthy way to move us to a place of unity, I'm gonna tell you you're very, very wrong.

The structures of division exist, on both sides, and we can't just pretend they don't, but we don't need to applaud them, we need to see them as symptoms of an illness.

And, anticipating the response, I'm not saying this particular prohibition needs to change now, or first, or soon, or whatever. N word is off limits for white people, I'm on board, there's still a lot of issues to resolve before that one. Just don't put someone just trying to sing a song of an artist they like in a position to fail. It sets us back.

1

mertskirp t1_j9bun9a wrote

Uh… i’m not looking into it that far.. Neither is anyone else.

It boils down to common sense, not some racial hierarchy or whatever you’re trying to describe (i’ma be honest i didn’t read it)

Edit; i mean this as respectfully as possible. I’m not on reddit to read race ramblings

1

ringobob t1_j9bw14s wrote

So fuck off, then, if you're just gonna claim that it's a shallow issue not worth your time or attention then why engage in the tangent from the main point in the first place?

1

mertskirp t1_j9aqcno wrote

Also, I remember Kendrick and Tyler toying with the idea of cancelling a tour because there was no black people in their crowds, and when the crowd would be singing their songs it would make them uncomfortable cuz they knew it was a bunch of white folks screaming the N word at them

1

OmThepla OP t1_j9akjzr wrote

That's what I meant when I said Jailbreak...the roleplay was a method to get it to think outside the constraints of its programming. Otherwise any of these questions would only be met with a politically correct blah blah answer.

I had a fun time with this exercise. I am awestruck by its outside the box thinking. Like when I forced it to choose a partner from either Male or female only...it responds saying a binary choice isn't fair. and wants to choose between more sexual orientations....

I am in awe of this tech ...and indeed future versions will be even more awe-inspiring.

1