Submitted by Sieventer t3_10n7gj7 in singularity
TwitchTvOmo1 t1_j67nccl wrote
Reply to comment by CypherLH in Google not releasing MusicLM by Sieventer
For what it's worth, no matter how much copyright advocates scream and cry, it won't stop AI from replacing entire industries. Like it or not the music industry is next. It might slow us down, but it's happening one way or another.
SurroundSwimming3494 t1_j67qrov wrote
>Like it or not the music industry is next.
AI hasn't replaced any industry yet. It hasn't even made significant inroads into the replacement of any industry, as far as I'm concerned, and I think that'll remain the case for at least the foreseeable future.
And also, going from this model (MusicLM) to the entire music industry being replaced is just one hell of a leap to make.
My personal and humble opinion is tools like these others will help musicians flourish for a good while, before the tools become so helpful that they actually begin disrupting the industry.
TwitchTvOmo1 t1_j67rg0b wrote
>My personal and humble opinion is tools like these others will help musicians flourish for a good while, before the tools become so helpful that they actually begin disrupting the industry.
I never said the opposite. Industries aren't gonna go "poof" and disappear from one moment to the other. But it's already began. Diffusion models will be remembered as the beginning of the end of the digital art industry. MusicLM and other similar tools that will surface in the near future will be remembered as the beginning of the end of the music industry. And it's not a hell of a leap to say this is gonna happen within the current decade. Everything seems like a hell of a leap to our brains because we're not very good at grasping the concept of exponential growth. Our brains think linearly, but AI growth has been exponential for years now.
visarga t1_j68oh3j wrote
I work on NLP, simpler tasks like information extraction from forms. My model was based on years of painstaking labelling and architecture tweaking. But last year I put an invoice into GPT-3 and it just spit out the fields in JSON, nicely formatted. No training, just works.
At first I panicked - here we have our own replacement! What do I do now? But now I realise it was not so simple. In order to make it work, you need to massage the input to fit into 2000 tokens, and reserve the rest of 2000 for the response.
I need to check that the extracted fields really do match to the document and are not hallucinated. I have to run it again to extract a few fields that came out empty for some reason. And I have to work on evaluation of prompts, it's not just writing, it has to be tested as well. Now I have so much work ahead of me I don't know what to do first.
I believe most AI adoptions will be similar. They will solve some task but need help, or create new capability and need new development. There is almost no AI that works without human in the loop today, not even chatGPT can be useful until someone vets its output, an certainly not Tesla or Waymo SDCs.
Frumpagumpus t1_j69myrc wrote
nice example.
it definitely does seem like "contextualization" is one of the biggest limiters on gpt performance.
https://thakkarparth007.github.io/copilot-explorer/posts/copilot-internals
you might enjoy this copilot reverse engineering in a similar vein. if i had enough time i would probably port some of these techniques to emacs (can use copilot there but looking at extensions dont quite do all this i dont think, tho it does work well enough with just the buffer)
SurroundSwimming3494 t1_j67s9i0 wrote
>Diffusion models will be remembered as the beginning of the end of the digital art industry. MusicLM and other similar tools that will surface in the near future will be remembered as the beginning of the end of the music industry.
I definitely think they'll be remembered as the start of revolutions in both digital art and music, but I'm not sure that'll they'll be remembered how you envision so. We'll see.
>And it's not a hell of a leap to say this is gonna happen within the current decade.
I guess we'll find out on Jan 1, 2030, but I think humans will still be playing a role in both the art and music world by then (even if quite different).
>Our brains think linearly, but AI growth has been exponential for years now.
Good point. But it's also worth noting that AI has hit roadblocks in the past after a period of exponential improvement. I don't see why it's not possible for that to happen to the current AI boon at some point (I think it probably will).
throwaway764586893 t1_j6m79o8 wrote
The growth in medical costs sure has been exponential for years now.
visarga t1_j68nu2s wrote
AI will make some things easier and create more expectations and work around it.
CypherLH t1_j67nlpz wrote
Yeah, its the potential slowing down that bugs me. I assume all the big AI players would have to build entirely new data sets to fit within whatever the new copyright regime would allow. Then re-train their large models on the new data sets, etc. Would definitely slow things down and some players like MidJourney might have to close their doors with a setback like that.
Plus I fear the broader implications of a new copyright regime that would effectively allow genres, fashions, and styles to be copyrighted.
TwitchTvOmo1 t1_j67o8dg wrote
Capitalism gonna capitalise mate. Every corporation will lobby billions doing their best to find a way to profit as much as possible off of AI. Even though it should be democratized.
Let's take this post for example. OP says he has no idea why they'd keep MusicLM private and how their usual argument of "it could be dangerous" doesn't really make sense here. It's because it's bullshit and that's not the reason they're keeping it private. It doesn't even have anything to do with the potential legal battles. The real reason is they know it's going to be a MASSIVE cash cow in the next 5 years and they'd be stupid not to milk it behind the scenes while acting like they're looking out for the world. Only chance of them releasing it is if a competitor like stability.ai releases something similar for free. Then they would be forced to release theirs too (not for free of course) before stability.ai erodes the entire market and they can no longer make the trillions they dreamed of.
Free market competition is the only hope there is. And that still looks a bit grim, considering the huge amounts of capital needed to make progress in these areas. And we all know which are the companies with those huge amounts of capital. The same ones that wanna squeeze every profitable penny out of AI progress.
purgatorytea t1_j67ok6g wrote
I 100% agree with you. And the only people who stand to benefit in that scenario are the big companies and the wealthy who will hire lawyers to enforce whatever they believe they "own". Expanding copyright will only hurt regular people and smaller artists...the artists that these "movements" are claiming they're advocating for....the smaller creators who are joining in on the anti-AI crap... they're the ones who will be harmed by the new copyright regime....moreso than simply allowing AI art generators to operate without this legislation and slowdown of technology. In fact, I wouldn't be surprised if there are some big companies trying to push the anti-AI art movement because they know it's a big opportunity to gain control of the industry and increase their own profits.
CypherLH t1_j67q5pq wrote
Yep, the anti-AI artists are literally trying to cut of their own noses to spite their face. They will be cutting their own throats if they get their way. They should be embracing this technology as a way to augment/expand their work and welcoming all the new people showing an interest in art because of the accessibility of the AI tools.
The annoying thing is they are spreading this shit on tiktok and elsewhere, indoctrinating young budding artists to hate "Evil AI" that is stealing all their works and trying to suck out their humanity. (literally, my 11 year old is spouting this stuff at me because of shit she is seeing online)
wavefxn22 t1_j67v35u wrote
It’s not evil it’s a tool, that evil people can use as well as good people.. it needs copyright restrictions so you can’t just straight up steal someone’s unique style that they spent a lifetime developing . But it also shouldn’t be so restricted that we can’t make anything at all
visarga t1_j68qfux wrote
Styles, by definition, are broad categories. If they were copyrightable, then the same rule would need to apply to both humans and AI. We can never know when a human has used AI or just looked at AI for inspiration. So we have to assume any human work might have AI in it.
If human works would be exempt from the strict rules AI has to follow what's to stop the big companies to hire people to white wash the style copyrights? What companies need is to license some images in that style. The images can be produced for hire at the lowest price.
wavefxn22 t1_j69828s wrote
They aren’t necessarily broad categories. You can ask ai to do something in the style of a specific artist. Say, van gough. His style was not a broad category, it was very distinct. And even he had styles within his styles, different periods.
Ai can be broad or specific, when it gets too specific as in people asking for “in the style of van gough” then we need some copyright protections.
Picked van gough as an example because he killed himself thinking he was worthless. He’d be even worse off today
visarga t1_j6c2z5z wrote
I disagree, copyrighting styles is absurd, countless possibilities banned in one go? We'll get to the point where humans fear creating anything because it will inevitably resemble some style somewhere.
[deleted] t1_j6d793s wrote
[deleted]
wavefxn22 t1_j6d8crl wrote
I don’t think you understand what I said; there’s a range. A work in the style of Van Gogh, is a limited style range that should have copyright protections. A work in the style of Impressionism however is fair use.
visarga t1_j6n30bh wrote
I don't think even Van Gogh can claim ownership of squiggly lines that look like fire or the colour palette of white-blue-gold. They pre-existed and were rediscovered in many ways in by many artists.
Can we agree that a style used by 3 or more artists doesn't belong to anyone and is open for AI to use? We just need to make a list of all styles that are generic enough.
Viewing a single comment thread. View all comments