Viewing a single comment thread. View all comments

AsthmaBeyondBorders t1_ja6kj6s wrote

Really cool but the flickering is still far from solved

17

__ingeniare__ t1_ja6z4j2 wrote

Flickering is not solved at the moment yes, but how do you know it is far from being solved? Temporal consistency has already been solved in other aspects of generative AI (like inter-frame interpolation for FPS upscaling). I wouldn't be surprised if flickering is solved by the end of this year. Stable diffusion's Emad has already talked about real-time generated videos coming very soon with a recent breakthrough in their algorithm, allowing for something like 100x generation speedup.

11

Plus-Recording-8370 t1_jaa70ae wrote

Haven't watched it, but aside from solving the temporal issues, another expected issue when it comes to fluidity is that ai is less likely to chose the same key frames as a human would, thus it all flowing less like we know it. However, that too is not far from being solved either.

1

dwarfarchist9001 t1_ja6lphv wrote

Purpose made text to video models are already pretty much perfect but there are no open source ones right now.

This is like typing on a keyboard one handed compared to the efficiency that near future models will allow.

9

ideadude t1_ja7c7ne wrote

FWIW, that was one of the new things in the process behind this video. They applied a fluorescent light deflicker effect to the output from Stable Diffusion (sometimes chaining a few together), and it handled the flicker very well.

1

Plus-Recording-8370 t1_jaa8jzg wrote

Not far from solved. Don't judge from corridor crew, these guys are always late to the party.

1