Comments

You must log in or register to comment.

sumane12 t1_jds5lwr wrote

That delay kills me, far too long. I'm guessing gpt5 will have to be multimodal with sound so can recognise words and doesn't need to process into text

69

NWCoffeenut t1_jdsgb83 wrote

I think a good part of the latency was with the TTS system. The actual text response for the most part came back reasonably quickly.

26

illathon t1_jdsoud8 wrote

No most implementations of whisper are slow.

2

itsnotlupus t1_jdt280v wrote

Whisper is the speech recognition component.
I don't think he said what he's using for TTS, might be MacOS' builtin thingy.

4

eggsnomellettes t1_jdt5dxl wrote

They're using elevenlabs, which isn't local and hence a slow API call

11

tortoise888 t1_jdtp8yj wrote

If we eventually get open source Elevenlabs quality models running locally it's gonna be insane.

1

ebolathrowawayy t1_jdvfmrk wrote

There's also Tortoise TTS which can be run locally but idk how fast it is.

1

stupidcasey t1_jdsff4l wrote

I expect gpt-5 or 6 to be super multimodal where they train it on anything and everything we have data for, audio shur video of course crossword puzzles hell yeah pong yup car driving why not, I think the only thing stopping us is it takes to long and we’ll have more processing power by then.

13

pokeuser61 t1_jdskrfs wrote

If you ran this on the hardware that gpt5 will require, it wouldn’t have a delay.

7

RedditLovingSun t1_jdtn0z9 wrote

It looks like from the title bar he's using whisper api for transcribing his audio to a text query. That has to send a API request with the audio out and wait for the text to come back over the internet. I'm sure a local audio text transcriber would be considerably faster

Edit nvm whisper can be run locally so he's probably doing that

4

itsnotlupus t1_jdt2igm wrote

The model text output is(/can be) a stream, so it ought to be possible to pipe that text stream into a warmed up TTS system and start getting audio before the text is fully generated.

3

Drown_The_Gods t1_jdww8zc wrote

Use Talon Voice. The developer has their own engine that blows Whisper out of the water. Never worry about speed again. Don’t thank me, but do chuck them a few dollars if you find it useful.

2

moonpumper t1_jdsxn21 wrote

I just want a screen free phone that's basically just Jarvis. Read my texts to me, look shit up for me, keep track of and make appointments for me, give me stock quotes, tell me the news, just don't suck me into an infinite scroll anymore. If I need to see something cast it to a screen in my house. Done with phone screens.

40

RedditLovingSun t1_jdtnafr wrote

Can't wait till we get there with a better alpaca model + local transcription and audio generation + chatgpt style plugins for operating apps. All possible today we just have to wait for it to be developed

10

SkyeandJett t1_jdt2zli wrote

That was my thought. No more phone. Just the smart watch.

9

SnipingNinja t1_jdv68wu wrote

I actually have a concept in my mind, don't have all the skills needed but will be learning things in the next few months, hopefully I'm not too late when I'm done making my idea into reality.

1

SkyeandJett t1_jdv6nju wrote

This is probably just my anxiety but I feel like anything we think of or try to execute is going to be eclipsed before it can be realized. We're going to go overnight from this moment to indistinguishable from human androids and FDVR. This past couple of weeks has been overwhelming in the extreme.

1

SnipingNinja t1_jdvg55n wrote

You're right but I think that issue isn't relevant to this, having a locally running AI would be useful regardless of other innovations, and there's something to say about cyberpunkness of such a device

1

[deleted] t1_jdv9fmu wrote

[deleted]

1

moonpumper t1_jdva8ow wrote

With chat gpt type stuff how would it sound much different than a phone conversation? The whole idea is that the os responds to natural language, like talking to a personal assistant or secretary.

1

czmax t1_jdwcbuq wrote

I was hoping that wearables (like a watch) could do this for me. Or at least force development in that direction.

(Seems to not be panning out… but i still have hope. I’d love to only carry a watch for most of my day. Initially I’d go through screen withdrawal but in the long run I think life would be better).

1

Dwanyelle t1_jdsjgfb wrote

Yeah, I'd be surprised if we don't have something like that available publicly before the end of the year(if only cause big tech is slowly and unwieldy and things need to work their way through the proper paperwork

29

pokeuser61 t1_jdskvem wrote

It is both public and open source

11

Dwanyelle t1_jdsmha6 wrote

I should clarify, it will be a packaged product from a big tech person.

I could do this, sure, I can putz around on computers a bit, but once you can just click an "install" button in the Microsoft store, that's it

13

micseydel t1_jdsr6vx wrote

Big tech will offer it as a service instead of a locally-running system. That will mean latency, increased data use, and other... differences 😅

9

Dwanyelle t1_jdss5uk wrote

Oh, there will definitely be a ton of downsides, but convenience will not be one of them.

9

imlaggingsobad t1_jdu555l wrote

I'm like 100% certain that Apple, Google and Meta are making a JARVIS assistant that connects to AR glasses. It would be a revolutionary product and it's actually feasible imo.

10

_dekappatated t1_jdt8e99 wrote

TIL there was a B programming language

7

GoSouthYoungMan t1_jdu54fg wrote

And before there was B, there was APL: A Programming Language. (This is not a joke.)

3

Grecu69 t1_jds1x7q wrote

This looks like a slightly better version of siri imo

5

HarbingerDe t1_jdst2fh wrote

It's a significantly better version of Siri.

GPT-4 can borderline pass the Turing Test and Siri can barely do... anything?

36

kevinzvilt t1_jdsv83o wrote

Me: Siri, set my alarm for 7am.

Siri: Here is a list of videos titled Tom Tom Solo by River Banks!

37

JDP87 t1_jdt6uhc wrote

At least you're getting an answer.

Working on that. Something went wrong. Please try again.

3

DaffyDuck t1_jdu15vr wrote

13b parameter llama is not as good as GPT4.

1

[deleted] t1_jdta7a5 wrote

Samantha >>>>>>>>>>

3

the_funambule t1_jdtjah6 wrote

ChatGPT states Samantha is the most accurate representation of AI in movies

4

InfoOnAI t1_jdtab19 wrote

I've been trying to set something similar up.

2

_Alasdair t1_jdy9mfd wrote

I built something exactly like this back when GPT3 API came out. Was pretty cool but eventually got bored with it because it couldn't do anything. I tried hooking it up to external apis to get real world live data but by the end everything was so complicated and slow that I gave up.

Hopefully with the GPT4 plugins we can now make something actually useful. It's gonna be awesome.

2

HesThePianoMan t1_jdtr4iy wrote

This is nothing special, just sounds like Google assistant

−4

Sigma_Atheist t1_jdswekv wrote

Marvel is cringe. Can we use some other name to compare stuff like this to?

−17

Anjz t1_jdsynyi wrote

You mean you don't like MODOK?

How about we just name it Dan? Dan's a cool guy.

1