OpenAI Employees FIRED, 10X Compute IN AI, Agi Levels, NEW AI Music , Infinite Context Length

okay so there was some actual interesting news in regards to open Ai and one of the things that I found out was that some openai researchers including an ally of sua were fired for alleged leaking this is pretty crazy news we can see here that opening ey has fired two researchers for allegedly leaking information according to a person with knowledge of the situation they include Leopold Ashen Brena a researcher on the team dedicated to keeping artificial intelligence safe for society Ashen Brena was also an ally of opening eye Chief scientist ILO Sasa who participated in a failed effort to force out CEO Sam Alman last fall it's not clear what information the two staffers leaked the other staffer pav isov a researcher who worked on reasoning had also spent time on the safety team and the alar of the two men is among the first Staffing changes that have surfaced since publicly Sam Alman resumed his board seat in March and it's pretty crazy because uh these two were on some of the you know super alignment research p ERS that were really important and it you know says that here says internally Ashen breno was one of the faces of what opening ey calls it super alignment team and that was the team in which they were trying well not were they are you know pretty much trying to solve super alignment with you know artificial superly intelligent systems if that makes any sense but ASI so they're trying to align you know those really powerful systems um and they were doing that with Sasa so it's pretty interesting that um you know many people were stating that why did they even mention that these guys were allies of Sask I think it's kind of interesting because you know sasa's role at the company is unknown there have been you know numerous rumors circulating around wondering where he is what he's doing and then of course two people who are quote unquote allies with ssova who were also working on Super alignment and now fired so I don't know it's kind of interesting to just you know see what's going on at open AI um and you can see that it says satova co-founder responsible for opening I bras breakthrough was part of the board that fired Sam Alman and um yeah he's been largely absent from open AI since the option brener when reached by phone did not have an immediate comment and is mof did not have a request to comment so um yeah it's pretty crazy and the lawyer who has represented Sasa did not represent uh you know for a comment so I mean the situation here is pretty interesting a lot of people are now speculating wondering whether that means open AI is going to get any more leaks but I don't know what kind of leaks they were doing some people have speculated that they were leaking to you foreign intelligence or foreign Nations or whatever that's just pure speculation some people are saying that you know it's links to Jimmy apples and you know the Twitter leaks but I mean I got to be honest I think whatever leak this is I do think it has to be really serious for them to get fired over it because the Jimmy Apple's leaks are like not substantial information it's not like it's an entire document that he posts on Twitter you know stating what the new models are going to have it's usually a vague tweet from account that has like three followers and then long after the you know information has been published um he retweets it and says look I knew this information is before and of course he does have inside information but it's just not usually leaked in the way that it as like you know would seem to lead to a firing maybe opening eyes is really strict but um I'm guessing that it had to be probably serious for them to fire two members of their really important team I know that yes um you know as well another thing that I do know is that you know AI Talent right now is really hard to come by in the sense that all these labs are fighting over you know people like these two these individuals but I wonder how that actually impacts their market value in terms of finding another career I don't think it's going to be too bad considering how competitive the AI space is in terms of trying to find AI researchers that can you know work on um reasoning and stuff like that and especially trying to get to AGI I'm just thinking that you know potentially it may have been you know more serious than we think considering that they just decided to fire them either way um it's pure speculation I don't think we're ever going to know because of is serious probably going to be lawyers involved uh stuff that's not disclosed to us so um yeah will be interesting to see if there is any more information on that but there was some other interesting news there was also this a voice agent IND distributor from humans handling interruptions smoothly and responding to the you know um person so take a look at this because this was pretty fascinating hi there this is Mia from Ace Plumbing how can I help you tonight hey Mia yeah I have an emergency here we've got water leaking from our upstairs bathroom it must be a burst pipe oh no that sounds stressful I can definitely help with that we do have an extra service charge for offour emergency services of $150 is the pipe still leaking yeah that charge is fine and yeah it's still leaking okay got it do you know how to shut off the water M to your house if not I can yeah I know how to do that don't worry about that I will do that right after this call Great do you still want a plumber to come tonight if so may I have your name and address please yes I we do it's Cara Smith at 146 uh Stevens Road in Alamo okay let me check the schedule um yes we can have someone at your house at 11:00 p. m. thank you for providing that information sounds good thanks so much you're welcome Cara is there anything else I can help with if not thank you for calling if anything else comes up feel free to give us a call back goodbye okay so I want to ask you guys this what do you think about this kind of software do you think that this is good for reducing overhead in terms of companies or do you think this is just Mindless automation that leads to you know people not doing the work I do think that this kind of work isn't exactly particularly forfill so I don't think it's as bad but I'm you know intrigued to know your opinions because I'm someone that when I call up a support place and then I have to talk to an AI system it's frustrating okay but I think our frustration comes from the fact that we don't understand these AI systems so in the future if these AI systems are actually you know infinitely smarter and they actually do work as well as a human will there be as big of a you know disagreement with these systems in place cuz that's what I want to ask you guys um and I don't think there will be considering the fact that some people just want their issue resolved um and of course some people like myself I think by that time we might be considered oldfashioned and I'm guessing that you know the newer Generation The Generation growing up will probably be just knowing that they've always spoken to AI systems and not potentially people so maybe it's just going to be a generational thing that changes as the new generations come in then we have introducing yudo and

this was by far one of the biggest announcements that I will cover in a more detailed video because there's actually a lot that people are missing but take a look at um this demo video and then I'm going to show you guys something that I found to be just absolutely hilarious from this my heart louder celebrate is but now that's [ __ ] go oh we are so bad it's never been more back than it is right now it was so over so bad make those break it down with that rolling sound so yeah that was ud. com maybe you skip the demo and all the music of listening to it but um I think it's important to actually look at the prompts and there was uh this is probably the funniest part of the video um and I just think this is honestly so funny okay and apologies to Seth in advance but I found this tweet okay and this is

basically on the platform and someone found an account on the udio platform that essentially is generating songs about how his friend Seth managed to uh you know I guess you could say release his bowels unexpectedly at work and honestly the fact that it sounds so professional is just it's just hilarious okay this is the funniest thing I've seen all day I honestly can cannot stop laughing at this but I'm guessing that some people are just continually to make songs about their friend um who managed to release their bowels at work and the songs are actually just hilarious take a listen [ __ ] his pants at Gladstones he was a grown man who pooped in his and Dave had to drive him home oh man okay that just never gets I got me a man but there's just one problem well he works 9 to 5 and he's a hell of guy his pants I'm sorry but like that's just the funniest thing I've ever seen um and I think the use cases for this are going to be pretty hilarious I mean there's so many custom soundtracks and creative ways that people are going to use this um hopefully Seth doesn't mind that um but uh it's pretty funny okay but um the point is that the quality is absolutely incredible and if you're using udio uh it's actually been created by former researchers at Google uh they made a previous um paper called Lyra and oh no it was either Lyra or Lia to apologies but um the point is that Google researchers I think are increasingly leaving Google to create products and I'm wondering if Google's even going to be standing in the future because recently deab talked about starting up his own AI lab and that's the current Google AI CEO and the reason is um Google just isn't putting out the products Google has literally I've looked through so many Google research papers when I tell you they have a boatload of stuff that is I wouldn't say it's ready to release but they could really crush the AI game if they wanted to but for some reason I don't know what's going on with the governance structure how things are organized there but for some reason they are taking forever to release products and it's frustrating people which is why people leave and they create you know software like this that people can use to make stuff like this so it will be interesting to see if Google Blows Its lead because honestly the way things are shaping up I think they're going to

now who we have a clip from Ray Kell a legendary futurist talking about how even his you know technological progress timelines it's moving faster than his predictions if you have been at the center of this um extraordinary uh last few years can I ask you is it moving faster than you expected it to how does it feel to you it feels like a few years I mean I made a prediction in 1999 it feels like we're two or three years ahead of that so this still pretty close Jeffrey how about you yeah I think for everybody except Ray it's moving faster than we expected there was also research paper from Google that was infinite uh context Windows which is uh it's pretty insane I'm not going to you know spend too much time talking about it but the point is that uh if this application is true then that means we could get infinite context Windows which could mean absolutely insane r ramifications for the future and the reason this is so crazy is that I remember when I was talking I think 8 months ago about how 100K context lens are just absolutely incredible and now it went from 100K to 128k to 500k to a million and now it's infinite like it like trying to wrap your head around how fast AI is moving is uh pretty surprising um so I mean you know like right now I can't even speak properly can't even make a sentence coherently to uh present this video but the point is uh you know it's just incredible how crazy this is moving and uh people like me are even shocked to so to speak in the amount of compute used to train the cutting Aji models per year so instead of doubling per year which is the mo law Trend we're increasing the amount of compute by 10 times per year because in this case we don't need the compute to be smaller we can just daisy chain more computers together so our server farmer inflection for example is the size of four football pitches right it's Absolut astronomical uses like 50 megawatt of power um and you know so you look at it it's like absolutely mind-blowing it raws like an engine and all of that is really just graphics cards you know just like you have in your you know if you have a desktop gaming machine you might have a GPU graphics card we just daisy chain tens of thousands of these up together so that they can do parallel processing um on you know trillions of words from the open web this 10x increase in the amount of compute used to train so yeah it's pretty incredible that how much compute is going up in terms of what they're using to train Cutting Edge AI um and him saying that it's you know a four football field is absolutely insane and we know that open AI are building you know Stargate which is going to be an insane level of compute in the future so I mean uh it's just going to be fascinating to see how Moos law continues to progress in terms of you know AI development because it's going to make things a lot faster a lot more efficient and of course a lot more crazy in terms of the capabilities that we're going to see in systems because we're going to be able to train models faster and deploy them faster definitely intuition involved there was Monte Carlo roll out too but it's playing with intuition about what moves to consider and how good the position is for it had neural nets for that capture intuition and so I see no reason to think it might not be creative in fact for the large language models as Ray pointed out they know much more than we do and you can and they know it in far fewer connections we have about 100 trillion synapses they have about a trillion connections so what they're doing is they're compressing a huge amount of information into not that many connections and that means they're very good at seeing the similarities between different things they have to see the similarities between all sorts of different things to compress the information into their connections that means they've seen all sorts of analogies that people haven't seen because they know about all sorts of things that no one person knows about and that's I think the source of creativity so yeah that was a fascinating piece of insight from Jeffrey Hinton and

he talks about you know the previous creative advances that we've seen in systems like Alpha go and I think in the future we're probably going to get to a really creative system because you know creativity does come from what you know and trying to think in creative and Abstract ways and then we're going to be able to get systems which you know of course know more than any human on the planet and combining that with certain Technologies I mean we're probably going to get really creative systems especially with hallucinations and all these kind of different things I mean it's just an interesting future to be a part of everyone bullish and concretely we believe that when we look at very complex scenes that Sora can generating like that snowy scene in Tokyo that we saw at the very beginning that Sora is already beginning to show a detailed understanding of how humans interact with one another how they have physical contact with one another and as we continue to scale this Paradigm we think eventually it's going to have to model how human think the only way you can generate truly realistic video with truly realistic sequence of actions is if you have an internal model of how all objects humans Etc environments work and so we think this is how Sora is going to Cony to AI so I'm gonna spend a bit of time talking about that one last question thanks for a great talk so my question is on the training data so how much training data do you estimate that is required for us to get to AGI and do you think we have enough data on the internet yeah that's a good question I think we have enough data get to AI um and I also think people always come up with creative ways to improve things and when we hit limitations we find creative ways to improve CS regardless so I think that whatever data we have will be enough a wonderful okay that's do AI thank most people including most scientists have a particular view of what the mind is that I think is utterly wrong so have this inner theater notion the idea is that what we really see is this inner theater called our mind and so for example if I tell you I have the subjective experience of little pink elephants floating in front of me most people inate that as there's some inner theater and in this inner theater that only I can see there's little pink elephants and if you ask what they're made of philosophers who tell you they're made of qualia um and I think that whole View complete nonsense and we're not going to be able to understand whether these things are sentient until we get over this ridiculous view of what the mind is so let me give you an alternative View and once I've given you this alternative view I'm going to try and convince you that chatbots are already sentient but I don't want to use the word sentience I want to talk about subjective experience it's just a bit less controversial because it doesn't have the kind of self-reflexive aspect of Consciousness so if we analyze what it means when I say I see little pink elephant floing in front of me what's really going on is I'm trying to tell you what my perceptual system is telling me when my perceptual system's going wrong and it wouldn't be any use for me to tell you which neurons are firing but what I can tell you is what would have to be out there in the world for my perceptual system to be working correctly and so when I say I see the little pink elephant floating in front of me you can translate that into um if there were little pink elephants out there in the world my perceptual system would be working properly and notice the last thing I said didn't contain the phrase subjective experience but it explains what a subjective experience is it's a hypothetical state of the world that allows me to convey to you what my perceptual systems telling me so the last clip of Jeffrey Hinton talking about AI chat BS have sentient and subjective experience because there's no such thing as qualia and AI house talking about the future of AGI let me know what your most interesting thing was this week