# NEOs New Automated AI Researcher Changes Everything (Autonomous Machine Learning Engineer) ## Метаданные - **Канал:** TheAIGRID - **YouTube:** https://www.youtube.com/watch?v=_c5R4_HwAng - **Дата:** 16.11.2024 - **Длительность:** 10:21 - **Просмотры:** 21,821 ## Описание Prepare for AGI with me - https://www.skool.com/postagiprepardness 🐤 Follow Me on Twitter https://twitter.com/TheAiGrid 🌐 Checkout My website - https://theaigrid.com/ Links From Todays Video: https://x.com/withneo/status/1857448521617592631 Welcome to my channel where i bring you the latest breakthroughs in AI. From deep learning to robotics, i cover it all. My videos offer valuable insights and perspectives that will expand your knowledge and understanding of this rapidly evolving field. Be sure to subscribe and stay updated on my latest videos. Was there anything i missed? (For Business Enquiries) contact@theaigrid.com Music Used LEMMiNO - Cipher https://www.youtube.com/watch?v=b0q5PR1xpA0 CC BY-SA 4.0 LEMMiNO - Encounters https://www.youtube.com/watch?v=xdwWCl_5x2s #LLM #Largelanguagemodel #chatgpt #AI #ArtificialIntelligence #MachineLearning #DeepLearning #NeuralNetworks #Robotics #DataScience ## Содержание ### [0:00](https://www.youtube.com/watch?v=_c5R4_HwAng) Segment 1 (00:00 - 05:00) so it looks like AI is not slowing down at all today I'm incredibly excited to show you guys Neo the first ever AI engineer specifically designed for machine learning engineers and get this it actually has outperformed open ai1 in certain tasks which is by any standard pretty incredible now the team behind Neo have actually been working on this product for 2 years and what they've achieved is genuinely revolutionary so let me break it down for you guys this is basically one of the first steps we have in order to move towards artificial super intelligence because automating AI researchers is essentially the key that unlocks everything so let me break down for you guys what we're about to see in our first demo so Neo is going to show us how it approaches a machine learning task from start to finish now for those of you who aren't familiar with machine learning workflows imagine trying to teach a computer to recognize cats you need to gather thousands of cat pictures clean up all that data and figure out the best way to process it then choose the right learning algorithm and then train the system it's incredibly complex and typically takes Engineers weeks or even months and what you're about to see is Neo doing all of this pretty much automatically sorup here from Neo the first AI engineer for ML engineers and yes Neo has outperformed openi we have been working on this for the past 2 years and we would love to show you how it works Neo is now crawling the competition link to understand the requirements it's planning key steps like data set prep model tuning evaluation and deployment Neo used multi-step reasoning to explore different possible solutions pick the best path and start implementation designing a powerful data pipeline is crucial in the machine learning workflow Neo curates evaluates merges transforms and pre-processes data setting the stage for seamless model performance Neo sets up multiple fine-tuning experiments with different hyperparameters to save time and resources it selects the most promising experiments to pursue in depth and runs them in a GPU sandbox after the fine tuning process a detailed evaluation report is generated offering insights into the loss curves that demonstrate the effective completion of the experiments Neo is now ready to deploy but first optimizing the pipeline for Peak efficiency it will analyze throw put and latency across different Frameworks like VM and tensor RT and different GPU types once approved it will lock in the best configuration for deployment after running experiment it shares its recommendations once approved it deploys the model and shares the link now let me explain what you're about to see in the second demo this is where things get really interesting the team basically challenged Neo to build a credit card fraud detection system this is one of the most critical applications in Financial Security and typically this kind of system takes a team of Engineers months to develop requiring deep expertise in both machine learning and Financial Security patterns and what you get to see in this demo is truly remarkable Neo is analyzing the kaggle data set understanding its structure and making sophisticated decisions about how to approach the problem the system is automatically evaluating different configurations and selecting the most promising approaches look at how it provides detailed metrics like precision and recall and these are crucial measures that tell us how the system can detect actual fraud while avoiding false alarms um I'm just going to show this task I did with Neo recently I was entering a kaggle competition and what I was trying to do was create a credit card fraud detection system so the first thing I did was I gave new the kaggle data set and then once I had downloaded it was able to go in and kind of start um processing the data and just like figuring out what the overall structure of the data set was and then once it had a good idea of this structure it was able to go into like evaluating potential configurations and just weighing between which one might be most suitable for this problem so as you can see here are like the options on the left in the chat um and then once it had evaluated these options it was able to come up with a finalized plan and then it executed that plan so it went ahead with running the training and the experimentation and then once these things were run um Nia was able to provide us with an evaluation which included a Precision recall and then also an F1 score so as you can see the evaluation is on the chat and the left ### [5:00](https://www.youtube.com/watch?v=_c5R4_HwAng&t=300s) Segment 2 (05:00 - 10:00) now for one of the final demos I want to show you guys something completely different that showcases Neo's versatility the team gave Neo a challenge using a Goodreads data set which is basically a huge collection of book reviews now here's why this is particularly challenging most book reviews are written in natural language with people using phrases like this book is amazing or life-changing and converting these subjective opinions into something a computer can understand is incredibly difficult take a look at how Neo approaches this challenge it's creating a sophisticated pipeline to transform written reviews into numerical data that can be analyzed it's running multiple experiments with different parameters constantly learning to improve its approach and the training loss you see decreasing means that the system is getting better and better at understanding and predicting reader preferences I am pretty easily impressed but this is still really cool take a look at what Neo did on this kagle challenge so we gave it a data set of book reviews from good reads and this is a data set that includes both quantitative and qualitative reviews and after we've given it the challenge it's just to understand what the requirements are it gets straight to work designing a solution so it starts by planning out a pretty sophisticated scheme to train something for this so the planner has a pretty detailed idea of the both the pipelines and the models that it wants to use a Critic comes in tries to poke some holes in that but it appears this is passing muster so we're ready to go so all the necessary dependencies the data set they're being downloaded uh it takes a little bit you know I'm at a school not known for CS or Wi-Fi isn't very good here but once that gets through um we're actually going to see what Neo thinks of the data set if there's any problems if there needs to be any massaging that needs to be done to the data because that's actually as I've understand a large part of what doing machine learning engineering is and already it's coming to the issue I mentioned earlier of how most of the data is qualitative so you have people saying this book is amazing this book is mid this book is life-changing what does that mean so Neo actually creates a transformation pipeline to turn that into numbers and then once those once that data is transformed it sets up all the training experiments so it's going to be running different hyperparameters different ways of training and it's going to see how that goes so it ran all those experiments seemed to pick a favorite and it ran it for 20 epoches and as we see by the training loss it actually iteratively improved a good amount so Neo is not perfect there's still a lot of room to go here but this is a lot better than what I can do for sure so thanks Neo now most people don't understand why what we've just seen is absolutely revolutionary for the tech industry traditional machine learning development is like trying to build a skyscraper with a small team of Architects and Engineers it's slow resource incentive and prone to human error Neo is basically turning this into an automated process while still maintaining sophistication and creativity that previously only human engine could provide this isn't about saving time or money though it does that pretty brilliantly it's about democratizing AI development and with Neo smaller companies that couldn't afford large teams of machine learning Engineers can now compete with tech Giants and researchers can focus on pushing the boundaries of what's possible instead of getting bugged down with technical implementation details now the team behind Neo is currently preparing for early beta access and I honestly believe this could be one of the most significant developments in AI this year we're witnessing the beginning of a new era where AI just isn't a tool being developed by Engineers AI is becoming the engineer and of course for those of you interested in being a part of this revolution you can join the wait list for Early Access trust me if you're in the tech world or interested in AI development you want to keep a close eye on Neo this is the kind of technology that can really start to change things and do you guys remember this image from the document called the decade ahead this was basically a long form document by someone who used to work at open a and basically documents how the future of super intelligence is basically going to come and one of the things that they talk about for the real explosion of intelligence was automated AI research and they state that automated AI research could probably compress a human decade of algorithmic progress into less than a year and that seems pretty conservative basically meaning that once who are able to automate the entire AI research pipeline it's quite likely that super intelligence is going to happen and of course with that it means that AI development speeds up pretty much 100 times you can see here it says I expect 100 million automated AI researchers working at about 100 times human speed not long after we've begin to automate AI research they'll be able to do a Year's worth of work in a few days this is going to be extraordinary and this could easily dramatically accelerate existing trends of algorithmic progress compressing a decade of advances into a year so when we take all of these things into account I definitely feel like this company is one that everyone needs to pay attention to if there were any more ### [10:00](https://www.youtube.com/watch?v=_c5R4_HwAng&t=600s) Segment 3 (10:00 - 10:00) advances from this company and they managed to somehow get to 80% or 90% this is going to be a huge development for the world of AI especially in the area of automated AI research because this is something it is pretty much new but it has one of the most St implications for the entire AI industry --- *Источник: https://ekstraktznaniy.ru/video/13733*