# OnDemands New AI Changes AI Development Forever! (Ondemand AI Tutorial)

## Метаданные

- **Канал:** TheAIGRID
- **YouTube:** https://www.youtube.com/watch?v=P_REty2WZVs
- **Дата:** 13.07.2024
- **Длительность:** 16:07
- **Просмотры:** 5,344
- **Источник:** https://ekstraktznaniy.ru/video/14192

## Описание

Try it out here - https://app.on-demand.io/auth/login 

Learn A.I With me - https://www.skool.com/postagiprepardness 
🐤 Follow Me on Twitter https://twitter.com/TheAiGrid
🌐 Checkout My website - https://theaigrid.com/

00:00 - Introduction to OnDemand platform
00:40 - Overview of the OnDemand dashboard
00:56 - Datasets section
01:56 - Bring Your Own Inference feature
02:33 - Bring Your Own Model Management
03:23 - Plugin Marketplace
04:55 - Creating custom plugins
05:48 - Serverless Applications section
06:48 - Cloud Services section
07:51 - Agent Builder (upcoming feature)
08:52 - Automations (upcoming feature)
09:38 - Playground section
11:44 - Example scenario in Playground
13:42 - Storage Management section
15:04 - API Key Management section
16:04 - Conclusion

Links From Todays Video:


Welcome to my channel where i bring you the latest breakthroughs in AI. From deep learning to robotics, i cover it all. My videos offer valuable insights and perspectives that will expand your know

## Транскрипт

### Introduction to OnDemand platform []

so welcome back to the AI grid and in today's video we'll be taking a look at on demand which is turbocharging air Innovation and is the fast track to product development on demand is an aid driven platform enabling the rapid deployment of endtoend products and this actually allows users to build deploy and manage AI agents and AI plugins for various different applications so let's actually go ahead and take a look here at what's going to be coming with this platform and how you can get started on using it today so in you come into the on demand menu you'll see an overview right here what you'll be able to see is an overview of the different things that you're going to need if you want to run your program successfully what we can

### Overview of the OnDemand dashboard [0:40]

see here is the plan usage you can see the storage the retrieval augmented generation calls you can also see the amount of tokens and vectors transcription hours and of course your storage now what you can also see here is your plugins media storage and your models but this is just an overview the fun begins when we start

### Datasets section [0:56]

building so now moving from the overview let's click the left hand side to go on over to data sets now that we're here this is where the fun begins in the data set section of the OnDemand platform here you can access a wealth of data that is crucial for training your machine learning models or enhancing the functionality of your plugin you can use these data sets for model training leveraging these data sets to train your own models directly within the platform this data can serve as a foundation for building accurate and robust machine learning models tailored to your specific needs what's also fascina fting is that these data sets can also be used in conjunction with the plugins that you build for example if you're developing a plugin for text analysis you can use a large Corpus of text Data from the data sets to enhance the accuracy of your plug-in here you can simply download and use these extensive libraries of data sets at will by utilizing the data sets feature you can significantly streamline the development and deployment of your AI model plugins making your workflows more efficient and effective welcome to

### Bring Your Own Inference feature [1:56]

bring your own inference sectioned of the on demand platform this feature allows you to host a language model and integrate it seamlessly into the OnDemand environment and here's how you can get started with bring your own inference you can utilize a language model hosted on an external server this integration allows you to leverage your existing models within the OnDemand platform without needing to migrate them to get started click on the create endpoint button here's where you'll need to configure several parameters in the endpoint you'll need to give your endpoint a descriptive name you'll have to look at the endpoint type the endpoint URL the bearer token the model ID and the max token length once all of this is done you can then create your own endpoint here's where things get

### Bring Your Own Model Management [2:33]

more interesting taking a look at the bring your own model management section so this feature actually allows you to integrate models from external sources such as hugging face directly into on demand and here's how you can get started to do this all you need to do is click the create model button this is where you'll be prompted to search a model from hugging face and you simply enter the name of the model you want to use now all we need to do is proceed to configure this model so now we can simply select Sal 38 biling parameters instruct and you can see right here the model is supported this is what happens when your model is working so now we need to do is type in our model once we just click our model here you can see that the model on hugging face is supported now here we'll have to enter the name we'll just call this llama 38 bilon parameters instruct and then once that's done you can see the number of parameters will be Auto detected and we'll just go ahead and click create model now that the model has been created successfully here you can see that we can now use this model

### Plugin Marketplace [3:23]

this now means that our model is now ready for use within on demand now once you've created the model you're then going to want to go ahead and click create endpoint then of course we're just going to want to bring in the model that we literally just created we can configure the endpoint name the quantization mode the engine arguments the engine type and of course for this one we'll be using the recommended one and we can also automatically scale to zero and once all of those things are figured out we can simply click deploy now let's take a look at the plug-in Marketplace section of the OnDemand platform the plug-in Marketplace is a powerful feature that allows you to extend the capabilities of your AI applications with a wide range of pre-existing plugins let's explore how you can actually make the most of this feature the plug-in Marketplace actually offers over a 100 pre-existing plugins that you can browse and integrate into your generative AI application these plugins cover a variety of different categories and use cases making it easy to find the tools that you need you can see here that you can browse the plugins by top plugins you can also education see that you can browse them by programming plugins and just any topic that you really wanted to discover there are also different plug-in types you can choose between chat plugins file plugins and knowledge spage plugin these filters make it easier to narrow down the list to the most relevant plugins for your needs if you wish for a custom solution you can create your own plugin click create plugin in the top right hand corner and then fill out the details for example to create a rest API plugin give your plugin a descriptive name add an icon for easy identification provide a description of what the plug-in does and choose a category of what is appropriate for your plug-in you can configure the

### Creating custom plugins [4:55]

plug-in by specifying the key name and key type and for the open a schema writing the code for the plugin following the openi schema once this is all configured you can then click create plugin after you publish your plugin you can then publish it to the marketplace this is where it will be reviewed by Ona's team of developers to ensure it meets the criteria for Marketplace inclusion and once it's approved your plug-in will be available for others to use if you wish to create a different type of plugin when you're creating your plugins you can choose a simple knowledge based plugin this is a plugin that will simply be allowing you to access a lot more data you can see right here you can upload different files and do the same things that we just did previously now if you want to manage your plugins just come over to this right here then click the my plugin section and you can now see what type of plugins you actually have this section allows you to see all the plugins you're subscribed to and those you have created you can manage your subscriptions and publish or update your plugins in this section welcome to the servers

### Serverless Applications section [5:48]

application section of the on demand platform this feature allows you to deploy and manage applications without the need to maintain your own server infrastructure here's how you can get started so serverless applications allow you to run your applications in the cloud without managing server infrastructure this ensures your applications are always available scalable and free from the risk of downtime with Associated local servers let's look at creating a serverless repository to start click on create repository then you're going to need to fill out the following details repository name repository platform repository visibility and repository URL once the repository is created you can now configure your serverless application click on the configurations tab in the left hand side then all we need to do now is click on create configuration and fill out the form here in the serverless configuration tab this is where you'll need to fill out your application name select the repository the branch name and the docker script path now configuring the endpoint is actually relatively easy too after configuring the application you'll just need to set up the endpoints once again click create endpoint then of course all you need to do is fill out these easy

### Cloud Services section [6:48]

details all you'll need to do is just fill them out and then click deploy welcome to the cloud section Services of the on demand platform cloud services provide essential functionalities that enhance the capabilities of your applications let's explore the available cloud services and how you can leverage them cloud services are integral components that offer Advanced capabilities such as text to speech and speech detection these services are designed to be easily integrated into your applications providing robust and scalable Solutions without the need for complex infrastructure as you can see we currently have text to speech this text to speecher service converts written text into natural sounding speech this is useful for applications that require audio output such as virtual assistance accessibility tools and interactive voice response system you can also enable this and for the speech to text service this is ideal for applications involving voice commands transcription services and voice activated controls now let's go ahead and take a look at the agent Builder this is something that isn't yet available but it currently will be in the coming week this feature is designed to help you create customized AI agents by combining various plugins and inference models let's explore what you

### Agent Builder (upcoming feature) [7:51]

can expect from this upcoming feature the agent Builder will essentially allow you to create tailored AI experts by integrating multiple plugins and different inference models you can see here on the right hand side we've got the aviation search plugin news plugin and we've got the aviation live tracker plugin when we combine those with an inference model we can get a super AI agent that can do many different tasks you can tail your AI agents behavior and responses to suit specific requirements and this allows you to automate complex workflows saving time and resources the agent Builder will continue to evolve with new features and improvements being added based on user feedback and other advancements and by leveraging the upcoming agent build a feature you can deploy powerful AI agents tailored to your specific needs now let's take a look at automations which are also coming soon this feature is designed to streamline and automate various tasks making your workflows more efficient and productive let's dive into what you can expect from this coming feature automations essentially enable you to set up tasks that can be performed automatically based on predefined triggers and actions this feature helps

### Automations (upcoming feature) [8:52]

in automating repetitive tasks reducing manual intervention and improving overall efficiency you're going to be able to create automation workflows by defining specific triggers and corresponding action triggers include events such as receiving new data reaching a specific time or changes in certain conditions actions are the tasks that the system will perform in response to the triggers such as sending notifications updating databases or executing scripts right here on the right hand side we've got an example automation workflow imagine you want to stay up toate with the latest cryptocurrency news you can set up an automation to fetch the latest crypto news every hour once the news is fetched it can be analyzed by a financial analyst agent based on the analysis the automation can then place the trades on your Finance trading platform keeping you informed and proactive in your Investments now let's take a look at the

### Playground section [9:38]

playground section of the on demand platform the playground is where you can build test and experiment with your generative AI applications let's dive into the features and capabilities of this powerful tool the playground is designed to be an interactive environment where you can develop and test your AI applications it provides a space to experiment with different plugins models and configurations to create sophisticated AI Solutions start by importing your plugins that you have subscribed to from the plug-in Marketplace so when you subscribe to plugins in the plug-in Marketplace all you need to do now is Click add right here then you'll just need to add these plugins to your chat conversation just click add and you can see I've now got the flight detail plugin added which searches for one-way flights using Skyscanner offering details like departure location and destination information once that's there I can now use this to test my application in real time so let's walk through an example scenario to demonstrate the playground's capability so for example let's say we wanted to create a travel assistant application that finds flights checks visa requirements and suggest activities at the destination in the playground we would need to select the relevant plugins such as the flight details plugins and of course we would need to configure the model we would need to get whichever model we wanted to use like GPT 4 Turbo now we would just need to test the application by inputting a query such as with your model you can see that you can choose any of the models that are currently available if you do want a model that isn't currently here you can always bring this in with the by bring your own model section where you can add any model from GitHub and then use it in this application the playground so I'm just going to stick with GPT 40 now for testing and debugging you can enable debug mode to see the multi-step processes in action and troubleshoot any issues this helps you ensure that your application functions correctly and efficiently before any deployment if you want to test and save certain presets don't forget to save your presets for easy access and reuse so for example right here what I can do is I can click save preset but of course I need to put in a name as you can see all you need to do now is put in a name and then of course click save presets you can see that the preset was created successfully so

### Example scenario in Playground [11:44]

easily what I can do is I can go ahead select a preset which is preset flights and then I can easily test anything I want to within the playground without having to load everything once again so let's walk through an example scenario to demonstrate the playgrounds capabilities let's say we wanted to create a travel assistant that finds flights checks visa requirements and toest so let's say we wanted to create a travel assistant application that finds flights checks visa requirements and suggests activities at the destination in the playground area select the relevant plugins such as the flights detail and of course ensure you have the right language model like GPT 4 Turbo what we can do now is test the application by inputting a query so I've said find flights from New York to Tokyo check of a US passport needs a Visa and suggest activities from Narita Airport so we're going to click run now and you can see it's now interacting retrieving the relevant plugins and it's going to give me exactly what I need currently you can see it's finding the flights from New York to Tokyo you can also see the direct flights it also checks the visa requirements for US Passport holders and it actually gives me all the activities near Narita Airport once your application is built and tested you can now integrate this into your system all you need to do is to click this button right here click get code to generate the necessary code for your programming language for example if we needed JavaScript all we would type in is Java and then we would click get code you can now see here this application is working to get us the code and the code has been generated successfully all we would now need to do is to implement the code in our system configure the API key and our generative AI application is ready to use the benefits of the playground are absolutely outstanding this allows you to experiment with different configurations and setups to find the best solution for your needs this also allows you to gain immediate feedback on how your application performs allowing for quick adjustments and improvements by leveraging the on demand playground you can create test and refine powerful gen AI applications tailored to your specific requirements ensuring Optimal Performance and functionality welcome to

### Storage Management section [13:42]

the storage management section of the ond demand platform this feature allows you to efficiently manage your documents videos and images ensuring that your resources are organized and accessible let's explore how you can utilize this feature the storage management helps you keep track of all of your uploaded files providing a comprehensive overview of your storage usage this feature ensures that you can easily locate organize and manage your resources you can sort them by date sort them by descending and of course you can view all your files here this is where we have the usage tab this feature allows you to Monitor and analyze your usage across various resources helping you to optimize your operations and manage cost effectively this provides detailed insight into your consumption of different resources on the on demand platform this helps you understand your usage patterns manage costs and make some forms decisions about the resource allocation this dashboard displays key metrics such as the total number of API calls storage use and model inference time if we switch over to the cost tab you can see this allows you to monitor how often each large language model is used this cost breakdown includes expenses related to API calls storage model inferences and other services now this is the API Keys management section of the on demand platform this feature allows you to create manage and secure API Keys which are essential for integrating on demand capabilities into your applications Now API keys ke are crucial for authenticating and authorizing requests made to the on demand platform for your

### API Key Management section [15:04]

applications proper management of these Keys ensures secure and efficient access to the platforms resources and services to create a new API key navigate to the API Keys management section and click create new key provide a new name for your API key to easily identify its purpose or the application it might be used for once your name is there just click create secret key you can now see it says success your API key is created now remember you're going to need to copy and P bces down because you're not going to be able to view it again for security reason now in this dashboard you can view and manage all your existing API keys from this API Key Management dashboard each key will be listed with details such as the name and the small details of the key here's where you can revoke keys that are no longer needed and have been compromised to maintain the security of your platform access now hopefully this video allows you to navigate and utilize the on demand platform from everything to managing data sets leveraging cloud services building and deploying sess applications to creating custom plugins and automation by following this guide you should have a clear understanding of how to make the most of on demand's powerful features hopefully you enjoyed

### Conclusion [16:04]

the video and I'll see you in the next one