NVIDIA has just released a of a chatbot which This is quite interesting because it allows the chatbot to access your files and documents. You can feed Chat with RTX a selection of personal data and ask it to create summaries based on this information. You can also ask it questions, like any chatbot, and it will dig through your data to find answers.
The company says it allows users to “quickly and easily connect local files on a PC as a dataset to a large open source language model like Mistral or Llama 2.” NVIDIA gives the example of a user asking the chatbot about a restaurant recommended by their partner in Las Vegas. The software analyzes local files to find the answer. It supports many file formats, including .txt, .pdf, .doc/.docx, and .xml. The company says it will load relevant files into its dataset “in seconds”.
Chat with RTX also integrates YouTube videos and playlists. You can add a video URL into the dataset and it will incorporate the knowledge in the clip for contextual queries. NVIDIA says this will be useful for requesting travel recommendations “based on video content from favorite influencers” or for finding tutorials and summaries derived from educational resources.
The edge with the chatbot and came away impressed, writing that they could see it as “a valuable part of data mining for journalists or anyone needing to analyze a collection of documents.”
This feels like a big step towards something resembling a real digital assistant that works within the contextual framework of your personal data. With most chatbots, data is sent to the cloud, but Chat with RTX “allows users to process sensitive data on a local PC without needing to share it with a third party or have an Internet connection.” So it's safer And more aware of the context.
There are certain limitations. This is a demo product, so you should expect a lot of bugs, although NVIDIA should start squashing them once users start issuing error reports etc. There are also strict hardware limitations here. Chat with RTX only works on Windows PCs with NVIDIA GeForce RTX 30 series GPUs or better and at least 8 GB of VRAM.
NVIDIA has really been showing off its AI prowess lately, as the company just launched its next generation of . It is mainly due to the company's AI and data center segments.
This post contains affiliate links; If you click on such a link and make a purchase, we may earn a commission.