• NVIDIA released a demo version of a chatbot that runs locally on your PC, giving it access to your files and documents.
• The chatbot, called Chat with RTX, can answer queries and create summaries based on personal data fed into it.
• It supports various file formats and can integrate YouTube videos for contextual queries, making it useful for data research and analysis.
Shame they leave GTX owners out in the cold again.
2xxx too. It’s only available for 3xxx and up.
The whole point of the project was to use the Tensor cores. There are a ton of other implementations for regular GPU acceleration.
Just use Ollama with Ollama WebUI