NVIDIA just released a free new chatbot that runs locally on Windows PCs. You need a GeForce RTX 30 Series GPU or higher and at least 8GB of VRAM to use the bot.

• NVIDIA released a demo version of a chatbot that runs locally on your PC, giving it access to your files and documents.

• The chatbot, called Chat with RTX, can answer queries and create summaries based on personal data fed into it.

• It supports various file formats and can integrate YouTube videos for contextual queries, making it useful for data research and analysis.

  • ScottEnglish
    9•5 months ago

    The performance on my 3070 was awful, tools like LM Studio work significantly better.

    • @anlumo@lemmy.worldEnglish
      4•5 months ago

      On my 4090, the performance is much better than ChatGPT4. The output is way worse though.

      • ScottEnglish
        1•5 months ago

        Yeah my boss did a screen share with me and it was done instantly, while mine was needing to recompile the embeddings for the 5th time