Any one try NVidia RTX AI yet?

[MarkShot]

I have it downloaded, but haven't installed yet.

This is an AI tool for 30 & 40 series cards that does RAG (Retrieval Augmented Generation). In RAG, documents such as PDF file are chunked into semantic embeddings via LangChain and a VectorDB. This technology was pre-NLP/LLMs, but, of course, LLMs improves the quality of search and returned responses using an open source/local LLM.

I think Mistral 7B is bundled with this.

So, imagine while playing be able to ask, "It will be raining heavy next month, tell me the top 10 considerations of how the rain will impact my campaign?" You can load the manual, the living doc, and even the forums(they can be fed in a printed PDFs). Further, it has the potential to work with YouTube videos.

I also see this being useful for Paradox titles which depend on WiKis.

The docs say you need Win11, but the blog says 10 or 11.

I am thinking this is attractive for older gamers like myself who have trouble keeping all the details in my head. I have a 4090 driving a 1080p display. This leaves a great deal of GPU and VRAM free for the AI component. A game like this with Windows is not going to use more than 1.5Gb of VRAM and the AI portion probably does not need more than 8Gb on a 24Gb card.

Well, I was curious if anyone has given this a try? A common application for businesses either RAG or CHAT-WITH-DOCS. There are like 100 commercial ventures doing this, but only 2 free GitHub versions (one is LINUX which doesn't fit the profile of most gamers).

Thanks.