Matrix Games Forums

In another thread here, I have been playing with RAG/AI: To build an AI Expert gaming assistant.

https://www.matrixgames.com/forums/view ... 6&t=404230

But I just realized something else which could easily done with RAG. Suppose you wanted to speak to Generaloberst Franz Halder. You take everything which he ever said directly (or from third party sources and feed it into RAG).

Your SYSTEM PROMPT:

You are Generaloberst Franz Halder. You have Halder's personality. You have Halder's memories. You have Halder's temperament.

The date is 06/24/1942.

The user who addresses you is Generalfeldmarschall Günther Adolf Ferdinand von Kluge. You will address his questions and issue orders concerning the Ostfront as is fitting the relationship between Halder and Kluge.

PS: If you are really interested in role playing your command, you will need to find what is called an "uncensored" LLM for your PC. As it must be able to present itself as a N*Z* and espouse N*Z* thought and appropriate contempt for the Red Army enemy untermensch.

Excellent idea!

I would add Guderian, that Stalins villain.... Sometimes Bock sided with him or Kluge when he dashed across Berezina.

With AI I imagine you could have a conversation with Hitler or Rommel if you wanted to. Even Chairman Mao, Churchill, or Stalin for that matter. With AI you could probably put them all in the same room. Wow what an interesting conversation that would be.

For RAG, I am using OLLAMA as my AI runtime:

https://ollama.com

However, for ability to tune the runtime, and as an excellent front end for chat, I recommend Oobabooga:

https://github.com/oobabooga/text-generation-webui

But to facilitate multi-character realtime chat you want Silly Tavern. I am well aware of it, but I have not used it, but it is popular for this type of usage:

https://github.com/SillyTavern/SillyTavern

However, you really want RAG behind your characters, like the German General Staff. Why? Because if you just use an AI/LLM, you are only getting the general training about these persons which will be limited. However, if you are able to do RAG, then you can load in memoirs and books (assuming they already scanned and beyond copyright). Your characters will be much richer.

PS1: You may ask why all these software names are unprofessional? That is because this is all open source software. I am retired. One position I had held was a SVP of a major US bank in charge of data warehousing. I was asked, by a board member what's the name of the new subsystem. I said "SUCS". ... "You got to be kidding." I said no, "Spreadsheet Upload Collection System". I was told to change it. Corporations have no sense of humor.

PS2: Every link I have provided is open source software (meaning you have access to the code and could modify it if you wish, and it is is free to use).