Eine potentiell spannende Option liefert KNIME.

https://hub.knime.com/mlauber71/spaces/LLM_Space/GPT4All%20-%20Create%20your%20own%20LLM%20Vector%20Store~RgLTaML-8RjQVBfi/current-state