So yeah, this is a proof of concept for entirely offline evaluation using free (as in freedom) gpt4all and its models. The plugin itself is a slightly changed ChatGPT.nvim.
Slight inconveniences:
- Your CPU at 100C
- One completion takes 30 seconds to 10 minutes depending on the model and the hardware
(the gif is a lie, in reality it took 1.5 minutes for me)
But it was fun.