Re: LLM Local Documents ?

[jeremy ardley <jeremy.ardley@gmail.com>]

On 25/6/24 13:59, Jeff Peng wrote:
> does gtp4all have a shell only interface? my debian is remote server, 
> has no desktop. 


GPT4ALl hosts a webservice on localhost - 127.0.0.1

There are many ways to access that including using haproxy or running a 
web browser on the server using X tunneling.

But your big problem will be speed. All LLMS require a modern graphics 
card / GPU to get acceptable speed. Something like an nVidia 3060 with 
12G video RAM or better.

If your server is headless you won't have that compute available and 
results will be very ordinary.