Installation Guide

[Darquedante]

I have not been able to successfully install/compile.

[parsehex]

Hey, sorry for the late response! I noticed that some past changes broke the build script so I fixed that and uploaded a build to the releases page. I put together a getting started guide that links to a page with info on models I've used with the app.

If you're still interested in building from source (option to use prebuilt binaries from llama.cpp, etc. - which is what I did for the build), I've also written a page on building for nvidia that I'm hoping is more accurate.