niansa/libjustlm
1
0
Fork 0
mirror of https://gitlab.com/niansa/libjustlm.git synced 2025-03-06 20:49:17 +01:00
Code Releases Activity

Add README.md

Browse source
This commit is contained in:
niansa 2023-04-28 16:16:41 +00:00
parent 9d8c7e0f67
commit 5b5156245d
1 changed files with 16 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

16
README.md Normal file
View file

@ -0,0 +1,16 @@
# JustLM
Super easy to use library for doing LLaMA/GPT-J stuff!
## Overview
This library implements an easy to use interface to both LLaMa and GPT-J, with optional Python bindings.
Context scrolling is automatic and supports a top window bar.
Additionally, "pooling" is implemented to support keeping `x` inference instances in RAM and automatically moving least recently used ones to disk, ready for retrieval.
## Documentation
Literally, just read the 2 header files in `include/`! The interface couldn't be simpler.
## Credits
Thanks to *Georgi Gerganov (ggerganov)* for having written `ggml` and `llama.cpp` C libraries, which are both extremely important parts of this project!
Also thanks to *Nomic AI* for having heavily helped me drive this project forward.