niansa/libjustlm
1
0
Fork 0
mirror of https://gitlab.com/niansa/libjustlm.git synced 2025-03-06 20:49:17 +01:00
Code Releases Activity

Set default context size limit

Browse source
This commit is contained in:
niansa/tuxifan 2023-04-27 09:47:23 +02:00
parent ca4ad5f096
commit 94e4ca5874
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
include/justlm.hpp
View file

@ -30,7 +30,7 @@ public:
struct Params {
int seed = 0; // RNG seed
unsigned n_threads = 0;
unsigned n_ctx; // Context size
unsigned n_ctx = 2012; // Context size
unsigned n_ctx_window_top_bar = 0; // Top bar of visible context. Must be smaller than context size
unsigned n_batch = 8; // Batch size
unsigned n_repeat_last = 0; // llama.cpp specific