163 commits

Author	SHA1	Message	Date
niansa	f0e55ee3c6	Added context size config key	2023-04-23 22:40:55 +02:00
niansa	06b815db08	Don't regenerate init_cache each time	2023-04-23 20:43:23 +02:00
niansa	cd2b7183a8	Fixed compile error	2023-04-23 20:34:57 +02:00
niansa	fba02eca47	Stop ignoring EOS and reenabled init cache	2023-04-23 20:33:31 +02:00
niansa	0ac2c63aca	Temporarily removed init cache	2023-04-23 20:09:28 +02:00
niansa	2a9a147f12	Ignore all EOS	2023-04-23 18:40:46 +02:00
niansa	af96377a6c	Only init translator if really needed	2023-04-23 16:11:57 +02:00
niansa	024d7a06ce	Fixed memory leak during translation	2023-04-23 16:08:34 +02:00
niansa	5391dec731	Added persistance config key	2023-04-23 15:37:53 +02:00
niansa	9b626a049a	Implemented inference pooling	2023-04-23 15:32:20 +02:00
niansa	18de66f8ab	Made age unknown!	2023-04-23 10:50:03 +02:00
niansa	96baf6d0f0	Remove all leading spaces	2023-04-23 02:05:59 +02:00
niansa	ee9eaa29d1	Use config file instead	2023-04-23 02:02:17 +02:00
niansa	6364f49d4a	Minor cleanup	2023-04-22 23:59:06 +02:00
niansa	870b145d2e	Increased temperatuer a bit again	2023-04-20 20:29:20 +02:00
niansa	e819cf1cbe	Reverted last commit	2023-04-20 20:07:03 +02:00
niansa	76acb5fb98	Use all tokens for repeat penalty	2023-04-20 19:41:52 +02:00
niansa	ad2d79b3b4	Decreased temperature significantly	2023-04-20 09:05:01 +00:00
niansa	8b5883a445	Fixed compile error	2023-04-19 22:38:09 +02:00
niansa	21dbc073a9	Remove need for restarting	2023-04-19 21:10:59 +02:00
niansa	0eaab135a1	Fixed behavior after timeout	2023-04-19 09:36:10 +02:00
niansa	e395dbe3b4	Use 13B for translation	2023-04-18 19:17:54 +02:00
niansa	a7d29ccb6d	Changed parameters (to the better?)	2023-04-18 17:49:58 +02:00
niansa	baa488faae	Attempt to replace all mentions	2023-04-18 17:29:50 +02:00
niansa	a22254add6	Updated anyproc and increased temperature	2023-04-18 17:22:27 +02:00
niansa	1c842b62ad	Maxed context size	2023-04-18 00:40:51 +02:00
niansa	1d920a151a	Initialize llm to nullptr	2023-04-18 00:18:17 +02:00
niansa	c51522601d	Do not reinitialize translator EVER	2023-04-18 00:14:50 +02:00
niansa	857d257b91	Removed "german" reference	2023-04-17 22:12:01 +02:00
niansa	8c44ce1334	Use 13B for inference	2023-04-17 19:12:04 +02:00
niansa	6d7259e18f	Use better placeholder	2023-04-17 19:02:38 +02:00
niansa	7f9a32b52a	Append unrelated messages to history	2023-04-17 00:31:11 +02:00
niansa	e4b3dba517	Updated argc check	2023-04-17 00:11:43 +02:00
niansa	71e01f4d1a	Minor improvements	2023-04-17 00:09:40 +02:00
niansa	5f92f21e8a	Translate everything using anyproc	2023-04-16 23:59:59 +02:00
niansa	5b0faba244	Doubled context size again	2023-04-16 17:05:27 +02:00
niansa	b0ebf0d843	Decreased context size	2023-04-16 03:47:44 +02:00
niansa	ba0d17bef1	Fixed prompt and enabled mlock	2023-04-03 10:05:45 +02:00
niansa	48bcb29654	Fixed typo in prompt	2023-04-02 20:52:41 +02:00
niansa	7a420cecb6	Extended prompt and incresed temperature further	2023-04-02 20:50:41 +02:00
niansa	892974c757	Changed prompt to deny NSFW topics	2023-04-02 20:30:12 +02:00
niansa	6455ad2956	Decreased temperature even further	2023-04-02 16:28:44 +02:00
niansa	ee11cff7e6	Decreased temperature	2023-04-02 16:12:39 +02:00
niansa	5437c9874e	Made the few-shot prompt shorter	2023-04-01 21:28:46 +02:00
niansa	e80d6446d1	Oops, too much temperature	2023-04-01 18:42:56 +02:00
niansa	07e0c4d80a	Use 13B model	2023-04-01 18:33:39 +02:00
niansa	ee2fee2a1b	Increased temperature	2023-04-01 18:33:10 +02:00
niansa	6e7fffc5a1	Improved few-shot prompt	2023-04-01 18:32:32 +02:00
niansa	e179f1ae50	Ignore messages during startup	2023-04-01 18:26:48 +02:00
niansa	4921be8793	Added few-shot prompt	2023-04-01 18:22:46 +02:00