203 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
niansa	bf568c3c8a	Added tons of features including thread creation	2023-04-25 15:55:46 +02:00
niansa	a0edf72a43	Send placeholder message from main thread	2023-04-25 10:50:34 +02:00
niansa	b157224911	Removed built-in prompt	2023-04-24 23:28:22 +02:00
niansa	b169276443	Fixed missing line break after bots message	2023-04-24 23:16:49 +02:00
niansa	1f4ffb29e5	Clean up after missing init_cache	2023-04-24 23:01:13 +02:00
niansa	561a4ff40a	abort() on prompt file read failure	2023-04-24 22:51:57 +02:00
niansa	445e08ef5e	Added example prompt file	2023-04-24 22:36:42 +02:00
niansa	7edc933990	Added prompt_file to example config	2023-04-24 22:24:06 +02:00
niansa	3eebfcc961	Added fmt	2023-04-24 22:19:45 +02:00
niansa	f0e55ee3c6	Added context size config key	2023-04-23 22:40:55 +02:00
niansa	06b815db08	Don't regenerate init_cache each time	2023-04-23 20:43:23 +02:00
niansa	cd2b7183a8	Fixed compile error	2023-04-23 20:34:57 +02:00
niansa	fba02eca47	Stop ignoring EOS and reenabled init cache	2023-04-23 20:33:31 +02:00
niansa	0ac2c63aca	Temporarily removed init cache	2023-04-23 20:09:28 +02:00
niansa	67d605d15e	Updated anyproc	2023-04-23 19:35:17 +02:00
niansa	bb09e7a0d5	Updated anyproc	2023-04-23 18:44:04 +02:00
niansa	2a9a147f12	Ignore all EOS	2023-04-23 18:40:46 +02:00
niansa	57401321b0	Updated anyproc	2023-04-23 18:08:07 +02:00
niansa	154543df49	Updated anyproc	2023-04-23 16:29:14 +02:00
niansa	af96377a6c	Only init translator if really needed	2023-04-23 16:11:57 +02:00
niansa	024d7a06ce	Fixed memory leak during translation	2023-04-23 16:08:34 +02:00
niansa	5391dec731	Added persistance config key	2023-04-23 15:37:53 +02:00
niansa	9b626a049a	Implemented inference pooling	2023-04-23 15:32:20 +02:00
niansa	18de66f8ab	Made age unknown!	2023-04-23 10:50:03 +02:00
niansa	6ef7bf27a5	Added mlock to example config	2023-04-23 02:10:26 +02:00
niansa	96baf6d0f0	Remove all leading spaces	2023-04-23 02:05:59 +02:00
niansa	ee9eaa29d1	Use config file instead	2023-04-23 02:02:17 +02:00
niansa	6364f49d4a	Minor cleanup	2023-04-22 23:59:06 +02:00
niansa	3716eb9db0	Removed slow from readme, performance issues have mostly been fixed	2023-04-22 21:41:41 +00:00
niansa	c9dc206a12	Updated anyproc	2023-04-22 15:37:22 +02:00
niansa	870b145d2e	Increased temperatuer a bit again	2023-04-20 20:29:20 +02:00
niansa	e819cf1cbe	Reverted last commit	2023-04-20 20:07:03 +02:00
niansa	76acb5fb98	Use all tokens for repeat penalty	2023-04-20 19:41:52 +02:00
niansa	a9b912b617	Updated anyproc	2023-04-20 19:28:25 +02:00
niansa	9b045c9239	Updated anyproc	2023-04-20 18:41:39 +02:00
niansa	ad2d79b3b4	Decreased temperature significantly	2023-04-20 09:05:01 +00:00
niansa	9fb93d75ae	Add LICENSE	2023-04-20 06:21:05 +00:00
niansa	89d23b442d	Add README.md	2023-04-20 06:18:08 +00:00
niansa	8b5883a445	Fixed compile error	2023-04-19 22:38:09 +02:00
niansa	21dbc073a9	Remove need for restarting	2023-04-19 21:10:59 +02:00
niansa	64f983a18e	Updated anyproc	2023-04-19 10:01:06 +02:00
niansa	0eaab135a1	Fixed behavior after timeout	2023-04-19 09:36:10 +02:00
niansa	e395dbe3b4	Use 13B for translation	2023-04-18 19:17:54 +02:00
niansa	4848ce3a77	Updated anyproc	2023-04-18 18:34:09 +02:00
niansa	a7d29ccb6d	Changed parameters (to the better?)	2023-04-18 17:49:58 +02:00
niansa	baa488faae	Attempt to replace all mentions	2023-04-18 17:29:50 +02:00
niansa	a22254add6	Updated anyproc and increased temperature	2023-04-18 17:22:27 +02:00
niansa	aa4a3df032	Updated anyproc	2023-04-18 01:22:25 +02:00
niansa	1c842b62ad	Maxed context size	2023-04-18 00:40:51 +02:00
niansa	1d920a151a	Initialize llm to nullptr	2023-04-18 00:18:17 +02:00