1
0
Fork 0
mirror of https://gitlab.com/niansa/libjustlm.git synced 2025-03-06 20:49:17 +01:00
Commit graph

93 commits

Author SHA1 Message Date
5b01daa764 Properly implemented MPT 2023-05-15 14:46:19 +02:00
6d2910b7b9 Initial MPT support (buggy) 2023-05-15 12:55:49 +02:00
f3a9092ca5 Moved gptj/utils.* to g4a-common.* 2023-05-15 09:44:04 +02:00
36a6fa6290 Warn about use of exceptions with cosched properly 2023-05-15 09:40:41 +02:00
81c8f39732 Added missing LM_COTHROW define 2023-05-15 09:38:49 +02:00
niansa
59a6a8b1d1 Check for errors during llama evaluation properly 2023-05-11 18:46:41 +02:00
niansa
087fe1396b Fixed all other known compilation issues 2023-05-10 21:50:37 +02:00
niansa
b61c751d33 Reverted last commit. but fixed invalid ssize_t typedef on msvc 2023-05-10 16:39:44 +02:00
niansa
bdb87534e8 Eliminate use of ssize_t 2023-05-10 16:37:43 +02:00
niansa
0f8ef2fd32 Removed if_error because it wasn't needed 2023-05-10 12:18:42 +02:00
niansa
c9d261701d (Hopefully) fixed msvc compilation 2023-05-10 12:14:49 +02:00
niansa
5c0e7c64c1 Fixed cmake force option 2023-05-09 22:35:44 +02:00
niansa
b8b7766d1b Removed function that isn't needed anymore 2023-05-09 22:29:38 +02:00
niansa
6968f3459a Made last commit more beautiful 2023-05-09 22:25:04 +02:00
niansa
a43c5e64ce Fixed compilation error with exceptions enabled 2023-05-09 22:23:34 +02:00
niansa
5e666d83db Actually implemented error return values 2023-05-09 22:20:01 +02:00
niansa
0d5cba0530 Added LM_NOEXCEPT cmake option 2023-05-09 21:33:49 +02:00
niansa
05fa44e1e0 Removed some assertions in GPT-J 2023-05-07 12:43:23 +02:00
niansa
e4832f1077 Added GPT-J serialization/deserialization 2023-05-07 12:02:04 +02:00
niansa
ca33a27e05 Fixed a warning 2023-05-06 01:14:24 +02:00
niansa
7076f863d4 Check for task termination 2023-05-05 19:02:28 +02:00
96076d4e9b Updated for latest cosched 2023-05-05 10:35:41 +02:00
niansa
9bda8106b9 Added missing co_await 2023-05-05 00:28:04 +02:00
niansa
8984e66067 Improved cache variable descriptions 2023-05-04 19:48:30 +02:00
58b3a278d8 Don't use weak pointers 2023-05-04 15:53:19 +02:00
niansa
7f20f8b609 Revert "Fidxed InferencePool::get_inference returning trash"
This reverts commit e2acff3540
2023-05-04 13:45:48 +00:00
e2acff3540 Fidxed InferencePool::get_inference returning trash 2023-05-04 15:37:24 +02:00
5a57db5e75 Added CoSched support 2023-05-04 15:22:32 +02:00
niansa
57364ae560 Use conversion to time_t to improve cross-platform compatibility 2023-04-30 00:33:00 +02:00
niansa
5e5fc4a25f Fixed InferencePool::cleanup() deleting newer files 2023-04-30 00:29:24 +02:00
niansa
d87a6ffc08 In InferencePool::cleanup, check filename 2023-04-29 23:56:47 +02:00
niansa
3c62cbebaf Inlined InferencePool constructor and added addional cleanup functions 2023-04-29 23:43:45 +02:00
niansa
06984bf36c Add gptj implementation license. 2023-04-28 16:17:35 +00:00
niansa
5b5156245d Add README.md 2023-04-28 16:16:41 +00:00
niansa
9d8c7e0f67 Add LICENSE 2023-04-28 16:08:19 +00:00
niansa
d236e36d26 Implemented proper scrolling 2023-04-28 18:04:07 +02:00
4f03b75560 Fixed uninitialized mem_per_token 2023-04-27 13:34:30 +02:00
17f30e0761 Removed uninitialized GPTJInference::State::n_ctx 2023-04-27 10:41:56 +02:00
e640f093df Removed context size exception 2023-04-27 10:04:03 +02:00
c6b1f2bc2b Implemented context window scrolling 2023-04-27 09:57:28 +02:00
493186509a Renamed function and updated Python bindings 2023-04-27 09:48:44 +02:00
94e4ca5874 Set default context size limit 2023-04-27 09:47:23 +02:00
ca4ad5f096 Added context window scrolling with top bar 2023-04-27 09:45:37 +02:00
219186f4b6 Take const string reference instead of string view in append() 2023-04-27 09:31:22 +02:00
4e74517bb5 Changed parameter types to some that make more sense 2023-04-27 09:27:09 +02:00
ea5c5fe7f4 Minor fixes 2023-04-27 09:00:21 +02:00
niansa
bfcda5a3bf Merge branch 'devel' into 'master'
Devel

See merge request niansa/libjustlm!1
2023-04-27 06:23:45 +00:00
7aca184dba Updated llama.cpp 2023-04-27 08:22:51 +02:00
0661b2e33d Updated for latest llama.cpp and working gpt-j implementation 2023-04-27 08:21:02 +02:00
566f8227fd Should be functional now 2023-04-27 08:00:08 +02:00