niansa/libjustlm
1
0
Fork 0
mirror of https://gitlab.com/niansa/libjustlm.git synced 2025-03-06 20:49:17 +01:00
Code Releases Activity
152 commits 1 branch 6 tags 544 KiB
Commit graph

152 commits

This branch
This branch
All branches
Author SHA1 Message Date
niansa
abbb35c6a9 Minor improvements on EOS handling 2023-05-17 10:51:20 +02:00
niansa
8e7e310757 Only look up im_end once 2023-05-17 10:17:51 +02:00
niansa
f5cf0ecff2 MPT works now! 2023-05-17 09:33:16 +02:00
niansa
4ec47699f0 Repeat penalty fixes 2023-05-17 08:44:25 +02:00
niansa
a77d25d01d Declare MPT as non-functional in readme 2023-05-16 22:53:29 +00:00
niansa
ddd130b2d9 Updated MPT implementation 2023-05-16 23:49:43 +02:00
niansa
a98784aa53 Minor MPT improvements 2023-05-16 23:35:42 +02:00
niansa
4c4ef9e441 Merge branch 'sharedobjects' into 'master' 
Load implemenations as shared objects

Shouldn't change the API at all!

See merge request niansa/libjustlm!3
 2023-05-16 19:10:06 +00:00
niansa
60fe6b9c55 Load implemenations as shared objects 2023-05-16 19:10:05 +00:00
niansa
5b01daa764 Properly implemented MPT 2023-05-15 14:46:19 +02:00
niansa
6d2910b7b9 Initial MPT support (buggy) 2023-05-15 12:55:49 +02:00
niansa
f3a9092ca5 Moved gptj/utils.* to g4a-common.* 2023-05-15 09:44:04 +02:00
niansa
36a6fa6290 Warn about use of exceptions with cosched properly 2023-05-15 09:40:41 +02:00
niansa
81c8f39732 Added missing LM_COTHROW define 2023-05-15 09:38:49 +02:00
niansa
59a6a8b1d1 Check for errors during llama evaluation properly 2023-05-11 18:46:41 +02:00
niansa
087fe1396b Fixed all other known compilation issues 2023-05-10 21:50:37 +02:00
niansa
b61c751d33 Reverted last commit. but fixed invalid ssize_t typedef on msvc 2023-05-10 16:39:44 +02:00
niansa
bdb87534e8 Eliminate use of ssize_t 2023-05-10 16:37:43 +02:00
niansa
0f8ef2fd32 Removed if_error because it wasn't needed 2023-05-10 12:18:42 +02:00
niansa
c9d261701d (Hopefully) fixed msvc compilation 2023-05-10 12:14:49 +02:00
niansa
5c0e7c64c1 Fixed cmake force option 2023-05-09 22:35:44 +02:00
niansa
b8b7766d1b Removed function that isn't needed anymore 2023-05-09 22:29:38 +02:00
niansa
6968f3459a Made last commit more beautiful 2023-05-09 22:25:04 +02:00
niansa
a43c5e64ce Fixed compilation error with exceptions enabled 2023-05-09 22:23:34 +02:00
niansa
5e666d83db Actually implemented error return values 2023-05-09 22:20:01 +02:00
niansa
0d5cba0530 Added LM_NOEXCEPT cmake option 2023-05-09 21:33:49 +02:00
niansa
05fa44e1e0 Removed some assertions in GPT-J 2023-05-07 12:43:23 +02:00
niansa
e4832f1077 Added GPT-J serialization/deserialization 2023-05-07 12:02:04 +02:00
niansa
ca33a27e05 Fixed a warning 2023-05-06 01:14:24 +02:00
niansa
7076f863d4 Check for task termination 2023-05-05 19:02:28 +02:00
niansa
96076d4e9b Updated for latest cosched 2023-05-05 10:35:41 +02:00
niansa
9bda8106b9 Added missing co_await 2023-05-05 00:28:04 +02:00
niansa
8984e66067 Improved cache variable descriptions 2023-05-04 19:48:30 +02:00
niansa
58b3a278d8 Don't use weak pointers 2023-05-04 15:53:19 +02:00
niansa
7f20f8b609 Revert "Fidxed InferencePool::get_inference returning trash" 
This reverts commit e2acff3540
 2023-05-04 13:45:48 +00:00
niansa
e2acff3540 Fidxed InferencePool::get_inference returning trash 2023-05-04 15:37:24 +02:00
niansa
5a57db5e75 Added CoSched support 2023-05-04 15:22:32 +02:00
niansa
57364ae560 Use conversion to time_t to improve cross-platform compatibility 2023-04-30 00:33:00 +02:00
niansa
5e5fc4a25f Fixed InferencePool::cleanup() deleting newer files 2023-04-30 00:29:24 +02:00
niansa
d87a6ffc08 In InferencePool::cleanup, check filename 2023-04-29 23:56:47 +02:00
niansa
3c62cbebaf Inlined InferencePool constructor and added addional cleanup functions 2023-04-29 23:43:45 +02:00
niansa
06984bf36c Add gptj implementation license. 2023-04-28 16:17:35 +00:00
niansa
5b5156245d Add README.md 2023-04-28 16:16:41 +00:00
niansa
9d8c7e0f67 Add LICENSE 2023-04-28 16:08:19 +00:00
niansa
d236e36d26 Implemented proper scrolling 2023-04-28 18:04:07 +02:00
niansa
4f03b75560 Fixed uninitialized mem_per_token 2023-04-27 13:34:30 +02:00
niansa
17f30e0761 Removed uninitialized GPTJInference::State::n_ctx 2023-04-27 10:41:56 +02:00
niansa
e640f093df Removed context size exception 2023-04-27 10:04:03 +02:00
niansa
c6b1f2bc2b Implemented context window scrolling 2023-04-27 09:57:28 +02:00
niansa
493186509a Renamed function and updated Python bindings 2023-04-27 09:48:44 +02:00