niansa/libjustlm
1
0
Fork 0
mirror of https://gitlab.com/niansa/libjustlm.git synced 2025-03-06 20:49:17 +01:00
Code Releases Activity

Commit graph

  • 449a25c360 Use option() in CMake master niansa 2024-03-25 01:19:05 +01:00
  • 90e54d66d0 Removed cosched support niansa 2024-03-25 01:18:37 +01:00
  • 1a04a0e6d9 Updated llama.cpp-mainline v1.4 niansa 2023-12-25 16:55:30 +01:00
  • ef5df1dc31 Updated llama.cpp-mainline v1.3 niansa 2023-11-09 12:51:53 +01:00
  • fc5e4f5aa1 Updated llama.cpp-mainline niansa 2023-10-04 22:13:48 +02:00
  • 215db6b9b7 Fully implemented grammar sampling niansa 2023-09-05 10:22:42 +02:00
  • f5314a0dde Added python bindings for grammar niansa 2023-09-05 09:27:45 +02:00
  • 79cf49faae Implemented grammar sampling and zero-temperature sampling niansa 2023-08-31 19:37:33 +02:00
  • 3a953ed13a Convert tokens to text correctly in llama niansa 2023-08-31 18:23:55 +02:00
  • 907cea7f9d Fixed exception if pre_tick is nullptr niansa 2023-08-31 18:07:42 +02:00
  • 7cd3899dd0 Check for correct magic value in llama niansa 2023-08-31 17:57:56 +02:00
  • cb683aa8fc Updated llama.cpp.cmake niansa 2023-08-31 17:00:50 +02:00
  • 5d818e31aa Call llama_backend_init()/llama_backend_free() niansa 2023-08-31 16:56:10 +02:00
  • e3d52c42b7 Updated llama-mainline and deleted old llama versions niansa 2023-08-31 16:52:38 +02:00
  • d8f4efb0c9 Cut off ending from run() result properly niansa 2023-06-25 01:20:56 +02:00
  • 08ff1e72e7 Update llama.cpp-mainline niansa 2023-06-25 01:18:57 +02:00
  • 01b0d059ed Added pre_tick niansa 2023-06-15 18:14:09 +02:00
  • bcacfc3d54 Minor CMake fixes v1.2 niansa 2023-06-10 02:04:50 +02:00
  • 0199db02b7 Added GPU support v1.1 niansa 2023-06-10 00:49:21 +02:00
  • e2f7da65e4 Fixed llama.cpp not generating symbols niansa 2023-06-10 00:38:38 +02:00
  • 94953cd174 Improve some error handling macros niansa 2023-06-09 23:53:01 +02:00
  • 24849804b6 Major CMake improvements niansa 2023-06-09 20:01:49 +02:00
  • b3bd78b350 Fixups in llama.cpp.cmake niansa 2023-06-09 19:43:29 +02:00
  • a03558ae89 Expose options niansa 2023-06-09 19:39:24 +02:00
  • 38b229dab5 Updated to latest functional llama version niansa 2023-06-09 18:43:00 +01:00
  • 09e59a9536 Fixed compile errors because of previous commit niansa 2023-05-31 20:22:18 +02:00
  • 0142db3f7c Renamed operator ""_MB -> operator ""_MiB niansa 2023-05-31 20:20:31 +02:00
  • 2d57ade1b8 add msvc support -polyfill unistd niansa 2023-05-31 19:56:40 +02:00
  • 4b19bc49a5 Fixed llama.cpp.cmake niansa 2023-05-26 13:44:26 +02:00
  • 53a4623aef Added mirostat support niansa 2023-05-26 00:43:07 +02:00
  • ad0b7e3c71 Updated llama.cpp-mainline niansa 2023-05-23 13:41:06 +02:00
  • 24ff52919f Renamed justlm_llama_old to justlm_llama_230511 niansa 2023-05-21 16:13:51 +02:00
  • fe850337df Pass context to llama_sample_repetition_penalty v1.0 niansa 2023-05-21 15:40:49 +02:00
  • e69157764b Fixed capitalization of justLM_LLAMA_OLD target niansa 2023-05-21 15:39:27 +02:00
  • 85eb2047cb Improved llama.cpp version naming scheme niansa 2023-05-20 16:53:03 +02:00
  • 9a3952597a Another abort fix niansa 2023-05-20 03:09:25 +02:00
  • 30a0a77cb2 Fixed an abort() niansa 2023-05-20 02:53:32 +02:00
  • 5feca59be7 Fixed linebreaks and support latest llama.cpp niansa 2023-05-20 02:25:46 +02:00
  • c9dac7cb89 Fixed file type detection niansa 2023-05-19 17:45:32 +02:00
  • a608135bf7 Removed new llama sampling stub niansa 2023-05-19 16:39:09 +02:00
  • ad1e8a3368 Completed mainline llama implementation niansa 2023-05-19 16:35:55 +02:00
  • b17cc6ffbd Final fixup step #3 niansa 2023-05-19 16:20:51 +02:00
  • 4974338e41 Fixup step #2 niansa 2023-05-19 16:18:26 +02:00
  • 9bf70e3f5d Renamed llama-mainline to llama_old niansa 2023-05-19 15:57:17 +02:00
  • b5e10d1fa3 Use magic to identify llama models niansa 2023-05-19 02:40:57 +02:00
  • f279b31d5f Minor improvemens in CMakeFiles and dlhandle niansa 2023-05-18 22:31:17 +02:00
  • e489f0f53c Removed now-dead allocation from mpt_model niansa 2023-05-16 23:56:37 +02:00
  • 8fbbf58622 Removed magic_match for llama.cpp niansa 2023-05-18 17:49:22 +00:00
  • 88e35fd25d Fixed output directory niansa 2023-05-18 17:48:54 +00:00
  • a0ec6f8a11 Fixed . being used instead of ${DIRECTORY} in llama.cpp.cmake niansa 2023-05-17 19:01:08 +00:00
  • abbb35c6a9 Minor improvements on EOS handling niansa 2023-05-17 10:51:20 +02:00
  • 8e7e310757 Only look up im_end once niansa 2023-05-17 10:17:51 +02:00
  • f5cf0ecff2 MPT works now! niansa 2023-05-17 09:33:16 +02:00
  • 4ec47699f0 Repeat penalty fixes niansa 2023-05-17 08:44:25 +02:00
  • a77d25d01d Declare MPT as non-functional in readme niansa 2023-05-16 22:53:29 +00:00
  • ddd130b2d9 Updated MPT implementation niansa 2023-05-16 23:49:43 +02:00
  • a98784aa53 Minor MPT improvements niansa 2023-05-16 23:35:42 +02:00
  • 4c4ef9e441 Merge branch 'sharedobjects' into 'master' niansa 2023-05-16 19:10:06 +00:00
  • 60fe6b9c55 Load implemenations as shared objects niansa 2023-05-16 19:10:05 +00:00
  • 5b01daa764 Properly implemented MPT v0.1 niansa 2023-05-15 14:46:19 +02:00
  • 6d2910b7b9 Initial MPT support (buggy) niansa 2023-05-15 12:55:49 +02:00
  • f3a9092ca5 Moved gptj/utils.* to g4a-common.* niansa 2023-05-15 09:44:04 +02:00
  • 36a6fa6290 Warn about use of exceptions with cosched properly niansa 2023-05-15 09:40:41 +02:00
  • 81c8f39732 Added missing LM_COTHROW define niansa 2023-05-15 09:38:49 +02:00
  • 59a6a8b1d1 Check for errors during llama evaluation properly niansa 2023-05-11 18:46:41 +02:00
  • 087fe1396b Fixed all other known compilation issues niansa 2023-05-10 21:50:37 +02:00
  • b61c751d33 Reverted last commit. but fixed invalid ssize_t typedef on msvc niansa 2023-05-10 16:39:44 +02:00
  • bdb87534e8 Eliminate use of ssize_t niansa 2023-05-10 16:37:43 +02:00
  • 0f8ef2fd32 Removed if_error because it wasn't needed niansa 2023-05-10 12:18:42 +02:00
  • c9d261701d (Hopefully) fixed msvc compilation niansa 2023-05-10 12:14:49 +02:00
  • 5c0e7c64c1 Fixed cmake force option niansa 2023-05-09 22:35:44 +02:00
  • b8b7766d1b Removed function that isn't needed anymore niansa 2023-05-09 22:29:38 +02:00
  • 6968f3459a Made last commit more beautiful niansa 2023-05-09 22:25:04 +02:00
  • a43c5e64ce Fixed compilation error with exceptions enabled niansa 2023-05-09 22:23:34 +02:00
  • 5e666d83db Actually implemented error return values niansa 2023-05-09 22:20:01 +02:00
  • 0d5cba0530 Added LM_NOEXCEPT cmake option niansa 2023-05-09 21:33:49 +02:00
  • 05fa44e1e0 Removed some assertions in GPT-J niansa 2023-05-07 12:43:23 +02:00
  • e4832f1077 Added GPT-J serialization/deserialization niansa 2023-05-07 12:02:04 +02:00
  • ca33a27e05 Fixed a warning niansa 2023-05-06 01:14:24 +02:00
  • 7076f863d4 Check for task termination niansa 2023-05-05 19:02:28 +02:00
  • 96076d4e9b Updated for latest cosched niansa 2023-05-05 10:35:14 +02:00
  • 9bda8106b9 Added missing co_await niansa 2023-05-05 00:28:04 +02:00
  • 8984e66067 Improved cache variable descriptions niansa 2023-05-04 19:48:30 +02:00
  • 58b3a278d8 Don't use weak pointers niansa 2023-05-04 15:53:19 +02:00
  • 7f20f8b609 Revert "Fidxed InferencePool::get_inference returning trash" niansa 2023-05-04 13:45:48 +00:00
  • e2acff3540 Fidxed InferencePool::get_inference returning trash niansa 2023-05-04 15:37:24 +02:00
  • 5a57db5e75 Added CoSched support niansa 2023-05-04 15:22:32 +02:00
  • 57364ae560 Use conversion to time_t to improve cross-platform compatibility niansa 2023-04-30 00:33:00 +02:00
  • 5e5fc4a25f Fixed InferencePool::cleanup() deleting newer files niansa 2023-04-30 00:29:24 +02:00
  • d87a6ffc08 In InferencePool::cleanup, check filename niansa 2023-04-29 23:56:47 +02:00
  • 3c62cbebaf Inlined InferencePool constructor and added addional cleanup functions niansa 2023-04-29 23:43:45 +02:00
  • 06984bf36c Add gptj implementation license. niansa 2023-04-28 16:17:35 +00:00
  • 5b5156245d Add README.md niansa 2023-04-28 16:16:41 +00:00
  • 9d8c7e0f67 Add LICENSE niansa 2023-04-28 16:08:19 +00:00
  • d236e36d26 Implemented proper scrolling niansa 2023-04-28 18:04:07 +02:00
  • 4f03b75560 Fixed uninitialized mem_per_token niansa 2023-04-27 13:34:30 +02:00
  • 17f30e0761 Removed uninitialized GPTJInference::State::n_ctx niansa 2023-04-27 10:41:56 +02:00
  • e640f093df Removed context size exception niansa 2023-04-27 10:04:03 +02:00
  • c6b1f2bc2b Implemented context window scrolling niansa 2023-04-27 09:57:28 +02:00
  • 493186509a Renamed function and updated Python bindings niansa 2023-04-27 09:48:44 +02:00