12 commits

Author	SHA1	Message	Date
niansa	90e54d66d0	Removed cosched support	2024-03-25 01:18:37 +01:00
niansa	9bda8106b9	Added missing co_await	2023-05-05 00:28:04 +02:00
niansa	58b3a278d8	Don't use weak pointers	2023-05-04 15:53:19 +02:00
niansa	7f20f8b609	Revert "Fidxed InferencePool::get_inference returning trash" ... This reverts commit e2acff3540	2023-05-04 13:45:48 +00:00
niansa	e2acff3540	Fidxed InferencePool::get_inference returning trash	2023-05-04 15:37:24 +02:00
niansa	5a57db5e75	Added CoSched support	2023-05-04 15:22:32 +02:00
niansa	57364ae560	Use conversion to time_t to improve cross-platform compatibility	2023-04-30 00:33:00 +02:00
niansa	5e5fc4a25f	Fixed InferencePool::cleanup() deleting newer files	2023-04-30 00:29:24 +02:00
niansa	d87a6ffc08	In InferencePool::cleanup, check filename	2023-04-29 23:56:47 +02:00
niansa	3c62cbebaf	Inlined InferencePool constructor and added addional cleanup functions	2023-04-29 23:43:45 +02:00
niansa	316e8cbf18	Initial GPT-J support	2023-04-26 16:32:45 +02:00
niansa	5f6cf17871	Moved pool functions into seperate file	2023-04-26 11:18:12 +02:00