niansa-misc/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-03-06 20:48:53 +01:00
Code Wiki Activity
784 commits 380 branches 3159 tags 553 MiB
Commit graph

1 commit

Author SHA1 Message Date
jwj7140
f257fd2550
Add an API example using server.cpp similar to OAI. (#2009) 
* add api_like_OAI.py
* add evaluated token count to server
* add /v1/ endpoints binding
 2023-07-04 21:06:12 +03:00