llama.cpp

niansa-misc/llama.cpp

Fork 0

mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-03-06 20:48:53 +01:00

Commit graph

Author	SHA1	Message	Date
Howard Su	ca74884f66	opencl : use strstr to check if fp16 supported (#1611 ) * Use strstr to check if fp16 supported * Ensure ext_buffer is null terminated	2023-05-28 20:09:56 +03:00
Maarten ter Huurne	7d873811f3	Fix handling of "invalid property" when creating OpenCL command queue (#1565 ) The `clCreateCommandQueue()` function will return the code `CL_INVALID_QUEUE_PROPERTIES` when passed unsupported properties, not `CL_INVALID_PROPERTY` as the original code was checking for.	2023-05-23 19:01:15 +03:00
0cc4m	2e6cd4b025	OpenCL Token Generation Acceleration (#1459 ) * Move back to C++ for OpenCL * Refactor OpenCL code to work more like the CUDA code, add missing functions * Deduplicate dequant kernels * Add OpenCL compile options * Use compile args for preprocessing constants * Restore default platform + device selection by id behavior --------- Co-authored-by: Johannes Gäßler <johannesg@5d6.de> Co-authored-by: Henri Vasserman <henv@hot.ee>	2023-05-23 00:33:24 +03:00

Author

SHA1

Message

Date

Howard Su

ca74884f66

opencl : use strstr to check if fp16 supported (#1611 )

* Use strstr to check if fp16 supported

* Ensure ext_buffer is null terminated

2023-05-28 20:09:56 +03:00

Maarten ter Huurne

7d873811f3

Fix handling of "invalid property" when creating OpenCL command queue (#1565 )

The `clCreateCommandQueue()` function will return the code
`CL_INVALID_QUEUE_PROPERTIES` when passed unsupported properties,
not `CL_INVALID_PROPERTY` as the original code was checking for.

2023-05-23 19:01:15 +03:00

0cc4m

2e6cd4b025

OpenCL Token Generation Acceleration (#1459 )

* Move back to C++ for OpenCL

* Refactor OpenCL code to work more like the CUDA code, add missing functions

* Deduplicate dequant kernels

* Add OpenCL compile options

* Use compile args for preprocessing constants

* Restore default platform + device selection by id behavior

---------

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
Co-authored-by: Henri Vasserman <henv@hot.ee>

2023-05-23 00:33:24 +03:00

3 commits