Skip to content

ggml-cuda: Q8_0 weights take dequant-to-BF16 + cuBLAS by default; k-quants stay on MMQ - #39

Open
danielhanchen wants to merge 1 commit into
sync-upstream-a77d362from
cuda-q8-bf16-cublas
Open

danielhanchen wants to merge 1 commit into
sync-upstream-a77d362from
cuda-q8-bf16-cublas

Enhance your code review process with GitHub Actions

GitHub Actions make it easy to automate all your software workflows, now with world-class CI/CD.
Build, test, and deploy your code right from GitHub. Learn more about GitHub Actions.

Linux, macOS, Windows, and containers
Linux, macOS, Windows, and containers
Matrix builds
Matrix builds
Any language
Any language
Live logs
Live logs
Built-in secret store
Built-in secret store
Multi-container testing
Multi-container testing