Feature Request: Convert deepseek-v3's mtp module to gguf and quantize to q4km #12242
Open
4 tasks done
Labels
enhancement
New feature or request
Prerequisites
Feature Description
Convert deepseek-v3's mtp module to gguf and quantize to q4km
Motivation
I want to get the gguf weight of deepseek-v3 layer 62 and convert to q4km
Possible Implementation
No response
The text was updated successfully, but these errors were encountered: