Is MTP supported?

#5
by SlavikF - opened

Since README says nothing about MTP,
Is it correct to conclude, that MTP is not supported?

Wasn't supported last time so would not be surprising if it isn't this time, either.

Speculative decoding is supported : https://vllm.ai/blog/2026-06-12-minimax-m3-vllm

Speculative decoding is supported : https://vllm.ai/blog/2026-06-12-minimax-m3-vllm

Yes but is not present in the model itself like with Qwen3.5/3.6 models, config.json has actual MTP fields:

"num_mtp_modules": 7,
"num_nextn_predict_layers": 1

But inside the model there is no actual MTPs:

safetensors files: 59
checking model-00001-of-00059.safetensors
checking model-00002-of-00059.safetensors
checking model-00003-of-00059.safetensors
checking model-00004-of-00059.safetensors
checking model-00005-of-00059.safetensors
checking model-00006-of-00059.safetensors
checking model-00007-of-00059.safetensors
checking model-00008-of-00059.safetensors
checking model-00009-of-00059.safetensors
checking model-00010-of-00059.safetensors
checking model-00011-of-00059.safetensors
checking model-00012-of-00059.safetensors
checking model-00013-of-00059.safetensors
checking model-00014-of-00059.safetensors
checking model-00015-of-00059.safetensors
checking model-00016-of-00059.safetensors
checking model-00017-of-00059.safetensors
checking model-00018-of-00059.safetensors
checking model-00019-of-00059.safetensors
checking model-00020-of-00059.safetensors
checking model-00021-of-00059.safetensors
checking model-00022-of-00059.safetensors
checking model-00023-of-00059.safetensors
checking model-00024-of-00059.safetensors
checking model-00025-of-00059.safetensors
checking model-00026-of-00059.safetensors
checking model-00027-of-00059.safetensors
checking model-00028-of-00059.safetensors
checking model-00029-of-00059.safetensors
checking model-00030-of-00059.safetensors
checking model-00031-of-00059.safetensors
checking model-00032-of-00059.safetensors
checking model-00033-of-00059.safetensors
checking model-00034-of-00059.safetensors
checking model-00035-of-00059.safetensors
checking model-00036-of-00059.safetensors
checking model-00037-of-00059.safetensors
checking model-00038-of-00059.safetensors
checking model-00039-of-00059.safetensors
checking model-00040-of-00059.safetensors
checking model-00041-of-00059.safetensors
checking model-00042-of-00059.safetensors
checking model-00043-of-00059.safetensors
checking model-00044-of-00059.safetensors
checking model-00045-of-00059.safetensors
checking model-00046-of-00059.safetensors
checking model-00047-of-00059.safetensors
checking model-00048-of-00059.safetensors
checking model-00049-of-00059.safetensors
checking model-00050-of-00059.safetensors
checking model-00051-of-00059.safetensors
checking model-00052-of-00059.safetensors
checking model-00053-of-00059.safetensors
checking model-00054-of-00059.safetensors
checking model-00055-of-00059.safetensors
checking model-00056-of-00059.safetensors
checking model-00057-of-00059.safetensors
checking model-00058-of-00059.safetensors
checking model-00059-of-00059.safetensors

MTP-ish tensor count: 0

Sign up or log in to comment