Are some files missing??

#7
by julianchong - opened

image

julianchong changed discussion title from Some files are missing?? to Are some files missing??

I checked and M2.1 and M2.5 have similarly "incomplete" file counts, might be normal. If there's already a bunch of other quantizations made by other people based on it, there must be enough files there to use it.

It's fine.

I suspect their internal BF16 used 130 tensors and when quantizing to FP8 they kept the filenames except 5 less where necessary.

https://huggingface.co/MiniMaxAI/MiniMax-M2.7/discussions/9

They mentioned they are not open sourcing the MTP layers. Perhaps that's the reason?

they hide the mtp layers

True, not hive mtp layers

Sign up or log in to comment