Skip to main content
← Back to news

Spark-X2.6-4B: the 4B model from Xhtk that runs locally and goes from 0 to 4.49 on HLE

Model releases
Xhtk releases Spark-X2.6-4B in GGUF format under an MIT license: 4B parameters, 3B activated, 48 hybrid layers (36 Sparse Attention + 12 Mamba2), KV cache cut to a third, and context support from 32K up to 256K. In a single training cycle, the HLE (Humanity's Last Exam) score jumps from 0 to 4.49. For anyone who wants a light model that doesn't tax the GPU, it's one of the most complete options right now.

Get the next local-AI briefing

Once a week, the top selection from iaLocale: articles, news and resources on local AI, and more.

After signing up you receive a confirmation email (double opt-in). Without confirmation we send nothing. No spam, we promise.