Hy4 Base vs Olala Mini 7A1B
Compare documented capabilities and access. A dash means a comparable figure is unavailable.
| Specification | ||
|---|---|---|
| Task | Multimodal pretraining | Multilingual language generation |
| Published capabilities | Pretrained checkpoint for continued training and adaptation. Tencent’s flagship Hy4 uses a 78-layer language backbone with a separate vision encoder. | Compact mixture-of-experts model combining hybrid attention and Mamba layers. |
| Model size | 770B total / 49B active per token in the language backbone | 7B total / 1B active |
| Access | Downloadable under the Tencent Hy License | Downloadable checkpoint for local inference or fine-tuning |
| Sources | Model weights | Model weights · Additional documentation |
| Inputs | Text, Images, Video | Text |
| Context window | — | 32,000 tokens |
| Weights | Open weights · Tencent Hy License | Open weights · Apache-2.0 |
| Released | Nov 20, 2026 | Nov 19, 2026 |