Skip to content

Commit f77bce0

Browse files
[Model] Add Afmoe architecture implementation (vllm-project#28332)
Signed-off-by: Maziyar Panahi <[email protected]> Signed-off-by: Pranav <[email protected]> Co-authored-by: Maziyar Panahi <[email protected]>
1 parent a289cc1 commit f77bce0

File tree

7 files changed

+804
-0
lines changed

7 files changed

+804
-0
lines changed

docs/models/supported_models.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -351,6 +351,7 @@ th {
351351

352352
| Architecture | Models | Example HF Models | [LoRA](../features/lora.md) | [PP](../serving/parallelism_scaling.md) |
353353
|--------------|--------|-------------------|----------------------|---------------------------|
354+
| `AfmoeForCausalLM` | Afmoe | TBA | ✅︎ | ✅︎ |
354355
| `ApertusForCausalLM` | Apertus | `swiss-ai/Apertus-8B-2509`, `swiss-ai/Apertus-70B-Instruct-2509`, etc. | ✅︎ | ✅︎ |
355356
| `AquilaForCausalLM` | Aquila, Aquila2 | `BAAI/Aquila-7B`, `BAAI/AquilaChat-7B`, etc. | ✅︎ | ✅︎ |
356357
| `ArceeForCausalLM` | Arcee (AFM) | `arcee-ai/AFM-4.5B-Base`, etc. | ✅︎ | ✅︎ |

tests/models/registry.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -173,6 +173,10 @@ def check_available_online(
173173

174174
_TEXT_GENERATION_EXAMPLE_MODELS = {
175175
# [Decoder-only]
176+
"AfmoeForCausalLM": _HfExamplesInfo(
177+
"arcee-ai/Trinity-Nano",
178+
is_available_online=False,
179+
),
176180
"ApertusForCausalLM": _HfExamplesInfo("swiss-ai/Apertus-8B-Instruct-2509"),
177181
"AquilaModel": _HfExamplesInfo("BAAI/AquilaChat-7B", trust_remote_code=True),
178182
"AquilaForCausalLM": _HfExamplesInfo("BAAI/AquilaChat2-7B", trust_remote_code=True),

0 commit comments

Comments
 (0)