Model | Parameters | (Activated) Parameters | (Activated) Non-embedding parameters |
Mistral-7B | 7.2 | 7.2 | 7.0 |
Gemma-7B | 8.5 | 7.8 | 7.8 |
Qwen1.5-7B | 7.7 | 7.7 | 6.4 |
DeepSeekMoE 16B | 16.4 | 2.8 | 2.4 |
Qwen1.5-MoE-A2.7B | 14.3 | 2.7 | 2.0 |
Model | Throughput | TPS |
Qwen2-7B-Chat | 1.15 | 2298.89 |
Qwen1.5-MoE-A2.7B-Chat | 2.01 | 4010.27 |
欢迎光临 ToB企服应用市场:ToB评测及商务社交产业平台 (https://dis.qidao123.com/) | Powered by Discuz! X3.4 |