LLaMA-MoE

https://github.com/pjlab-sys4nlp/llama-moe

AI & ML interests

None defined yet.

Recent Activity

Spico submitted a paper 6 days ago

Intern-Decision: Efficient Multimodal Decision Making with Autoregressive Masked Language Modeling

tongjingqi authored a paper 7 months ago

LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training

tongjingqi authored a paper 7 months ago

Adaptive Fast-and-Slow Visual Program Reasoning for Long-Form VideoQA

View all activity

llama-moe 's models 8

llama-moe/LLaMA-MoE-v2-3_8B-residual-sft

8B • Updated Dec 3, 2024 • 10 • 2

llama-moe/LLaMA-MoE-v2-3_8B-2_8-sft

8B • Updated Dec 3, 2024 • 32 • 6

llama-moe/LLaMA-MoE-v1-3_0B-2_16

Text Generation • Updated Jun 25, 2024 • 309 • 11

llama-moe/LLaMA-MoE-v1-3_5B-4_16

Text Generation • Updated Jun 25, 2024 • 205 • 17

llama-moe/LLaMA-MoE-v1-3_0B-2_16-sft

Text Generation • 7B • Updated Jun 25, 2024 • 23 • 2

llama-moe/LLaMA-MoE-v1-3_5B-2_8-sft

Text Generation • 7B • Updated Jun 25, 2024 • 77 • 3

llama-moe/LLaMA-MoE-v1-3_5B-4_16-sft

Text Generation • 7B • Updated Jun 25, 2024 • 21 • 1

llama-moe/LLaMA-MoE-v1-3_5B-2_8

Text Generation • Updated Jun 25, 2024 • 289 • 15