👋 Open to Work

Jen Wei

bird-of-paradise

·

https://birdofparadise.ai/

AI & ML interests

Training dynamics, systems, RL & scaling

Recent Activity

liked a Space about 2 months ago

HuggingFaceBio/carbon-tokenization

published an article 3 months ago

DeepSeek Engram × OLMo-core: Distributed Implementation

published an article 4 months ago

The Three Horsemen of Numerical Divergence in Hybrid Models

View all activity

Organizations

Articles 9

Article

2

DeepSeek Engram × OLMo-core: Distributed Implementation

Article

3

The Three Horsemen of Numerical Divergence in Hybrid Models

View all Articles

spaces 2

Post Training Techniques Guide

A visual guide to post-training techniques for LLMs

ReTool Implementation

Enhance LLMs with strategic tool use for math problems

models 3

bird-of-paradise/Llama-Hopper-Reasoning-v1

Reinforcement Learning • Updated Feb 6

bird-of-paradise/deepseek-mla

Text Generation • Updated Feb 27, 2025 • 20

bird-of-paradise/deepseek-moe

Text Generation • Updated Feb 27, 2025 • 5

datasets 4

bird-of-paradise/transformer-from-scratch-tutorial

Updated Jan 12 • 101 • 42

bird-of-paradise/muon-tutorial

Viewer • Updated Jan 12 • 3 • 295 • 15

bird-of-paradise/muon-distributed-reproducibility

Updated Nov 30, 2025 • 21 • 2

bird-of-paradise/muon-distributed

Updated Nov 8, 2025 • 37 • 1