ldwang's picture

ldwang

ldwang

·

ftgreat

AI & ML interests

LLM, MLLM, Infra

Recent Activity

updated a collection about 3 hours ago

liked a model about 3 hours ago

tanaos/tanaos-text-anonymizer-v1

upvoted a collection about 24 hours ago

View all activity

Organizations

authored a paper 5 months ago

Trainable Dynamic Mask Sparse Attention

Paper • 2508.02124 • Published Aug 4 • 17

authored a paper 6 months ago

Infinity Instruct: Scaling Instruction Selection and Synthesis to Enhance Language Models

Paper • 2506.11116 • Published Jun 9 • 4

authored a paper 7 months ago

CCI4.0: A Bilingual Pretraining Dataset for Enhancing Reasoning in Large Language Models

Paper • 2506.07463 • Published Jun 9 • 10

authored 3 papers about 1 year ago

CCI3.0-HQ: a large-scale Chinese dataset of high quality designed for pre-training large language models

Paper • 2410.18505 • Published Oct 24, 2024 • 11

Infinity-MM: Scaling Multimodal Performance with Large-Scale and High-Quality Instruction Data

Paper • 2410.18558 • Published Oct 24, 2024 • 18

Emu3: Next-Token Prediction is All You Need

Paper • 2409.18869 • Published Sep 27, 2024 • 95

authored 2 papers over 1 year ago

AquilaMoE: Efficient Training for MoE Models with Scale-Up and Scale-Out Strategies

Paper • 2408.06567 • Published Aug 13, 2024 • 2

Aquila2 Technical Report

Paper • 2408.07410 • Published Aug 14, 2024 • 15