Bowen Peng's picture

Bowen Peng

bloc97

·

bloc97

AI & ML interests

Machine Learning, Computer Graphics, Language Models

Recent Activity

upvoted a paper 6 days ago

Decoupling the Benefits of Subword Tokenization for Language Model Training via Byte-level Simulation

upvoted a paper 9 days ago

Targeted Neuron Modulation via Contrastive Pair Search

upvoted a paper 13 days ago

Long Context Pre-Training with Lighthouse Attention

View all activity

Organizations

submitted a paper to Daily Papers 13 days ago

Long Context Pre-Training with Lighthouse Attention

Paper • 2605.06554 • Published 22 days ago • 31

authored a paper 14 days ago

Efficient Pre-Training with Token Superposition

Paper • 2605.06546 • Published 22 days ago • 46

submitted a paper to Daily Papers 15 days ago

Efficient Pre-Training with Token Superposition

Paper • 2605.06546 • Published 22 days ago • 46

authored a paper over 1 year ago

DeMo: Decoupled Momentum Optimization

Paper • 2411.19870 • Published Nov 29, 2024 • 6

authored a paper over 2 years ago

YaRN: Efficient Context Window Extension of Large Language Models

Paper • 2309.00071 • Published Aug 31, 2023 • 85