Bio
Papers
Experience
Projects

Activation Chunking

AutoChunk: Automated Activation Chunk for Memory-Efficient Long Sequence Inference

Memory-efficient long sequence inference through automated activation chunking.

May 7, 2024

2024 Ziming Liu, NUS HPC-AI lab. All rights reserved.

Published with Hugo Blox Builder — the free, open source website builder that empowers creators.