AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
· 11 min read
Abstractact
in terms of memory size and bandwidth, pose significant deployment challenges.
One post tagged with "Model Acceleration"
Model acceleration techniques
View All Tags