AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
· 11 min read
Abstractact
in terms of memory size and bandwidth, pose significant deployment challenges.
One post tagged with "Model Quantization"
Model quantization techniques
View All Tags