AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
· 11 min read
Abstractact
in terms of memory size and bandwidth, pose significant deployment challenges.
One post tagged with "Model Compression"
Model compression techniques
View All Tags