up
100
作者 blueardour 2022-04-26 02:38:59
Wrote 0 BlogsTotally 0 words
Training Quantization

Introduction

  1. Robust Quantization: One Model to Rule Them All
    paper

Use Kurtosis regularization (KURE) to force the weight distribution to uniform distribution

  1. BSQ: EXPLORING BIT-LEVEL SPARSITY FOR MIXED-PRECISION NEURAL NETWORK QUANTIZATION
    paper

compose the quantization into bit-wise and optimize each bit

  1. Ultra-Low Precision 4-bit Training of Deep Neural Networks
    paper
-->