Questions about quantization
Read more about quantization
python (12.9k questions)
javascript (9.2k questions)
reactjs (4.7k questions)
java (4.2k questions)
java (4.2k questions)
c# (3.5k questions)
c# (3.5k questions)
html (3.3k questions)
onnx.load() | ALBert throws DecodeError: Error parsing message
Goal: re-develop this BERT Notebook to use textattack/albert-base-v2-MRPC.
Kernel: conda_pytorch_p36. PyTorch 1.8.1+cpu.
I convert a PyTorch / HuggingFace Transformers model to ONNX and store it. Deco...
DanielBell99
Votes: 0
Answers: 1
Converting PyTorch to ONNX model increases file size for ALBert
Goal: Use this Notebook to perform quantisation on albert-base-v2 model.
Kernel: conda_pytorch_p36.
Outputs in Sections 1.2 & 2.2 show that:
converting vanilla BERT from PyTorch to ONNX stays th...
DanielBell99
Votes: 0
Answers: 1
ValueError: Unsupported ONNX opset version: 13
Goal: successfully run Notebook as is on Jupyter Labs.
Section 2.1 throws a ValueError, I believe because of the version of PyTorch I'm using.
PyTorch 1.7.1
Kernel conda_pytorch_latest_p36
Very simi...
DanielBell99
Votes: 0
Answers: 2
Reproducing arithmetic with pytorch's quantized tensors with numpy operations
I would like to know what exact arithmetic operations I have to do to reproduce results of quantized operations in pytorch.
This is almost duplicate question to:
I want to use Numpy to simulate the in...
Roman Malashin
Votes: 0
Answers: 1