Papers
arxiv:2603.03383
Accelerating OpenPangu Inference on NPU via Speculative Decoding
Published on Mar 3
Authors:
Abstract
An end-to-end speculative inference acceleration scheme is presented for OpenPangu-7B to address memory constraints and lack of native support for speculative decoding on NPU hardware.
AI-generated summary
To mitigate the Memory Wall bottleneck encountered by Large Language Models (LLMs) during inference on NPU hardware, and addressing the scarcity of native support for mainstream speculative decoding algorithms on domestic infrastructure, this study presents an end-to-end speculative inference acceleration scheme for OpenPangu-7B.
Get this paper in your agent:
hf papers read 2603.03383 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 3
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2603.03383 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2603.03383 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.