Hugging Face · agents
September 29, 2025 · Read the original
Intel researchers accelerated Qwen3-8B on Intel Core Ultra using OpenVINO.GenAI speculative decoding with a lightweight Qwen3-0.6B draft model, reaching an average of about 1.3× speedup over a 4-bit OpenVINO baseline on an Intel Lunar Lake integrated GPU. They then pruned 6 out of 28 layers from the Qwen3-0.6B draft model and fine-tuned it on synthetic data generated by Qwen3-8B from 500k prompts in the BAAI/Infinity-Instruct dataset, which brought the speedup to about 1.4×. The work was demonstrated running a local AI agent with smolagents, and the notebook and depth-pruned draft model were released for reproduction.
Written from the article itself at capture time and checked against it before publication: every number and every name in it comes from the source. It is our summary, not the lab’s wording — the original is linked above.
The announcement says what the lab claims. The record says what was measured, by whom, and whether anyone reproduced it. Read both before believing either.