CANN/pypto-gym Qwen3.5-9B融合算子
·
Qwen3.5-9B fused operators
【免费下载链接】pypto-gym PyPTO-Gym 是基于 PyPTO 编程框架构建的算子与模型样例仓库 项目地址: https://gitcode.com/cann/pypto-gym
PyPTO fused-operator implementations targeted at Qwen3.5-9B (qwen3_5 architecture in upstream transformers). Each operator lives in its own subdirectory with an _impl.py exporting a *_wrapper function and a README.md describing the contract.
产品支持情况
- Ascend 950PR:支持
- Atlas A3 训练系列产品/Atlas A3 推理系列产品:支持
- Atlas A2 训练系列产品/Atlas A2 推理系列产品:支持
Operators
| Operator | Subdirectory | Status |
|---|---|---|
gated_delta_rule |
gated_delta_rule/ |
Available |
Common shape constraints
Qwen3.5-9B's qwen3_5 architecture has:
| Symbol | Meaning | Value |
|---|---|---|
D |
Per-head dimension | 128 |
Nv |
Value head count | 32 |
Nqk |
Query/Key head count | 16 |
Wrappers enforce these constraints at call time and raise NotImplementedError outside the supported envelope.
Integration
The kernels are wired into the model through the modeling_qwen3_5.py shim — see that file for the monkey-patch hook pattern.
【免费下载链接】pypto-gym PyPTO-Gym 是基于 PyPTO 编程框架构建的算子与模型样例仓库 项目地址: https://gitcode.com/cann/pypto-gym
更多推荐


所有评论(0)