chenjian 6727df8286 [Optimization] Optimize ttft for prefill pd (#6680) ...

* optimize ttft

* fix

* fix

* fix ci

* fix ci

* fix

* fix bug

* fix

* add comments

* fix ci

* fix

* fix ci

* fix format

* update according to review

* add comment

* fix

* fix format

2026-03-30 20:36:23 +08:00

..

assets/images

更新文档 (#3975)

2025-09-08 16:53:37 +08:00

best_practices

[Docs]add deepseek model doc (#6513)

2026-02-26 14:08:19 +08:00

cli

[docs] add cli uasge to docs (#4569)

2025-10-28 10:35:11 +08:00

features

[RL] Adapt async rollout checkpoint update flow (#7042)

2026-03-30 19:19:34 +08:00

get_started

[Iluvatar] Support wi4a16 group_gemm (#7078)

2026-03-30 19:03:51 +08:00

observability

[Feature] Tracing: Fine-Grained Tracing for Request Latency Part1 (#5458)

2025-12-16 16:36:09 +08:00

online_serving

[Feature] Update Counter Release (#6943)

2026-03-20 10:51:37 +08:00

quantization

[Feature] Support NVFP4 MoE on SM100 (#6003)

2026-01-29 14:16:07 +08:00

usage

[Optimization] Optimize ttft for prefill pd (#6680)

2026-03-30 20:36:23 +08:00

zh

[Optimization] Optimize ttft for prefill pd (#6680)

2026-03-30 20:36:23 +08:00

benchmark.md

[Docx] add language (en/cn) switch links (#4470)

2025-10-17 15:47:41 +08:00

index.md

[Docs] add doc for glm (#4933)

2025-11-10 21:21:33 +08:00

offline_inference.md

update doc (#4675)

2025-10-30 11:19:04 +08:00

parameters.md

[Docs] Add Doc for Online quantification (#6399)

2026-02-08 22:09:18 -08:00

requirements.txt

fix: correct typo in nvidia_gpu.md (#4848)

2025-11-06 16:03:02 +08:00

supported_models.md

remove load default_v1 since already been as default (#4980)

2025-11-12 16:49:48 +08:00