RAM 870364b547 [CUDAGraph]CUDA Graph support unique memory pool (#4230) ...

* cuda graph use unique memory pool

* fix custom device import bug

* refine code

* refine code

* refine code

2025-09-24 19:45:22 +08:00

..

graph_optimization

[CUDAGraph]CUDA Graph support unique memory pool (#4230)

2025-09-24 19:45:22 +08:00

guided_decoding

[FDConfig]Remove max_num_batched_tokens/max_num_seqs in parallel config (#4116)

2025-09-17 10:43:35 +08:00

layers

[OPs] MoE support wfp8afp8(channelwise) and improve per_token_quant_fp8 (#4238)

2025-09-24 16:39:51 +08:00

model_loader

[v1 loader]code style (#4204)

2025-09-23 19:36:00 +08:00

models

[Model] Qwen2.5VL support --use-cudagraph and unit testing (#4087)

2025-09-24 19:45:01 +08:00

ops

[Intel HPU] Support intel hpu platform (#4161)

2025-09-24 12:27:50 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

forward_meta.py

[Intel HPU] Support intel hpu platform (#4161)

2025-09-24 12:27:50 +08:00

load_weight_utils.py

[v1 loader]code style (#4204)

2025-09-23 19:36:00 +08:00

pre_and_post_process.py

[Intel HPU] Support intel hpu platform (#4161)

2025-09-24 12:27:50 +08:00

utils.py

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00