comfyanonymous bf4c9a08fc Implement comfy kitchen attention. (#15479) ...

Add a ModelAttentionBackend node to manually select the attention for models in the workflows. Currently supports pytorch attention or comfy kitchen attention.

Add --use-ck-attention to enable comfy kitchen attention as the default attention backend for all models (might break some).

2026-08-10 22:03:08 -07:00

..

ace

Support gqa on all attention backends, drop support for pytorch 2.4 (#14772)

2026-07-07 22:57:52 -04:00

anima

Support anima lllite control models. (#14954)

2026-07-17 07:36:21 -07:00

audio

Support gqa on all attention backends, drop support for pytorch 2.4 (#14772)

2026-07-07 22:57:52 -04:00

aura

Enable Runtime Selection of Attention Functions (#9639)

2025-09-12 18:07:38 -04:00

boogu

Support gqa on all attention backends, drop support for pytorch 2.4 (#14772)

2026-07-07 22:57:52 -04:00

cascade

cascade: remove dead weight init code (#13026)

2026-03-17 20:59:10 -04:00

chroma

Implement NAG on all the models based on the Flux code. (#12500)

2026-02-16 23:30:34 -05:00

chroma_radiance

Radiance: support variant with nonzero txt_ids (#14206)

2026-06-01 22:07:48 -07:00

cogvideo

Cogvideox (#13402)

2026-04-29 19:30:08 -04:00

cosmos

Support anima lllite control models. (#14954)

2026-07-17 07:36:21 -07:00

depth_anything_3

Depth anything 3 (Core-135) (#13853)

2026-06-10 09:28:24 +08:00

ernie

Make Ernie use comfy kitchen rms rope (#15055)

2026-07-23 22:06:52 -04:00

flux

Remove old useless no comfy kitchen fallback. (#14245)

2026-06-02 17:52:41 -07:00

genmo

Enable Runtime Selection of Attention Functions (#9639)

2025-09-12 18:07:38 -04:00

hidream

Enable Runtime Selection of Attention Functions (#9639)

2025-09-12 18:07:38 -04:00

hidream_o1

Fix hidream o1 regression. (#14923)

2026-07-13 12:52:28 -07:00

hunyuan3d

Enable Runtime Selection of Attention Functions (#9639)

2025-09-12 18:07:38 -04:00

hunyuan3dv2_1

MultiGPU Work Units For Accelerated Sampling (CORE-184) (#7063)

2026-05-25 18:26:40 -07:00

hunyuan_video

Implement NAG on all the models based on the Flux code. (#12500)

2026-02-16 23:30:34 -05:00

hydit

Change cosmos and hydit models to use the native RMSNorm. (#7934)

2025-05-04 06:26:20 -04:00

ideogram4

Optimize ideogram model using comfy kitchen rms rope. (#15080)

2026-07-25 15:09:26 -04:00

joyimage

Use optimized rms_rope function in joyai image model. (#15018)

2026-07-21 20:02:45 -07:00

kandinsky5

Fix qwen scaled fp8 not working with kandinsky. Make basic t2i wf work. (#11162)

2025-12-06 17:50:10 -08:00

krea2

Implement regular and timestep zero reference images to krea 2 for ostris and identity edit ref loras. (#14843)

2026-07-18 17:12:18 -07:00

lens

Lens: some cleanup (#14112)

2026-05-26 10:32:53 +03:00

lightricks

Speedup LTX and Wan (#15138)

2026-08-05 21:15:48 -04:00

lumina

Make z image/lumina 2 models use comfy kitchen rms rope. (#15036)

2026-07-22 15:34:27 -04:00

mage_flow

Fix MageFlow on cards that don't support bf16 (#15081)

2026-07-25 21:01:51 -04:00

minimax

Implement comfy kitchen attention. (#15479)

2026-08-10 22:03:08 -07:00

mmaudio/vae

Implement the mmaudio VAE. (#10300)

2025-10-11 22:57:23 -04:00

models

Add support for small flux.2 decoder (#13314)

2026-04-07 03:44:18 -04:00

modules

Implement comfy kitchen attention. (#15479)

2026-08-10 22:03:08 -07:00

moge

Remove useless annotations imports. (#14105)

2026-05-25 19:23:29 -07:00

omnigen

Support gqa on all attention backends, drop support for pytorch 2.4 (#14772)

2026-07-07 22:57:52 -04:00

pixart

Remove windows line endings. (#8866)

2025-07-11 02:37:51 -04:00

pixeldit

Support PID 1.5 models. (#14894)

2026-07-12 09:43:30 -07:00

qwen_image

fix: Add back apply_rotary_emb for Qwen Image (#14364)

2026-06-09 11:55:49 +08:00

rt_detr

CORE-13 feat: Support RT-DETRv4 detection model (#12748)

2026-03-28 23:34:10 -04:00

sam3

Improve SAM3 large input handling (#13767)

2026-05-07 17:18:28 -07:00

seedvr

Try to fix some issues with the seedvr VAE. (#14877)

2026-07-10 19:54:28 -04:00

supir

feat: SUPIR model support (CORE-17) (#13250)

2026-04-18 23:02:01 -04:00

triposplat

feat: Add TripoSplat support (#14210)

2026-06-01 07:01:50 -07:00

wan

feat: Support Wan-Animate2 (CORE-358) (#15362)

2026-08-06 21:08:16 -04:00

colormap.py

Depth anything 3 (Core-135) (#13853)

2026-06-10 09:28:24 +08:00

common_dit.py

add RMSNorm to comfy.ops

2025-04-14 18:00:33 -04:00

util.py

New Year ruff cleanup. (#11595)

2026-01-01 22:06:14 -05:00