Skip to content

Add LoRA Inference Support for LTX2 Model#372

Open
prishajain1 wants to merge 1 commit intomainfrom
ltx2_lora
Open

Add LoRA Inference Support for LTX2 Model#372
prishajain1 wants to merge 1 commit intomainfrom
ltx2_lora

Conversation

@prishajain1
Copy link
Copy Markdown
Collaborator

@prishajain1 prishajain1 commented Apr 7, 2026

This PR adds LoRA inference support for the LTX2 model in MaxDiffusion

New Files Added

  • ltx2_lora_nnx_loader.py: A new loader that handles loading and merging LoRA weights for both the central Transformer and the Connectors, including prefix-based log filtering.

Files Modified

  • lora_conversion_utils.py: Added the complete key mapping and path translation logic required for LTX2 LoRA keys.
  • ltx2_video.yml: Added LoRA configuration related params

Results

Configuration Inference Time (s) Video Samples
Distilled LoRA (3 steps) 6.27 Sample 0 / Sample 1
Camera Dolly-In LoRA 23.77 Sample 0 / Sample 1
Baseline 23.94 Sample 0 / Sample 1

@prishajain1 prishajain1 requested a review from entrpn as a code owner April 7, 2026 16:24
@github-actions
Copy link
Copy Markdown

github-actions bot commented Apr 7, 2026

@Perseus14
Copy link
Copy Markdown
Collaborator

I recommend splitting this PR into two. This PR can focus on LoRA and a new one on the additional changes and bug fixes.

@prishajain1 prishajain1 force-pushed the ltx2_lora branch 3 times, most recently from e9c9610 to ff23ced Compare April 8, 2026 03:57
@prishajain1
Copy link
Copy Markdown
Collaborator Author

prishajain1 commented Apr 8, 2026

I recommend splitting this PR into two. This PR can focus on LoRA and a new one on the additional changes and bug fixes.

Removing changes from this PR for those additional changes seems to be cumbersome. We can wait for #373 PR to be merged (which separates out the additional changes), post which we can push this PR ahead.

@prishajain1 prishajain1 force-pushed the ltx2_lora branch 2 times, most recently from 2f7a594 to 61a2de6 Compare April 8, 2026 04:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants