Skip to content

Refactor LTX2 text encoders#354

Open
syhuang22 wants to merge 1 commit intoAI-Hypercomputer:mainfrom
syhuang22:ltx2/refactor_encoder
Open

Refactor LTX2 text encoders#354
syhuang22 wants to merge 1 commit intoAI-Hypercomputer:mainfrom
syhuang22:ltx2/refactor_encoder

Conversation

@syhuang22
Copy link
Collaborator

@syhuang22 syhuang22 commented Mar 11, 2026

There are some LTX2 updates on text encoder, this pr aims to follow that changes

@syhuang22 syhuang22 requested a review from entrpn as a code owner March 11, 2026 17:12
@syhuang22 syhuang22 force-pushed the ltx2/refactor_encoder branch 2 times, most recently from a41a80d to 1f3b235 Compare March 11, 2026 17:44
@mbohlool mbohlool self-requested a review March 12, 2026 18:39

# Padding has been filled with valid register tokens. The entire sequence
# must now be attended to, so we clear the mask.
new_mask = None
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: just return output, None? instead of declaring a new variable.

audio_connector_num_attention_heads: int = 30,
audio_connector_num_layers: int = 2,
audio_connector_num_learnable_registers: int = 128,
connector_rope_base_seq_len: int = 4096,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this new parameter is not used?! did you forget passing it to the connector?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes this should pass to the connector

@syhuang22 syhuang22 force-pushed the ltx2/refactor_encoder branch from 1f3b235 to 8a57774 Compare March 13, 2026 02:12
…beddingsProcessor; move tests to tests/ltx2/

Signed-off-by: James Huang <syhuang1201@gmail.com>
@syhuang22 syhuang22 force-pushed the ltx2/refactor_encoder branch from 8a57774 to 0bb0067 Compare March 13, 2026 17:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants