Add position_ids to RoFormerForCausalLM forward pass #44705

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed

saivedant169 wants to merge 1 commit into huggingface:main from saivedant169:fix/issue-32937-roformer-position-ids

+14 −1

Closed

Add position_ids to RoFormerForCausalLM forward pass #44705

Add position_ids support to RoFormerForCausalLM forward pass

CircleCI Checks / run_tests succeeded Mar 14, 2026 in 6m 21s

Workflow: run_tests

View CircleCI Workflow

tests_generate - Success
collection_job - Success
tests_hub - Success
tests_tensor_parallel_ci - Success
tests_training_ci - Success
tests_torch - Success
pipelines_torch - Success

View more details on CircleCI Checks