Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

thunder.jit - fix ignoring compile options #358

Merged
merged 2 commits into from May 3, 2024
Merged

Conversation

nikitaved
Copy link
Contributor

As per title. This enables using use_cudagraphs and other options that were previously ignored.
Fixes #347

@nikitaved nikitaved force-pushed the nikitaved/compile_options_fix branch from 102fc32 to ea7d066 Compare May 3, 2024 10:24
@t-vi t-vi merged commit 1571fd9 into main May 3, 2024
34 of 39 checks passed
@t-vi t-vi deleted the nikitaved/compile_options_fix branch May 3, 2024 11:39
Copy link
Collaborator

@t-vi t-vi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you n Nik!

@IvanYashchuk
Copy link
Collaborator

use_cudagraphs, use_torch_compile, and use_rematerialization are still ignored because there's no code path that actually uses these flags in thunder.jit.

These flags are used only in thuner.common._create_callable that is only used in thunder.compile.

@nikitaved
Copy link
Contributor Author

@IvanYashchuk , yes, it is a follow-up!

t-vi added a commit that referenced this pull request May 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

use_cudagraphs=True is silently ignored.
3 participants