You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The conversion we have with litgpt convert to a huggingface checkpoint creates a model.pth file. But then you have to load it like so as described in the tutorial:
The only blocker for this is that from_pretrained requires the pytorch_model.bin to be loaded with weights_only=True. Our checkpoints don't satisfy this constraint, because we save checkpoints using the incremental pickle save. See #1357 for more context where we had to work around this.
The text was updated successfully, but these errors were encountered:
The conversion we have with
litgpt convert
to a huggingface checkpoint creates a model.pth file. But then you have to load it like so as described in the tutorial:But we should make it work like this:
The only blocker for this is that
from_pretrained
requires thepytorch_model.bin
to be loaded withweights_only=True
. Our checkpoints don't satisfy this constraint, because we save checkpoints using the incremental pickle save. See #1357 for more context where we had to work around this.The text was updated successfully, but these errors were encountered: