Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding OLMo 1B and 7B #925

Open
rasbt opened this issue Feb 12, 2024 · 0 comments · May be fixed by #927
Open

Adding OLMo 1B and 7B #925

rasbt opened this issue Feb 12, 2024 · 0 comments · May be fixed by #927
Assignees

Comments

@rasbt
Copy link
Collaborator

rasbt commented Feb 12, 2024

OLMo is a pretty attractive set of models by Allen AI since they open sourced the whole training code etc. It's one of the few fully open models: https://github.com/allenai/olmo

We have a lot of 7B models (OLMo would be just another one here) but it's also interesting for its 1B model, because we don't have that many good models on a small scale, and that small scale is attractive for experiments on single GPU.

@rasbt rasbt changed the title Adding OLMo Adding OLMo 1B and 7B Feb 12, 2024
@rasbt rasbt self-assigned this Feb 12, 2024
@rasbt rasbt linked a pull request Feb 12, 2024 that will close this issue
14 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant