Skip to content

Issues: pytorch/benchmark

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

58 Open 782 Closed
58 Open 782 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

V3 Performance Signal Detected by TorchBench Userbenchmark "torch-nightly" on '2.4.0.dev20240509+cu121' torchbench-perf-report
#2260 opened May 10, 2024 by xuzhao9
RuntimeError When Enabling Accuracy Checks in yolov3 Training on GPU. accuracy
#2248 opened Apr 26, 2024 by scshtyk
Rolling the nightly release testing using the main branch
#2244 opened Apr 25, 2024 by xuzhao9
RuntimeError When Enabling Accuracy Checks in DALLE2_pytorch Training on GPU. accuracy
#2241 opened Apr 25, 2024 by cjxjxjx
2
Validate the bf16 precisions across models
#2203 opened Mar 19, 2024 by xuzhao9
1
eval(f.read()) is used, which will cause security issue
#2202 opened Mar 18, 2024 by duck7216
1
Skip GPU memory metrics when running with AMD GPU
#2199 opened Mar 15, 2024 by xuzhao9
Llava model is not running its vision module
#2180 opened Feb 28, 2024 by BowenBao
1
Use CPU-only instance to run the CPU tests
#2135 opened Jan 26, 2024 by xuzhao9
Fix model_flops feature on PT2
#2131 opened Jan 23, 2024 by xuzhao9
1
Enable memory profiling on the models
#2098 opened Dec 21, 2023 by xuzhao9
Wrap up the distributed benchmark and get them running on conda_mast
#2096 opened Dec 19, 2023 by xuzhao9
redundant memory allocation maybe the root cause of OOMs
#2060 opened Nov 27, 2023 by jinsong-mao
1
llama_7b model OOM issue
#2051 opened Nov 21, 2023 by jinsong-mao
2
Rework Dynamic Benchmarks To Actually Vary Shapes
#2028 opened Nov 6, 2023 by eellison
Reuse the code from dynamo bench for accuracy checking
#2012 opened Oct 25, 2023 by xuzhao9
[optim] Noisy benchmarks
#1988 opened Oct 15, 2023 by janeyx99
Permission Issue with installation. windows
#1983 opened Oct 14, 2023 by pranavsharma
2
Torchbench models that don't run in dynamo runners
#1901 opened Sep 15, 2023 by msaroufim
1
[optim][ub] pt2 values keep flip-flopping nondeterministically torchbench-perf-report
#1888 opened Sep 11, 2023 by github-actions bot
ASGD perf regression torchbench-perf-report
#1886 opened Sep 9, 2023 by github-actions bot
1
Add examples in algorithm_efficiency
#1844 opened Aug 23, 2023 by xuzhao9
Test that grad is disabled in eval tests by default
#1838 opened Aug 18, 2023 by xuzhao9
Implement unit test for userbenchmarks
#1827 opened Aug 16, 2023 by xuzhao9
Add llama_v2_7b_16h to the optim benchmarks once the model supports train
#1793 opened Jul 28, 2023 by janeyx99
1
ProTip! Find all open issues with in progress development work with linked:pr.