【Hackathon No.13】为 Paddle 新增 CyclicLR 优化调度器 #40698

Asthestarsfalll · 2022-03-18T07:02:39Z

PR types

Others

PR changes

APIs

Describe

解决了issue：#40321
增加了CyclicLR优化调度器。具体地，paddle.optimizer.lr.CyclicLR(base_learning_rate,max_learning_rate,step_size_up,step_size_down, mode='triangular',gamma=1.,scale_fn=None,scale_mode='cycle',last_epoch=-1,verbose=False)能控制学习率以固定周期在base_learning_rate和max_learning_rate之间变化，它的调整是以batch step进行的，同时还有3种内置的波幅调整策略：“triangular”、“triangular2”、“exp_range”。
设计文档：PaddlePaddle/community#33
中文文档：PaddlePaddle/docs#4315

CLAassistant · 2022-03-18T07:02:42Z

All committers have signed the CLA.

paddle-bot-old · 2022-03-18T07:02:52Z

✅ This PR's description meets the template requirements!
Please wait for other CI results.

paddle-bot-old · 2022-03-18T07:02:55Z

你的PR提交成功，感谢你对开源项目的贡献!
请关注后续CI自动化测试结果，详情请参考Paddle-CI手册。
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

paddle-bot-old · 2022-03-22T02:55:31Z

PR格式检查通过，你的PR将接受Paddle专家以及开源社区的review，请及时关注PR动态。
The format inspection passed. Your PR will be reviewed by experts of Paddle and developers from the open-source community. Stay tuned.

… cycliclr

dingjiaweiww · 2022-03-31T03:40:20Z

请先通过CI噢~

… cycliclr

Asthestarsfalll · 2022-04-01T10:07:13Z

@dingjiaweiww 你好，已修改更新了，但还是有些过不了，可以帮忙看下吗？十分感谢！

dingjiaweiww · 2022-04-02T02:41:39Z

PR-CI-Coverage表示代码覆盖率不够

dingjiaweiww · 2022-04-02T02:42:31Z

R-CI-iScan-Python指代码不符合规范

dingjiaweiww · 2022-04-02T02:43:19Z

PR-CI-Kunlun-KP-Build和PR-CI-Static-Check可以不通过~

Asthestarsfalll · 2022-04-02T03:16:14Z

感谢帮助！

… cycliclr

zhiboniu

LGTM

TCChenlong

LGTM

XiaoguangHu01

LGTM

TCChenlong · 2022-06-01T02:48:27Z

@Asthestarsfalll 请解决一下 CI 中 Code Style error 的问题

… cycliclr

Asthestarsfalll · 2022-06-02T06:38:39Z

@Asthestarsfalll 请解决一下 CI 中 Code Style error 的问题

down

TCChenlong · 2022-06-06T07:00:46Z

@Asthestarsfalll 请解决一下冲突~

python/paddle/optimizer/lr.py

XiaoguangHu01

LGTM

… cycliclr

XiaoguangHu01

LGTM

TCChenlong

LGTM

zhiboniu

LGTM

jeff41404

LGTM

Asthestarsfalll added 2 commits March 18, 2022 14:55

add paddle.optimizer.lr.CyclicLR

620ac56

add unittest of CyclicLR

4fe10c4

paddle-bot-old bot added contributor External developers status: proposed labels Mar 18, 2022

dingjiaweiww assigned zhwesky2010 and DDDivano and unassigned zhwesky2010 Mar 22, 2022

dingjiaweiww added status: open review and removed status: proposed labels Mar 22, 2022

Asthestarsfalll added 2 commits March 28, 2022 20:36

fix code format

41a2fe0

Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…

2ba48b6

… cycliclr

Asthestarsfalll added 2 commits March 31, 2022 19:05

fix bug

d47a8c0

Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…

9318274

… cycliclr

Asthestarsfalll mentioned this pull request Apr 1, 2022

【PaddlePaddle Hackathon 第二期】任务总览 #40234

Closed

dingjiaweiww closed this Apr 2, 2022

dingjiaweiww reopened this Apr 2, 2022

Asthestarsfalll added 3 commits April 2, 2022 22:59

try

efdb2fe

Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…

ac13dfb

… cycliclr

fix CI-Coverage

fc0d68c

Asthestarsfalll added 3 commits May 20, 2022 18:01

gamma->exp_gamma

ef0b383

polish docs

03d7fac

Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…

85e5eb1

… cycliclr

Asthestarsfalll mentioned this pull request May 30, 2022

更新API CyclicLR设计文档 PaddlePaddle/community#145

Merged

zhiboniu previously approved these changes May 31, 2022

View reviewed changes

TCChenlong previously approved these changes Jun 1, 2022

View reviewed changes

DDDivano previously approved these changes Jun 1, 2022

View reviewed changes

XiaoguangHu01 previously approved these changes Jun 1, 2022

View reviewed changes

Asthestarsfalll added 2 commits June 1, 2022 13:38

fix code-style

5ebf5c1

Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…

36ca157

… cycliclr

Asthestarsfalll dismissed stale reviews from XiaoguangHu01, DDDivano, TCChenlong, and zhiboniu via 36ca157 June 1, 2022 05:42

Asthestarsfalll added 2 commits June 6, 2022 16:03

fix conflit and update code format

cab314a

adjust code format again

f86f9e3

zhiboniu reviewed Jun 7, 2022

View reviewed changes

python/paddle/optimizer/lr.py Outdated Show resolved Hide resolved

XiaoguangHu01 previously approved these changes Jun 7, 2022

View reviewed changes

Asthestarsfalll added 2 commits June 7, 2022 17:41

change format of __all__ in lr.py

07db9a0

Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…

5227cd6

… cycliclr

Asthestarsfalll dismissed XiaoguangHu01’s stale review via 5227cd6 June 7, 2022 09:43

XiaoguangHu01 approved these changes Jun 7, 2022

View reviewed changes

TCChenlong approved these changes Jun 7, 2022

View reviewed changes

zhiboniu approved these changes Jun 8, 2022

View reviewed changes

jeff41404 approved these changes Jun 8, 2022

View reviewed changes

jeff41404 merged commit 33949fc into PaddlePaddle:develop Jun 8, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

【Hackathon No.13】为 Paddle 新增 CyclicLR 优化调度器 #40698

【Hackathon No.13】为 Paddle 新增 CyclicLR 优化调度器 #40698

Asthestarsfalll commented Mar 18, 2022 •

edited

CLAassistant commented Mar 18, 2022 •

edited

paddle-bot-old bot commented Mar 18, 2022 •

edited

paddle-bot-old bot commented Mar 18, 2022

paddle-bot-old bot commented Mar 22, 2022

dingjiaweiww commented Mar 31, 2022

Asthestarsfalll commented Apr 1, 2022

dingjiaweiww commented Apr 2, 2022

dingjiaweiww commented Apr 2, 2022

dingjiaweiww commented Apr 2, 2022

Asthestarsfalll commented Apr 2, 2022

zhiboniu left a comment

TCChenlong left a comment

XiaoguangHu01 left a comment

TCChenlong commented Jun 1, 2022

Asthestarsfalll commented Jun 2, 2022

TCChenlong commented Jun 6, 2022

XiaoguangHu01 left a comment

XiaoguangHu01 left a comment

TCChenlong left a comment

zhiboniu left a comment

jeff41404 left a comment

【Hackathon No.13】为 Paddle 新增 CyclicLR 优化调度器 #40698

【Hackathon No.13】为 Paddle 新增 CyclicLR 优化调度器 #40698

Conversation

Asthestarsfalll commented Mar 18, 2022 • edited

PR types

PR changes

Describe

CLAassistant commented Mar 18, 2022 • edited

paddle-bot-old bot commented Mar 18, 2022 • edited

paddle-bot-old bot commented Mar 18, 2022

paddle-bot-old bot commented Mar 22, 2022

dingjiaweiww commented Mar 31, 2022

Asthestarsfalll commented Apr 1, 2022

dingjiaweiww commented Apr 2, 2022

dingjiaweiww commented Apr 2, 2022

dingjiaweiww commented Apr 2, 2022

Asthestarsfalll commented Apr 2, 2022

zhiboniu left a comment

Choose a reason for hiding this comment

TCChenlong left a comment

Choose a reason for hiding this comment

XiaoguangHu01 left a comment

Choose a reason for hiding this comment

TCChenlong commented Jun 1, 2022

Asthestarsfalll commented Jun 2, 2022

TCChenlong commented Jun 6, 2022

XiaoguangHu01 left a comment

Choose a reason for hiding this comment

XiaoguangHu01 left a comment

Choose a reason for hiding this comment

TCChenlong left a comment

Choose a reason for hiding this comment

zhiboniu left a comment

Choose a reason for hiding this comment

jeff41404 left a comment

Choose a reason for hiding this comment

Asthestarsfalll commented Mar 18, 2022 •

edited

CLAassistant commented Mar 18, 2022 •

edited

paddle-bot-old bot commented Mar 18, 2022 •

edited