You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Usually in SAC we use Normal distribution coupled with tanh to bound action space. However, after such transformation the actual distribution is now not just standard Normal and we can not use it's lob_prob to get the probabilities of actions. This formula accounts for the transformation and gives right probabilities for TanhNormal distribution. See Appendix C in the original paper: https://arxiv.org/pdf/1801.01290.pdf
Problem Description
Hi! Thanks for this clean script to help me understand
sac
.But I have some questions about the implementation of
sac
's get action function, mainly focused on the following code snippetcleanrl/cleanrl/sac_continuous_action.py
Lines 139 to 141 in 2d660b6
What is the purpose of this? Thanks!
Checklist
poetry install
(see CleanRL's installation guideline.The text was updated successfully, but these errors were encountered: