Feature: SoftMax, CosFace, ArcFace layers

[ditwoo]

Before submitting

• Was this discussed/approved via a Github issue? (no need for typos and docs improvements)
• Did you read the contribution guide?
• Did you check the code style? catalyst-make-codestyle && catalyst-check-codestyle (pip install -U catalyst-codestyle).
• Did you make sure to update the docs? We use Google format for all the methods and classes.
• Did you check the docs with make check-docs?
• Did you write any new necessary tests?
• Did you add your new functionality to the docs?
• Did you update the CHANGELOG?
• You can use 'Login as guest' to see Teamcity build logs.

Description

Related Issue

Type of Change

• Examples / docs / tutorials / contributors update
• Bug fix (non-breaking change which fixes an issue)
• Improvement (non-breaking change which improves an existing feature)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to change)

PR review

Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in Github issues there's a high chance it will not be merged.

[pep8speaks]

Hello @ditwoo! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

There are currently no PEP 8 issues detected in this Pull Request. Cheers! 🍻

Comment last updated at 2020-10-01 21:23:14 UTC

[github-actions]

Remaining comments which cannot be posted as a review comment to avoid GitHub Rate Limit

pep8

catalyst/contrib/nn/tests/test_criterion.py|2 col 1| I001 isort found an import in the wrong position
catalyst/contrib/nn/tests/test_criterion.py|7 col 1| I001 isort found an import in the wrong position
catalyst/contrib/nn/tests/test_criterion.py|27 col 1| D103 Missing docstring in public function
catalyst/contrib/nn/tests/test_criterion.py|63 col 5| F841 local variable 'feats' is assigned to but never used

[Scitator]

as far as this is criterions, could we move them to contrib/nn/criterion? what do you think about this?

[mergify]

This pull request is now in conflicts. @ditwoo, could you fix it? 🙏

[mergify]

This pull request is now in conflicts. @ditwoo, could you fix it? 🙏