1.16.1 cherry picks (#6108)

### Description
Check-pick commits from `main` into `rel-1.16.1` branch

### Motivation and Context
Fix 1.16.0 issues and enabled 1.16.1 builds by cherry-picking the
following PRs from `main` into the `1.16.1` branch

* Fixes since 1.16.0 release
    * #6049
    * #6048
    * #6080
    * #6122

* Update CI and Build to enable 1.16.1 builds
    * #6106
    * #6129
    * #6075
    * #6117

---------

Co-authored-by: liqun Fu <liqfu@microsoft.com>
Co-authored-by: G. Ramalingam <grama@microsoft.com>
Co-authored-by: Matthieu Darbois <mayeut@users.noreply.github.com>
Co-authored-by: Adrian Lizarraga <adlizarraga@microsoft.com>
Co-authored-by: Justin Chu <justinchuby@users.noreply.github.com>