fix: return quorum based error, temporary failures must be ignored

[harshavardhana]

Community Contribution License

All community contributions in this pull request are licensed to the project maintainers
under the terms of the Apache 2 license.
By creating this pull request I represent that I have the right to license the
contributions to the project maintainers under the Apache 2 license.

Description

fix: return quorum based error, temporary failures must be ignored

Motivation and Context

do not return prematurely due to network errors

How to test this PR?

hard to reproduce but can be reproduced via naughty-disk_test.go

Types of changes

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Optimization (provides speedup with no functional changes)
• Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

• Fixes a regression (If yes, please add commit-id or PR # here)
• Unit tests added/updated
• Internal documentation updated
• Create a documentation update request here

[vadmeste]

LGTM

[klauspost]

LGTM