Use total_cmp for floating value ordering and remove nan_ordering feature flag

[viirya]

Which issue does this PR close?

Closes #2613.

Rationale for this change

What changes are included in this PR?

Are there any user-facing changes?

[tustvold]

Could you perhaps run the benchmarks just to see what performance impact this has?

[viirya]

Sure. I'll run the benchmark.

[viirya]

Ran the comparison benchmarks. No performance difference shown.

[tustvold]

No performance difference shown.

Even when the nan_ordering feature is enabled?

[viirya]

Even when the nan_ordering feature is enabled?

Yes.

[ursabot]

Benchmark runs are scheduled for baseline = 62eeaa5 and contender = 9f4d56d. 9f4d56d is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Skipped ⚠️ Benchmarking of arrow-rs-commits is not supported on ec2-t3-xlarge-us-east-2] ec2-t3-xlarge-us-east-2
[Skipped ⚠️ Benchmarking of arrow-rs-commits is not supported on test-mac-arm] test-mac-arm
[Skipped ⚠️ Benchmarking of arrow-rs-commits is not supported on ursa-i9-9960x] ursa-i9-9960x
[Skipped ⚠️ Benchmarking of arrow-rs-commits is not supported on ursa-thinkcentre-m75q] ursa-thinkcentre-m75q
Buildkite builds:
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

[viirya]

Thanks @tustvold