Support get_multi_ranges
in ObjectStore
#2293
Labels
enhancement
Any new improvement worthy of a entry in the changelog
object-store
Object Store Interface
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
now we have
arrow-rs/object_store/src/lib.rs
Lines 115 to 118 in 6c3f9a2
I found in #2110 already support multi ranges
arrow-rs/parquet/src/arrow/async_reader.rs
Lines 115 to 124 in aeb2776
we should support same location path with multi ranges read in object_store,
like
This will reduce some overhead like in HDFS:
We need to get file metadata for each
location
from metadata server(nameNode), if we can get multi ranges in one location will reduce some rpc call in system.Describe the solution you'd like
Describe alternatives you've considered
Additional context
The text was updated successfully, but these errors were encountered: