Feature request: run_pending_tasks method to optionally take the max number of entries to process in a call

[tatsuya6502]

Split from #345 (comment).

And does the eviction handler then block data or threads for such a long time that the end-user observes a very long response time?

If that is the case, would it not be more handy to give the user some control over this behavior? Either beforehand by giving the run_pending_tasks() function an input u64 parameter of the maximum amount of items which can processed, and/or afterwards supply a boolean or u64 as return value containing the numbers of items which still needs to be processed...?

So, without queued delivery mode, cache writes could be blocked in the above case. As you see in the migration guide, run_pending_tasks does many types of task, so we could provide a struct with some fields to specify the maximum amounts of items to process per task type. As for the return type, it is expensive (e.g. O(n)) to count the numbers of items, which still needs to be processed. So probably we will return a stuct having the counters for the numbers of items, which were processed, per task type.

[tatsuya6502]

let counters = cache.pending_task_processing_options()
    // The maximum entries to process by the tasks that can call the
    // eviction listener.
    .max_entries_to_evict_due_to_size_limit(100)
    .max_expired_entries_to_evict(100)
    // (The entries scanned after calling `invalidate_all` or
    // `invalidate_entries_if`)
    .max_entries_to_scan_by_bulk_invalidation(500)
    // The maximum items to process by other tasks.
    .max_read_logs_to_process(2000)
    .max_write_logs_to_process(100)
    // Process the pending tasks.
    .run();

// NOTE: If you do not set some options above, `0` will be used for them.

// Resulting counters.
dbg!(counters.entries_evicted_due_to_size_limit);
dbg!(counters.expired_entries);
dbg!(counters.scanned_entries_by_bulk_invalidation);
dbg!(counters.read_logs_processed);
dbg!(counters.write_logs_processed);

EDIT: Renamed items to entries.