Commits on Apr 12, 2022

1. Allow stealing of fast tasks in some situations …

   Previously we avoided the stealing of fast tasks in some situations.  It
   was generally considered a bad idea to spend non-trivial time in order
   to move around a 1ms task.  However, sometimes it's not this task that
   matters, but the tasks that it unblocks.  Being strict about not
   stealing may not always be ideal.
   
   This commit relaxes stealing of fast tasks in three ways:
   
   1.  It sets a minimum duration of tasks to 5ms,
       this being something like the overhead in a real system
   
   2.  It changes the network latency variable in stealing.py from 100ms to 10ms
   
   3.  It no longer completely rules out very fast tasks from stealing, but
       instead lets them compete based on their compute/transfer ratio
       (which should ordinarily be terrible)
   
       In cases where transfer times are trivial this becomes doable again.
   
   Tests don't pass yet, this is up for comments

   

   mrocklin committed Apr 12, 2022
   Configuration menu

   • View commit details
   • Copy full SHA for c9613fe
   • Browse repository at this point

   Copy the full SHA

   c9613fe View commit details

   Browse the repository at this point in the history