[Pydra] Task scheduling code preview
peter at osuosl.org
Mon Jun 8 14:03:40 UTC 2009
I checked out your repo but didn't see any code committed in either the
master or sched_experiment branches.
Yin QIU wrote:
> Hi Peter,
> I made some changes to the code on the task scheduling part. Though
> the current code is unlikely to work, I hope you can review my early
> changes to see if I'm on the right track. I will polish the code to
> make it work according to your comments.
> Briefly speaking, my changes include:
> 1) Added a sched module, which contains logic to queue worker requests
> and maintain worker states. The core of this module is the Scheduler
> class. It, as mentioned before, keeps a long-term queue and a
> short-term one. Periodically, these two queues are re-ordered. By
> applying a simple observer pattern, it notifies the master when a
> scheduling decision is made.
> For the scheduling algorithm to work,
> TaskExecutionRecord.compute_score() ought to be well defined. Though
> currently, it simply returns the priority attribute of the task.
> Besides, some other logic may be included when making a scheduling
> 2) Trying to migrate code that is related to task scheduling in
> master.py to sched.py. Not completed yet.
> The planned Task.workunit() generator has been put off by me.
> My code is only an early draft and is rather messy. But I plan to have
> a usable prototype in the next two weeks.
> You can pull my changes from
> in a new branch named "sched_experiment". It has been merged with
> commit 951ec7, which was the latest commit on the master branch from
More information about the Pydra