[Pydra] Task scheduling code preview

Peter Krenesky peter at osuosl.org
Mon Jun 8 14:03:40 UTC 2009


Hi yin,

I checked out your repo but didn't see any code committed in either the
master or sched_experiment branches.

Yin QIU wrote:
> Hi Peter,
>
> I made some changes to the code on the task scheduling part. Though
> the current code is unlikely to work, I hope you can review my early
> changes to see if I'm on the right track. I will polish the code to
> make it work according to your comments.
>
> Briefly speaking, my changes include:
>
> 1) Added a sched module, which contains logic to queue worker requests
> and maintain worker states. The core of this module is the Scheduler
> class. It, as mentioned before, keeps a long-term queue and a
> short-term one. Periodically, these two queues are re-ordered. By
> applying a simple observer pattern, it notifies the master when a
> scheduling decision is made.
>
> For the scheduling algorithm to work,
> TaskExecutionRecord.compute_score() ought to be well defined. Though
> currently, it simply returns the priority attribute of the task.
> Besides, some other logic may be included when making a scheduling
> decision.
>
> 2) Trying to migrate code that is related to task scheduling in
> master.py to sched.py. Not completed yet.
>
>
> The planned Task.workunit() generator has been put off by me.
>
> My code is only an early draft and is rather messy. But I plan to have
> a usable prototype in the next two weeks.
>
>
> You can pull my changes from
>
>   http://218.94.9.38:8081/git/pydra.git
>
> in a new branch named "sched_experiment". It has been merged with
> commit 951ec7, which was the latest commit on the master branch from
> git://trac.osuosl.org/pydra.git.
>
>
>   



More information about the Pydra mailing list