 |
 |
Hi, just some things to say: xrootd with the current set of plugins is not supposed to schedule jobs by itself, since it is a data access clusterizable server I don't know your requirements, but if you only have to submit your jobs near to the data they need, you can query a cluster (even spread through WANs) for the location of the data, and then take your scheduling decision. Depending on your needed throughpout and data patterns, you can access data which is not local, with good (or very good) performance, which can be much better than with other data access prptocols. Also, the next versions of xrootd will be more powerful from this point of view, since we are planning to implement multistream xfers. I just said that with the current set of plugins you cannot submit anything through xrootd, but you can only use the responses as an advice to submit your job. But somebody which is interested could write some other plugins in order to do other things instead of simply reading/writing to a file. Andy could be more specific to this if you are interested. Fabrizio Ashiq Anjum wrote: > I want to do data intensive Grid scheduling. For example, I plan to schedule a compute job that will do certain operations on a dataset. Should data be moved to job or job should be moved towards data or any other related decision making. > > My query is, can xrootd in any way become such a scheduling platform or it will remain only a data access mechanism in which scheduler will request xrootd to access cetain datasets? > > cheers, > Ashiq Anjum > > > -----Original Message----- > From: Jerome LAURET [mailto:[log in to unmask]] > Sent: Mon 6/12/2006 9:21 PM > To: Ashiq Anjum > Cc: Peter Elmer; [log in to unmask] > Subject: Re: Scheduling with xrootd > > > What does "grid scheduling with Xrootd" means ??? You > need to expand really. There are Meta-Schedulers aimed to do > diverse task (including scheduling where the data is if knowledge > is available). Xrootd could "place" the data bringing it from a > distance or MSS. > > What are you after ?? > > Ashiq Anjum wrote: >> Hi Peter, >> >> Thanks for your quickly reply. >> >> Actually I want to know can i do Grid Scheduling with xrootd? Is that possible with PROOF? >> >> cheers, >> >> Ashiq Anjum >> >> >> >> -----Original Message----- >> From: Peter Elmer [mailto:[log in to unmask]] >> Sent: Mon 6/12/2006 9:01 PM >> To: Ashiq Anjum >> Cc: [log in to unmask] >> Subject: Re: Scheduling with xrootd >> >> Hi Ashiq, >> >> On Mon, Jun 12, 2006 at 09:55:37PM +0200, Ashiq Anjum wrote: >>> I have a quick question. Can we do >>> Meta-Scheduling/co-scheduling(scheduling of compute jobs taking into >>> account data location) with xrrotd? What I found that xrootd is only a >>> data access mechanism in a decentralized way and I will be grateful if >>> I can be proven wrong:) >> As designed it is a data access mechanism. >> >> Are you asking for PROOF or for something else? >> >> Pete >> >> ------------------------------------------------------------------------- >> Peter Elmer E-mail: [log in to unmask] Phone: +41 (22) 767-4644 >> Address: CERN Division PPE, Bat. 32 2C-14, CH-1211 Geneva 23, Switzerland >> ------------------------------------------------------------------------- >> >