[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: distributed batch processing


Last I checked, OpenPBS was still free as in beer and source
was available.  Wether it is free as in Stallman is another matter.
It is still part of the OSCAR cluster solution
(http://www.csm.ornl.gov/oscar/home.html)

There are some others available as well:

  Sun's Grid Engine (http://gridengine.sunsource.net)
  which is a reincarnation of Codine, which was a reincarnation
  of DQS.

  The Condor (http://www.cs.wisc.edu/condor) cycle-scavenging
  batch system.

  GenericNQS (http://www.gnqs.org/) which is mostly dead, but
  source is still available.



On May 10, 2005, at 4:11 PM, Paul Brossier wrote:


Hi all,

I sent the following mail to -devel, but thought this list will
have some fine advices. I am not really willing to set up a
cluster just to distribute jobs though.

Many thanks, Paul
----- Forwarded message from Paul Brossier <piem-lists@altern.org> ----- 

Date: Tue, 10 May 2005 01:05:28 +0100
From: Paul Brossier <piem-lists@altern.org>
To: debian-devel@lists.debian.org
Subject: distributed batch processing
Reply-To: Paul Brossier <piem-lists@altern.org>
Resent-Date: Mon,  9 May 2005 19:05:57 -0500 (CDT)

Hi all,

I am looking at ways to distribute batch jobs on various hosts.
Essentially, i have N different command lines, and M different
hosts to run them on:

        foo -i file1.data -p 0.1
        foo -i file2.data -p 0.1
        foo -i file3.data -p 0.1
        ...
        foo -i file1.data -p 0.2
        ...

I had a try with 'queue' [1], but it seems rather obsolete now.
I am now seeking recent alternatives. I went across a few
solutions, such as DQS [2] (non-free, unmaintained), OpenPBS [3]
(non-free), and distribulator [4] (looks interesting).

Now i feel like i have missed something obvious. Is there a tool
out there that i could use as a drop in replacement for queue?

cheers, paul

[1] http://sourceforge.net/projects/queue/
[1] http://packages.debian.org/stable/admin/dqs
[2] http://www.openpbs.org/
[3] http://distribulator.sourceforge.net/


--
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org 



----- End forwarded message -----


--
To UNSUBSCRIBE, email to debian-beowulf-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org 



--
/*  Dale Southard Jr.   dsouth@llnl.gov  925-422-1463  f:422-9429
 *  Computer Scientist, Advanced Simulation and Computing Program
 *  Lawrence Livermore National Lab, L-073,  Livermore, CA  94551
 */
Reply to: