[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: Building a cluster with debian?

On Wednesday 03 December 2008, Micha Feigin <michf@post.tau.ac.il> wrote 
about 'Re: Building a cluster with debian?':
>On Wed, 3 Dec 2008 14:18:37 +0200
>Micha Feigin <michf@post.tau.ac.il> wrote:
>> On Wed, 3 Dec 2008 12:40:45 +0200
>> Johann Spies <jspies@sun.ac.za> wrote:
>> > On Tue, Dec 02, 2008 at 04:53:45PM +1100, Alex Samad wrote:
>> > > I believe there is software out there that will do that, I read
>> > > about some recently, but can't find reference to it now :(
>> >
>> > Have a look at http://gridengine.sunsource.net/
>> Thanks, looks like a glorified pbs mostly but may be of some help. I
>> was hoping to somehow abuse numa and processor queues to make the
>> cluster look as a single numa computer but that seems to require
>> hardware support (multi processor numa system and not several systems
>> combined into one numa).
>> The solutions I found so far:
>> 1. Hardware - Buy a very expensive multi opetron system (not an option
>> at this time)
>>2. ssi (single system image) cluster, seems to be what I want,
>> it's just not clear to me at the moment if there is anything that can
>> properly migrate threads
>> http://en.wikipedia.org/wiki/Single-system_image
>Looks like current options are
>LinuxPMI ( continues that dropped openmosix project)
>Kerrighed (web page says that they are planning to allow thread migration
> in november) Mosix 2 (commercial)
>Looks like all of them support comunication through pipes, doesn't seem
> like any of them support thread migration yet, would love to hear
> otherwise.

LinuxPMI does not support thread migration. The only person that's doing 
*any* work on it right now is Juri_, who happens to be my roommate.  She's 
not really interested in doing thread migration.  She's of the opinion 
currently that LinuxPMI should treat processes atomically -- either the 
whole process (and all threads) moves or not at all.

And really, with the number of people helping on LinuxPMI and their 
available time, we don't have time to add new feature and thats how 
OpenMOSIX worked.

Assuming you have access to the source code, you could modify it to use 
shared memory across multiple processes.  Then, it can benefit from the 
distributed shared memory that I believe is in MODIX 2 and, last I 
checked, one of the LinuxPMI goals.  It's also quite similar to threaded 
programming -- explicit sharing vs. implicit sharing -- and just a smidge 
more robust.

>> I prefered number 2 but as I said, it doesn't seem to handle multi
>> threaded and shared memory programs, most of them not even as a whole
>> (i.e once you have threads the whole job will not migrate).

I know migrating threaded processes as a single unit is a goal for 
LinuxPMI, can't say with absolute certainty that it works right now.

We are always looking for more help on LinuxPMI!
Boyd Stephen Smith Jr.                     ,= ,-_-. =. 
bss03@volumehost.net                      ((_/)o o(\_))
ICQ: 514984 YM/AIM: DaTwinkDaddy           `-'(. .)`-' 
http://iguanasuicide.org/                      \_/     

Attachment: signature.asc
Description: This is a digitally signed message part.

Reply to: