[BiO BB] Help : How to interoperate between a WebServer and aCluster ?

[Balamurugan.R]

Hi Shameer,

 

If you already have a cluster setup and running and you also have a
dedicated web server that can reach the head node of your cluster in the
network, then your job is simple.

 

All you have to do is install and cluster resource manager and scheduler. 

Below is a list of few open source tools you could use.

1. TORQUE

2. SLURM

If what you wish is a simple FIFO queue and no complications, then the
choice would be SLURM.

It is very simple to port and install SLURM on a linux cluster.

 

Just three steps.

 

1.       Install SLURM.

2.      At the web server, convert the query into a linux shell script that
can run independently.

3.      Submit the job to the head node of the cluster using srun command of
the SLURM utility.

 

You can check with the documentation of this utility at
www.llnl.gov/linux/slurm

Hope this helps.

 

Happy new year!

 

 

Best Regards,

Balamurugan.R,

HCL Infosystems Ltd.

  _____  

| RS 107/5, 6 & 7, Sedarapet  |  Puducherry -605111, India. | 
| *Office :   0413-2677585 | *Extn: 120  | Email: rb at hcl.in |  

  _____  

This e-Mail may contain proprietary and confidential information and is sent
for the intended recipient(s) only.  If by an addressing or transmission
error this mail has been misdirected to you, you are requested to delete
this mail immediately. You are also hereby notified that any use, any form
of reproduction, dissemination, copying, disclosure, modification,
distribution and/or publication of this e-mail message, contents or its
attachment other than by its intended recipient(s) is strictly prohibited.

-----Original Message-----
From: bio_bulletin_board-bounces+rb=hcl.in at bioinformatics.org
[mailto:bio_bulletin_board-bounces+rb=hcl.in at bioinformatics.org] On Behalf
Of Shameer Khadar
Sent: Sunday, December 31, 2006 12:06 AM
To: General Forum at Bioinformatics.Org
Subject: [BiO BB] Help : How to interoperate between a WebServer and
aCluster ?

 

Dear All,

 

Currently we are developing an Integrated Web Server for protein sequence

and structure analysis.

We are planning to provide a dedicated cluster to support the server.

 

I need help to set up a web application that can manage the web server and

our cluster.

For example  if the user is submitting a huge set  of sequence for MSA, the

program should take care of

the process and pass it on to the cluster and display the status of the job

(que and other details).

I know this is possible and people are doing it for example (Robetta

Server).

 

It will be great, If any of the BioIT techies around can help me out with

some help :))

 

We are using Ganglia as the server management tool. Web  Server is apache

running on  CentOS4 .

 

Thanks in Advance and Happy New Year to all...

-- 

S Khadar

_______________________________________________

General Forum at Bioinformatics.Org - BiO_Bulletin_Board at bioinformatics.org

https://bioinformatics.org/mailman/listinfo/bio_bulletin_board