Version 4 (modified by mmamonski, 9 years ago) (diff)

--

QCG-Computing

QCG-Computing (formerly known as  Smoa Computing) is an open architecture implementation of SOAP Web service for multi-user access and policy-based job control routines by various queuing and batch systems managing local computational resources. This key service in QosCosGrid is using Distributed Resource Management Application API (DRMAA) to communicate with the underlying queuing systems. QCG-Computing has been designed to support a variety of plugins and modules for external communication as well as to handle a large number of concurrent requests from external clients and services. Consequently, it can be used and integrated with various authentication, authorization and accounting services. QCG-Computing service is compliant with the  OGF HPC Basic Profile specification, which serves as a profile over Open Grid Forum standards like JSDL and OGSA Basic Execution Service. In addition, it offers remote interfaces for advance reservation management, and supports basic file transfer mechanisms. QCG-Computing was successfully tested with the following queuing systems:

  • Grid Engine,
  • Platform LSF,
  • Torque/Maui,
  • PBS Pro,
  • Condor,
  • Apple XGrid,
  • SLURM,
  • LoadLeveler.

Therefore, as a primary computing element of QosCosGrid stack, it can be easily set up on the majority of computing clusters and supercomputers running the aforementioned queuing systems. Currently, advance reservation capabilities in QCG-Computing are exposed for SGE, Platform LSF and Maui (a scheduler that is typically used in conjunction with Torque). Moreover, generic extensions for advance reservation have been proposed for the next DRMAA standard release.

Applications

  • QosCosGrid - In this projectd QCG-Notification together with other Web Services using the QosCosGrid framework, in particular QCG-Computing, was used to build highly efficient grid middleware for cross-cluster parallel application execution and monitoring.
  • BREIN - QCG-Notification was demonstrated in asynchronous and dynamic message exchange in a distributed IT system controlling some events generated by an example airport management system, such as flight delays, SLA violations, etc.
  • PL-Grid - QCG-Notification is going to be productively used under the national grid infrastructure initiative in Poland.
  • Mapper - In the Mapper project, QosCosGrid stack is exploited to perform multiscale computations on EGI and PRACE resources.

Further reading

Installation

Tools

Related software

  • QCG-Core - generic library must be installed in the system in prior to the installation of QCG-Computing.
  • QCG-XMPP - plugins for Pidgin may be utilized for enabling WS-Notifications in the popular XMPP communicator.
  • Nagios Probes?
  • Java SDK?

Changelog

Changelog

Acknoledgments

The development of this component is partially funded by the PL-Grid project (POIG.02.03.00-00-007/08-00) and corresponding SPUB-M grants from the Polish Ministry of Science and Higher Education.