Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

European distributed supercomputing infrastructure is being born

08.11.2004


In one of the most important moves to bring together national supercomputing infrastructures to advance science and technology in Europe, several leading European HPC centres devised an innovative strategy to build a terascale supercomputing facility with continental scope, called Distributed European Infrastructure for Supercomputing Applications (DEISA).



Led by IDRIS-CNRS (France) the DEISA project started its activities in May 2004 with eight partners: FZJ and RZG in Germany, CINECA in Italy, EPCC and ECMWF in the UK, CSC in Finland and SARA in the Netherlands. The project is partially funded by the European Commission under the 6ththFramework Program, as part of a vigorous initiative aimed at deploying grid enabled, production quality research infrastructures in Europe.

The main objective of the DEISA project is to enable scientific discovery across a broad spectrum of science and technology, by the deployment and operation of a world class, persistent, production quality, distributed supercomputing environment. This becomes possible through a deep integration of existing national high-end platforms, tightly coupled by a dedicated network and supported by innovative system and grid software. Strategies of coordinated operation have been identified and agreed, which will make the integrated infrastructure superior to the sum of its parts.


This integrated supercomputing power is intended to bring a boost in competitiveness for Europe in scientific areas where extreme performance is needed. The provision of high performance computing resources to researchers has traditionally been the objective and mission of the national HPC centres in Europe. However, the increasing global competition between Europe, USA, and Japan is inducing growing demands for computational resources at the highest performance levels, as well as a need of fast innovation. To stay competitive, major investments are needed every two years – an innovation cycle that is difficult to follow even for the most prosperous countries.

The architecture of the DEISA supercomputing environment has been designed following a number of strategic requirements: the necessity of operating in a transparent and non-disruptive way as a layer on top on the existing national services, the desire to hide complex grid technologies from the end scientific users, and the need to guarantee persistence and portability of scientific applications, since they are an essential part of the corporate wealth of research organizations.

The DEISA supercomputing infrastructure is constituted of two layers. At the innermost layer, similar computing platforms (same architecture and operating system) are glued together to create a “distributed virtual supercomputer”. The resulting platform is a super-cluster of computing nodes which are located in a few places in different countries, but which appears to end users as a single unified system. In the first phase of the project, four IBM supercomputers in Germany (FZJ and RZG), France (IDRIS) and Italy (CINECA) are being integrated in this way. The resulting system will consist of more than 4000 processors, a huge memory space and an aggregate computing power of over 22 teraflops. In the second phase, other IBM systems (in particular, the Finnish system) will be added to the super-cluster.

The key integration technology for the distributed super-cluster (in addition to the network itself) is the capability to efficiently share data across a wide area network, provided by a global file system (in this case, IBM’s Global Parallel File System, GPFS). The high added value of this integrated platform arises from the possibility of redistributing the computational workload by migrating jobs across national borders, in order to free huge resources for one specific application in one site.

At the next layer of the DEISA infrastructure, this IBM super-cluster is federated with other selected leading computing platforms to constitute a heterogeneous supercomputing grid, which will include vector platforms and Linux clusters. The first platform to be integrated in the grid is SARA’s SGI ALTIX supercomputer, providing 416 Itanium processors. The DEISA heterogeneous grid will provide a number of relevant services to the scientific community: workflow management based on UNICORE middleware (complex applications that visit several platforms to perform a job), high performance global data management in the whole grid (sharing data between different applications, applications accessing distributed data), grid applications that run on several platforms simultaneously, and, last but not least, portals and Web interfaces to hide complex environments from end users.

The DEISA infrastructure fully exploits the network bandwidth provided by the European research network GEANT and the national research networks (today DFN in Germany, RENATER in France, and GARR in Italy). It also depends critically on the aggressive evolution planned for these and other European organizations, to enhance the network performance. “The DEISA concept is based on the educated guess that network bandwidth will become, by the ends of this decade, a commodity very much like raw computing power became a commodity in the early 90’s”, said Prof. Victor Alessandrini from IDRIS-CNRS, director of the project. “A tightly integrated European supercomputing environment is mandatory to share the extreme computational resources that are needed for extreme efficiency and performance. This is the road that is being paved by DEISA”.

DEISA can expand horizontally by adding new systems, new architectures, and new partners thus increasing the capabilities and attractiveness of the infrastructure in a non-disruptive way. Recently, agreement has been reached with three leading organizations in Europe (HLRS and LRZ in Germany, and BSC, the new supercomputing centre in Barcelona, Spain) to join the DEISA Consortium, and detailed negotiations are under way. With this enlargement, practically all the leading computing platforms in Europe would be in the DEISA grid. Moreover, DEISA will be open to collaboration with other Europe HPC centres and related initiatives world-wide, like TeraGrid in the USA or the other major European research infrastructure project, EGEE, led by CERN.

In summary, DEISA is focused on the advancement of science in Europe. DEISA collaborates with leading European research groups initially from several scientific and industrial disciplines (Material Sciences, Cosmology, Fusion Research, Life Sciences, Computational Fluid Dynamics, and Environmental Sciences). The researchers aim to demonstrate that DEISA will enable new research results and enhanced scientific output in several different ways. As the infrastructure consolidates, DEISA will be launching aggressive scientific initiatives to enable new, ground breaking research activities that could not come to life otherwise.

Jari Jarvinen | alfa
Further information:
http://www.csc.fi

More articles from Information Technology:

nachricht Stable magnetic bit of three atoms
21.09.2017 | Sonderforschungsbereich 668

nachricht Drones can almost see in the dark
20.09.2017 | Universität Zürich

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: The pyrenoid is a carbon-fixing liquid droplet

Plants and algae use the enzyme Rubisco to fix carbon dioxide, removing it from the atmosphere and converting it into biomass. Algae have figured out a way to increase the efficiency of carbon fixation. They gather most of their Rubisco into a ball-shaped microcompartment called the pyrenoid, which they flood with a high local concentration of carbon dioxide. A team of scientists at Princeton University, the Carnegie Institution for Science, Stanford University and the Max Plank Institute of Biochemistry have unravelled the mysteries of how the pyrenoid is assembled. These insights can help to engineer crops that remove more carbon dioxide from the atmosphere while producing more food.

A warming planet

Im Focus: Highly precise wiring in the Cerebral Cortex

Our brains house extremely complex neuronal circuits, whose detailed structures are still largely unknown. This is especially true for the so-called cerebral cortex of mammals, where among other things vision, thoughts or spatial orientation are being computed. Here the rules by which nerve cells are connected to each other are only partly understood. A team of scientists around Moritz Helmstaedter at the Frankfiurt Max Planck Institute for Brain Research and Helene Schmidt (Humboldt University in Berlin) have now discovered a surprisingly precise nerve cell connectivity pattern in the part of the cerebral cortex that is responsible for orienting the individual animal or human in space.

The researchers report online in Nature (Schmidt et al., 2017. Axonal synapse sorting in medial entorhinal cortex, DOI: 10.1038/nature24005) that synapses in...

Im Focus: Tiny lasers from a gallery of whispers

New technique promises tunable laser devices

Whispering gallery mode (WGM) resonators are used to make tiny micro-lasers, sensors, switches, routers and other devices. These tiny structures rely on a...

Im Focus: Ultrafast snapshots of relaxing electrons in solids

Using ultrafast flashes of laser and x-ray radiation, scientists at the Max Planck Institute of Quantum Optics (Garching, Germany) took snapshots of the briefest electron motion inside a solid material to date. The electron motion lasted only 750 billionths of the billionth of a second before it fainted, setting a new record of human capability to capture ultrafast processes inside solids!

When x-rays shine onto solid materials or large molecules, an electron is pushed away from its original place near the nucleus of the atom, leaving a hole...

Im Focus: Quantum Sensors Decipher Magnetic Ordering in a New Semiconducting Material

For the first time, physicists have successfully imaged spiral magnetic ordering in a multiferroic material. These materials are considered highly promising candidates for future data storage media. The researchers were able to prove their findings using unique quantum sensors that were developed at Basel University and that can analyze electromagnetic fields on the nanometer scale. The results – obtained by scientists from the University of Basel’s Department of Physics, the Swiss Nanoscience Institute, the University of Montpellier and several laboratories from University Paris-Saclay – were recently published in the journal Nature.

Multiferroics are materials that simultaneously react to electric and magnetic fields. These two properties are rarely found together, and their combined...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

Event News

“Lasers in Composites Symposium” in Aachen – from Science to Application

19.09.2017 | Event News

I-ESA 2018 – Call for Papers

12.09.2017 | Event News

EMBO at Basel Life, a new conference on current and emerging life science research

06.09.2017 | Event News

 
Latest News

Rainbow colors reveal cell history: Uncovering β-cell heterogeneity

22.09.2017 | Life Sciences

Penn first in world to treat patient with new radiation technology

22.09.2017 | Medical Engineering

Calculating quietness

22.09.2017 | Physics and Astronomy

VideoLinks
B2B-VideoLinks
More VideoLinks >>>