HNSciCloud in the proceedings of the CHEP 2018 conference

Two publications about HNSciCloud have been published in the proceedings of the CHEP 2018 conference (EPJ Web Conf. Volume 214, 2019, 23rd International Conference on Computing in High Energy and Nuclear Physics)

 

HNSciCloud, a Hybrid Cloud for Science

  • 1 CERN, IT Department 1211 Geneva, Switzerland
  • 2 Desy, Notkestrasse 85, 22607 Hamburg, Germany
  • 3 INFN-CNAF, Viale Carlo Berti Pichat 6, 40127 Bologna, Italy
  • * João Fernandes: joao.fernandes@cern.ch.

Published online: 17 September 2019

Abstract

Helix Nebula Science Cloud (HNSciCloud) has developed a hybrid cloud platform that links together commercial cloud service providers and research organizations’ in-house IT resources via the GEANT network. The platform offers data management capabilities with transparent data access where applications can be deployed with no modifications on both sides of the hybrid cloud and with compute services accessible via eduGAIN [1] and ELIXIR [2] federated identity and access management systems. In addition, it provides support services, account management facilities, full documentation and training. The cloud services are being tested by a group of 10 research organisations from across Europe [3], against the needs of use-cases from seven ESFRI infrastructures [4]. The capacity procured by ten research organisations from the commercial cloud service providers to support these use-cases during 2018 exceeds twenty thousand cores and two petabytes of storage with a network bandwidth of 40Gbps. All the services are based on open source implementations that do not require licenses in order to be deployed on the in-house IT resources of research organisations connected to the hybrid platform. An early adopter scheme has been put in place so that more research organisations can connect to the platform and procure additional capacity to support their research programmes.

 

Experience in using public Cloud for Belle II experiment within HNSciCloud Project

  • 1 INFN – Napoli Unit – Via Cintia. 80126, Napoli Italy
  • 2 GARR – Via dei Tizii, 6 00185, Roma Italy
  • * Corresponding author: spardi@na.infn.it

Published online: 17 September 2019

Abstract

The current level of flexibility reached by Cloud serviceproviders enables Physicists to take advantage of extra resources to extend the distributed computing infrastructure supporting High Energy Physics Experiments. However, the discussion about the optimal use of such kind of resources is currently ongoing. Moreover, because each Cloud provider offers its interfaces, API sets, and different service levels, the integration in the computing model of an experiment requires a specific work for each provider. In this paper, we summarize the experience matured in the usage of Cloud res urces offered by different providers within the Europeanproject Helix Nebula Science Cloud for Belle II experiment. The goal of the user-case was to run Montecarlo Production jobs properly on Virtual Machines created dynamically. To do that, we defined the golden image, based on CENTOS; we then set up the basic environment, the internal and external network, and local DNS services. For each cloud, we implemented a cache server based on Squid, while the orchestrator has been entralized on a single server located in the INFN-Napoli infrastructure. Finally, we integrated the available resources in the Belle II production framework based on DIRAC, using VCYCLE as Virtual Machine Life Cycle Manager. After a tuning activity that required the optimization of severalaspects included Image distribution and Network configuration, we wer able to run production jobs over the different Cloud with success.

Who's behind HNSciCloud?

HNSciCloud Pre-Commercial Procurement is driven by ten leading research organisations from across Europe.