Marine Metagenome Assembly on Helix Nebula Science Cloud
Tony Wildish from EMBL-EBI explains how the Helix Nebula project helped his team to use cloud resources to increase the throughput of their metagenome assembly pipeline.
The EMBL-EBI Technology & Science Integration (TSI) team was involved in the European Helix Nebula Science Cloud project, which had acquired a significant quota on the Deutsche Telekom cloud. The HNSciCloud project work was completed early, in Autumn 2018, allowing the MGnify team to use the leftover quota for the remaining period of the project.
Access to the HNSciCloud allowed the MGnify team to produce ~1200 assemblies in the space of two months, the majority of which would have required using one of the 6 high-memory machines at EMBL-EBI. With access to 11 dedicated high memory machines, their throughput increased by 180% for high memory jobs.
This brief implementation study has demonstrated the possibility of quickly deploying an internal EMBL-EBI pipeline (with minimal re-configuration) onto elastic compute resources to overcome internal backlogs and bottlenecks.
Read the full articicle published by EMBL-EBI clicking here.