Building a High Performance Container Solution with Super Computing Cluster and Singularity

High Performance Container: Singularity

User Permissions

Performance and Isolation

HPC-Optimized

E-HPC Elastic High Performance Container Solution

Singularity Deployment Cases

Case 1: Run the NAMD Container Job on Multiple SCC Nodes

#!/bin/sh
#PBS -l ncpus=32,mem=64gb
#PBS -l walltime=20:20:00
#PBS -o namd_local_pbs.log
#PBS -j oe
# Run the job in the Singularity container
/opt/intel/impi/2018.3.222/bin64/mpirun --machinefile machinefile -np 128 singularity exec --bind /usr --bind /sys --bind /etc /opt/centos7-intelmpi-namd.sif /namd-cpu/namd2 /opt/apoa1/apoa1.namd
# Run the job on the local host
/opt/intel/impi/2018.3.222/bin64/mpirun --machinefile machinefile -np 128 /opt/NAMD_2.12_Linux-x86_64-MPI/namd2 apoa1/apoa1.namd

Case 2: Run the TensorFlow Image Classification Container Job on an EGS Instance

# Run the job in the Singularity container
singularity exec --nv /opt/cifar10.sif python /cifar10/models/tutorials/image/cifar10/cifar10_multi_gpu_train.py --num_gpus=2
# Run the job in the Docker container
nvidia-docker run -it d6c139d2fdbf python /cifar10/models/tutorials/image/cifar10/cifar10_multi_gpu_train.py --num_gpus=2

Conclusion

--

--

--

Follow me to keep abreast with the latest technology news, industry insights, and developer trends. Alibaba Cloud website:https://www.alibabacloud.com

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Resolve AWS Private Hosted zones from on-premise with Route 53 Inbound Resolver

Setup Jenkins on SAP Cloud Foundry

Basic Linux command line tutorial to start developing in Ubuntu Linux

Cautious Impact

KuanKua: A New Platform to Digitize Undigitized Languages

Highlight text in WKWebView

Light Probes vs. Screen Space Reflections in Unity

EDA Implementation — Exposing Events as Managed APIs

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Alibaba Cloud

Alibaba Cloud

Follow me to keep abreast with the latest technology news, industry insights, and developer trends. Alibaba Cloud website:https://www.alibabacloud.com

More from Medium

Deploy IBM Sterling Order Manager Software on OpenShift — Part 4

Azure IoT Edge with proxy and Certificate

How to set timezone and locale in an Ubuntu image properly

Docker deep level with architecture — part 1