Description
Bridges-2 combines high-performance computing (HPC), high performance artificial intelligence (HPAI), and large-scale data management to support simulation and modeling, data analytics, community data, and complex workflows.
Bridges-2 Extreme Memory (EM) nodes enable memory-intensive genome sequence assembly, graph analytics, in-memory databases, statistics, and other applications that need a large amount of memory and for which distributed-memory implementations are not available. Bridges-2 Extreme Memory (EM) nodes each consist of 4 Intel Xeon Platinum 8260M “Cascade Lake” CPUs, 4TB of DDR4-2933 RAM, 7.68TB NVMe SSD. They are connected to Bridges-2's other compute nodes and its Ocean parallel filesystem and archive by two HDR-200 InfiniBand links, providing 400Gbps of bandwidth to read or write data from each EM node.
RP Description
Bridges-2 EM is the extreme-memory tier of Bridges-2: 4 nodes with 96 cores each (four Intel Xeon Platinum 8260M) and up to 4 TB of RAM. It suits problems that need very large shared memory and cannot be split across nodes, and is often used for genome sequence assembly, graph analytics, and large in-memory statistics. Its software base is strongest in memory-bound genomics and statistical or data-analysis work.
Top Software (cached)
[{"name":"python","job_count":12550,"description":"Python is a high-level, interpreted programming language known for its simplicity and readability. It supports multiple programming paradigms and has a vast ecosystem of libraries and frameworks.","research_field":"Computer & Information Sciences, Software Engineering, Systems & Development","web_page":"https:\/\/www.python.org\/","documentation":"https:\/\/docs.python.org"},{"name":"r","job_count":58,"description":"R is a free software environment for statistical computing and graphics. It compiles and runs on a wide variety of UNIX platforms, Windows, and MacOS.","research_field":"Computer Science","web_page":"https:\/\/www.r-project.org\/","documentation":"https:\/\/cran.r-project.org\/manuals.html"},{"name":"lammps","job_count":37,"description":"LAMMPS (Large-scale Atomic\/Molecular Massively Parallel Simulator) is a classical molecular dynamics code designed for simulating large-scale atomistic systems. It is highly versatile and can be used to model a wide range of materials and complex molecular structures.","research_field":"Chemical Sciences","web_page":"https:\/\/www.lammps.org\/","documentation":"https:\/\/docs.lammps.org\/Manual.html"},{"name":"q-espresso","job_count":15},{"name":"samtools","job_count":10,"description":"Samtools is a suite of programs for interacting with high-throughput sequencing data generated in sequence alignment\/map (SAM) format, such as those produced by the Short Read Mapping (SHRiMP) or Burrows-Wheeler Aligner (BWA) aligners. It allows various operations on SAM\/BAM files, including indexing, sorting, merging, and manipulating sequence alignments.","research_field":"Biological Sciences","web_page":"https:\/\/www.htslib.org\/","documentation":"https:\/\/www.htslib.org\/doc\/samtools.html"},{"name":"gromacs","job_count":4,"description":"GROMACS (GROningen MAssive Parallel MD for Molecular Dynamics) is a versatile package for molecular dynamics simulations with a strong emphasis on high-performance computing capabilities.","research_field":"Biological Sciences","web_page":"https:\/\/www.gromacs.org\/","documentation":"https:\/\/manual.gromacs.org\/current\/index.html"},{"name":"cp2k","job_count":2,"description":"CP2K is an open-source quantum chemistry and solid state physics software package designed to perform atomistic simulations of solid-state, liquid, molecular, and biological systems. It can be used to study a wide range of properties, including electronic structures, molecular dynamics, and vibrational spectra.","research_field":"Physical Sciences","web_page":"https:\/\/www.cp2k.org\/","documentation":"https:\/\/manual.cp2k.org\/trunk\/"},{"name":"orca","job_count":1,"description":"Orca is a flexible, efficient, and powerful quantum chemistry software written by Frank Neese and co-workers. It provides accurate and reliable computational simulations of molecular structures and properties based on quantum mechanical methods.","research_field":"Chemical Sciences","web_page":"https:\/\/www.kofo.mpg.de\/en\/research\/services\/orca","documentation":"https:\/\/www.kofo.mpg.de\/970316\/orca_manual_5_0_4.pdf"}]
Login Text
Sign in over SSH by following the Connecting to Bridges-2 guide. EM runs batch jobs only, so it is not available through OnDemand. Before your first sign-in:
- You need an active ACCESS allocation on Bridges-2.
- Log in with your PSC username, not your ACCESS ID. Once your allocation on Bridges-2 is approved, you will see your username on the ACCESS Allocations page.
- Set your PSC password before you connect for the first time.
Jobs Information
You can run jobs at different sizes and durations on Bridges-2 EM. The following lists the different queues that you can submit to, describing how many nodes you get, how long you can run, the type of resources you get, and the average wait time.
Jobs are submitted through Slurm in batch mode. EM does not support interactive jobs or OnDemand, so connect over SSH and submit from a Bridges-2 login node with sbatch. A job uses at most one EM node, and you request cores in multiples of 24 (24, 48, 72, or 96); memory scales with the cores you request, at about 1 TB per 24 cores. The default walltime is 1 hour and the maximum is 120 hours.
For submission commands, a sample batch script, and more detail, see the Bridges-2 Extreme Memory section of the user guide, or the Bridges-2 Batch Jobs guide.