Skip to main content

Announcements

Read announcements for NREL’s high-performance computing (HPC) system users. 

CSC User & Applications Support

June 8, 2021

  • A new Anaconda installation is in testing, and will be put into production shortly. To access the test installation, as always just enable the Test modules collection via
    module use /nopt/nrel/apps/modules/test/modulefiles
    and you should then see a conda/4.9.2 module
  • Unlike with previous Anaconda installations, we have enabled the conda activate and conda deactivate syntax without requiring conda init (which creates "environmental" problems, something we're all against). The "source"ing syntax still works, but you now have the option to use either. Our hope is that enabling the conda commands will permit greater interoperability with scripts developed elsewhere (where conda activate may have worked), perhaps prove slightly faster, and eliminate awkward error messages.
    • This Conda deployment includes a new faster command for setting up new environments and installing packages. Instead of conda ..., you can try mamba ..., e.g., mamba install tensorflow
  • Other application upgrades have been or will be deployed shortly. If they are not already in production, you may access the installations via the module use statement above.
  • Application New Version:
    • ANSYS 2021R1
    • CMake 3.18.2
    • COMSOL 5.6
    • CUDA 11, includes cudnn and development tools and libraries
    • GAMS 34.3.0
    • MATLAB R2020b
    • MPT 2.23
    • OpenMPI 4.1.0, including Java support
Continue reading

AUP Renewals

June 8, 2021

You may have received an email from DocuSign (dse_NA3@docusign.net) requesting that you renew your NREL HPC Appropriate Use Policy (AUP). We are required to maintain these agreements and, should you receive one, it will be necessary for you to complete it within 30 days in order to continue accessing HPC systems. We appreciate your cooperation. Continue reading

Fiscal Year 2022 HPC Allocation Requests Due Monday, June 7th

June 8, 2021

The deadline for requests for HPC requests is TODAY, Monday, June 7, at Midnight Mountain Time. Thank you to everyone who have already submitted requests.

Please submit a request if you are a researcher at any national laboratory, university, or other organization pursuing EERE-funded research, or if you are an NREL-affiliated researcher performing research aligned with the EERE mission funded through other organizations. Requests are welcome for current projects, projects where a funding request has been submitted, and projects where a funding request for FY22 is in preparation.

Additional information on the Eagle allocation process is available at https://www.nrel.gov/hpc/resource-allocation-requests.html. Please e-mail hpc-requests@nrel.gov if you have any additional questions.

Thank you,
NREL HPC Operations

Continue reading

FY22 NREL HPC Annual Call for Allocation Requests

May 7, 2021

The National Renewable Energy Lab (NREL) provides High Performance Computing and related capabilities to support the mission of the Department of Energy, Office of Energy Efficiency, and Renewable Energy (EERE). Research and development projects that are funded by EERE Offices or aligned with the EERE mission are eligible to utilize these resources. ​ Continue reading

Slurm Fairshare Refresher

May 7, 2021

FY21 saw the introduction of the "fairshare" priority algorithm in Eagle's job scheduler, Slurm. Queue times have been high during the Q2-Q3 rush and we've received some questions, so here's a quick refresher on Fairshare and what it means in regards to job scheduling. Continue reading

Queue Times

May 7, 2021

The allocation year transitioned from Q2 to Q3 on April 1st. The job queue leading up to the end of Q2 saw a very large spike in jobs submitted, and queue depth (job wait time) rose accordingly. A few projects saw some effect of fairshare, but much of the pressure came from over a third of all jobs being submitted as qos=high. Because of the large surge in jobs submitted, interactions with fairshare and a few projects that have used up their allocation we have been analyzing the scheduling algorithms. Based on some recommendations from SchedMD and internal analysis we have made a few adjustments to the slurm configuration. Those changes thus far appear to have alleviated some of the pressure on the queues as well as a reduction in the number of jobs submitted with qos=high. Continue reading

Eagle File System Usage

April 8, 2021

The Lustre file systems that hosts /projects and /scratch works most efficiently when it is under 80% full. Please do your part to keep the file system under 80% by cleaning up your /projects and /scratch spaces. Continue reading

FY22 Cloud Allocation Process and Website

April 8, 2021

HPC and Cloud are both supported by Advanced Computing Operations (ACO) in the Computational Sciences Center.  We are aligning the request process for both computing and cloud resources. Continue reading

Fiscal Year 2021 Quarterly Allocation Reductions

March 3, 2021

You may have noticed that NREL did not make any reductions to allocations that were under-using their AUs during Q1.   This is for two reasons.   First, we were in the process of putting together a new, more transparent, fairer allocation reduction policy.  Second, we are aware that many users were inconvenienced by the fact that allocation decisions were issued on October 1.
 
We realize allocation reductions for low use are not popular with our users.  However, they are physically necessary.   AUs are an “expiring resource.”   If an AU is not used in Q1, it cannot be stored and saved for use in Q4.   Because of this, we have to remove some percentage of the unused AUs every quarter.  Otherwise we can hit a situation where we have many more AUs available to users than the machine can physically provide as the year progresses.   This creates long queue times that make Eagle physically unusable.
 
Our new allocation policy is given below.   We had an informal discussion with users across multiple centers before designing this policy.  Users emphasized the need for a policy to be clear enough so they could see what they might lose at the end of the quarter.   Users have also increasingly requested allocations that had different usages in different quarters to deal with their project needs, and we wanted a policy that treated these fairly. Continue reading

Elevate your work with new tracking for Advanced Computing in the NREL Publishing Tracker

March 3, 2021

There is a new question on the User Facilities & Program Areas page when you enter a publication into the Pub Tracker – “The High Performance Computing Facility was used to produce results or data used in this publication.” Please be sure to check Yes on this question for your work that made use of the HPC User Facility or other systems in the ESIF HPC Data Center. In addition, there are three new Program Areas to use to tag your publication under the Advanced Computing heading: Cloud, HPC and Visualization & Insight Center. Making use of these metadata will enable us to elevate your work through communications highlights, feature stories, and reporting to EERE.

More information about the NREL Publishing Tracker can be found by visiting the Access and Use the NREL Publishing Tracker page on the Source.

Continue reading