Skip to content

Commit 786eb3a

Browse files
committed
Update NAS configs
1 parent 62fbc59 commit 786eb3a

File tree

4 files changed

+17
-21
lines changed

4 files changed

+17
-21
lines changed

configs/sites/tier1/nas/README.md

Lines changed: 8 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -60,7 +60,7 @@ are used to create the environments. You only need to do this once.
6060
To create the oneAPI environment, do:
6161

6262
```
63-
spack stack create env --name ue-oneapi-2024.2.0 --template unified-dev --site nas --compiler=oneapi-2024.2.0 |& tee log.create.ue-oneapi-2024.2.0
63+
spack stack create env --name ue-oneapi-2024.2.0 --template unified-dev --site nas --compiler=oneapi-2024.2.0
6464
cd envs/ue-oneapi-2024.2.0
6565
```
6666

@@ -69,7 +69,7 @@ cd envs/ue-oneapi-2024.2.0
6969
To create the GCC environment, do:
7070

7171
```
72-
spack stack create env --name ue-gcc-13.2.0 --template unified-dev --site nas --compiler gcc-13.2.0 |& tee log.create.ue-gcc-13.2.0
72+
spack stack create env --name ue-gcc-13.2.0 --template unified-dev --site nas --compiler gcc-13.2.0
7373
cd envs/ue-gcc-13.2.0
7474
```
7575

@@ -99,7 +99,7 @@ Because this step downloads all the source code for all packages and all version
9999
should be done on a login node with internet access.
100100

101101
```
102-
spack mirror create -a -d /nobackup/gmao_SIteam/spack-stack/source-cache
102+
spack mirror create -a -d /swbuild/gmao_SIteam/spack-stack/source-cache
103103
```
104104

105105
NOTE: Make sure you are in an environment when you run that `spack mirror create` command. Otherwise,
@@ -109,15 +109,10 @@ you will download *EVERY* package and *EVERY* version in spack!
109109

110110
Some packages use Rust/Cargo for dependencies. These need internet access to build. So we pre-fetch them here.
111111

112-
We need to set `CARGO_HOME` to a location inside the spack environment so that the cargo downloads are cached.
113-
When we are in an environment, we have, say:
114-
```
115-
SPACK_ENV=/nobackupp28/gmao_SIteam/spack-stack/spack-stack-2.0.0-test/envs/ue-oneapi-2024.2.0
116-
```
117-
set for oneapi, so we can use the same "path" for each stack.
112+
We need to set `CARGO_HOME` to a location where the Cargo deps have been downloaded
118113

119114
```
120-
export CARGO_HOME=${SPACK_ENV}/cargo-cache
115+
export CARGO_HOME=/swbuild/gmao_SIteam/spack-stack/cargo-cache
121116
../../util/fetch_cargo_deps.py
122117
```
123118

@@ -140,7 +135,7 @@ then have to build ecflow on a login node as well.
140135
So we first install all the dependencies of then codes.
141136

142137
```
143-
export CARGO_HOME=${SPACK_ENV}/cargo-cache
138+
export CARGO_HOME=/swbuild/gmao_SIteam/spack-stack/cargo-cache
144139
spack install -j 16 --verbose --fail-fast --show-log-on-error --no-check-signature --only dependencies py-cryptography py-maturin py-rpds-py ecflow 2>&1 | tee log.install.deps-for-rust-and-ecflow
145140
```
146141

@@ -153,7 +148,7 @@ you will get an illegal instruction error when the install below calls python3.
153148
So go back to an afe login node and run:
154149

155150
```
156-
export CARGO_HOME=${SPACK_ENV}/cargo-cache
151+
export CARGO_HOME=/swbuild/gmao_SIteam/spack-stack/cargo-cache
157152
spack install -j 2 -p 1 --verbose --fail-fast --show-log-on-error --no-check-signature py-cryptography py-maturin py-rpds-py ecflow 2>&1 | tee log.install.rust-and-ecflow
158153
```
159154

@@ -162,7 +157,7 @@ Note we are only using 2 processes here because NAS limits you to 2 processes on
162157
### Install Step 3: The rest (COMPUTE NODE)
163158

164159
```
165-
export CARGO_HOME=${SPACK_ENV}/cargo-cache
160+
export CARGO_HOME=/swbuild/gmao_SIteam/spack-stack/cargo-cache
166161
spack install -j 16 --verbose --fail-fast --show-log-on-error --no-check-signature 2>&1 | tee log.install.after-cargo
167162
```
168163

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,9 @@
11
config:
22
build_jobs: 6
3+
4+
# Overrides for spack build and staging areas to speed up builds
5+
# and avoid errors with Lustre file locking and xattr issues
6+
build_stage: /swbuild/gmao_SIteam/spack-stack/cache/build_stage
7+
test_stage: /swbuild/gmao_SIteam/spack-stack/cache/test_stage
8+
source_cache: /swbuild/gmao_SIteam/spack-stack/cache/source_cache
9+
misc_cache: /swbuild/gmao_SIteam/spack-stack/cache/misc_cache
Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
mirrors:
2-
local-source: file:///nobackup/gmao_SIteam/spack-stack/source-cache
3-
local-binary: file:///nobackup/gmao_SIteam/spack-stack/binary-cache-spack-v1
2+
local-source: file:///swbuild/gmao_SIteam/spack-stack/source-cache
3+
local-binary: file:///swbuild/gmao_SIteam/spack-stack/binary-cache-spack-v1

configs/sites/tier1/nas/packages_gcc-13.2.0.yaml

Lines changed: 0 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -60,9 +60,3 @@ packages:
6060
CPATH: /nobackup/gmao_SIteam/MPI/openmpi/4.1.8/gcc-13.2.0/include
6161
FPATH: /nobackup/gmao_SIteam/MPI/openmpi/4.1.8/gcc-13.2.0/include
6262
MANPATH: /nobackup/gmao_SIteam/MPI/openmpi/4.1.8/gcc-13.2.0/share/man
63-
# MAT: I cannot figure out how to get hdf-eos2 to build with GCC on NAS
64-
# When I try, it dies with an error trying to *patch* the code!
65-
# This turns off the variants of met that need it
66-
met:
67-
variants::
68-
- '+python +grib2 +graphics'

0 commit comments

Comments
 (0)