Cray recommends using repurposed compute nodes as tier2 servers. This procedure describes how to repurpose a compute node as a service node (and vice-versa).
This procedure assumes that the XC system is booted.
When a compute node is configured for a non-compute role, that node is called a repurposed compute node (RCN). Compute nodes can be repurposed to become service nodes for use as tier2 servers (recommended) or in other capacities. However, compute nodes should not be repurposed as service nodes for services that require external connectivity.
This procedure provides steps for repurposing a compute node to become a service node. It can also be used to repurpose a service node as a compute node, to return an RCN to its original compute role, for example. Note that nodes on a service blade must always have the service role.
In the example commands shown, two compute nodes (c0-0c0s2n0 and c0-0c0s2n1) are repurposed as service nodes.
- Shut down the compute node to be repurposed, and confirm that it was shut down.
crayadm@smw> xtcli shutdown c0-0c0s2n0,c0-0c0s2n1
crayadm@smw> xtcli status c0-0c0s2n0,c0-0c0s2n1
The node must be down when using the xtcli mark_node command in the next step.
- Mark the compute node as 'service' in the HSS database.
crayadm@smw> xtcli mark_node service c0-0c0s2n0,c0-0c0s2n1
If repurposing a service node as compute, use the following command instead.
crayadm@smw> xtcli mark_node compute c0-0c0s2n0,c0-0c0s2n1
Important. Using the xtcli mark_node command to change the node type in the HSS database is considered a hardware change. To keep everything in synch (HSS, NIMS, and IMPS), it must be followed by changing the NIMS parameters of the node, updating the CLE and global config sets, and rebooting the node.
- Update the NIMS group for the repurposed node and confirm the change.
crayadm@smw> cnode update -G compute -g service c0-0c0s2n0,c0-0c0s2n1
crayadm@smw> cnode list c0-0c0s2n0,c0-0c0s2n1
- Update the CLE config set (p0 in the example) and the global config set.
Whenever a node has been repurposed, it is necessary to update the associated CLE config set and the global config set.
crayadm@smw> su - root
smw# cfgset update -m prepare p0
smw# cfgset update -m prepare global
This ensures that the following file in the global config set directory structure is updated with accurate information:
/var/opt/cray/imps/config/sets/global/files/node_groups/platforms/p0.platform.json
- Reboot the repurposed node.
smw# exit
crayadm@smw> xtbootsys --reboot c0-0c0s2n0,c0-0c0s2n1