A snapshot of the UPS's used to support servers, switches, and other equipment under ChemIT's management. Mostly within ChemIT's Baker 248 server room.
UPS inventory for CCB Clusters and non-cluster HPCs
Note: Currently none of the clusters ChemIT manages have UPSs for their computer nodes.
Cluster name | UPS for | UPS shutdown algorithm, if any | Tools used | Other notes |
|---|---|---|---|---|
NONE | n/a | n/a | ||
(Unknown) | n/a | n/a | Cluster managed by CAC, not ChemIT | |
Done Spring'14 |
| |||
Done Spring'14 |
| |||
Done Spring'14 |
| |||
NONE | n/a | n/a | ||
Scheraga: Current, production Matrix | Done Fall'14 |
| ||
| Scheraga: Forthcoming Matrix | Done Fall'14 | UPS supporting both Synology storage system and headnode. UPS USB-connected to Synology storage system. Synology thus sends a signal to headnode. Algorithms are:
| Synology's own s/w. On Linux systems, running "nut". | |
Yes |
| |||
ChemIT (C4) | Done |
| ||
| Baird: 1 rack-mounted computational computer | NONE | n/a | n/a | |
| Freed: Eldor | NONE | n/a | n/a | |
| Petersen: 2 rack-mounted computational computers | Yes, but needs to be deployed in true production; using Widom's UPS for now. | UPS supporting both stem #50 and system #51. UPS USB-connected to system #50, which itself does not send signal to system #51. On system #50: Shutdown if only 10% battery power is left. On system #51: No s/w running to listen for signal from system #50(if signal were to be sent). | Windows OS | To do: Establish sending a signal from system #50 to system #51 and have system #51 properly shut down in the event of a prolonged outage. |
| Scheraga: 4 GPU rack-mounted computational computers | NONE | n/a | n/a |
What does it cost to UPS a research system?
Current goal: Do all head nodes and stand-alone computers in 248 Baker Lab. Started getting done, fall 2014.
Assuming protection for 1-3 minutes MAXIMUM:
About $180 (APC brand) per head node or server every ~3-4 years (3 yr for warranty and ~4 years actual battery life).
- Unusual case: ~$900/ set of 4 GPU systems (Scheraga) every ~3-4 years (for this, must confirm approach, appropriateness, and estimates).
Remaining UPS's to invest in
Clusters
Most we been done Spring 14, after the spate of power failures. See CCB's HPC page (first chart, in "UPS for headnode" column) for details
Cluster | Done | Not done | Notes |
|---|---|---|---|
Loring |
| X | Unique: Need to do ASAP |
Abruna |
| X | Unique: Need to do ASAP |
Non-clusters
See CCB's HPC page (second chart, in "UPS" column) and CCB's non-HPC page (in "UPS" column) for details of the few that are already done.
Stand-alone computers' UPS status:
Computer | Done | Note done | Notes |
|---|---|---|---|
Coates: MS SQL Server |
| X | Unique: Need to do ASAP |
Freed: Eldor |
| X | Unique: Need to do ASAP? (Q: Is OS backed up?) |
Review others at above two cited pages which might need a UPS, after above ones done.
Switches
Do all switches: Maybe ~$340 ($170*2), every ~4 years.
- Recommend: Do ASAP.
- Q: Funding?
- Other issues and concerns with actually implementing this approach:
- Rack space. Maybe power. Maybe cord lengths. What other issues?
Do all compute nodes: ~$18K initially, and perhaps ~$4.5K every ~4 years to replace batteries and deal with UPS hardware failures.
- ~20 20amp UPS's ($900 each) required.
- Replacement batteries ~$200 each, or ~1/4 replacement cost.
- Estimates are simply back-of-the-envelope calculations.
- If were to actually implement, there may be smarter ways to do this, but the total cost will likely not be lower.
- In fact, costs may be higher, if sufficiently higher benefit doing it a different way, for example.
- Issues and concerns with actually implementing this approach:
- Costs. Rack space. Maybe power. Maybe cord lengths. What other issues?
Compute node counts, for UPS pricing estimates. Does not include head node:
- Count source: ChemIT's Computer counts with CCB clusters
Cluster | Compute node count | Power strip equivalents | Cost estimate, | Notes |
|---|---|---|---|---|
Collum | 8 | 1 | $900 |
|
Lancaster, with Crane (new) | 10 | 2 | $1.8K |
|
Hoffmann | 19 | 2 | $1.8K |
|
Scheraga | 91 | 13 | $11.7K |
|
Loring | 4 | 1 | $900 |
|
Abruna | 9 | 1 | $900 |
|
C4 head node: pilot | N/A | N/A | N/A | This CCB Community head node pilot has no compute nodes of its own. |
Widom | 2 | 1 | ? | Compute nodes are hanging off of "C4" head node, above. |
TOTALS | ~140? | 21 | $18K + Widom |
|