...
How is the new Fall 2014 Matrix different than the old Matrix?
- Graphical Link to graphical representation comparing the old Matrix to the new Matrix, for researchers.
- Text Lin to text page containing full details on the new Matrix configurations. For both researchers and support staff.
- Matrix Partitioning Configuration 2014-09-15.pdf
- Includes conventions, intentions, and associated technically-imposed limitations.
...
Researchers in Poland should contact Czarek. Follow his instructions, please.
All others should contact the group member assigned as lead tester for the application they are having problems with. Follow their instructions, please.
Notes, to get you started and keep you going
Deadlines for researchers
DATE 1: DayOfWeek, 10/xx/14: By this date, all researchers are expected to at least simply login (verifying that their account itself works).
- KEEP? Email us once you are in and working by replying to this message using your Cornell account and keep the subject & tracking number.
DATE 2: DayOfWeek, 10/xx/14: By this date, all researchers will need to test and either approve, or report problems with, the software they depend on.
- Report details of any questions or problems you find to the appropriate researcher.
- See section above, "Each researcher must confirm that the applications they depend on work for them on the new Matrix.", for who to report to.
DATE 3: DayOfWeek, 10/xx/14: By this date we expect to have all testing completed – as long as everything is indeed working as expected.
- Any delays in your testing will extend the project schedule.
Testing schedule activities by ChemIT (dovetailing with above deadlines for researchers)
DayOfWeek, date: ChemIT makes a copy of the ChemIT will create a snap-shot copy of each end-user's current home directory (from on the production old Matrix) and place it into onto the end-user's storage directory (on the new Matrix).
All researchers most therefore move or copy items from their storage directory into their home directory, as they see fit.
...
- The initial home directory is almost empty. It initially contains just the following files in order to...
, for testing purposes.
Thursday, 10/16: End-user testing starts.
DayOfWeek, date: ChemIT deletes copy of end-user's storage (on the new Matrix). ChemiT retains copy of end-user's home directory (on the new Matrix).
- See section below, "Important notes in what data is erased. And what data is saved."
Notes, to get you started and keep you going
During testing, there is a new and an old cluster available to you at the same time.
- Thus, you will be able to log into two different home directories, within two completely different systems:
scheraga.chem.cornell.edu
matrixtest.scheraga.chem.cornell.edu
- Your account and password on the new Matrix are the same as the old Matrix.
- Continue to use the old Matrix cluster for your production research work.
- Use the new cluster ONLY to confirm it will work for you once we cut-over from the old Matrix. Do not use it for production research.
- Interruptions to the new Matrix during this testing phase may occur at any time, with no advanced warning.
Particulars you need to know about new Matrix cluster, for testing:
Your home directories, "/users/netID", are basically EMPTY of your files to start.
- Selectively choose (from storage) just the files you need for running jobs.
- ChemIT has pre-populated your home directory in the following way:....
A copy of your data from old Matrix has been put on the storage system in "/storage/netID".
You thus need to move or copy files needed to run jobs from storage to your new home "/users/netID" to test jobs.
- Leave files in storage which you don't need for your jobs.
In production (NOT DURING TESTING!), you will move results and data you want to save long term back to storage
...
ChemIT will maintain a chart to help the group track what does and does not work regarding MPI.
...
For testing, some old Matrix nodes will be moved to the new Matrix to ensure adequate computing capacity during testing. Initially 10 nodes will be made available.
Other details
- All research applications are installed under “/software”.
- See the storage chart for more details on disks & partitions in the new cluster, and how that compares to the old Matrix.
- The default queue is dque instead of express as the node is not available for express queue.
Important notes in what data is erased. And what data is saved.
ChemIT will save all end-user's home directories as they build them up on the new Matrix.
ChemIT will erase all end-user's storage directories on the new Matrix, at end of testing.
- On the day we cut-over from the old Matrix to the new Matrix, ChemIT will make a final copy of user's old Matrix home directories into their new Matrix storage directories.
Timeline for testing
??: ChemIT makes a copy of the ChemIT will create a snap-shot copy of each end-user's current home directory (on from the current production Matrix) onto and place it into the end-user's storage directory (on the new Matrix), for testing purposes.
Thursday, 10/16: End-user testing starts.
??: All end-users should have logged in and started to set up their new home directories.
...
.
All researchers most therefore move or copy items from their storage directory into their home directory, as they see fit.
- Home is where currently used files belong. Keeping this small aids in disaster recovery.
- The initial home directory is almost empty. It initially contains just the following files in order to...
- Storage is where non-actively used, Scheraga-related, research files belong.
(2) Information relevant for testing and after testing
...