Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • See the storage chart for more details on disks & partitions in the new cluster, and how that compares to the old Matrix.
    • All research applications are installed under “/software”.
    • Get instantly more space, for temporary use, in your home directory, by using the "/notbackedup" disk.
    • See section above, "How is the new Fall 2014 Matrix different than the old Matrix?", for links to more details.
  • Get info on the nodes on the new Matrix which are available during testing.
    • See chart with full details:
    • Summary info, true during Phase Two testing:
      • Initially about 18 nodes will be made available to all researchers.
        • This represents the newly purchased nodes and two of each of 5 types of old node.
        • There are 8 new compute nodes (m108-m115) accessible. Each new node has 20 cores available.
      • For testing, select old Matrix nodes will be moved to the new Matrix to ensure adequate computing capacity during testing.
      • During testing, GPU's are not available in the new cluster.
        • However, 2 of their nodes will be running as just CPU nodes.
  • Queuing information
    • No Express queue available for testing.
      • An Express queue will be provisioned when new Matrix is in production.
    • The default queue is dque instead of express as no node has been assigned to be available for Express queue.

...

  • Text containing full details on the new Matrix configurations. For researchers and support staff.
    • Includes conventions, intentions, and associated technically-imposed limitations.
    • Before production, migrate from above section, "How is the new Fall 2014 Matrix different than the old Matrix?", for links to more details, once those are updated

Get access to your account

  • ssh to:
    • During test:
      • matrixtest.scheraga.chem.cornell.edu

    • When new Matrix is in production, will be the same cname as is used for production now:
      • scheraga.chem.cornell.

New user's defaults

The group has instructed ChemIT to make the following defaults on a new user's account:

  • 50GB /home
  • 50GB /storage

...

      • edu
  • Use your username and your Matrix-specific password.

 

Learn to effectively use your home directory, along with /storage, /notbackedup, and /software.

  • Your home directory is "/users/netID".
    • In this location, just retain the files you need for running jobs.
    • Place files into storage which you don't need for your current jobs.
    • Get instantly more space, for temporary use, in your home directory, by using the "/notbackedup" disk.
      • See section below, "How to run jobs requiring lots of space in ones home directory".
    • KEY: Keeping your home directory small aids in disaster recovery for the entire group.

 

  • Your storage directory is "/storage/netID".
    • Storage is where non-actively used, Scheraga-related, research files belong.
    • In production (NOT DURING TESTING!), you will move results and data you want to save long term back to storage
      • REMEMBER: All date in "/storage/netID" will be deleted after this testing phase.
      • This deletion will allow us to move your current, production data from the old Matrix, when we cut-over.
  • All research applications are installed under “/software”.

How to run jobs requiring lots of space in ones home directory

  • Explain purpose and use of /notbackedup partition to expand a user's effective home directory's storage capacity.
    • Elaborate on how-to, here...
  • If using the /notbackedup is not adequate, researcher can explain this and request a larger quota through their Group Cluster Representative (Gia, as of 10/2014)

New user's defaults

The group has instructed ChemIT to make the following defaults on a new user's account:

  • 50GB /home
  • 50GB /storage

A new user can request a larger quota through their Group Cluster Representative (Gia, as of 10/2014.)