Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Selectively choose (from storage) just the files you need for running jobs.
  • For your convenience, ChemIT has pre-configured your home directory in the following way:...by copying your .ssh/ directory and your .tcshrc file from your /storage directory into your /home directory.

A recent snapshot copy of your data from old Matrix has been put on the storage system in  "/storage/netID".

...

  • See the storage chart for more details on disks & partitions in the new cluster, and how that compares to the old Matrix.
    • All research applications are installed under “/software”.
    • Get instantly more space, for temporary use, in your home directory, by using the "/notbackedup" disk.
    • See section above, "How is the new Fall 2014 Matrix different than the old Matrix?", for links to more details.
  • Get info on the nodes on the new Matrix which are available during testing.
    • See chart with full details:
    • Summary info, true during Phase Two testing:
      • Initially about 18 17 nodes will be made available to all researchers.
        • This represents the newly purchased nodes and two of each of 5 types of old node.
        • There are 8 new compute nodes (m108-m115) accessible. Each new node has 20 cores available.
      • For testing, select old Matrix nodes will be have been moved to the new Matrix to ensure adequate computing capacity during testing.
      • During testing, GPU's are not available in the new cluster.However, 2 of their At this point, 1 or 2 of GPU nodes will be running as just CPU nodes. GPU functions will be added at a later date if possible.
  • Queuing information
    • No Express queue available for testing.
      • An Express queue will be provisioned when new Matrix is in production.
    • The default queue is dque instead of express as no node has been assigned to be available for Express queue.

...

  • ssh to:
    • During test:
      • matrixtest.scheraga.chem.cornell.edu

    • When new Matrix is in production, will be use the new cname:
      • matrix.chem.cornell.edu
      • N.B. We were going to use the same cname as
      is
      • was used for production
      now:
      • before (scheraga.chem.cornell.edu).
  • Use your username and your Matrix-specific password.

...

  • Your home directory is "/users/netID".
    • In this location, just retain the files you need for running jobs.
    • Place files into storage which you don't need for your current jobs.
    • KEY: Keeping your home directory small aids in disaster recovery for the entire group.
    • Get instantly more space, for temporary use, in your home directory, by using the "/notbackedup" temporary disk.
      • See section below, "How to run jobs requiring lots of space in ones home directory".
  • Your storage directory is "/storage/netID".
    • Storage is where non-actively usedactive, Scheraga-related, research files belong.
    • In production (NOT DURING TESTING!), you will move results and data you want to save long term back to storage
      • REMEMBER: All date in "/storage/netID" will be deleted after this testing phase.
      • This deletion will allow us to move your current, production data from the old Matrix, when we cut-over.
  • All research applications are installed under “/software.Get instantly more space, for temporary use, in your home directory, by using the "/notbackedup" disk.See section below, "

How to run jobs requiring lots of space in ones home directory

...

How to run jobs requiring lots of space in ones home directory

  • Explain (to be added) purpose and use of /notbackedup partition to expand a user's effective home directory's storage capacity.Elaborate on how-to, here...
  • If using the /notbackedup is not adequate, researcher can explain this and request a larger quota through their Group Cluster Representative (Gia, as of 10/2014)

Matrix user quotas

New user's default quotas

...