Bulk Loading: Scheduling (LTS Procedure #46d)

Scope:  This procedure provides instructions for running automated import, export, cleanup, reporting and various related jobs using shell scripts and other tools created by the Library Systems Office. The list of jobs includes the frequency of the work, the list of people responsible for performing this work, as well as the function of each job. In addition, this procedure includes guidelines for scheduling batch routines.

Contact:   Gary Branch

Unit: Automation Services

Date last updated: 11/08/2015

Date of next review: July 2017

Scheduling

Individual jobs are run according to the prescribed schedules listed on the List of Jobs. However, be aware that because large jobs -- defined as BIB loads of 3000 records or more -- will place significantly more stress on the Voyager keyword index and may affect system performance, the Voyager keyword index will be turned off for all loads larger than 3000 records. Please observe the following guidelines:

• The maximum number of records in a file loaded with the LSTOOLS shouldn't exceed 20,000 records. Split the files containing more than 20,000 records appropriately.
• Public announcements about large loads should be postponed to a day after the next keyword index regeneration has occurred.
• NOTE: For large MARC file loads such as Marcive and Serial Solutions, please let the Batch Processing Supervisor know before the load.  Large loads can cause errors if loaded with other large files.