You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Next »

These statistics must be gathered from various Access reports, from multiple databases.  Some statistics are required for the department-wide spreadsheet that is shared with Library Administration; some are for inter-departmental use.

I.     Tools and Documents Used in Compiling Batch Statistics

A. The LTS Stats Database can be found at L://tsstats/1New_culv2-2012-2013.accdb. Queries to be run in this database:

1.) Batch Activity Summary Report, found under “Macros.” (See image below.)

This query looks at the following criteria:

2.) Record Enhancement Query found under “Queries.” You will need to scroll to the very bottom of the list of queries to access it. (See image below.)

The criteria for this query looks like this:

The criteria for the “subfield_value” are: Like "WorldShare" Or Like "Fast_updates" Or Like "batchmatch" Or Like "ebookenhanced" Or Like "LVL3" Or Like "ogrm" Or Like "arab" Or Like "oels" Or Like "osea" Or Like "ice" Or Like "ohys" Or Like "oslv" Or Like "ocjk" Or Like "olat" Or Like "orom" Or Like "oeso" Or Like "osap"

 

B. An additional database, 3_BATCHstats.mdb can be found in the same folder. One query is to be run in this database, labeled “Batch Bib Summary Report.” It is found under “Macros.” (See image below.) When run, it produces a report with the title, “Batch Activity by Type Report.

This report runs two queries, one for items created and one for items modified, and displays the retrieved data. Criteria for these two queries are as follows:

 

And

 

C. Spreadsheets used for this process:

1.)    3_Batch_Stats_ FY[YY]_[YY].xlsx (found at L://tsstats/Batch Stats)

See Sections III.F and IV  of this document for details on the contents of this spreadsheet.

 

2.) LTS_Stats_2005-20[YY].xlsx (found at L://tsstats)

The portion of this spreadsheet devoted to Batch Processing includes these categories

See Section III of this document for details of how these numbers are determined.

3.) BATCHID_Stats_FY[YY[_[YY].xlsx (found at L:\Batch_Processing\BatchIDStats)

This document contains statistics for records created or updated by a Batch Processing staff member using their “batchnetid” log in. See Sections III.F and IV of this document for details of how these statistics are compiled.

4.) VoyagerExtracts20[YY]-[YY].xls (found at L:\Batch_Processing\LoadExtractLogs) – Contains log of OCLC extract jobs run for the FY; includes log data for  OCLC Batchmatch (MARCadia), OCLC Manuscript & Archive Records, OCLC Local Holdings, OCLC Daily Export/Delete, and Withdrawals.

II.   Batch Processing Statistics Requested For Dept. Spreadsheet (LTS_Stats_2005-20[YY].xlsx, see I.C.2, above.):

New records (print)

New records (e-journals)

New records (e-books)

Records exported

Records enhanced

Headings maintenance

Batch jobs

III.  How The Values for the Department Spreadsheet Are Gathered:

  1.  

A. “New records (print) – This information is found by running the “Batch Activity Summary Report” (I.A.1. above) in the LTS Stats database. The total consists of “total Approvals input” + “total Books input” + “total NPAC input.” (net id in 948 is “batch” for these counts.)

B. “New records (e-journals) – This information is found in the “Batch Activity Summary Report” (I.A.1. above) in the LTS Stats database. The “Catalog/Format/e-Resources (journals) total” is the desired total. (net id in 948 is “batch” for these counts.)

C. “New records (e-books) -- This information is found in the “Batch Activity Summary Report” (I.A.1. above) in the LTS Stats database. The total is derived by adding “Catalog/Format/Computer files” total + “Catalog/Format/e-Resources (books)” total + “Catalog/Format/Sound recordings” total. (net id in 948 is “batch” for these counts.)

D. “Records Exported – The information for this total comes from the spreadsheet found at “L://Batch_Processing/LoadExtractLogs/VoyagerExtracts[FYdates].xls.” (I.C.4. above) The total for the FY is derived by adding together the totals from the following sheets in the document: “Batchmatch (MARCadia)” + “OCLC Archives & Man. Records” + “OCLC Institutional Records” + “OCLC MARC Holdings” + “OCLC Daily Export.” (These jobs are cron jobs, run against large numbers of records at a time.)

E. “Records enhanced – This information is found by running the Record Enhancement query in the database 1New_culv2-2012-2013.accdb (I.A.2. above). It includes info for WorldShare, Batchmatch, ebooksenhanced, and all “Update Backlog Records” (storage items) jobs.  This query is run against the Batch_Stats table in the built by PH’s job in LS Tools, mentioned in H, below. To get the total number of records enhanced, run “Records enhanced” query and then run “Get Records Enhancements Grand Total” query. The resulting table will consist of one number: The total number of records enhanced in the FY. (Note: Need to go into first query and edit to limit for specific FY.)

 F. “Headings maintenance – Batch Processing staff have each been given an additional Voyager sign-on, to be used when they are running batch processes using Gary Strawn’s LocationChanger or RecordReloader. These sign-ons take the form of “batch[netid]” and will show up in the record histories of any records edited in this fashion. A separate database called “3_BATCHstats.mdb,” (I.B. above) a set of queries, and a report called “Batch Bib Summary Report” have been created to harvest this information. For this specific line item in the department spreadsheet, information will be gathered by running the “Batch Bib Summary Report” and using the total of updated records for the operator id of “batchjm17,” “batchstr1” and “GLOBAL”.

G. “Batch OP ID Stats – This information will be gathered by running the “Batch Bib Summary Report” found in the “3_BATCHstats.mdb.” (I.B. above) Statistics for all batch operatorid’s will be gathered for interdepartmental use and entered into the spreadsheet, “BATCHID_Stats_ FY[YY]_[YY].xlsx” (I.C.1., above) found in L:\Batch_Processing\BatchIDStats.

H. “Batch jobs”* – LTS managers would like to determine how many batch processes are run each month. Additionally, Batch Processing unit managers would like to know how many records for each vendor/collection are processed. Not all of this information can be gathered via the existing LTS statistics database, so Pete Hoyt built a job in LS Tools to gather the data. (See query spec, “BatchStats_countXandH.docx,” a copy of which has been placed in the L:\tsstats\Batch Stats folder). The job is found under “Administrative Proc” in LS Tools, and is called “TS Stats Summary”. The data from this job should be entered into the spreadsheet “3_Batch_Stats_FY[YY]_[YY].xlsx” found in L:\tsstats\. (Get count from adding together “#of jobs run” from each page of 3_Batch_Stats_FY15_16.xlsx. This grand total will be entered into the “Batch jobs” line item in the LTS_Stats_2005-20[YY].xlsx spreadsheet.)  (Do we want to create a report for this data that presents it in some way other than monthly breakouts?)

I. “Fastshelve – In 1New_culv2-2012-2013.accdb, there is a make table query called “Find fastshelve” that can be run to gather bib-level statistics on the number of records fast-shelved by LTS staff. Criteria for the date range and the name of the output table must be manually changed each year.

 

*IV. Section H of “Batch Stats for FY End,” Explained

Staff member must run this LS Tools script found at Admin Proc/TS Stats Summary for each individual month. 

The data from the section headed “Summary for [date] through [date]” must be copied and pasted into the spreadsheet,

The data from the section headed “Batch Stats Summary” must have entries separated by “query” (‘bi’ on ‘Inputting’ page, ‘bm’ on ‘Maintenance’ page, and ‘ind3’ on ‘New’ page) and then by “subfield value,” and must be copied and pasted into the spreadsheet, “3_Batch_Stats_FY[yy]_[yy].xlsx” found in L:\tsstats\Batch Stats.

Sample of a report from “Cornell University Library: Voyager Production System
TS Statistics,” “show details” view, below.

A. Summary for 2017-11-01 through 2017-11-30 --- 463885 Activity records

Input

Input total

69318

Catalog

FastShelve

64376

Catalog

Books

63457

Input

Books input

62310

Catalog

e-Resources (books)

59908

Input

e-Resources (books) input

59871

Post cataloging

Maintenance

56957

Catalog

Fastcat

3573

Input

Approvals input

3171

Catalog

Electronic Video

2380

Catalog

Computer files

2373

Input

Computer files input

2372

Catalog

Serials

1901

Input

Serials input

1884

Catalog

e-Resources (journals)

1836

Catalog

Copy NonPCC

1267

Received

Received total

877

Input

pre-Cat Maintenance

798

Received

Books Received

797

Catalog

Full NonPCC

456

Post cataloging

Withdrawal

454

Input

Miscellaneous input

423

Input

Gifts input

422

Catalog

Minimal level

363

Input

NPAC input

309

Catalog

Class on Receipt

279

Input

PL480 input

263

Catalog

Sound recordings

232

Input

Sound recordings input

214

Catalog

Added locs

202

Post cataloging

Added copy

142

Catalog

Archival Materials

110

Input

Patron Driven Books input

77

Catalog

Scores

72

Input

Scores input

71

Catalog

Microforms

60

Input

Archival & Manuscripts input

55

Catalog

Full PCC

40

Catalog

Videos

29

Catalog

Projected Medium

24

Input

Projected Medium input

22

Received

Videos received

18

Received

Sound recordings received

16

Catalog

Maps

15

Input

Monograph Series Order input

13

Input

Maps input

12

Received

Scores received

11

Input

Videos input

10

Post cataloging

Recatalog

9

Received

Projected Medium received

8

Catalog

Conser

7

Catalog

Database

5

Post cataloging

Reclassification

3

Input

e-Resources (journals) input

3

Input

Microforms input

2

Received

Serials received

2

Received

Archival & Manuscripts Receipts

1

Catalog

Electronic Miscellaneous

1

Input

Depository input

1

Catalog

2-Dim. Nonprojectable Graphic

1

Input

2-Dim. Nonprojectable Graphic input

1

Post cataloging

Recon staff

1

 

 

 

 

 

 

 

 

 

 

B.   Batch Stats Summary

query

subfield value

instance

records

 

 

 

 

bi

Andinos1391

20171110

12

bi

Andinos1391

TOTAL (1)

12

bi

BACH1316

20171106

13

bi

BACH1316

TOTAL (1)

13

bi

BACH1317

20171110

15

bi

BACH1317

TOTAL (1)

15

bi

BACH1318

20171101

16

bi

BACH1318

TOTAL (1)

16

bi

BACH1319

20171115

16

bi

BACH1319

TOTAL (1)

16

bi

BACH1320

20171109

8

bi

BACH1320

TOTAL (1)

8

bi

BACH1322

20171106

18

bi

BACH1322

TOTAL (1)

18

bi

BACH1323

20171110

17

bi

BACH1323

TOTAL (1)

17

bi

BACH1324

20171110

19

bi

BACH1324

TOTAL (1)

19

bi

BACH1325

20171101

14

bi

BACH1325

TOTAL (1)

14

bi

BACH1326

20171110

17

bi

BACH1326

TOTAL (1)

17

bi

Cambeiro1095

20171108

20

bi

Cambeiro1095

TOTAL (1)

20

bi

Cambeiro1167

20171107

19

bi

Cambeiro1167

TOTAL (1)

19

bi

Cambeiro1191

20171107

21

bi

Cambeiro1191

TOTAL (1)

21

bi

Eulyoo

20171103

31

bi

Eulyoo

TOTAL (1)

31

bi

HoChiMinh

20171108

317

bi

HoChiMinh

TOTAL (1)

317

bi

Iturriaga8706

20171128

11

bi

Iturriaga8706

TOTAL (1)

11

bi

Iturriaga8707

20171128

15

bi

Iturriaga8707

TOTAL (1)

15

bi

Retta16831

20171107

25

bi

Retta16831

TOTAL (1)

25

bi

Retta16832

20171107

21

bi

Retta16832

TOTAL (1)

21

 

 

 

 

bm

UpdatedTreatises_20171009UTF8.mrc

20171122

30

bm

UpdatedTreatises_20171009UTF8.mrc

TOTAL (1)

30

bm

WorldShare

20171120

6484

bm

WorldShare

20171127

1549

bm

WorldShare

20171113

1211

bm

WorldShare

20171106

796

bm

WorldShare

TOTAL (4)

10040

bm

addnew899

20171109

59

bm

addnew899

20171101

49

bm

addnew899

TOTAL (2)

108

bm

bib_replace

20171110

795

bm

bib_replace

TOTAL (1)

795

bm

deloclcprefix

20171103

705

bm

deloclcprefix

20171110

617

bm

deloclcprefix

20171117

547

bm

deloclcprefix

20171124

429

bm

deloclcprefix

TOTAL (4)

2298

bm

olat

20171107

29

bm

olat

TOTAL (1)

29

 

 

 

 

ind3

AUX_Fine

20171116AuxamInvoice171030592923.mrc.uc

10

ind3

AUX_Fine

20171116AuxamInvoice171011591776.mrc.uc

10

ind3

AUX_Fine

20171116AuxamInvoice171019592315.mrc.uc

9

ind3

AUX_Fine

TOTAL (3)

29

ind3

AUX_Olin

20171102AuxamInvoice171009591556.mrc.uc

1

ind3

AUX_Olin

20171102AuxamInvoice170928590873.mrc.uc

1

ind3

AUX_Olin

20171127AuxamInvoice171027592854.mrc.uc

1

ind3

AUX_Olin

20171102AuxamInvoice171004591372.mrc.uc

1

ind3

AUX_Olin

20171101AuxamInvoice171009591557.mrc.uc

1

ind3

AUX_Olin

20171102AuxamInvoice171013591932.mrc.uc

1

ind3

AUX_Olin

20171120AuxamInvoice171027592848.mrc.uc

1

ind3

AUX_Olin

TOTAL (7)

7

ind3

Casalini

20171115bsr-Nyra40b.983

9

ind3

Casalini

20171115bsr-Nyra40b.984

7

ind3

Casalini

20171103bsr-Nyra40g.366

7

ind3

Casalini

20171103bsr-Nyra40g.370

5

ind3

Casalini

20171116bsr-Nyra40x.771

5

ind3

Casalini

20171115bsr-Nyra40w.899

5

ind3

Casalini

20171115bsr-Nyra40w.898

5

ind3

Casalini

20171103bsr-Nyra40g.364

5

ind3

Casalini

20171115bsr-Nyra40f.839

4

ind3

Casalini

20171103bsr-Nyra40g.368

4

ind3

Casalini

20171128bsr-Nyra40w.900

3

ind3

Casalini

20171115bsr-Nyra40d.607

3

ind3

Casalini

20171115bsr-Nyra40g.371

3

ind3

Casalini

20171115bsr-Nyra40f.840

3

ind3

Casalini

20171103bsr-Nyra40g.369

3

ind3

Casalini

20171128bsr-Nyra40q.264

3

ind3

Casalini

20171103bsr-Nyra40e.256

2

ind3

Casalini

20171110bsr-Nyra40q.262

2

ind3

Casalini

20171116bas-Nyra40O.186

2

ind3

Casalini

20171115bsr-Nyra40d.608

2

ind3

Casalini

20171116bsr-Nyra40x.770

2

ind3

Casalini

20171115bsr-Nyra40m.343

2

ind3

Casalini

20171108bsr-Nyra40O.185

1

ind3

Casalini

20171115bas-Nyra40t.052

1

ind3

Casalini

20171103bas-Nyra40t.051

1

ind3

Casalini

20171115bsr-Nyra40v.501

1

ind3

Casalini

20171115bsr-Nyra40z.111

1

ind3

Casalini

20171115bsr-Nyra40O.187

1

ind3

Casalini

20171115bsr-Nyra40q.263

1

ind3

Casalini

20171120bsr-Nyra40u.283

1

ind3

Casalini

20171107bsr-Nyra40u.281

1

ind3

Casalini

20171115bsr-Nyra40g.372

1

ind3

Casalini

20171115bsr-Nyra40m.342

1

ind3

Casalini

20171103bsr-Nyra40e.257

1

ind3

Casalini

20171108bsr-Nyra40v.500

1

ind3

Casalini

20171120bsr-Nyra40u.282

1

ind3

Casalini

TOTAL (36)

100

ind3

CassLex

20171120COR_LEXIS-ETREATn20171117.mrc

13

ind3

CassLex

20171130COR_LEXIS-ETREATu20171117.mrc

1

ind3

CassLex

TOTAL (2)

14

ind3

Coutts

20171128110917NAapp.mrc.uc

354

ind3

Coutts

20171101101917NAapp.mrc.uc

300

ind3

Coutts

20171115110217NAapp.mrc.uc

298

ind3

Coutts

20171108102617NAapp.mrc.uc

211

ind3

Coutts

20171101101917NAapp.mrc.u

1

ind3

Coutts

TOTAL (5)

1164

ind3

CouttsShelfReady

2.01711E+15

10

ind3

CouttsShelfReady

TOTAL (1)

10

ind3

EastView

20171108EV20171107-155.mrc.uc

12

ind3

EastView

TOTAL (1)

12

ind3

Fast_updates

20171101FASTChangeReport2017-08-09.txt

3284

ind3

Fast_updates

20171103FASTChangeReport2017-09-18.txt

1818

ind3

Fast_updates

20171101FASTChangeReport2017-07-12.txt

1657

ind3

Fast_updates

20171103FASTChangeReport2017-10-12.txt

1465

ind3

Fast_updates

20171103FASTChangeReport2017-09-19.txt

593

ind3

Fast_updates

20171103FASTChangeReport2017-10-10.txt

158

ind3

Fast_updates

20171101FASTChangeReport2017-08-04.txt

1

ind3

Fast_updates

TOTAL (7)

8976

ind3

HARRASSMARCNOW

20171117COR#2794_22_10_2_2017.mrc.uc

22

ind3

HARRASSMARCNOW

20171129COR#2793_20_10_2_2017.mrc.uc

20

ind3

HARRASSMARCNOW

20171115COR#2789_15_9_25_2017.mrc.uc

15

ind3

HARRASSMARCNOW

20171129COR#2811_13_10_16_2017.mrc.uc

13

ind3

HARRASSMARCNOW

20171109COR#2788_11_9_25_2017.mrc.uc

11

ind3

HARRASSMARCNOW

20171103COR#2779_10_9_11_2017.mrc.uc

10

ind3

HARRASSMARCNOW

20171115COR#2787_9_9_25_2017.mrc.uc

9

ind3

HARRASSMARCNOW

20171117COR#2800_8_10_9_2017.mrc.uc

8

ind3

HARRASSMARCNOW

20171117COR#2799_8_10_9_2017.mrc.uc

8

ind3

HARRASSMARCNOW

20171103COR#2767_7_9_04_2017.mrc.uc

7

ind3

HARRASSMARCNOW

20171106COR#2786_8_9_25_2017.mrc.uc

7

ind3

HARRASSMARCNOW

20171106COR#2759_7_28_8_2017.mrc.uc

7

ind3

HARRASSMARCNOW

20171115COR#2785_6_9_25_2017.mrc.uc

6

ind3

HARRASSMARCNOW

20171128COR#2797_6_10_9_2017.mrc.uc

6

ind3

HARRASSMARCNOW

20171120COR#2798_6_10_9_2017.mrc.uc

6

ind3

HARRASSMARCNOW

20171103COR#2778_6_9_11_2017.mrc.uc

6

ind3

HARRASSMARCNOW

20171120COR#2804_5_10_16_2017.mrc.uc

5

ind3

HARRASSMARCNOW

20171115COR#2784_5_9_25_2017.mrc.uc

5

ind3

HARRASSMARCNOW

20171117COR#2795_5_10_9_2017.mrc.uc

5

ind3

HARRASSMARCNOW

20171106COR#2777_5_9_11_2017.mrc.uc

5

ind3

HARRASSMARCNOW

20171120COR#2805_5_10_16_2017.mrc.uc

5

ind3

HARRASSMARCNOW

20171103COR#2776_4_9_11_2017.mrc.uc

4

ind3

HARRASSMARCNOW

20171116COR#2782_4_9_25_2017.mrc.uc

4

ind3

HARRASSMARCNOW

20171120COR#2796_5_10_9_2017.mrc.uc

4

ind3

HARRASSMARCNOW

20171103COR#2764_4_9_04_2017.mrc.uc

4

ind3

HARRASSMARCNOW

20171108COR#2781_3_9_25_2017.mrc.uc

3

ind3

HARRASSMARCNOW

20171117COR#2790_3_10_2_2017.mrc.uc

3

ind3

HARRASSMARCNOW

20171103COR#2763_3_9_04_2017.mrc.uc

3

ind3

HARRASSMARCNOW

20171103COR#2762_3_9_04_2017.mrc.uc

3

ind3

HARRASSMARCNOW

20171115COR#2783_4_9_25_2017.mrc.uc

2

ind3

HARRASSMARCNOW

20171115COR#2783_4_9_25_2017.mrc.uc..f

1

ind3

HARRASSMARCNOW

20171117COR#2801_2_10_16_2017.mrc.uc

1

ind3

HARRASSMARCNOW

TOTAL (32)

218

ind3

Harrassowitz

2017110320170922102706.24setblo.inv.mrc.uc

25

ind3

Harrassowitz

2017112820171027111939.24setblo.inv.mrc.uc

23

ind3

Harrassowitz

2017112820171027111943.24setblo.inv.mrc.uc

11

ind3

Harrassowitz

2017110320170922102712.24setblo.inv.mrc.uc

6

ind3

Harrassowitz

TOTAL (4)

65

ind3

IndoRR

20171116IndoRRset1.mrc

99

ind3

IndoRR

TOTAL (1)

99

ind3

Kanopy

20171116Kanopy_11152017_17_fxd.mrc

16

ind3

Kanopy

TOTAL (1)

16

ind3

Myilibraryeeduappr

20171106Cornell_ePDA_11032017_edu.mrc.uc

3

ind3

Myilibraryeeduappr

TOTAL (1)

3

ind3

OverDriveEbk

20171103OverDrive_OvD_11032017_5_Cataloged.mrc

3

ind3

OverDriveEbk

TOTAL (1)

3

ind3

PRVATY_X2C

20171106Rand_20170807through20171031.mrc

106

ind3

PRVATY_X2C

TOTAL (1)

106

ind3

PRVEHT_~ZI

20171130Law_Nov2017.mrc.uc

10

ind3

PRVEHT_~ZI

TOTAL (1)

10

ind3

PRVLSH_ACAJP

20171109CITH1711-NOV17.uc

1410

ind3

PRVLSH_ACAJP

TOTAL (1)

1410

ind3

PRVLSH_AJLOV

20171109coo-20171109aln.mrc.uc

5

ind3

PRVLSH_AJLOV

20171117coo-20171115aln.mrc.uc

4

ind3

PRVLSH_AJLOV

TOTAL (2)

9

ind3

SerialSolutions

20171120COO_360MARC_Update_20171116_monographs_new.mrc.uc

58911

ind3

SerialSolutions

20171120COO_360MARC_Update_20171116_monographs_changed.mrc.uc

19871

ind3

SerialSolutions

20171117COO_360MARC_Update_20171116_serials_changed.mrc.uc

9496

ind3

SerialSolutions

20171117COO_360MARC_Update_20171116_serials_new.mrc.uc

1801

ind3

SerialSolutions

TOTAL (4)

90079

ind3

berenguer

20171130hbbooks_271712.mrc.uc

24

ind3

berenguer

20171130hbbooks_271711.mrc.uc

24

ind3

berenguer

TOTAL (2)

48

ind3

bks24x7SKSFTevid

20171103Books24x7_all_videoall_2017-09-30.mrc.uc

2317

ind3

bks24x7SKSFTevid

20171101Books24x7-videoall-UPDATED-on-03-31-17.mrc.uc

47

ind3

bks24x7SKSFTevid

TOTAL (2)

2364

 

 

 

 

 

 

 

 

 

 

 

  • No labels