Bob
------------------------------------------------------------------------
Date: Tue, 2 Jan 1996 12:53:24 -0800
From: root (root of cithe502)
To: nolty
Hi Colin,
I got your constants from rsgs02:~okada/intererp.tar.gz, made a new
copy of the standard CALMOD database here, then applied each of the
ceocal kumacs in order, then each of the inter kumacs in order,
resulting in a CEO database. I already had a BOB database here, which
I created by finding interERP pair-weeks with poor performance and
applying the most recent interERP constants for that pair from a week
with good performance. (So the non-interERP constants are identical
in BOB and STD.) I ran a complete upgoing muon analysis with all cuts
on my entire dataset (sets 7244-9381) three times, once with standard
constants, once with CEO and once with BOB.
I use histograms to evaluate the quality of each box or interERP pair.
The histograms are of a quantity I call tError -- the difference (in
nanoseconds) between the time reconstructed in a box and the time you
expect to be reconstructed, assuming that the time in some other hit
box is correct and the particle is traveling at c. The rms of the
tError histogram is the timing resolution, independent of path length.
After all the histograms are filled, I record the mean, sigma and
number of outliers.
Using these measures of quality, I find the non-interERP performance
of CEO to be no better than STD. I'm not sure what you were trying to
accomplish with the ceocal kumacs which change non-interERP constants.
I find that whenever the performance of CEO differs from STD on
interERP constants, CEO is better. However, there are pair-weeks
where BOB does a good job while neither STD nor CEO do well. So I
think we need to merge some of your constants with some of mine to do
our best job. (There are also pair-weeks that BOB screws up even
though STD is good, so apparently I still have a bug in my perl script
that applies old constants.)
I append two files -- my constants, and an output file from my quality
checks. Let me know what you think (I'll be incommunokada until 26
Dec.)
Bob
P.S. Chris W. tells me you've done some work on checking ST efficiency
with SC -- I'll want to ask you about that soon.
------------------------ ierpFix.kumac (BOB) ---------------------------
RUN 8430
ERP INTERSLOPE 1 0 .4344
ERP INTERSLOPE 1 1 .4332
ERP INTEROFFSET 1 1 43.79
RUN 8487
ERP INTERSLOPE 1 0 .4344
ERP INTERSLOPE 1 1 .4332
ERP INTEROFFSET 1 1 43.79
RUN 8534
ERP INTERSLOPE 1 0 .4344
ERP INTERSLOPE 1 1 .4332
ERP INTEROFFSET 1 1 43.79
RUN 8582
ERP INTERSLOPE 1 0 .4344
ERP INTERSLOPE 1 1 .4332
ERP INTEROFFSET 1 1 43.79
RUN 8628
ERP INTERSLOPE 1 0 .4344
ERP INTERSLOPE 1 1 .4332
ERP INTEROFFSET 1 1 43.79
RUN 8677
ERP INTERSLOPE 1 0 .4344
ERP INTERSLOPE 1 1 .4332
ERP INTEROFFSET 1 1 43.79
RUN 7825
ERP INTERSLOPE 1 1 .4329
ERP INTERSLOPE 1 2 .4290
ERP INTEROFFSET 1 2 -3.71
RUN 7869
ERP INTERSLOPE 1 1 .4329
ERP INTERSLOPE 1 2 .4290
ERP INTEROFFSET 1 2 -3.71
RUN 7894
ERP INTERSLOPE 1 1 .4329
ERP INTERSLOPE 1 2 .4290
ERP INTEROFFSET 1 2 105.56
RUN 7928
ERP INTERSLOPE 1 1 .4329
ERP INTERSLOPE 1 2 .4290
ERP INTEROFFSET 1 2 -14.1
RUN 7989
ERP INTERSLOPE 1 1 .4329
ERP INTERSLOPE 1 2 .4290
ERP INTEROFFSET 1 2 208.47
RUN 8035
ERP INTERSLOPE 1 1 .4329
ERP INTERSLOPE 1 2 .4290
ERP INTEROFFSET 1 2 -3.71
RUN 8064
ERP INTERSLOPE 1 1 .4329
ERP INTERSLOPE 1 2 .4290
ERP INTEROFFSET 1 2 -3.71
RUN 8094
ERP INTERSLOPE 1 1 .4329
ERP INTERSLOPE 1 2 .4290
ERP INTEROFFSET 1 2 -3.71
RUN 8137
ERP INTERSLOPE 1 1 .4329
ERP INTERSLOPE 1 2 .4290
ERP INTEROFFSET 1 2 -3.71
RUN 8430
ERP INTERSLOPE 1 1 .4332
ERP INTERSLOPE 1 2 .4284
ERP INTEROFFSET 1 2 47.86
RUN 8487
ERP INTERSLOPE 1 1 .4332
ERP INTERSLOPE 1 2 .4284
ERP INTEROFFSET 1 2 47.86
RUN 8534
ERP INTERSLOPE 1 1 .4332
ERP INTERSLOPE 1 2 .4284
ERP INTEROFFSET 1 2 47.86
RUN 8582
ERP INTERSLOPE 1 1 .4332
ERP INTERSLOPE 1 2 .4284
ERP INTEROFFSET 1 2 47.86
RUN 8628
ERP INTERSLOPE 1 1 .4332
ERP INTERSLOPE 1 2 .4284
ERP INTEROFFSET 1 2 47.86
RUN 8677
ERP INTERSLOPE 1 1 .4332
ERP INTERSLOPE 1 2 .4284
ERP INTEROFFSET 1 2 47.86
RUN 7689
ERP INTERSLOPE 2 2 .2422
ERP INTERSLOPE 2 3 .2485
ERP INTEROFFSET 2 3 -113
RUN 7928
ERP INTERSLOPE 2 2 .2416
ERP INTERSLOPE 2 3 .2478
ERP INTEROFFSET 2 3 -115.3
RUN 7689
ERP INTERSLOPE 2 3 .2485
ERP INTERSLOPE 2 4 .2442
ERP INTEROFFSET 2 4 13.4
RUN 7869
ERP INTERSLOPE 2 3 .2484
ERP INTERSLOPE 2 4 .2429
ERP INTEROFFSET 2 4 10.99
RUN 7928
ERP INTERSLOPE 2 3 .2478
ERP INTERSLOPE 2 4 .2428
ERP INTEROFFSET 2 4 11.68
RUN 7689
ERP INTEROFFSET 2 5 2.49000000000001
RUN 7869
ERP INTEROFFSET 2 5 -11.5
RUN 7928
ERP INTERSLOPE 2 4 .2428
ERP INTERSLOPE 2 5 .2437
ERP INTEROFFSET 2 5 -10.93
------------------------------------------------------------------------
The format of this file is
Run Pair Nstd meanstd sigstd uflstd ovfstd Nbob meanbob sigbob uflbob ovfbob Nceo meanceo sigceo uflceo ovfceo
Run - calibration set
Pair - 0 = N/1, 1 = 1/2, ... 6 = 6/S
N - number of events reconstructed in that pair that week
mean - mean of tError distribution for all events in that interERP pair
sigma - rms of tError. (Usually between 1 and 1.5 ns for good pair-weeks)
ufl - number of underflows (events with tError < -6 ns)
ovf - number of overflows (events with tError > 6 ns)
For the majority of pair-weeks, all three databases give exactly the
same results. This file only contains the pair-weeks with significant
differences.
7309 1 8129 0.763834 1.74466 11 22 8136 0.112288 1.29922 6 8 8129 0.763834 1.74466 11 22
7689 2 5535 0.32712 2.49636 290 175 5544 0.387215 2.51807 283 134 5467 2.6228 3.54565 1137 2907
7689 3 6788 0.780303 3.80378 1531 5224 7014 0.094670 2.30801 183 686 7024 -0.61229 2.40972 216 523
7689 4 6363 -0.11130 1.12735 7 11 6197 0.125 3.48882 1301 4892 6360 -0.17455 1.14404 7 11
7788 0 129 0 0 0 129 137 -0.07692 2.24954 6 1 129 0 0 0 129
7825 1 590 4.58333 0.552771 117 467 600 0.2625 1.28235 0 0 590 4.58333 0.552771 117 467
7825 2 277 -0.02536 1.22928 0 1 277 0.088768 1.21967 0 1 277 -0.02536 1.22928 0 1
7825 3 6777 0.015262 1.15944 5 7 6779 0.094932 1.15432 4 7 6777 0.015262 1.15944 5 7
7825 4 6737 0.065230 1.1445 3 4 6736 -0.20311 1.22003 4 3 6737 0.065230 1.1445 3 4
7869 3 5786 5.25 0 4 5781 6100 -0.12206 1.12873 0 3 5786 5.25 0 4 5781
7894 0 191 0 0 3 188 191 4 0.25 1 188 190 1.75 0 3 186
7894 1 8159 0 0 0 8159 8542 -0.17516 1.13281 10 7 8543 -0.12837 1.13554 9 8
7928 0 1059 0 0 16 1043 1067 0 0 0 1067 1286 -2.21559 2.5753 607 214
7928 1 6065 0 0 0 6065 6312 -0.12205 1.19829 27 1 6318 -0.86888 1.58067 45 2
7928 3 3635 0.804513 1.56741 101 498 3635 0.768939 1.53346 101 498 3635 0.804513 1.56741 101 498
7928 4 6756 -0.63767 1.64503 7 1 6756 -0.63255 1.63845 7 1 6756 -0.63767 1.64503 7 1
7989 0 328 0 0 2 326 327 0.928571 3.82476 9 304 420 -0.175 3.14235 69 151
7989 1 7044 0 0 0 7044 7383 -0.1508 1.19403 7 2 7389 -0.10224 1.16181 8 4
8035 1 7927 2.61364 4.53149 1536 6358 8117 0.035652 1.16156 4 7 8117 -0.03281 1.1601 4 7
8064 1 8731 2.64189 4.11513 1860 6834 8934 0.013727 1.14226 6 4 8934 -0.08381 1.14595 7 3
8094 1 7556 2.05556 3.95509 1605 5915 7772 -0.12106 1.13181 16 8 7772 -0.19747 1.13662 16 8
8137 0 182 0 0 0 182 184 0 0 0 184 182 0 0 0 182
8137 1 888 5.75 0 159 728 921 1.01969 1.53506 0 7 888 5.75 0 159 728
8143 0 1329 0.919492 2.36967 159 875 1329 0.919492 2.36967 159 875 1733 -0.21924 1.613 6 4
8177 0 1621 0.907779 1.71824 3 24 1627 0.0625 1.68803 3 8 1621 0.907779 1.71824 3 24
8430 1 4951 0.490602 3.65762 507 4311 5170 0.467228 1.81784 74 290 4951 0.490602 3.65762 507 4311
8487 0 786 -0.13529 2.91627 147 20 781 2.98113 1.59477 81 64 719 -0.14285 2.94339 140 19
8487 1 3994 0.335086 2.42582 351 76 3989 -0.04332 1.64497 139 134 3546 0.367247 2.40778 317 69
8534 0 704 0.078422 2.84964 103 24 698 3.37716 1.55321 71 49 675 0.105978 2.86496 102 21
8534 1 3373 -2.71316 3.09631 1381 336 3380 0.022554 1.6632 97 135 3244 -2.72334 3.07998 1332 318
8582 0 132 0.176471 3.02473 16 14 129 3.75962 1.76093 4 21 132 0.176471 3.02473 16 14
8582 1 680 0.446429 3.06285 91 533 703 0.581595 2.1081 7 25 680 0.446429 3.06285 91 533
8628 0 310 -1.77331 2.39802 71 3 310 0.9 1.4239 3 7 310 -1.77331 2.39802 71 3
8628 1 1611 0.528689 3.30035 244 1184 1719 2.48355 3.39582 91 93 1611 0.528689 3.30035 244 1184
8677 0 1040 0.337609 3.29502 178 63 1026 2.16504 4.05607 66 242 1040 0.337609 3.29502 178 63
8677 1 4198 -3.13292 3.24305 2729 632 4255 -0.64195 1.59098 176 127 4198 -3.13292 3.24305 2729 632
8677 2 5234 -0.17973 1.3354 7 132 5238 -0.17792 1.33839 7 132 5234 -0.17973 1.3354 7 132
8724 0 2299 -1.15423 2.47561 398 11 2329 -0.06607 1.07782 1 1 2326 -0.19298 1.08258 1 1
8724 1 7462 0.344672 3.46167 1483 4928 7840 -0.09263 1.59814 8 41 7840 0.15112 1.57804 6 67
8775 6 21 3.75 1 8 11 21 4 0.75 8 11 21 3.75 1 8 11
8817 6 294 5.75 0 0 293 294 -0.125 4.46339 3 287 409 0.25 1.42514 0 6
8866 6 998 5.75 0 0 997 998 5.75 0 0 997 1585 -0.03869 1.34203 2 0
8925 6 675 0 0 0 675 675 0 0 0 675 1049 0.045042 1.24613 0 0
8963 6 917 0 0 0 917 917 0 0 0 917 1278 -0.14241 1.17117 0 0
8995 6 1052 0 0 0 1052 1052 0 0 0 1052 1485 -0.15694 1.22768 0 2
9031 6 674 0 0 0 674 674 0 0 0 674 995 -0.11167 1.26564 1 0
9083 6 148 0 0 0 148 148 0 0 0 148 206 -0.17682 1.26086 1 0
9123 6 715 0 0 0 715 715 0 0 0 715 1041 -0.11359 1.28508 0 0
9179 6 794 0 0 0 794 794 0 0 0 794 1148 -0.14223 1.20116 1 1
9231 6 791 0 0 0 791 791 0 0 0 791 1216 -0.03806 1.25894 0 1
9279 6 417 0 0 0 417 417 0 0 0 417 614 -0.15065 1.31574 0 0
9327 6 877 0 0 0 877 877 0 0 0 877 1331 -0.14616 1.31343 2 0
9381 6 506 0 0 0 506 506 0 0 0 506 727 -0.45757 2.54711 11 3
I find it useful to read this file into an ntuple I book interactively
in PAW to find out where the significant differences are. Here are
the results of some queries I ran:
CEO worse than STD:
PAW [15] nt/sca 2 sigceo-sigstd>0.1.and.sigstd.ne.0 ! ! ! set pair nstd sigstd nceo sigceo
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
| ENTRY | SET | PAIR | NSTD | SIGSTD | NCEO | SIGCEO |
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
| 87 | 7689.0 | 2.0000 | 5535.0 | 2.4964 | 5467.0 | 3.5457 |
==> Only one event satisfied the cuts
CEO better than STD
PAW [16] nt/sca 2 sigstd-sigceo>0.1 ! ! ! set pair nstd sigstd nceo sigceo
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
| ENTRY | SET | PAIR | NSTD | SIGSTD | NCEO | SIGCEO |
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
| 88 | 7689.0 | 3.0000 | 6788.0 | 3.8038 | 7024.0 | 2.4097 |
| 142 | 8035.0 | 1.0000 | 7927.0 | 4.5315 | 8117.0 | 1.1601 |
| 149 | 8064.0 | 1.0000 | 8731.0 | 4.1151 | 8934.0 | 1.1459 |
| 156 | 8094.0 | 1.0000 | 7556.0 | 3.9551 | 7772.0 | 1.1366 |
| 169 | 8143.0 | .00000E+00| 1329.0 | 2.3697 | 1733.0 | 1.6130 |
| 253 | 8724.0 | .00000E+00| 2299.0 | 2.4756 | 2326.0 | 1.0826 |
| 254 | 8724.0 | 1.0000 | 7462.0 | 3.4617 | 7840.0 | 1.5780 |
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
==> 7 events have been scanned
CEO gets some right when STD gets them all wrong:
PAW [17] nt/sca 2 sigstd.eq.0.and.sigceo>0 ! ! ! set pair nstd sigstd nceo sigceo
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
| ENTRY | SET | PAIR | NSTD | SIGSTD | NCEO | SIGCEO |
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
| 121 | 7894.0 | 1.0000 | 8159.0 | .00000E+00| 8543.0 | 1.1355 |
| 127 | 7928.0 | .00000E+00| 1059.0 | .00000E+00| 1286.0 | 2.5753 |
| 128 | 7928.0 | 1.0000 | 6065.0 | .00000E+00| 6318.0 | 1.5807 |
| 134 | 7989.0 | .00000E+00| 328.00 | .00000E+00| 420.00 | 3.1423 |
| 135 | 7989.0 | 1.0000 | 7044.0 | .00000E+00| 7389.0 | 1.1618 |
| 273 | 8817.0 | 6.0000 | 294.00 | .00000E+00| 409.00 | 1.4251 |
| 280 | 8866.0 | 6.0000 | 998.00 | .00000E+00| 1585.0 | 1.3420 |
| 287 | 8925.0 | 6.0000 | 675.00 | .00000E+00| 1049.0 | 1.2461 |
| 294 | 8963.0 | 6.0000 | 917.00 | .00000E+00| 1278.0 | 1.1712 |
| 301 | 8995.0 | 6.0000 | 1052.0 | .00000E+00| 1485.0 | 1.2277 |
| 308 | 9031.0 | 6.0000 | 674.00 | .00000E+00| 995.00 | 1.2656 |
| 315 | 9083.0 | 6.0000 | 148.00 | .00000E+00| 206.00 | 1.2609 |
| 322 | 9123.0 | 6.0000 | 715.00 | .00000E+00| 1041.0 | 1.2851 |
| 329 | 9179.0 | 6.0000 | 794.00 | .00000E+00| 1148.0 | 1.2012 |
| 336 | 9231.0 | 6.0000 | 791.00 | .00000E+00| 1216.0 | 1.2589 |
| 343 | 9279.0 | 6.0000 | 417.00 | .00000E+00| 614.00 | 1.3157 |
| 350 | 9327.0 | 6.0000 | 877.00 | .00000E+00| 1331.0 | 1.3134 |
| 357 | 9381.0 | 6.0000 | 506.00 | .00000E+00| 727.00 | 2.5471 |
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
==> 18 events have been scanned
CEO better than BOB:
PAW [6] nt/sca 1 sigbob-sigceo>.1.and.sigceo>0 ! ! ! set pair sigbob sigceo meanbob meanceo
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
| ENTRY | SET | PAIR | SIGBOB | SIGCEO | MEANBOB | MEANCEO |
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
| 89 | 7689.0 | 4.0000 | 3.4888 | 1.1440 | .12500 | -.17455 |
| 107 | 7825.0 | 1.0000 | 1.2823 | .55277 | .26250 | 4.5833 |
| 134 | 7989.0 | .00000E+00| 3.8248 | 3.1423 | .92857 | -.17500 |
| 169 | 8143.0 | .00000E+00| 2.3697 | 1.6130 | .91949 | -.21924 |
| 246 | 8677.0 | .00000E+00| 4.0561 | 3.2950 | 2.1650 | .33761 |
| 273 | 8817.0 | 6.0000 | 4.4634 | 1.4251 | -.12500 | .25000 |
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
==> 6 events have been scanned
CEO gets some right when BOB gets them all wrong:
PAW [7] nt/sca 1 sigbob.eq.0.and.sigceo>0 ! ! ! set pair sigbob sigceo meanbob meanceo
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
| ENTRY | SET | PAIR | SIGBOB | SIGCEO | MEANBOB | MEANCEO |
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
| 127 | 7928.0 | .00000E+00| .00000E+00| 2.5753 | .00000E+00| -2.2156 |
| 280 | 8866.0 | 6.0000 | .00000E+00| 1.3420 | 5.7500 | -.38690E-01|
| 287 | 8925.0 | 6.0000 | .00000E+00| 1.2461 | .00000E+00| .45042E-01|
| 294 | 8963.0 | 6.0000 | .00000E+00| 1.1712 | .00000E+00| -.14241 |
| 301 | 8995.0 | 6.0000 | .00000E+00| 1.2277 | .00000E+00| -.15694 |
| 308 | 9031.0 | 6.0000 | .00000E+00| 1.2656 | .00000E+00| -.11167 |
| 315 | 9083.0 | 6.0000 | .00000E+00| 1.2609 | .00000E+00| -.17682 |
| 322 | 9123.0 | 6.0000 | .00000E+00| 1.2851 | .00000E+00| -.11359 |
| 329 | 9179.0 | 6.0000 | .00000E+00| 1.2012 | .00000E+00| -.14223 |
| 336 | 9231.0 | 6.0000 | .00000E+00| 1.2589 | .00000E+00| -.38060E-01|
| 343 | 9279.0 | 6.0000 | .00000E+00| 1.3157 | .00000E+00| -.15065 |
| 350 | 9327.0 | 6.0000 | .00000E+00| 1.3134 | .00000E+00| -.14616 |
| 357 | 9381.0 | 6.0000 | .00000E+00| 2.5471 | .00000E+00| -.45757 |
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
==> 13 events have been scanned
BOB better than CEO:
PAW [8] nt/sca 1 sigceo-sigbob>.1.and.sigbob>0 ! ! ! set pair sigbob sigceo meanbob meanceo
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
| ENTRY | SET | PAIR | SIGBOB | SIGCEO | MEANBOB | MEANCEO |
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
| 16 | 7309.0 | 1.0000 | 1.2992 | 1.7447 | .11229 | .76383 |
| 87 | 7689.0 | 2.0000 | 2.5181 | 3.5457 | .38721 | 2.6228 |
| 88 | 7689.0 | 3.0000 | 2.3080 | 2.4097 | .94670E-01| -.61229 |
| 128 | 7928.0 | 1.0000 | 1.1983 | 1.5807 | -.12205 | -.86888 |
| 212 | 8430.0 | 1.0000 | 1.8178 | 3.6576 | .46723 | .49060 |
| 218 | 8487.0 | .00000E+00| 1.5948 | 2.9434 | 2.9811 | -.14285 |
| 219 | 8487.0 | 1.0000 | 1.6450 | 2.4078 | -.43320E-01| .36725 |
| 225 | 8534.0 | .00000E+00| 1.5532 | 2.8650 | 3.3772 | .10598 |
| 226 | 8534.0 | 1.0000 | 1.6632 | 3.0800 | .22554E-01| -2.7233 |
| 232 | 8582.0 | .00000E+00| 1.7609 | 3.0247 | 3.7596 | .17647 |
| 233 | 8582.0 | 1.0000 | 2.1081 | 3.0628 | .58160 | .44643 |
| 239 | 8628.0 | .00000E+00| 1.4239 | 2.3980 | .90000 | -1.7733 |
| 247 | 8677.0 | 1.0000 | 1.5910 | 3.2431 | -.64195 | -3.1329 |
| 266 | 8775.0 | 6.0000 | .75000 | 1.0000 | 4.0000 | 3.7500 |
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
==> 14 events have been scanned
BOB gets some right when CEO gets them all wrong:
PAW [9] nt/sca 1 sigceo.eq.0.and.sigbob>0 ! ! ! set pair sigbob sigceo meanbob meanceo
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
| ENTRY | SET | PAIR | SIGBOB | SIGCEO | MEANBOB | MEANCEO |
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
| 99 | 7788.0 | .00000E+00| 2.2495 | .00000E+00| -.76920E-01| .00000E+00|
| 116 | 7869.0 | 3.0000 | 1.1287 | .00000E+00| -.12206 | 5.2500 |
| 120 | 7894.0 | .00000E+00| .25000 | .00000E+00| 4.0000 | 1.7500 |
| 163 | 8137.0 | 1.0000 | 1.5351 | .00000E+00| 1.0197 | 5.7500 |
+-------+-------------+-------------+-------------+-------------+-------------+-------------+
==> 4 events have been scanned