Accelerator Update for May 9, 2008 - May 12, 2008

Friday May 9

The day shift began with Operations monitoring Tevatron (TeV) store 6128 (96.33E30) and the Recycler stash (229.3E10), with the Antiproton Source (Pbar) stacking (24.5E10), with the Main Injector, Booster, and Linac operating normally, with the Collider Detector at Fermilab (CDF) and DZero (D0) using the colliding beams, and with the NuMI and SciBooNE / MiniBooNE (BNB) experiments taking beam.

At 8:13 AM, a Linac Klystron RF station (KRF7) tripped off. It reset.

At 8:22 AM, KRF4 tripped off. It reset.

At 9:08 AM, KRF6 tripped off. It reset.

At 9:20 AM, KRF2 tripped off. It reset.

FESS personnel reported at 10:08 AM that they were beginning to test the MINOS sump pumps.

At 10:15 AM, KRF3 tripped off. It reset.

FESS personnel reported at 10:46 AM that they were performing preventive maintenance on the Wilson Hall emergency generator.

At 10:59 AM, BRF13 tripped off. It reset.

Operations terminated store 6128 at 11:47 AM.

Operations reported at 11:54 AM that feeder 36 was reenergized.

At 11:56 AM, KRF7 tripped off. It reset.

Cryo system experts reported at 11:59 AM that they had turned on compressor #4 at TeV sector F0.

Operations prepared D0 for an access at 12:03 PM.

At 12:14 PM, a TeV vacuum pump (IP7A) tripped off. It reset.

At 12:52 PM, two MI vacuum pumps (IP1290 & 1282) tripped off. They reset and vacuum began improving.

D0 came out of access at 1:10 PM.

Operations put the TeV through a dry squeeze at 1:40 PM.

Operations put the TeV into shot setup at 2:15 PM.

Operations halted all beam at 3:23 PM so that Linac experts could install diagnostics on Klystron stations 3 & 7 and to look for a LCW leak on LRF3.

Operations put Pbar into standby at 3:24 PM.

Operations established store 6130 at 3:56 PM with an initial luminosity of 273.58E30.

Operations reported at 4:09 PM that the Recycler had stashed antiprotons four times during the day shift.

At 4:21 PM, BRF13 tripped off. It reset.

At 5:14 PM, KRF2 tripped off. It reset.

At 5:32 PM, a Booster vacuum pump (IPRF17) tripped off and caused BRF7 & 8 to trip off. Everything reset.

MTest experimenters reported at 6:01 PM that they were through with the beam for the day.

At 8:04 PM, KRF7 tripped off for the first of two times in about 30 minutes. It reset.

At 8:59 PM, KRF4 tripped off. It reset.

Operations reported at midnight that the Recycler had stashed five times during the evening shift.

Saturday May 10

The midnight shift began with Operations monitoring store 6130 (104.97E30) and the stash (188.7E10), with Pbar stacking (16.1E10), and with NuMI and BNB taking beam.

At 12:10 AM, Operations reported a problem with the network at MI-31. Operations called in an expert.

At 1:19 AM, a controls expert reported that there was a failed network switch at MI-31 (S_AD_C 2950-MI31). Another expert was called in.

The controls experts reported 3:22 AM that they had replaced the network switch at MI-31 and that everything was operating normally.

At 3:38 AM, LRF2 tripped off. It reset.

At 4:15 AM, KRF7 tripped off. It reset.

At 4:16 AM, a MI south anode power supply tripped off. It reset.

At 4:52 AM, KRF3 tripped off. It reset.

At 6:30 AM, KRF6 tripped off. It reset.

At 7:12 AM, BRF13 tripped off. It reset.

Operations reported at 7:57 AM that the Recycler had stashed four times during the midnight shift.

Operations established beam to MTest around 8 AM.

At 8:26 AM, BRF7 tripped off. It reset.

At 8:27 AM, Operations reported that they had lowered the beam intensity for NuMI due to beam position problems in MI that operators could not improve. Operations will contact experts after shot setup.

Operations terminated store 6130 at 8:37 AM.

At 9:01 AM, KRF7 tripped off. It reset.

At 9:30 AM, KRF6 tripped off. It reset.

Operations established store 6131 at 10:23 AM with an initial luminosity of 267.37E30.

At 11:14 AM, KRF2 tripped off. It reset.

Operations conferred with a MI expert about the bad beam positions at 11:15 AM. He believed the problem was not in MI, but in Booster. Operations called in a Booster expert.

At 1:53 PM, a Pbar Debuncher beam valve (BV728) closed for the first of two times in about five minutes. It reset.

At 2:05 PM, KRF3 tripped off. It reset.

At 2:37 PM, KRF2 tripped off. The station would not reset immediately. Operators had the station back on ten minutes later.

At 2:45 PM, KRF6 tripped off. It reset.

At 3:06 PM, a TeV vacuum pump (T:E0IP10) tripped off. It will be reset later.

Operations reported at 4:08 PM that a MI expert had worked for an hour trying to improve beam positioning for NuMI with no success. He reported that this was a Booster problem. A Booster expert also worked on the beam with no success. His investigations continued.

At 4:20 PM, BV728 closed again. It reset and opened.

At 5:13 PM, a Linac Klystron vernier tripped off on a transformer LCW flow fault. It reset.

Operations reported at 5:16 PM that during the last stash, Pbar beam valves 210D, 309, and 728 all closed with a ground fault indication on a septum (ISEPV). Everything reset.

At 5:54 PM, KRF4 tripped off. It reset.

Operations turned off MTest beam at 6:14 PM.

At 6:15 PM, KRF6 tripped off. It reset.

At 6:51 PM, a Booster sextupole magnet (B:TSXS13) alarmed on high temperature. Operations contacted an expert who requested that operators raise the temperature limit.

Operations reported at 7:56 PM that the Recycler had stashed seven times during the last 12 hours.

At 8:17 PM, KRF2 tripped off. It reset.

At 8:55 PM, KRF7 tripped off for the first of two times in 30 minutes. It reset.

At 9:47 PM, BRF13 tripped off. It reset.

At 11:09 PM, KRF4 tripped off. It reset.

At 11:33 PM, KRF7 tripped off. It reset.

At 11:37 PM, KRF3 tripped off. It reset.

Sunday May11

The midnight shift began with Operations monitoring store 6131 and the stash, with Pbar stacking, and with NuMI and BNB taking beam.

Operations terminated store 6131 at 1:21 AM.

Operations put the TeV into shot setup at 1:35 AM.

Operations established store 6132 at 3:09 AM with an initial luminosity of 270.49E30.

At 3:51 AM, the NuMI beam permit tripped off due to a power supply’s current (E:V108) drifting low. Everything reset.

At 5:19 AM, BRF13 tripped off. It reset.

At 7:30 AM, KRF7 tripped off. It reset.

Operations established beam to MTest at 7:47 AM.

Operations reported at 7:53 AM that the Recycler had stashed eight times during the last 12 hours.

At 9:41 AM, KRF6 tripped off. It reset.

At 1:36 PM, KRF2 tripped off. It reset.

At 2:07 PM, KRF7 tripped off. It reset.

At 3:50 PM, a MTest power supply (MT2WU) tripped off. It reset.

Around 4 PM, a TeV vacuum pump (A0IP11) tripped off. It will be reset later.

At 4:14 PM, the Pbar sweeping magnet power supply (M:USWA) tripped off. It reset.

At 4:46 PM, KRF2 tripped off. It reset.

At 5:02 PM, BRF8 tripped off. It reset.

At 5:19 PM, KRF6 tripped off. It reset.

At 5:39 PM, KRF4 tripped off. It reset.

Operations terminated store 6132 at 6 PM.

Operations put the TeV into shot setup at 6:12 PM.

At 7:40 PM, KRF7 tripped off. It reset.

Operations established store 6133 at 7:54 PM with an initial luminosity of 277.76E30.

Operations reported at 8 PM that the Recycler had stashed eight times during the last 12 hours.

At 8:34 PM, KRF7 tripped off. It reset.

Operations stopped delivering beam to MTest at around 8:59 PM.

At 9:10 PM, LRF4 tripped off. It reset.

At 9:57 PM, KRF6 tripped off and would not reset. Operations called in a Linac expert.

At 10:30 PM, Operations reported having trouble measuring the Recycler emittances. Rebooting its scope helped initially and rebooting its VME also helped, but only for a short time. Operations contacted Recycler experts who said this was a network problem. Operations contacted a VME expert.

At 10:41 PM, KRF6 tripped off. It would not reset easily, but it did reset after a number of tries.

Monday May12

The midnight shift began with Operations monitoring store 6133 and the stash, with Pbar stacking, and with NuMI and BNB taking beam.

Operations reported at midnight that all they had lost all the Recycler VSA/diagnostic parameters used to monitor the Pelletron cooling. Operations contacted an expert.

At 12:01 AM, KRF3 & 7 tripped off. They reset.

At 12:03 AM, three vacuum pumps (IP826, 827, & 828) tripped off in the MI-8 transfer line. They all reset and turned on.

Operations reported at 12:11 AM that the Recycler VSA was back in operation. The expert reported that he had loaded a previous version of the software.

At 1:12 AM, LRF7 tripped off. It reset.

At 1:38 AM, LRF3 tripped off. It reset.

At 2:36 AM, KRF4 tripped off for the first of two times in one hour. It reset.

At 3:35 AM, Operations reported that after the last KRF6 trip, Pbar stacking dropped to 15mA an hour. Operators investigated.

At 4:06 AM, Operations reported a building alarm for AP10.

At 4:11 AM, Operations reported that operators turned most of the equipment in AP10 off. Operators found a septa (ISEP1V) power supply smoking and pulled the fire alarm. Due to the smoke, operators had to turn off the power supply from a different panel than they wanted. Unfortunately, this caused other equipment to turn off and the loss of the stack: about 30 mA. Operations called in experts.

Operations put Pbar in standby at 4:46 AM.

Operations established beam to MTest at 6:23 AM.

A power supply expert reported at 6:42 AM that he found a bad cable in the charge recovery circuit for ISEP1V.

Operations prepared Pbar for access at 7:51 AM to check cables (this had nothing to do with ISEP1V problem).

Operations reported at 7:57 AM that the Recycler had stashed five times during the last 12 hours.

The Plans for Monday

The plans for today are to increase NuMI’s intensity and to resume normal stacking, stashing, and storing. The Run Coordinator will allow MI experts to conduct studies and may allow some TeV studies. He also reported a record integrated luminosity of 56.085 inverse picobarns last week.

Accelerator Update Archive

More Information
For Tevatron luminosity charts and the current status of Fermilab's accelerators and detectors (live!), please go to Fermilab Now.

Comments and Suggestions
What do you think about the Accelerator Updates? Please send comments and suggestions to: accelupdates@fnal.gov.