Accelerator Update for June 27, 2008 - June 30, 2008

Friday June 27

The day shift began with the Tevatron (TeV) in shot setup, with Operations monitoring the Recycler (RR) stash (356.1E10), with the Antiproton Source stacking (43.4E10), with the Main Injector, Booster, and Linac operating normally, with the Collider Detector at Fermilab (CDF) and DZero (D0) waiting for beam, and with the SciBooNE / MiniBooNE (BNB) and the Meson MTest experiments taking beam.

At 8:09 AM, the MI Power Supply interlock Loop (MI PS Loop) tripped off. It reset.

At 8:15 AM, a MECAR trip caused a MI abort. Everything reset.

A MI expert began a study at 8:21 AM.

At 8:40 AM, the MI PS Loop tripped off for the first of two times in eight minutes. It reset. An expert investigated.

Operations established store 6251 at 10:02 AM with an initial luminosity of 269.14E30.

A Recycler expert began a Low Level RF (RRLLRF) study at 10:02 AM.

Two controls experts reported at 10:23 AM that they were going to replace a module in the RRLLRF system.

Operations put Pbar into standby at 11:07 AM.

Pbar resumed stacking at 11:30 AM.

At 1:03 PM, Operations received a Recycler Electron Cooling (ECool) alarm. Experts investigated and had Ecool back on line in 25 minutes.

At 2:16 PM, Operations reported that they were having problems extracting antiprotons from MI and stashing them into the Recycler. An operator pulled out the MI collimators and contacted experts.

At 2:41 PM, Operations reported that the Pelletron had an energy mismatch. Operations contacted an expert.

Operations reported at 2:49 PM that the MI extraction problems were due to the timing settings for a BPM display and the timing of a MI smooth during shot setup. Operations restored the MI collimators to their normal positions.

A Recycler expert reported at 3:12 PM that he was rebooting the RRLLRF system.

A Recycler expert reported 3:53 PM that she had resolved the Pelletron energy mismatch problem.

Operations reported at 3:59 PM that the Recycler had stashed antiprotons three times during the day shift.

At 5:30 PM, the BNB beam permit tripped off. It reset.

Operations disabled the MTest beam at 6:11 PM.

At 7:13 PM, the BNB horn tripped off. It reset.

At 8:52 PM, Operations reported a possible Recycler damper problem; antiprotons were being lost. Operations contacted experts who later reported that they had found an irregularity with the vertical damper system.

Operations reported at 11:57 PM that the Recycler had stashed three times during the evening shift.

Saturday June 28

The midnight shift began with Operations monitoring store 6251 (66.78E30) and the stash (316.0E10), with Pbar stacking (16.0E10), and with BNB taking beam.

At 12:46 AM, ECool tripped off. It reset.

Operations reported at 5:14 AM that they had completed an MI orbit smooth.

Operations established beam to MTest at 6 AM.

Operations terminated store 6251 at 6:02 AM.

The Water group reported at 6:10 AM that they were beginning to configure the TeV heat exchangers for the next round of cleaning. They completed their preparation work in 30 minutes.

Operations put the TeV into shot setup at 6:14 AM.

Operations established store 6252 at 7:50 AM with an initial luminosity of 262.18E30.

Operations reported at 8:04 AM that the Recycler had stashed two times during the midnight shift.

At 11:39 AM, the LRF3 vacuum pump tripped off. It reset.

At 2:40 PM, BRF9 tripped off. It reset.

At 4:13 PM, a P1 transfer line vacuum pump (IP7144) tripped off. Operators closed beam valves and reset the pump. After the vacuum stabilized, Pbar resumed stacking.

At 6:39 PM, Operations reported that a TeV MADC crate (#15) had failed. Operations called in a controls expert.

At 6:59 PM, LRF3 tripped off for the first of three times in seven minutes. It reset.

Operations reported at 7:10 PM that a controls expert replaced a bad 5-volt power supply for TeV MADC crate #15.

Operations reported at 7:54 PM that the Recycler had stashed eight times during the last 12 hours.

At 8:53 PM, Operations reported that the Booster RF system was sparking and causing beam permit trips. Operations lowered the beam intensity to BNB to 9 turns.

Operations terminated store 6252 at 9:06 PM.

At 9:07 PM, LRF5 tripped off. It reset.

Operations put the TeV into shot setup at 9:18 PM.

At 9:19 PM, Operations reported that BRF12 was sparking so much that they bypassed it and BRF19 was brought online in its place.

Operations established store 6253 at 11:18 PM with an initial luminosity of 267.34E30.

Sunday June 29

The midnight shift began with Operations monitoring store 6253 and the stash, with Pbar stacking, and with BNB taking beam.

At 1:07 AM, a Booster vacuum pump (IPRF17) tripped off and caused BRF7 & 8 to also trip off. Everything reset.

At 5:42 AM, LRF1 tripped off. It reset.

At 5:44 AM, BRF16 tripped off. It reset.

At 7:23 AM, the cryo system experts at CHL reported that the wet engine speed for the TeV sector C3 system had been dropping. They will tighten its belts in between stores.

Operations reported at 7:59 AM that the Recycler had stashed eight times during the last 12 hours.

Operations established beam to MTest around 8 AM.

At 8:17 AM, BRF16 tripped off. It reset.

At 9:23 AM, a Booster vacuum pump (B:IP61) tripped off. It reset.

At 9:58 AM, a Booster vacuum pump (B:IPRF23) tripped off and caused BRF13 & 14 to trip. Everything reset.

At 12:50 PM, LRF5 tripped off for the first of two times in 13 minutes. It reset.

Operations terminated store 6253 at 3:36 PM.

Experts put the TeV C3 cryo system into JT mode at 3:43 PM and began work on the wet engine belts.

At 4:26 PM, a TeV sector C quadrupole magnet (TDQ0) tripped off on a reverse switch SCR fault. It reset.

Operations put the TeV into shot setup at 5:04 PM.

Operations established store 6255 at 6:31 PM with an initial luminosity of 279.7E30.

At 7:18 PM, a Booster vacuum pump (B:IPD2) tripped off and closed the beam valves and all associated equipment. Everything reset.

At 7:38 PM, a Meson MS2 LCW water skid came into alarm on a “make water” indication. Operators made up the water, but the alarm never cleared.

Operations reported at 8 PM that the Recycler had stashed six times during the last 12 hours.

At 9:28 PM, LRF2 tripped off. It reset.

Monday June 30

The midnight shift began with Operations monitoring store 6255 and the stash, with Pbar stacking, and with BNB taking beam.

At 5:53 AM, MIRF1 tripped off for the first of four times in two minutes. It would trip after every reset. Operators bypassed the station.

At 7:27 AM, BRF10 tripped off. It reset.

Operations reported at 8 AM that the Recycler had stashed ten times during the last 12 hours.

The Plans for Monday

The plans for today are to stack, stash, and store.

Accelerator Update Archive

More Information
For Tevatron luminosity charts and the current status of Fermilab's accelerators and detectors (live!), please go to Fermilab Now.

Comments and Suggestions
What do you think about the Accelerator Updates? Please send comments and suggestions to: accelupdates@fnal.gov.