Non Expert FPD Instructions

FPD Phone Contact List	FPD Expert Instructions	FPD HV Instructions

Non Expert FPD Instructions

This page can be found at http://d0server1.fnal.gov/users/strang/web/fpd/documents/nonfpd_shifter.html

This is a list of tasks for a non-expert shifter to perform to monitor FPD running . There will be an FPD expert on call for day (0800 to 2000) and night shifts (2000 to 0800) to insert pots and resolve any problems.

Page the FPD expert when luminosity reaches 45. They will begin insertion no sooner than two hours after the store is declared, provided that the luminosity is below 40e30. Pager numbers are listed on the FPD console and in the front of the FPD documents binder.

If you need to contact an expert, start with the appropriate pager first. If you don't get a response, try the other pager. If still no response, use the FPD contact list in the front of the FPD binder and start contacting FPD experts, starting with those living at FNAL.

An FPD expert will insert the pots and verify that everything is in working condition (FPDGui, DAQ, HV, alarms). He will record initial conditions in the e-log book. He will review these instructions with the captain as they switch over if necessary.

Basic Tasks

These will be explained in more detail by the FPD Expert.

Your routine tasks will be to monitor rates (monitor) and alarms. You will also keep an eye out for fire alarms (none have ever happened).
You will be responsible for putting the FPD system into standby (removing pots, putting HV into standby, turning off control lines) when the MCR informs you of end of store or beginning of beam studies (at 15 minute EOS warning from MCR), if store ends suddenly or when otherwise instructed. Make sure the store is not ended or studies begun before the FPD system is in standby. See instructions below or click on (Pots out / system standby details).
If anything happens that is not covered here, contact the on-call FPD expert at any time. IF IN DOUBT, TAKE THE POTS OUT. (Pots out / system standby details)

Things that can go wrong:

If a smoke alarm appears, proceed to the Smoke Alarm instructions below or click (Smoke Alarm details).
If a rate alarm appears, proceed to the Monitoring Rates instructions below or click (Monitoring Rates Alarm details).
If halo rates are increasing in the ACNET window proceed to the Halo Rate instructions below or click (Halo Rates details).
If computer freezes proceed to Frozen computer instructions below or click (Frozen Computer details).
If there is a rescrape, proceed to rescrape instruction below or click (Rescrape details).
If any other alarm appears in SES screen, page the expert to get it cleared.
If verbal warnings are being issued make sure all control and emergency lines are turned off. Then call expert.

FPD Station Layout

Above the d0ol49 monitor are three switches. From top to bottom they are:

Emergency Line
- DO *NOT* USE EMERGENCY LINE TO REMOVE POTS, EXCEPT IF POT SOFTWARE HAS CRASHED *AND* THERE IS AN EMERGENCY SITUATION. In almost all cases, it should not be used until end of store.
P side Control Line
A side Control Line

If the red light is on, that means the switch is enabled. When it standy, the red lights should be off except for the one at the very top labeled +5V.

The various software components are located on d0ol49 in the following virtual desktops: Looking at the pager bar along the bottom left of the screen and looking at the six virtual desktops on the left of that bar under the title Shift you should find the following programs:

Virtual Desktop 1	Virtual Desktop 2	Virtual Desktop 3
FPDGui Alternate Fire Alarm Reset	DAQ program:	Mozilla
Virtual Desktop 4	Virtual Desktop 5	Virtual Desktop 6
HV Significant Alarm Display	FPD Elogbook

The ACNET windows are displayed in four quadrants of the screen as follows:

Quadrant 1 Fast Time Plot	Quadrant 2 Lumberjack Plot
Quadrant 3 C72 Rates	Quadrant 4 D44 Lumberjack Control

Monitoring Rates

Actions occur on ACNET display using all 4 windows.

Periodically (every half our or so) keep track of the rates in the ACNET window. They should decrease with time.
- On window 3, the rates for each pot location are updated. A Rate alarm watcher will open an alarm window if rates get too high. See Monitoring Rates Alarm details if this happens.
Also monitor the halo rates at D0 and CDF ( details). They should stay flat or decrease with time. Sometimes, D0 LM shows spikes. If this is not reflected in any other rates, just ignore. If they show an increasing trend, notify the captain who should contact the MCR, and contact the FPD expert (this almost never happens except in case of problem in Tevatron). If rates have gone up by more than 50%, turn off HV (details) and remove pots (details).
If the MCR requests that the pots should be removed or things are changing too quickly for the FPD expert to arrive, the pots can be removed by the shifter using the instructions below ( details). Also, at end of store, the shifter should remove pots (details). In either case the system should be set to standby (details).

Monitor Rate Alarms

A Rate alarm watcher monitors the singles rates in the trigger scintillators of the FPD detectors.
If a yellow rate alarm is activated, check the rates in ACNET.
- On Window 3 (screen c72) of the ACNET display, all of the rates are updated by pot locations in kHz.
If there was just a transient spike, do nothing and alarm will go away. If rates are growing or have stepped up, end run, remove pots and put system in standby (details). Then call FPD expert.
If the rates get too high, the monitor program will give a red alarm, and automatically turn off the HV. In this case, end the current run, remove pots (details), verify HV is off, and contact the on call expert.

Monitor Halo Rates

Halo rates are observed in Window 1 and Window 2 (controlled by Window 4).
Window 1 (Fast time plot) continuously updates the rates automatically scrolling off the screen within 30 minutes.
Window 2 (Lumberjack plot) shows a persistent history of the rates. To update this plot, click in the black area to the left in Window 4 (screen D44) and it will update.
These rates should either stay steady or decrease with time. Sometimes D0 LM halo rates will spike up and down. If these are the only rates showing this behavior, ignore them. If this is not the case, and the trend is gradual, contact the oncall expert. If they are raising quickly, end the current run, remove pots and put system in standby (details). Then call the FPD expert.

Rescrape

If MCR is going to rescrape during a store ask them if it is minor or major.

Minor: Do nothing special. Just keep an eye for spikes and tubes tripping.
Major: Ramp down all HV until scrape is finished then ramp back up. See HV instructions below for details.

Removing pots and setting system to standby

Actions occur on d0ol49 in Desktop1, Desktop4 and Desktop5. Perform these tasks when informed of end of store by shift captain, store is lost without notice, beam studies are begining or when otherwise instructed. This procedure will usually be started at the 15 minute EOS warning from the MCR. There is a physical checklist that also contains these steps that should be at the FPD station, left by the expert that inserted the pots. Check off the items in green at the bottom of the list.

Turn the voltage to the MAPMT tubes in the MAPMT tab of the HV control program to standby. (details Located in Desktop4).
Turn on both the A Side and P Side control lines
- located above the d0ol49 display (2nd and 3rd toggle switches).
On Desktop 1, In the FPDGui, select the pots home button at the top of the gui and click on init. All pots should now come to home at high speed and the pot bars should turn yellow. You should see the numbers getting smaller and a small slider bar moving to the left.
- When all pots return home, the bar will turn blue and the slider will be at zero. The text window in the upper right corner should report that the pot is at 0.00 or at HOME. Note, while the pots are moving out, the numbers will be going towards zero and the rates will be decreasing.
  -If the position numbers increase (never happened), hit emergency stop button, notify captain, and call expert.
  -If pots don't move at all, check if you forgot to turn on control lines.
  -If pots still do not go home (never happened), notify captain that pots are not home and call FPD expert.
When all pots are at home, turn off the control lines (both A Side and P Side).
Verify pots are at home in the C72 window (window 3 of ACNET display) by clicking in the upper left corner where you see -<4>+ on the - until you see -<1>+. On this page all of the pots should show a value of 1 if they are home. If you click on the + you will go to -<2>+ where you should see values hovering around 0.
In the HV control program, in the L0 and Veto tabs, turn all voltages to standby (0%). Verify that MAPMT voltages are at 0V. (details In Desktop4.)
In the examine screen, in the window with scrolling text type stop to stop the examine.
In Desktop5, make an entry in the Elogbook that the pots have been removed and the system has been set to standby. Record the current D0 runnumber.
If the computer becomes unresponsive or there is another problem that needs to be cleared but pots need to be removed please proceed to Frozen computer instructions below or click (Frozen Computer details).

Smoke Alarm

Occurs in whatever Desktop is active at time of alarm. Optional reset is in Desktop1 or the FPD Gui

Spurious smoke alarms may appear during shot setup. When a real smoke alarm is detected, power to the appropriate crates in the tunnel is disabled and a FIRUS alarm is issued. An RMI alarm should show in the alarm screen whenever the alarm trips. Also, the FPD log should record the time of the alarms.

A reset window will appear on d0ol49 listing the location of the alarm. While performing the following tasks, contact the on-call FPD expert.
Click on the reset button. (If the alarm doesn't reset, there is either a real problem (never seen), or it is a communication alarm (more likely)).
If the alarm does not reset, go the FPDGui window (on Desktop 1). Go to the Commands -> Reset Alarms and press.
If the alarm does not reset, use the Rack Monitor Display window (on Desktop 1) resetting the appropriate alarm in the tunnel tab. It will have a red window to the left under smoke and a reset button on the right. (If you don't see a green or red status box, click on reconnect in the bottom left corner of the Rock Monitor Display window). Click on the reset button.
If there is an alarm that doesn't reset, the captain should be notified (note the power is disabled to the pots, so they are unable to move).

HV control

Actions carried out in Desktop4.

FPD uses the standard HV Gui display. It is located in Desktop 4. We have three tabs: L0, Veto, MAPMT.

Select appropriate tab (TRIGGER or MAPMT).
Select the Set HV button at the tob of the Gui.
Select standby from the options.
Select the Ramp button from the bottom. All active channels will begin to ramp down.
When the control button for each channel reads Holding and the V_read is oscillating near 0.00V the channel is in standby.

Select appropriate tab (TRIGGER or MAPMT).
Select the Set HV button at the tob of the Gui.
Select 100% from the options.
Select the Ramp button from the bottom. All active channels will begin to ramp down.
When the control button for each channel reads Holding and the V_read is oscillating near 0.00V the channel is in standby.

Frozen Computer

If the computer stops responding to the mouse or FPDGui becomes unresponsive:

Contact FPD Expert to bring system back up.

If you have to remove pots while the system is in this state:

Use the Emergency line to remove the pots. Always contact the FPD Expert if you have had to use the Emergency line.
- Flip the switch labeled Emergency Line above the terminal at the FPD Console. Of the three switches, it is the uppermost switch. This will bring the pots home at high speed.
- Verify pots are at home in the C72 window (window 3 of ACNET display). By clicking in the upper left corner where you see -<4>+ on the - sign until you see -<1>+. On this page all of the pots should show a value of 1 if they are home. If you click on the + sign you will go to -<2>+ where you should see values hovering around 0. If you go to -<2>+ while the pots are moving, you should see the valued getting progressively smaller approaching zero.
- When all pots are home, turn the Emergency Line off.
On another terminal in an xterm session do the following:
- Type setup d0online
- Log in as d0fpd or d0run.
- Type /online/config/fpd/hv/fpd.hv &
- Follow normal instruction for putting HV into standby. (details).
- Close the HV Gui by clicking on File then Exit

If you have any questions or comments, please mail me at: strang@fnal.gov

This page last updated: 31-Jan-2005 05:41 PM (GMT -06:00) v2.4