Out with the old, in with the new

Pictures of a backup power systems replacement evolution at one of our clients.  The old generator was a Katolight 45FGH4, circa 1990.  The new generator is a Cummins Power GGHE-1503557 60 KW 3 phase.  Unfortunately, when the Katolight generator was moved from the previous studio location in 1998, it was never installed correctly.  The 500-gallon propane tank was undersized, the gas tubing was undersized, etc.  We fixed those items, but the damage was done.  After running too lean under load a few times, the head gasket blew and there is oil in the antifreeze and antifreeze in the oil.  It is a Ford straight-six engine, and sure, we could rebuild it, but why bother?  This is a major group of stations in a very lucrative market, it makes much more sense to replace the entire unit.

Katolight Genset hooked up to the crane, ready to move
Katolight Genset hooked up to the crane, ready to move
Generator lift
Generator lift

In addition to the head gasket problem, the load on the generator has increased. Since the old generator was installed in 1998, two more stations have been added to this facility. That means another air studio, another production studio, more computers, servers, air conditioning, etc. Thus, the new generator is rated for 60 KW.

Cummins Power Generator delivery
Cummins Power Generator delivery
Cummins generator lift
Cummins generator lift

After the GENSET is placed, connections for remote start, battery charger, block heater, and AC power output are made. We were able to reuse the existing conduit and cable, thankfully the electricians used 3/0 AWG cable for the AC power connections to the transfer switch.

Cummins Power generator in place
Cummins Power generator in place

It appears that they have dropped the Onan name, but not the color, completely.

Series surge suppressor

Radio facilities, particularly mountaintop transmitter sites, are prone to power transients. The causes can be varied, but most often, lightning is the culprit.  Long power transmission lines to the site are vulnerable to direct strikes and EMF-induced spikes from nearby strikes.  Other issues, such as switching transients, load fluctuations, and malfunctioning equipment can lead “clear weather” outages.  Of course, the best way to deal with such things is through prevention.

Power line surge suppressors have been around for quite some time.  They usually take the form of a MOV (Metal Oxide Varistor) connected between the hot leg and neutral or ground.  There are a few differences in designs, however.  Typically, most facilities employ a parallel surge suppressor.  That normally takes to form of an enclosure hung next to the main power panel with a group of MOV modules in it.  The MOVs are fed from a circuit breaker in the panel.  Like this:

LEA parallel surge suppressor
LEA parallel or shunt surge suppressor

This is an LEA three-phase 208-volt shunt surge suppression unit, which has MOVs between all phases to ground and each other.  That is connected in parallel to the electrical service with the circuit breaker disconnect.  These function well enough, provided there is a good bit of series inductance before the unit and also, preferably after.  The series inductance can come from many sources, including long secondary leads from the utility company transformer or electrical conductors enclosed in metal conduit, particularly rigid (verses EMT, or FMC) metal conduit.  The inductance adds a bit of resistance to the transient voltages, which come in higher than 50 or 60 Hz AC waveform.

A better method of transient protection is the Series Surge Suppressor.  These units are installed in line with the incoming service and include an inductor to add the required series resistance coupled with MOVs and capacitors.  Most series surge suppressors also filter out harmonics and RF by design, something desirable, particularly at a transmitter site.  Series surge suppressors look like this:

LEA DYNA systems series surge protector
LEA DYNA systems series surge protector

This is an LEA three-phase 240-volt unit.  As in the other example, all phases have MOVs to neutral and each other.   There are MOVs and capacitors on the line and load side of this unit (the line side is the bottom of the inductor).  A basic schematic looks like this:

Series surge suppressor basic schematic
Series surge suppressor basic schematic

A few things to note; MOVs have a short circuit failure mode and must be fused to protect the incoming line from shorts to the ground.  MOVs also deteriorate with age, the more they fire, the lower the breakdown voltage becomes.  Eventually, they will begin to conduct current at all times and heat up, thus they should also be thermally fused.  MOVs that are not properly protected from overcurrent or over-temperature conditions have the alarming capacity to explode and/or catch on fire.  From experience, this is something to be avoided.  Matched MOVs can be paralleled to increase current handling capacity.

The inductor is in the 100 µH range, which adds almost no inductive reactance at 60 Hz.  However, it becomes more resistive as the frequency goes up.  Most transients, especially lightning, happen at many times the 60 Hz fundamental frequency used in power distribution (50 Hz elsewhere unless airborne, then it may be 400 Hz).

Capacitors are in the 1-10 mF range and rated for 1 KV or greater as a safety factor.  The net effect of adding capacitance is to create a low-pass filter.  Hypothetically speaking, of course, playing around with the capacitance values may net a better lowpass filter.  For example, at 100 uH and 5 mF, the cutoff frequency is 225 Hz, or below the fourth harmonic.  Care must be taken not to affect or distort the 60 Hz waveform or all sorts of bad things will happen, especially to switching power supplies.

These units also need to have a bypass method installed.  If one of the MOV modules needs to be replaced, power to the unit has to be secured.  This can be done by connecting it to the AC mains before any generator transfer switch.  That way, the main power can be secured and the site can run on generator power while the maintenance on the surge suppression unit is taking place.

Backing up the UPS

Power loss is a critical failure, thus much money is spent to prevent or mitigate commercial power interruptions in broadcast facilities.  Backup generators and Uninterruptible Power Supplies (UPS) are the first lines of defense against commercial power interruptions.  It is prudent to research products and check reliability and interoperability when specifying and installing these systems.  However, even the best mechanical and electrical systems will fail, often at the worst possible time.  The UPS has a startling tendency to shut down, often at the worst possible moment, due to some internal control circuit or something similar.   This can happen when commercial power is being supplied without interruption.  The net result is some critical piece of equipment is now dark and the station is off the air.

Eaton Automatic Transfer Switch and UPS
Eaton Automatic Transfer Switch and UPS

There is a solution: The Eaton EATS EPDU TPC 2234-A Automatic Transfer Switch.

Eaton EATS EPDU
Eaton EATS EPDU

With this unit, the primary plug is connected to the output of the UPS, the secondary plug is connected to the commercial power source.  If the UPS fails, the load is automatically transferred to the commercial power.  Typically, the commercial power is also backup up with a generator.  The secondary plug can also be connected to a second UPS.  In theory, having two UPSs connected in parallel via an Automatic Transfer Switch would increase the Mean Time Between Failure (MTBF) by 50%.

UPS Eaton ATS EPDU block diagram
UPS Eaton ATS EPDU block diagram

The Eaton products come with a variety of options, including basic network monitoring, advanced network monitoring, switching, and management.  Those features are available via Ethernet or serial data port.

Multiple layers of redundancy is the best method to avoid those late-night, weekend, or holiday phone calls.

Generators and mice

Never a good mix, unfortunately, it usually turns out bad for the mice and sometimes the equipment.  This is an Onan GGMA 20 KW propane generator installed in a rural area, not that the location matters that much.  Mice will find what they perceive as a safe secure spot to hold up for the winter.

Onan GGMA20 propane generator
Onan GGMA20 propane generator

Unfortunately, the mice decided that the generator cooling fan was a good place to make a nest.  It probably was until the generator started, then the mice had a quick lesson in centripetal force.

Mice and generator
Mice and generator

This will require some additional maintenance in the springtime when I change to oil.  By that time, the carcasses should be mostly dried out and easier to deal with.

Onan generator mice
Onan generator mice

The mice are generally a nuisance, getting into ATU’s, transmitters, electrical panels, spare parts boxes, etc.  Once in place, they begin to breed and reproduce.  The gestational period for a mouse is 21 days, which means populations rapidly increase creating further problems. If left alone, mice will chew through electrical insulation, control wires, cardboard boxes, packing material, and so on.  They tend to carry diseases like hantavirus and bubonic plague.

I don’t usually agree to using poison to get rid of pests, it tends to linger in the environment and accumulate up the food chain.  However, judicious use of some type of poison is usually the only way to effectively get rid of a mouse infestation.

Wherever possible, make sure that all openings and holes into equipment and buildings are sealed up.  Do not kill snakes and other predators, who will assist in keeping the mice in check.  Employ traps and wear gloves when removing dead mice and mouse parts.  Beware of fleas.