Ticket Number: HEA-NOC/20060105-3 Ticket Status: UPDATE
Ticket Type: scheduled Resolver: HEA-NOC
Ticket Opened: 20060105 11:29 UTC Problem Start: 20060111 08:00 UTC
Ticket Update: 20060222 08:51 UTC Problem End: 20060222 08:44 UTC
Site/line: CAO, GEANT, INEX, JANET, NUIG, Schools Network, St.
Angela's, UL, CityWest-Galway GE (HEANET0105),
Cork-Limerick GE (HEAN0118), Galway-Limerick GE (HEAN0116),
Global Crossing-CW STM-16, Géant STM-16 Secondary, JANET GE
Primary, KP - Cork GE (HEAN0125), Citywest PoP, Galway PoP,
Limerick PoP, Akamai
Due to the identified memory leak on the Kilcarbery Park core router it has
been decided that the remaining PoP core Cisco GSRs should also be
upgraded. The three routers (Hyperion - CW, Rhea - Limerick & Titan -
Galway) will be upgraded as early as possible during the 2 hour
maintenance window. Each reload is expected to take roughly ten minutes.
In the case of Limerick & Galway traffic should reroute to the backup
circuits meaning no loss in connection but an increase in latency will
occur during the work. This increase will affect all clients connected to
In the case of Citywest all traffic will reroute over other connections
and while some external BGP peerings will drop traffic will continue to
flow (however some increase in latency may be noted). These external
peers are Citywest INEX connection, the secondary Geant connection, the
primary Janet connection and the primary Global Crossing General Internet
20060105 11:07 BN This work is reliant on the new IOS running clean on the
Kilcarbery Park core router for one week, however no problems have so far
been noted nor are they expected.
20060110 17:12 AH Due to hardware availability, only the Citywest upgrade
will proceed as scheduled affecting HEAnet's Citywest INEX connection, the
secondary Geant connection, the primary Janet connection and the primary
Global Crossing General Internet connection. The remainder of the work
will take place in the next maintenance window.
20060111 08:33 AH Reload proceeded as scheduled but one linecard failed to
return cleanly. Service was restored when the individual linecard was
reloaded. No further upgrades will proceed until this is investigated, due
to similarities observed in ticket #20060106-3
20060214 09:40 BN This work is still pending the completion of testing on
the Kilcarbery Core router.
20060220 12:43 DW Galway core router scheduled for upgrade at 08:30 on
Wednesday 22 February 2006.
20060222 08:49 DW Galway upgraded proceeded successfully. Traffic to
customers in Galway rerouted over the ATM backup circuits with reduced
performance. Routing convergence caused 2*2 minute outages between 08:30
Time to Fix:
This ticket can be monitored at http://www.hea.net/tickets/20060105-3