Ticket Number: HEA-NOC/20040105-1 Ticket Status: UPDATE
Ticket Type: unscheduled Resolver:
Ticket Opened: 20040105 09:14 UTC Problem Start: 20040105 09:00 UTC
Ticket Closed: Problem End:
Site/line: CAO, NUIG, St. Angela's, UCC, UL, Akamai
Both UCC and UL have reported problems reaching any sites
outside the HEAnet network.
Network traffic from hosts in UCC and UL is not being properly routed.
20040105 09:11 BB Opening ticket; performing tests
20040105 09:27 BB Ron Owens, NUIG also reports general network
20040105 10:00 BB Both router BGP tables and logs indicate core routers
rhea (Limerick POP), titan (Galway POP) and phobos (Citywest POP) are
having problems maintaining routing table adjacency with each other -
constant resets are being observed. Lan Communictaions called for
20040105 10:05 BB CAO report similar problems - added to list of affected
20040105 10:26 BB Circuit HEAN0105 (gigabit Ethernet between Galway POP
and CityWest POP) is having problems passing traffic. Esat contacted -
support ticket 10185011 issued.
20040105 10:28 BB & DW Increased the OSPF cost on titan and phobos -
traffic is re-routing via alternative paths. There may be very small
increases in latency for some clients)
20040105 10:39 BB This may also have affacted Akamai - contacting them to
see if their problem reaching their co-located equipment has been
20040105 11:20 BB Akamai, UL, NUIG, CAO report network traffic to be
flowing according to expectations since the workaround.
20040105 11:36 BB Esat called back and said they cannot see errors on the
circuit. They have agreed to take the circuit out of service for more
20040105 14:51 BB Esat have reported that they are able to see problems
with the line (23% traffic loss).
20040105 16:26 BB Esat to arrange site access in the Galway POP
20040105 18:25 BB Esat have cleaned the fibre, and report better (but not
perfect) performance. They will continue to investigate. Pings on
titan/phobos show some improvement too (23% loss, from ~90% earlier).
This ticket can be monitored at http://www.hea.net/tickets/20040105-1