Ticket Number: HEA-NOC/20020613-03 Ticket Status: UPDATE
Ticket Type: Unscheduled Ticket Source: HEA-NOC
Ticket Scope: Site Site/Line: Dublin PoP
Ticket Owner: [log in to unmask] Problem Fixer: HEA-NOC
Ticket Opened: Problem Start: 20020613 17:59:00 UTC+1
Ticket Closed: Problem End: 20020614 12:10 UTC+1
Memory error on Dublin Core router Miranda. Card has been replaced,
cleanup work scheduled for Wednesday 19th June 08:00 to 10:00.
The following services were affected:
* Dublin Leased Line customers - all traffic to 23:00, partial till 11:00
* Traffic through INEX and UUnet until 23:00
* Access to NOC services until 23:00
20020613 21:30 - 23:20 Report fault to Lancomms and arrange workarounds at reduced performance.
20020613 23:48 davew
22:50 Approx - rewired PoP, all clients back except DIT (investigating futher), using route via Cork instead of Citywest/Galway as necessary.
23:30 UUnet and INEX restored (routing loop repaired).
Continuing to work with LAN Comms who have auxilary access to the
affected router and are troubleshooting.
20020614 00:00 davew
Monitoring tools indicate DIT is unreachable but tests from outside
HEAnet show connectivity. Continuing to work with LAN Comms who
beleive there is a fault with the Fast Ether card on Miranda and
are calling in Cisco.
20020614 12:15 davew
01:00 Lancomms and Cisco had access to the router and were troubleshooting; NOC personnel had finished intervention but
11:00 Problem discovered with routing to leased line customers
in Dublin and corrected
11:50 Replacement Fast Ethernet card installed in Miranda, initial
fault corrected. ISDN customers in Dublin returned to service.
12:10 Uther returned to service; some rerouting still in place but all customers should be operating at full capacity. Please contact NOC
(+353-1-660-9040) if you still encounter problems. Further brief
outages may be necessary while we undo temporary solutions; these will be minimised.
20020618 12:00 davew
Cleanup work will take place between 08:00 and 10:00 Wednesday 19th
June, during the regular scheduled maintenance window. Short outages
will occur during this time to Dublin leased line customers, backup
ATM PVCs for Dublin clients, and the Cork-Dublin backbone line (traffic
to regional PoPs will reroute via Galway and Limerick).
Time to Fix:
Time to full service - 18h 11m