IT Services

IT Services

Network incident

[c]

23rd April 2007 - 16:30 

Following the change made at 15:30 today, the network problems remaining at Gibbet Hill and Walsgrave have now been resolved.

If you continue to experience network connectivity problems please contact the Service Desk on 024 765 73737.

23rd April 2007 - 15:00

IT Services will be making an urgent change at 15:30 this afternoon to the network to remedy problems at Gibbet Hill and Walsgrave. There maybe a short interruption to customers at Gibbet Hill. If you are affected by this change, in the first instance please restart your computer.

If you continue to experience network connectivity problems please contact the Service Desk on 024 765 73737.

23rd April 2007 - 11:00

A majority of departments should now have network connectivity restored with the exception of some locations within the Gibbet Hill campus. 3rd Party network engineers are en route to the University to establish the cause of these failures.

IT Services will continue to work on restoring connectivity to these locations. If you are still experiencing network difficulties please contact the IT service desk on 02476 573737

23rd April 2007 - 08:25 

IT Services are continuing restore the network connection problems around campus, work has been carried out throughout the weekend and through the early hours of Monday morning. Some users in Gibbet Hill and Social Studies area may be experiencing problems with access to the network. Investigation of the cause is still being carried out we anticipate the issues in Gibbet Hill and Social Studies to be resolved by 11.30 am. Further updates will be posted as soon as possible.  

22nd April 2007 - 15:00

Work started as planned last night at 10pm and completed the process of backing out the changes made to the campus network just after the Easter weekend. Our testing indicates that the network has returned to stable operation and that there are no problems in the areas that were affected at the end of last week.

Unless additional problems develop over the course of the afternoon there will be no further work tonight (Sunday).

21st April 2007 - 14:30

Testing done since the last update indicates that network connectivity has now been restored to the areas affected by yesterdays disruption, including Social Studies. Customers in those areas should now be able to log in and access their networked storage, applications and the Internet.

It will still be necessary to complete the back-out work tonight, starting from 10pm. 

21st April 2007 - 11:00

Work started as planned last night at 8pm. Whilst we were able to successfully back-out the changes on the 'core routers' and some other parts of the network, problems encountered during the night meant that not all the work could be completed. This means that we have not yet been able to confirm whether or not service has recovered in the areas affected yesterday, including the Social Studies building.

It will be necessary for us to complete the back-out work tonight, as originally advised, at the (later) planned time of 10pm; depending on progress, it may be necessary to work on the Sunday slot also announced for this emergency work.

20th April 2007 - 15:45

We have not been able to identify a solution to the problems which continue to affect parts of the campus network. A decision was therefore taken at our Major Incident meeting at 15:00 today that we would proceed with backing-out the changes made to the campus network last week.

This work will start at 8pm tonight and run into the early hours of Saturday morning. Whilst it is underway, there will be major disruption to the network, which will prevent access to the Internet, Email, Networked Filestore, and many other central IT Services. Any emails sent to the University during this period will be queued at the recipients end and delivered to us when the network returns and our services become available again. It will not be lost.

If further work is necessary to complete the backout process, this will take place on Saturday and Sunday nights, starting at the later time of 10pm and finishing by 7am the following morning.

20th April 2007 - 13:45 

Whilst much of the campus network is now stable, problems remain in some larger areas, including Social Studies.

If we are unable to identify a fix to these problems before 3:00pm today, then a decision will be taken over whether to back-out some major changes which were made to the campus network last week. If this needs to be done, then it will result in network outages tonight (Friday) and on Saturday and Sunday nights.

IT Services are currently in the process of contacting departments to warn them of this possibility and to assess the impact should we go ahead.

20th April 2007 - 12:45

Some work has taken place to stabilise the network and this seems to have been partly successful. We are aware of and are still investigating disruption affecting customers at Gibbet Hill, Social Studies, Maths and the IT Services buildings. However, other parts of the network now seem to have stabilised.

The network however does remain at risk whilst these problems are ongoing and there is a danger that in the process of fixing these, further disruption to the network may result. We continue to recommend that all customers regularly save anything they are working on the minimise the risk of data loss should there be any further more widespread disruption. 

20th April 2007 - 10:30

Further problems are developing on the campus network this morning. Some parts of the campus have lost their connections to the network (including ITS buildings on central campus and westwood, parts of Gibbet Hill, Social Studies and some parts of University House). We are working urgently to resolve these and a Major Incident has been declared. Staff from our network supplier are en-route to site to assist with this work.

If you are able to connect to the network and access files and applications then we strongly recommend that you regularly save anything you are working on the reduce the risk of data loss should the problems spread and affect you. 

19th April 2007 - 12:00

Work is continuing to identify the cause of the network connectivity issues which occurred on the 17th of April. The campus network is still operating largely as normal, but with a reduced level of reliability owing to the removal from service of one of the four 'core routers'. There should be no customer impact as a result of this, unless additional network failures occur. 

18th April 2007 - 12:15

Work is continuing to identify the cause of yesterdays network connectivity issues. The campus network is still operating largely as normal, but with a reduced level of reliability owing to the removal from service of one of the four 'core routers'. There should be no customer impact as a result of this, unless additional network failures occur.

17th April 2007 -18:00

In an attempt to resolve network connectivity issues being experienced by some customers, emergency maintenance work is necessary on one of the 'core routers' based at Gibbet Hill. This work involves taking the router offline for diagnostics.

Whilst the router is taken offline any network traffic sent through it will be redirected via alternative paths around the network. There may be a momentary interruption to some network connections whilst this takes place, but it should quickly pass. If you experience problems connecting to the network that do not clear themselves within a few minutes, please contact our Service Desk for assistance in resolving them.

The results of these diagnostics will be sent back to our network support provider for analysis overnight and tomorrow. Until the results are known and a fix is identified, we will be operating with only three of the four core routers in service and with a corresponding reduced level of resilience to other failures on the network. Outside of this reduced level of reliability, there should be no noticeable reduction in service.

Summary

Network connectivity problems.

Impact

Affecting customers in some locations in Bio Medical Sciences and Walsgrave (CSRI).

Estimated fix time

Fixed at 16:00.

Page contact: ITS Web Team Last revised: Mon 23 Apr 2007
Back to top of page
 

Web site search

People search

News

News.