Columbia University Information Technology

Service Alerts

SERVICE RESTORED (WAS: MANY SERVICES DOWN)

Service Impact: 
Alert Date: 
12/16/2013 - 08:42am to 03/24/2014 - 12:05pm
Outage Type: 
Outage
Main Content
Alert Message: 

UPDATE 12:15pm

We believe all applications are working, though in some cases administrators may have trouble ssh'ing to underlying hosts.

Please open tickets via ServiceNow or askcuit@columbia.edu if any further issues are seen.

---

UPDATE 11:10am

We believe all critical applications are now available, but continue to verify other applications.

All queued mail has been delivered to Cyrus and LionMail.

---

UPDATE 10:10am

Still down: Secure Wireless and VPN; Drupal (web site maintenance); InfoEd reporting; and likely other applications.

CourseWorks, ARC, PAC, FDS, Rascal are now all working.

---

UPDATE 9:20am

Authentication seems to be working again, for the most part.  Mail has begun flowing again, but there is a backlog.  Messages will not be received in the order they were sent.

CUIT is working on bringing up CourseWorks, ARC, FDS, etc. We are also confirming which other applications are unavailable, and will post another alert by 10:30am.

---

Beginning 6:30am, VMware became unavailable due to a disk space issue. CUIT administrators have been notified and are currently working to resolve the issue.

A number of services were affected, in particular authentication, i.e. ability to log in to services such as LionMail, ServiceNow, the CUIT Wiki, Radius, etc.  Authentication will be brought up first, followed by other services. (This is what caused the unfortunate delay in posting the service alert.)

CUIT expects to have an update by 9:30am. We apologize for this service interruption.

For a complete list of recent and upcoming scheduled service changes, please visit http://cuitalerts.columbia.edu/.