Columbia University Information Technology

Service Alerts

RESOLVED SERVICE ALERTS

Resolved Service Alerts

Resolved Service Alerts

  • VMware
    07/30/2012 - 03:26pm to 08/01/2012 - 02:02pm

    UPDATE 16:00

    An addititonal ESX server has crashed bringing the total to three.  This server was hosting the following virtual machines: fnprfrdb, airwave, girasole, projectdbprod, secscan, projectdbtst.

    ----------------------------------------------------------------------------------------------------------------------------

    Two of our ESX servers have crashed.  These servers were hosting the following virtual machines:  cocoyam, rw3, fnprfweb1, infoed-qa.ais, PFXenApp2, ISSO, project1, xenapp2, Lenel-comm10-cc, centipede, pacman, idmuniprod2, cucuzza, OB-EISTest, ATH2-, idmora, garlic, OB-EISdev, GE-SEE8, Fortify, pulitzer-test1, siptest1,cas-hub2, SEP, secbuild, secscan, pfprodsched, sakaitest2, and arrowhead.

    Engineers are currently investigating.  We apologize for this service interruption.


     

    For a complete list of recent and upcoming scheduled service changes, please visit http://www.columbia.edu/acis/alerts-list.html.

  • VMware
    11/19/2012 - 10:30am to 11/19/2012 - 02:00pm

    WHAT?
    We are upgrading the administrative interface for our ESXi infrastructure to the latest version of the server software.

    WHEN?
    Monday, November 19th 2012 at 10:30am-2pm

    WHO WILL BE AFFECTED?
    Engineers will be unable to make changes to the ESXi infrastructure during the maintenance.  User-facing functions will not be affected.

    WHY?

    This is to apply various bugfixes and stability patches to our virtualization infrastructure.

     

    For questions about this event, please contact the CUIT Helpdesk at askcuit@columbia.edu, or call 212-854-1919.

    To see all active and future Service Alerts, please visit http://www.columbia.edu/acis/alerts-list.html

     

  • VMware
    02/22/2013 - 02:00pm to 02/22/2013 - 08:00pm

    CUIT is performing routine maintenance on this service. This scheduled update is expected to be completed on time. No service interruption is anticipated.

    This work is being performed in preparation for submitting information to HP regarding last nights outage. This is routine work which will be extended after hours in the event we suspect it will impact the virtual server on these systems. 

    For questions about this event, please contact the CUIT Helpdesk at askcuit@columbia.edu, or call 212-854-1919.

    To see all active and future Service Alerts, please visit http://cuitalerts.columbia.edu/

     

  • VMware
    05/09/2013 - 04:20pm to 05/10/2013 - 09:58am

    **UPDATE 8:45 AM**

    We have identified the 22 hosts that need to be recovered; of these nearly half have been restored or recovered.  We are getting in touch with application owners to confirm status.

    **UPDATE 12:48 AM**

    Servers are still being rebuilt.  We will provide a detailed status in the morning.  

    **UPDATE 10:09 PM**  

    About 100 servers are affected by this outage. Engineers are working on recovering them.

    ------------------------------------------------------------------------------------------------------------------------------

    We are experiencing a VMware issue in our dev and test cluster that may impact several dev and test VMs.  We are working on the issue and will provide updates when available.

    For a complete list of recent and upcoming scheduled service changes, please visit http://cuitalerts.columbia.edu/.

  • VMware
    02/28/2014 - 01:00am to 02/28/2014 - 02:00am

    Begining at approximately 1 am, VMs hosted on one of our ESX servers began experiencing intermittent network connectivity issues.  VMs on the host were migrated off and the host was removed from service by 2 am.

    The list of affected VMs is:

    c-print
    cspa
    fndevdb
    fnprdweb2
    isso1
    keybox
    lindaw-vm7
    pinnacle
    rmanproddb
    tumeric
    vetiver
    yuca

    For a complete list of recent and upcoming scheduled service changes, please visit http://cuitalerts.columbia.edu/.