alabama - hard drive (Resolved)
  • Priority - Critical
  • As of this morning all accounts have been moved to a new server with the same name.  If you are still experiencing issues with your site please open a support ticket.

    ==============

    Our attempts at restoring the original server have failed but we do have another server online and we are starting to migrate accounts from backups to that server now.  The process will take time but we wanted you to know that we are working as hard as we can to get everybody back online as fast as possible.

    ==============

    Earlier today we experienced a disk failure on our Alabama server.   While server hardware is very robust,  disk issues can on the rare occasion occur.  

    Please understand that we are actively working to restore the server, but doing so can take time because of the massive size of server hard drives.   This is also not a process that we can expedite any more than we currently are, because we will not take any shortcuts that might jeopardize your data.  

    We appreciate your patience and understanding while we work through this process.   We will update you again as soon as we have additional information.

    We are in the process of restoring the drives and this will happen overnight.  We do have backups that can be restored to another server if you want to be back online before this process is complete.  If so, please contact support and we will add you to the list to move.

  • Date - 11/27/2020 07:00 - 12/01/2020 21:44
  • Last Updated - 12/01/2020 09:06
Network Services - Traffic Loss (Resolved)
  • Priority - High
  • Affecting System - System Network
  • Maintenance Scope: Network Services

    Customer Impact:

    There will be several periods of traffic loss as we make repairs to
    one of the distribution routers out of this facility. While every
    effort will be made to limit the impact some traffic loss is
    unavoidable due to the nature of the work being performed.

  • Date - 09/03/2020 23:00 - 09/04/2020 05:00
  • Last Updated - 11/27/2020 19:41
florida - hard drive (Resolved)
  • Priority - Critical
  • Affecting Server - florida
  • We have experienced an issue on a hard drive on our florida server.  This can be a time-consuming process as we troubleshoot and investigate, and we appreciate your patience.  We are focused on resolving these issues and have the right people working on the problem.  Please check back here with updates.

    Update 1:  We are continuing our work on the hard drive and attempting to recover it in place.

    Update 2:  The disk has a lot of corruption, so we are going to parallel a full restore from yesterday's backup as well as attempt to recover the drive.

    Update 3:  The hard disk has become un-responsive and we are now waiting on the restore form yesterday's backup to restore service.  Since we are restoring an entire hard drive this will take some time complete.  We are anticipating the restore to be complete around 10:00 PM CST today.

    Update 4:  Data has been restored from yesterday at 2PM CST.  If you are still experiencing issues please submit a ticket.

  • Date - 10/12/2019 07:00
  • Last Updated - 09/01/2020 09:01
georgia - File System (Resolved)
  • Priority - Critical
  • Affecting Server - georgia
  • We experienced issues with a few services on our Georgia server this morning.  When attempting to restore these services we found inconsistencies with the file systems on our hard drives.  This can be a time-consuming process as we troubleshoot and investigate, and we appreciate your patience.  We are focused on resolving these issues and have the right people working on the problem.

    Update (1): We have the hard drive with the faulty filesystem to a state where we can read data off of it.  The server is online but apache is turned off because we are copying contents from the failing hard drive to another and want to minimize load on a hard drive that is failing.  Once we have the data copied over we will bring apache back online.  

    Update (2): We have restored services and about half of the accounts to active.  We are actively working thorugh the remaining accounts.

  • Date - 05/16/2019 08:44
  • Last Updated - 10/12/2019 07:42
maine - Hard Drive Maintenance (Resolved)
  • Priority - High
  • Affecting Server - maine
  • We are scheduling downtime on this server for Tuesday evening starting at 9PM CST.  We will do our best to expedite the process but need to allow a 4 hour window for this work. 

    We will keep this notice updated as the work is performed.

    Update:  This work will commence at 9PM CST

    Update:  Work has started

    Update:  Work is progressing as planned

    Update: Work is complete

  • Date - 11/21/2017 21:00 - 11/21/2017 23:09
  • Last Updated - 11/21/2017 23:09
michigan - Hard Drive Maintenance (Resolved)
  • Priority - High
  • Affecting Server - michigan
  • We are scheduling downtime on this server for Monday evening starting at 9PM CST.  We will do our best to expedite the process but need to allow a 4 hour window for this work. 

    We will keep this notice updated as the work is performed.

    Update:  This work will commence at 9PM CST

    Update:  Work has started

    Update:  Work is progressing as planned

    Update: Work is complete

  • Date - 11/20/2017 21:00 - 11/20/2017 23:10
  • Last Updated - 11/20/2017 23:11
nevada - Hard Drive Maintenance (Resolved)
  • Priority - High
  • Affecting Server - nevada
  • We are scheduling downtime on this server for Sunday evening starting at 9PM CST.  We will do our best to expedite the process but need to allow a 4 hour window for this work. 

    We will keep this notice updated as the work is performed.

    Update:  This work will commence at 9PM CST

    Update:  Work has started

    Update:  Work is progressing as planned

    Update:  The server should be back up within the hour

    Update: Work is complete

  • Date - 11/19/2017 21:00 - 11/19/2017 23:58
  • Last Updated - 11/19/2017 23:58
alabama - Hard Drive Maintenance (Resolved)
  • Priority - High
  • We are scheduling downtime on this server for Saturday evening starting at 9PM CST.  We will do our best to expedite the process but need to allow a 4 hour window for this work. 

    We will keep this notice updated as the work is performed.

    Update:  This work will commence at 9PM CST

    Update:  Work has started

    Update:  Work is progressing as planned

    Update:  The server should be back up within the hour

    Update: Work is complete

  • Date - 11/18/2017 21:00 - 11/18/2017 23:38
  • Last Updated - 11/18/2017 23:38
kansas - Hard Drive Maintenance (Resolved)
  • Priority - High
  • Affecting Server - kansas
  • We are scheduling downtime on this server for Friday evening starting at 9PM CST.  We will do our best to expedite the process but need to allow a 4 hour window for this work. 

    We will keep this notice updated as the work is performed.

    Update:  This work will commence at 9PM CST

    Update:  Work has started

    Update:  Work is progressing as planned

    Update: Work is complete

  • Date - 11/17/2017 21:00 - 11/17/2017 23:35
  • Last Updated - 11/17/2017 23:35
iowa - apache upgrade (Resolved)
  • Priority - Critical
  • Affecting Server - iowa
  • We are upgrading Apache on our iowa server, there will be periodic downtime to your website while we do this.

  • Date - 10/15/2016 16:27 - 10/15/2016 21:16
  • Last Updated - 10/15/2016 21:16
alabama - server is temporarily offline (Resolved)
  • Priority - Critical
  • We are aware of an issue with our Alabama server and we are currently working to resolve the issue as soon as possible.  We appreciate your patience and hope to have the situation resolved shortly.

  • Date - 10/01/2016 15:59
  • Last Updated - 10/01/2016 17:26
florida - Kernel Update (reboot) (Resolved)
  • Priority - High
  • Affecting Server - florida
  • We will be rebooting our florida to apply a kernal patch that has been impacting performance.

    Update: We are rebooting now.

    Update: The reboot is complete.

  • Date - 06/07/2016 23:00 - 06/07/2016 23:20
  • Last Updated - 06/07/2016 23:12
florida - DDoS Attack - Intermittent (Resolved)
  • Priority - High
  • Affecting Server - florida
  • Our florida server is been suffering through a DDoS attack that has intermittently caused the apache server to slow down and be unable to handle new requests.  This has caused periods where your site may be slow or unresponsive. 

    We have been working diligently on mitigating the attack and will update this announcemnt when we have additional information.

    UPDATE: Load is currently lower; however, we are continuously monitoring to make sure we have taken the appropriate actions.  We will update this notice again later with information as we have it available.

    UPDATE: We are rebooting the server.

    UPDATE:  We apologize for your experience over the last approximately nine hours.  We are continuing to work on the issue as we are still experiencing intermittent load spikes.  These load spikes have not been as frequent as before.  We have identified a few accounts on this server that are directly caussing excess strain and this will be remedied over the coming weeks.  We will keep this network notice open because we may still tweak services during the over night hours (US time).  Expect another update during the day, May 12th.

  • Date - 05/11/2016 15:25 - 05/13/2016 00:00
  • Last Updated - 05/20/2016 23:12
vermont - reboot (Resolved)
  • Priority - Critical
  • Affecting Server - vermont
  • We are rebooting this server. It will be offline until the reboot is complete.

  • Date - 04/11/2016 23:01 - 04/11/2016 23:13
  • Last Updated - 04/11/2016 23:13
iowa - Reboot (Resolved)
  • Priority - Critical
  • Affecting Server - iowa
  • We are rebooting this server. It will be offline until the reboot is complete.

  • Date - 07/03/2013 11:47 - 04/11/2016 23:12
  • Last Updated - 04/11/2016 23:12
Security - Server Reboot (All) (Resolved)
  • Priority - High
  • Affecting Other - All Servers
  • All of our systems were recently patched to protect again the OpenSSL Heartbleed vulnerability; however, as an extra precaution we are going to reboot all of our servers. We expect less than 15 minutes of downtime for each server during the reboot process.

  • Date - 04/09/2014 02:00 - 04/09/2014 04:00
  • Last Updated - 03/10/2015 10:51
florida - DDoS Attack - Intermittent (Resolved)
  • Priority - Medium
  • Affecting Server - florida
  • Our florida server is been suffering through a DDoS attack that has intermittently caused the apache server to slow down and be unable to handle new requests.  This has caused periods where your site may be slow or unresponsive.  When the attackers have been able to send enough traffic to overwhelm the server we have been able to mitigate it and get things restored fairly quickly but they have been persistent and do not seem to want to go away.

    Rest assured that we are aware of this issue and are doing everything in our power to permanently resolve it and we are monitoring things closely.

    We appreciate your patience as we work through this.

    UPDATE: We believe that we have narrowed the cause to bittorrent announcements and isolated the user agent responsible for them.  We will be monitoring this over the next couple of days to determine if the problem is resolved.

    UPDATE:  We had a short slowness today and made a few more changes that should mitigate this further.  We will continue to monitor this, but as of now everything is working normally and we are dropping the attack prior to the traffic reaching the apache server.

    UPDATE: Final update, the actions taken have mitigated this.  We will continue to monitor but are marking this issue as resolved. 

  • Date - 01/01/2015 19:10 - 01/08/2015 09:59
  • Last Updated - 01/07/2015 20:00
Security - Kernel Update (Resolved)
  • Priority - Critical
  • Affecting Server - utah
  • Due to a security flaw with the current kernel, an update and reboot is required on our utah server. We expect the server to be down a maximum of 15 minutes while it is rebooted.

  • Date - 03/10/2014 03:30 - 03/10/2014 04:18
  • Last Updated - 03/10/2014 03:36
VPS Node Down (Resolved)
  • Priority - Critical
  • Affecting Server - vps
  • Our Main VPS Node is currently down, we are investigating the outage.  

    Update: The Node was rebooted and everything is running normally.

  • Date - 02/23/2014 06:23 - 02/23/2014 06:34
  • Last Updated - 02/23/2014 06:35
Security - Kernel Update (Resolved)
  • Priority - Medium
  • Affecting Server - vps
  • We will be performing a Kernel update on our main VPS Node which required a server reboot. All VPS's on the server will be offline during the reboot process.

  • Date - 02/21/2014 03:00 - 02/21/2014 04:00
  • Last Updated - 02/21/2014 06:40
Security - Kernel Update (Resolved)
  • Priority - Critical
  • Affecting Server - vps
  • Due to a security flaw with the current kernel, an update and reboot is required.  We expect this maintenance to impact your VPS for less than 15 minutes.

  • Date - 05/25/2013 00:00 - 05/24/2013 23:20
  • Last Updated - 05/24/2013 22:31
Security - Kernel Update (Resolved)
  • Priority - Critical
  • Affecting Server - maine
  • Due to security issues with the kernel on this machine an update is required.  The server will be rebooted during this update to install the kernel.

  • Date - 05/17/2013 09:41 - 05/17/2013 09:52
  • Last Updated - 05/17/2013 09:52
Security - Kernel Update (Resolved)
  • Priority - Critical
  • Affecting Server - kansas
  • Due to security issues with the kernel on this machine an update is required.  The server will be rebooted during this update to install the kernel.

  • Date - 05/17/2013 09:31 - 05/17/2013 09:45
  • Last Updated - 05/17/2013 09:45
Security - Kernel Update (Resolved)
  • Priority - Critical
  • Affecting Server - iowa
  • Due to security issues with the kernel on this machine an update is required.  The server will be rebooted during this update to install the kernel.

  • Date - 05/17/2013 09:23 - 05/17/2013 09:33
  • Last Updated - 05/17/2013 09:33
Security - Kernel Update (Resolved)
  • Priority - Critical
  • Affecting Server - vermont
  • Due to security issues with the kernel on this machine an update is required.  The server will be rebooted during this update to install the kernel.

  • Date - 05/17/2013 09:12 - 05/17/2013 09:27
  • Last Updated - 05/17/2013 09:27
Security - Kernel Update (Resolved)
  • Priority - Critical
  • Affecting Server - utah
  • Due to security issues with the kernel on this machine an update is required.  The server will be rebooted during this update to install the kernel.

  • Date - 05/17/2013 08:43 - 05/17/2013 08:58
  • Last Updated - 05/17/2013 09:00
Reboot - Unresponsive (Resolved)
  • Priority - Critical
  • Affecting Server - utah
  • The server was unresponsive, a reboot was required to bring it back online.  Everything should now be functioning normally now.

  • Date - 05/13/2013 00:50 - 05/14/2013 00:10
  • Last Updated - 05/14/2013 00:29

Server Status

Below is a real-time overview of our servers where you can check if there's any known issues.

Server Name HTTP FTP POP3 PHP Info Server Load Uptime
alabama PHP Info
florida PHP Info
georgia PHP Info
kansas PHP Info
maine PHP Info
michigan PHP Info
nevada PHP Info
utah PHP Info
vermont PHP Info