MSSQL01 Outage (Resolved)

Currently the MSSQL01 SQL Server is offline due to a failure in the RAID subsystem. During a normal rebuild of the RAID array after a failed drive had been replaced, additional drives failed within 5-10 minutes of each other causing a loss of the RAID and all data stored within it.

Currently the server is being restored from the last bare metal backup image (12:06AM MDT). We expect this rebuild will take a few hours to complete. Once done, the server will be restored to full operational status.

Thank you for your patience during this time.

(No Ratings Yet)

Loading...

TS01-GA Network Outage

Currently the data-center that hosts our TeamSpeak services in Atlanta, Georgia is experiencing a network interruption. Network engineers are currently working to resolve the issue. At this time we do not have an ETA.

We’d like to thank everyone for their continued patience as this issue is being addressed.

Thank you for choosing ASPnix!

(No Ratings Yet)

Loading...

Denver Colorado Outrage / Service Interruption

This evening at 4:08PM MDT an electrical issue with one of our cabinets power delivery units (PDU) caused a brief interruption or all servers and services in our Colorado data-center. Technicians were dispatched, however upon arrival were unable to identify any issues as services had resumed normal.

Another electrical issue at approximately 5:25PM MDT caused a major electrical fault in the cabinet that handles all network communications for our network. The fault triggered the data-center power delivery systems to cut power to the cabinet resulting in a full outage of our Colorado location. The technician who responded found the power delivery unit had fully failed. Once the unit was removed, power was restored to the cabinet.

The total outage time was about 58 minutes between the 2 interruptions.

After contacting Level 3’s electricians and discussing options to better handle these unfortunate events in the future, we will be purchasing additional electrical equipment to have better fault tolerance for these issues in the future.

We apologize for any inconvenience during this time. If there are any questions or concerns, please open a support ticket the technical support department for your service.

(No Ratings Yet)

Loading...

Outage – US Network (Denver) – Resolved

We are currently working with our carrier, Level 3, to find and stop what appears to be a denial of service (DDOS) attack. While it is not causing a full outage, it is causing a major disruption to our servers and services within our Denver data-center. Status updates will be posted as they come in.

UPDATE 12:15 PM MST – Level 3 has notified us that they’ve stopped the attacks that were being sent against our primary router / circuit. All services should now be running normally.

Thank you for your patience and understanding.

(No Ratings Yet)

Loading...

MX01 SmarterMail Unscheduled Outage

Today around 10:40AM MST our primary SmarterMail service on MX01 went down. This was an unscheduled outage that was caused by a SmarterTools support employee who mistakenly restarted the service while investigating a bug that we had reported earlier last week. The service is now back online and running and we are working with SmarterTools to make sure this mistake does not happen in the future. The support technician was new and has since apologized for the action.

We’d like to apologize to everyone who was affected by this mistake. We are making sure this does not happen again in the future.

Thank you for choosing ASPnix!

(No Ratings Yet)

Loading...

TS01-GA Continued Outage (Resolved)

Currently the data-center that hosts our TeamSpeak services in Atlanta, Georgia is experiencing a very large scale DDOS attack. Their network engineers have been working around the clock to attempt to mitigate the attack, but with slow results. We’ve been informed that they are slowly restoring full network capacity, but they are unable to provide an ETA on the restoration our nodes or servers.

We’d like to thank everyone for their continued patience as this issue is being addressed.

Thank you for choosing ASPnix!

Update – 11:26AM: Engineers are still working to resolve the issue. We had about a 2 hour window where the services in our Atlanta location worked perfectly before the attackers started another massive attack with a new vector.

(No Ratings Yet)

Loading...

TS01-IL TeamSpeak Outage (Resolved)

Our TS01-IL TeamSpeak server is currently experiencing an unexpected outage. We are working with our upstream provider to find the cause is and resolve it. We apologize for any inconvenience caused by this.

UPDATE 12:25PM MDT – The issue has been resolved, services have returned to normal

Thank you for your patience and for choosing ASPnix!

(No Ratings Yet)

Loading...

WEB14 Connection Issues / Outage

We are working to address an intermittent issue affecting WEB14. The server is suffering intermittent connection issues and performance problems. This post will be updated with more information as we work on the server.

Thank you for your patience and understanding during this time!

(No Ratings Yet)

Loading...

MX01 Emergency Maintenance / Service Outage (Resolved)

Around 2:10PM MDT our MX01 SmarterMail service encountered a fatal issue that caused the main service process to crash. The issue has already been identified by the SmarterTools team and we’ve been issued a custom build that will resolve this issue. We are applying this fix now and the server will be back online within the next 15 – 20 minutes.

UPDATE: 2:45PM MDT – The issue has been resolved and SmarterMail is now back online.

We appreciate your patience during this time and apologize for any inconvenience caused by this.

Thank you for choosing ASPnix!

(1 votes, average: 5.00 out of 5)

Loading...

MSSQL01 Minor Outages / Encrypted Connections

Sites may experience small outages / connection issues today while we adjust the node that serves the MSSQL01 service. At this time encrypted connections are currently unavailable however will be available shortly.

Thank you for your continued patience while we stabilize our platform.

(2 votes, average: 5.00 out of 5)

Loading...