All systems are go

Don't agree with this? Please let us know

  • US

    United States data center location

    • Pro Apps

      US

      • Web delivery

        US Pro

      • Object Storage

        US Pro

      • Memcache

        US Pro

      • Worker

        US Pro

    • Universal Apps

      US web delivery

    • MySQL

      US Universal and Pro Apps

    • Deployment

      US Git, SSH, SFTP for Pro and Universal

  • EU

    European data center location

    • Pro Apps

      EU

      • Memcache

        EU Pro

      • Object Storage

        EU Pro

      • Web delivery

        EU Pro

      • Worker

        EU Pro

    • Universal Apps

      EU web delivery

    • MySQL

      EU Universal and Pro Apps

    • Deployment

      Git, SSH, SFTP

  • Dashboard
Previous Incidents

[Resolved] DDOS on a single IP

This incident lasted 32 minutes.
  • Universal Apps
Thu, 5 Sep 2019
07:31:18 UTC

We experience unusual network traffic on a single IP and mitigating the root cause.

08:04:00 UTC

We've now resolved the incident. Thanks for your patience.

[Resolved] Performance issues with a single node in EU

This incident lasted 38 minutes.
  • Universal Apps
Wed, 4 Sep 2019
15:09:11 UTC

We have noticed performance issues with a single node in EU / Universal.

15:34:55 UTC

We've confirmed there is a network connectivity problem, we're working to resolve it.

15:48:00 UTC

We've now resolved the incident. Thanks for your patience.

[Resolved] Problems with MySQL for newly created Apps in US

This incident lasted 13 hours and 20 minutes.
Tue, 3 Sep 2019
20:42:09 UTC

We see that newly created (so far only Universal) Apps are not correctly provisioned. MySQL connections are not working. We are looking into that.

Wed, 4 Sep 2019
00:17:54 UTC

We've fixed the core issue, and are waiting for things to recover.

06:52:01 UTC

We are still monitoring the situation. Everything should be OK.

10:03:07 UTC

We think the issues are solved for good now. No post mortem possible.

[Resolved] deployment issues in EU

This incident lasted 38 minutes.
  • Deployment
Sat, 24 Aug 2019
10:57:25 UTC

Git is currently not working for some users in EU.

10:59:52 UTC

SSH & SFTP seem to work

11:13:38 UTC

Services are back. Currently still monitoring.

11:36:08 UTC

We've now resolved the incident. Thanks for your patience.

[Resolved] Issues with the fortrabbit Dashboard

This incident lasted 6 hours and 24 minutes.
Fri, 23 Aug 2019
05:00:31 UTC

Users are not able to login to our Dashboard currently.

07:08:20 UTC

We have identified the issue with the Dashboard.

11:24:37 UTC

Operations back to normal. Sorry for the inconvenience. Thanks for your patience. Quick post mortem: There has been some trouble with the encryption of internal communication channels.

[Resolved] Deployment issues in US

This incident lasted 3 minutes.
  • Deployment
Mon, 19 Aug 2019
05:41:29 UTC

For the last 5 hours there have been deployment issues in US. Git / SSH / SFTP was not available for clients.

05:44:30 UTC

We've now resolved the incident. Thanks for your patience.

[Complete] imageMagick patch 2 maintenance

This was a planned incident, it took 13 hours and 59 minutes.
  • Universal Apps
  • Universal Apps
  • Worker
  • Web delivery
  • Web delivery
  • Worker
Fri, 16 Aug 2019
13:04:35 UTC
Overview

We are performing platform wide updates. The main focus is on optimizing imageMagick performance, but also new minor patch versions of various client facing software packages will be installed.

No - or just a very short (>1 minute) - expected downtime for web delivery is expected. Pro Apps on production plans are planned to have near-to-zero downtime. For the deployment services (Git, SSH and SFTP) we do not expect a service interruption.

The total maintenance window is 4 hours per region (US, EU). We will start with US.

All details on the update here:
https://blog.fortrabbit.com/imagemagick-update-2019-08

  • Scheduled for Tue, 20 Aug 2019 08:00 UTC
  • Expected to take 14 hours
Tue, 20 Aug 2019
08:00:02 UTC

The scheduled maintenance is now underway. We'll keep you updated on our progress.

11:21:34 UTC

We are done with the US part of the upgrade, everything looks good so far. We will take a break and continue with EU part soon.

13:29:14 UTC

We discovered an issue affecting some clients in US and are working to resolve it.

16:10:49 UTC

Issues in US have been resolved. We are now starting with EU part.

17:00:05 UTC

The maintenance is now complete. Thanks for your patience.

17:58:28 UTC

This is taking longer than expected and we will have to extend the maintenance window.

19:26:10 UTC

Extended a little longer. We are still on it. Some clients might experience issues with deployment.

22:00:00 UTC

The maintenance is now complete. Thanks for your patience.

No further notices from the past 30 days.