B10:27
We deployed to staging on Tuesday afternoon.
We deployed to staging on Tuesday afternoon.
Everything looked fine in the test environment.
Everything looked fine in the test environment.
But after rollout, users saw a broken page.
But after rollout, users saw a broken page.
We had to roll it back fast.
We had to roll it back fast.
The fix was behind a feature flag.
The fix was behind a feature flag.
We turned the flag off and the old version worked.
We turned the flag off and the old version worked.
Next time we will test the hotfix more.
Next time we will test the hotfix more.
I felt nervous during the whole thing.
I felt nervous during the whole thing.
But the team stayed calm and solved it.
But the team stayed calm and solved it.
Now I always check feature flags first.
Now I always check feature flags first.
That time we had to roll back a deploy
by @nora_talks