REL05-BP07 Implement emergency levers
Emergency levers are rapid processes that can mitigate availability impact on your workload.
Level of risk exposed if this best practice is not established: Medium
Implementation guidance
Implement emergency levers. These are rapid processes that may mitigate availability impact on your workload. They can be operated in the absence of a root cause. An ideal emergency lever reduces the cognitive burden on the resolvers to zero by providing fully deterministic activation and deactivation criteria. Levers are often manual, but they can also be automated
-
Example levers include
-
Block all robot traffic
-
Serve static pages instead of dynamic ones
-
Reduce frequency of calls to a dependency
-
Throttle calls from dependencies
-
-
Tips for implementing and using emergency levers
-
When levers are activated, do LESS, not more
-
Keep it simple, avoid bimodal behavior
-
Test your levers periodically
-
-
These are examples of actions that are NOT emergency levers
-
Add capacity
-
Call up service owners of clients that depend on your service and ask them to reduce calls
-
Making a change to code and releasing it
-
-
