Q: Your admission webhook is blocking all pod creation cluster-wide. How do you recover?
If webhook server is down, set failurePolicy: Ignore on the webhook or delete the MutatingWebhookConfiguration object.
#Kubernetes #Advanced Scenarios #L3 #Container Orchestration #K8s
🎙️ Candidate Opening & Architectural Context
""When troubleshooting Kubernetes, I always follow a structured layered model: Pod status -> Events -> Logs -> Network. When addressing this question, I walk the interviewer through our production incident runbook: isolating the blast radius, checking diagnostic logs and metrics, and applying a safe fix.""
Advertisement
🛠️ Production Runbook & Step-by-Step Resolution
1️⃣
Production Solution & Architecture
If webhook server is down, set failurePolicy: Ignore on the webhook or delete the MutatingWebhookConfiguration object.
💡 The Senior SRE Gold Nugget (Key Architectural Takeaway)
"Pro-Tip: If webhook server is down, set failurePolicy: Ignore on the webhook or delete the MutatingWebhookConfiguration object.."
⚡ 60-Second Elevator Pitch Talking Points
- Immediate Triage: If webhook server is down, set failurePolicy: Ignore on the webhook or delete the MutatingWebho
- Run targeted verification commands before modifying configuration.
- Automate permanent guardrails (CI check, alerts, IaC policy) to prevent recurrence.
Advertisement