⚡ ~/naveed Interview Prep
⚡ Portfolio Home 👤 About Naveed Bio & Credentials 📫 Contact Naveed Get In Touch ✍️ Engineering Blog Deep Dives 🎯 Interview Hub 1,000+ Scenarios ☸️ Kubernetes Mastery Hub 24 Modules 🎮 DevOps Arcade & Quizzes Subnet Blitz ⚡ 🗺️ DevOps Roadmaps PDFs & Guides 🤖 Morpheus Analysis AI Quant ↗ 🛠️ Developer Tools Utilities 🧪 Labs & Experiments 📄 Interactive CV & Certs 🔗 All Links & Socials ⚡ Join The Dispatch (Weekly SRE Newsletter) →
← Back to All CI/CD & GitOps Interview Questions Scenario 106 of 187 in CI/CD & GitOps
Staff SRE / Principal Architect [L3] CI/CD 🔐 Supply Chain Security & Advanced CI/CD Staff SRE Scenario [L3]
🎯 Target Role / Context: CI/CD Scenario #97 (L3) · 🔐 Supply Chain Security & Advanced CI/CD

Q: You implement a full GitOps pipeline where ArgoCD manages production. A developer accidentally pushes a Kubernetes deployment with `replicas: 0` to the GitOps repository. ArgoCD syncs it, silently taking down the entire service. How do you add a policy gate that prevents zero-replica deployments from ever reaching the GitOps repository?

Two layers of defence — one at the Git level, one at the cluster level:

#CI/CD #L3 #DevOps #Automation #Pipelines
🎙️ Candidate Opening & Architectural Context
""In our delivery pipeline supporting multiple engineering squads, pipeline reliability was paramount. The interviewer is testing: Pre-merge policy gates, Conftest in CI, OPA/Kyverno at admission.. I structure my answer around systematic triage first, root cause analysis second, and permanent remediation third.""
Advertisement
⚡ Recommended Practice Lab

Want to master this scenario in a live sandbox? KodeKloud's Enterprise GitOps with ArgoCD & Kubernetes Rollouts covers this exact problem with hands-on terminal drills.

🛠️ Production Runbook & Step-by-Step Resolution

Direct Answer: "In our delivery pipeline supporting multiple engineering squads, pipeline reliability was paramount. The interviewer is testing: Pre-merge policy gates, Conftest in CI, OPA/Kyverno at admission.. I structure my answer around systematic triage first, root cause analysis second, and permanent remediation third."

1️⃣

Production Solution & Architecture

Two layers of defence — one at the Git level, one at the cluster level: Layer 1 — CI policy gate on PR: In the CI pipeline that validates the GitOps repo, add a conftest check: Run conftest test on every PR diff. The PR is blocked from merging until this passes. Layer 2 — Admission controller in the cluster: Install a Kyverno policy as a final defence: Even if the Git gate is bypassed, the Kubernetes API server rejects the manifest. ArgoCD sync fails with a clear error message, and the service remains unaffected.

deny[msg] {
  input.kind == "Deployment"
  input.spec.replicas == 0
  msg := sprintf("Deployment %v has replicas=0 which would cause an outage", [input.metadata.name])
}
💡 The Senior SRE Gold Nugget (Key Architectural Takeaway)
"Pro-Tip: Two layers of defence — one at the Git level, one at the cluster level:."
⚡ 60-Second Elevator Pitch Talking Points
  • Immediate Triage: Two layers of defence — one at the Git level, one at the cluster level:
  • Run targeted verification commands before modifying configuration.
  • Automate permanent guardrails (CI check, alerts, IaC policy) to prevent recurrence.
⛔ Critical Candidate Mistakes to Avoid in This Scenario

Senior hiring managers and bar raisers evaluate how you prioritize during outages. Avoid these common anti-patterns:

  1. Promoting application releases to production without an automated, canary-validated rollback mechanism when configuring implement full GitOps Pipelines that lack automated rollback mechanisms force engineering teams to scramble manual hotfixes during severe production regressions.
  2. Running concurrent deployment pipeline jobs without stage mutex locking on shared target environments when configuring implement full GitOps Concurrent pipeline runs on the same environment race to apply state changes, causing out-of-order commits and unpredictable deployment state.
  3. Omitting dependency lockfiles (package-lock.json, go.sum, Cargo.lock) from continuous integration builds when configuring implement full GitOps Omitting lockfiles allows upstream package updates to break builds unpredictably without any changes to application codebase.
  4. Failing to define dynamic cache invalidation keys for CI package managers and layer caches when configuring implement full GitOps Stale build caches mask underlying dependency incompatibilities or pull outdated libraries, while un-cached runs slow feedback loops.
Advertisement
Want more CI/CD & GitOps scenarios?
Explore our complete collection of scenario-based CI/CD & GitOps interview runbooks.
Browse All CI/CD & GitOps Questions →