⚡ ~/naveed Interview Prep
⚡ Portfolio Home 👤 About Naveed Bio & Credentials 📫 Contact Naveed Get In Touch ✍️ Engineering Blog Deep Dives 🎯 Interview Hub 1,000+ Scenarios ☸️ Kubernetes Mastery Hub 24 Modules 🎮 DevOps Arcade & Quizzes Subnet Blitz ⚡ 🗺️ DevOps Roadmaps PDFs & Guides 🤖 Morpheus Analysis AI Quant ↗ 🛠️ Developer Tools Utilities 🧪 Labs & Experiments 📄 Interactive CV & Certs 🔗 All Links & Socials ⚡ Join The Dispatch (Weekly SRE Newsletter) →
← Back to All Platform Engineering & IDP Interview Questions Scenario 21 of 50 in Platform Engineering & IDP
Senior Platform Engineer Platform Engineering Developer Portals & Self-Service Event Streaming Vending
🎯 Target Role / Context: Senior Platform Engineer Interview · Event-Driven Architecture Track

Q: Developers wait 4 days for data engineering tickets to create Kafka topics and register Avro schemas, stalling event-driven microservices. How do you design an automated, self-service GitOps pipeline where developers declare topics and schemas in their repo with automated governance?

Architecting self-service Kafka topic and Avro/Protobuf schema creation using Strimzi KafkaTopic CRDs and GitOps validation.

#Platform Engineering #Kafka #Strimzi #GitOps #Kubernetes #Schema Registry #DevEx
🎙️ Candidate Opening & Architectural Context
"Manual ticket queues for event infrastructure stifle agility. By leveraging the Strimzi Operator's KafkaTopic CRDs and automated CI schema compatibility validation (Confluent/Apicurio), developers manage topics through declarative GitOps while the platform enforces retention and partition guardrails."
Advertisement
⚡ Recommended Practice Lab

Want to master this scenario in a live sandbox? KodeKloud's CKA & CKAD Hands-On Certification Track covers this exact problem with hands-on terminal drills.

🛠️ Production Runbook & Step-by-Step Resolution

Direct Answer: Manual ticket queues for event infrastructure stifle agility. By leveraging the Strimzi Operator's KafkaTopic CRDs and automated CI schema compatibility validation (Confluent/Apicurio), developers manage topics through declarative GitOps while the platform enforces retention and partition guardrails.

1

Declare Topic Infrastructure via Strimzi KafkaTopic CRD

Developers add a KafkaTopic manifest directly to their microservice repository.

apiVersion: kafka.strimzi.io/v1beta2
kind: KafkaTopic
metadata:
  name: orders.payment-processed.v1
  namespace: kafka-cluster
  labels:
    strimzi.io/cluster: production-kafka
spec:
  partitions: 12
  replicas: 3
  config:
    retention.ms: 604800000 # 7 days
    cleanup.policy: compact,delete
2

Enforce Topic Sizing and Naming Guardrails in CI

Run Conftest/OPA policies in PRs validating that partition counts do not exceed 24 without architecture approval, replication factor is strictly 3, and topic names follow the domain.event-name.version format.

# Conftest policy validation
package kafka.topics
deny[msg] {
  input.spec.partitions > 24
  msg := "Max partition limit for self-service topics is 24. Request architecture review for higher scale."
}
Advertisement
3

Automate Schema Registry Compatibility Verification

Run the Schema Registry maven/gradle plugin in CI against the central schema registry, verifying backward and forward compatibility before merging.

Pro Tip: Event Governance: Never allow topic creation without registered schemas; breaking changes in shared event payloads impact downstream consumers instantly.
💡 The Senior SRE Gold Nugget (Key Architectural Takeaway)
"Enable self-service Kafka by combining Strimzi KafkaTopic CRDs in GitOps repos with CI-level OPA naming policies and schema compatibility gates."
⚡ 60-Second Elevator Pitch Talking Points
  • Use Strimzi Kubernetes CRDs to manage Kafka topics declaratively via GitOps.
  • Implement Conftest policies enforcing standardized naming conventions and bounded partition counts.
  • Enforce automated schema compatibility checks in pull request checks before merging.
⛔ Critical Candidate Mistakes to Avoid in This Scenario

Senior hiring managers and bar raisers evaluate how you prioritize during outages. Avoid these common anti-patterns:

  1. Engineering bespoke in-house developer tools instead of adopting standardized platform Golden Paths when configuring Self Service Kafka Bespoke internal tools create long-term maintenance debt and fragmented workflows, whereas standardized Golden Paths accelerate delivery.
  2. Overlooking infrastructure cost visibility and FinOps allocation tagging across multi-tenant environments when configuring Self Service Kafka Without granular resource tagging, engineering organizations cannot attribute cloud infrastructure costs to specific teams or business units.
  3. Failing to define explicit Service Level Objectives (SLOs) and Error Budgets to balance feature velocity with reliability when configuring Self Service Kafka Without agreed SLOs, engineering and product teams lack an objective data-driven framework to prioritize technical debt over new features.
  4. Neglecting automated continuous drift detection between declarative configuration and deployed cloud state when configuring Self Service Kafka Unmanaged drift accumulates over time, causing future automated deployments to fail or overwrite emergency manual adjustments.
Advertisement
Want more Platform Engineering & IDP scenarios?
Explore our complete collection of scenario-based Platform Engineering & IDP interview runbooks.
Browse All Platform Engineering & IDP Questions →