Q: Your organization processes petabyte-scale geospatial data and microservice deployment triggers from multiple asynchronous sources: GitHub webhooks, AWS S3 bucket notifications when raw radar tiles land, and internal Kafka topics. Traditional polling CI tools like Jenkins cannot handle 10,000 asynchronous triggers per hour without memory crashes. You are tasked with deploying a native event-driven pipeline on Kubernetes using Argo Events and Argo Workflows that securely parses incoming webhooks, validates payloads, and triggers ephemeral batch jobs.

Deploy the Argo EventBus backed by clustered NATS JetStream for persistent, at-least-once message delivery, ensuring webhook events are never lost during worker pod restarts.

apiVersion: argoproj.io/v1alpha1
kind: EventBus
metadata:
  name: default
  namespace: argo-events
spec:
  nats:
    native:
      replicas: 3
      auth: token
      persistence:
        storageClassName: gp3-ebs
        size: 20Gi

Deploy a GitHub `EventSource` listening on an internal service port. Configure HMAC secret verification (`webhook-secret`) to reject unauthenticated external requests before events enter the message bus.

apiVersion: argoproj.io/v1alpha1
kind: EventSource
metadata:
  name: github-eventsource
  namespace: argo-events
spec:
  service:
    ports:
      - port: 12000
        targetPort: 12000
  github:
    releaseTrigger:
      repositories:
        - owner: enterprise-org
          names:
            - analytics-pipeline
      endpoint: /push
      port: '12000'
      method: POST
      events:
        - push
      apiToken:
        name: github-token
        key: token
      webhookSecret:
        name: github-webhook-secret
        key: secret

Define an Argo Events `Sensor` that subscribes to the EventBus, applies JSONPath filters to match push events targeting `refs/heads/release/*`, and renders parameter substitutions into an `Argo Workflow` custom resource.

apiVersion: argoproj.io/v1alpha1
kind: Sensor
metadata:
  name: release-pipeline-sensor
  namespace: argo-events
spec:
  template:
    serviceAccountName: argo-events-sa
  dependencies:
    - name: github-dep
      eventSourceName: github-eventsource
      eventName: releaseTrigger
      filters:
        data:
          - path: body.ref
            type: string
            value:
              - refs/heads/release/.*$
            comparator: regex
  triggers:
    - template:
        name: trigger-argo-workflow
        k8s:
          operation: create
          source:
            resource:
              apiVersion: argoproj.io/v1alpha1
              kind: Workflow
              metadata:
                generateName: release-build-
              spec:
                entrypoint: main
                templates:
                  - name: main
                    container:
                      image: builder-image:latest
                      command: [sh, -c]
                      args: ["echo Processing release commit: $COMMIT_SHA"]
                      env:
                        - name: COMMIT_SHA
                          value: ''
          parameters:
            - src:
                dependencyName: github-dep
                dataKey: body.after
              dest: spec.templates.0.container.env.0.value

Monitor sensor lag and event drops using the exposed Argo Events Prometheus metric `argo_events_event_bus_messages_total`. Configure Dead Letter Queue (DLQ) consumer workflows to capture malformed JSON payloads and alert on-call SREs.