| Job Description: |
Primary Skills: Digital : AKANA API Management Platform E2
Kafka Platform Engineer – Job Description
Platform Engineering & Operations
Design, deploy, and manage Kafka clusters across on‑premises, cloud, and Kubernetes environments.
Ensure platform high availability, fault tolerance, disaster recovery, and robust capacity planning.
Implement and support Kafka ecosystem components including Kafka Connect, Schema Registry, KSQL/ksqlDB, and related tools.
Automate cluster provisioning, configuration, and lifecycle management using Terraform, Ansible, Helm, and custom automation scripts.
Configure and maintain observability tooling for monitoring, alerting, and logging with Prometheus, Grafana, Splunk, ELK, Datadog, and other frameworks.
Perform performance tuning across partitions, replication factors, retention policies, ISR configurations, and broker-level settings.
Security & Governance
Implement and manage authentication and authorization mechanisms such as SASL, ACLs, and RBAC.
Enforce enterprise encryption standards for both data in transit and at rest using technologies like TLS and AES.
Work collaboratively with data governance teams to enforce schema standards, manage compatibility policies, and maintain schema lifecycle practices.
Development & Integration
Build, maintain, and optimize Kafka connectors, custom producers/consumers, and event‑streaming pipelines.
Partner with application and platform teams to drive adoption of event‑driven architecture across the organization.
Provide guidance, best practices, and architectural patterns to engineering teams to ensure scalable, resilient Kafka integrations.
Troubleshooting & Support
Diagnose and resolve issues involving Kafka brokers, ZooKeeper or KRaft controllers, networking, message throughput, and cluster health.
Conduct in‑depth root-cause analysis for incidents and lead corrective actions or platform-level improvements.
Participate in on‑call rotations to ensure platform uptime, operational reliability, and adherence to SLAs. |
