Kafka Architect

Job Description

**Role: Kafka Architect- H1B/US Citizen**

**Location : Remote**

**Responsibilities:**

* Consult with inquiring teams on how to leverage Kafka within their pipelines
* Architect, Build and Support existing and new Kafka clusters via IaC
* Partner with Splunk teams to route traffic through Kafka by utilizing open-source agents and collectors
* deployed via Chef
* Remediate any health issues within Kafka
* Automate (where possible) any operational processes on the team
* Create new and/or update monitoring dashboards and alerts as needed
* Manage a continuous improvement / continuous development (CI/CD) pipeline
* Perform PoC’s on new components to expand/enhance team’s Kafka offerings
* Skills & Qualifications:
* 3+ years of experience with Kafka clustering & administration
* 3+ years of experience building, deploying, and supporting multiple Kafka clusters using IaC (Infrastructure-as-Code) best practices
* Experience developing automated processes within and around Kafka to help supplement the service
* Experience working with multiple teams to build and architect data pipeline solutions where Kafka will be involved.
* Experience with Linux/Unix and system management
* IaC (Infrastructure-as-Code) experience with Virtual/Physical Servers using Chef, Ansible, Jenkins, Artifactory, etc.
* Understanding of Git workflows, continuous improvement / continuous development (CI/CD) concepts
* Strong verbal and written communication skills
* Strong technical acumen
* Strong analytical skills
* Experience working in Agile/Lean methodologies
* Preferred Qualifications:
* Knowledge and experience with Splunk, Elastic, Kibana and Grafana
* Knowledge and experience with log collection agents such as Open-Telemetry, Fluent Bit, FluentD, Beats and LogStash.
* Knowledge and experience with Kubernetes / Docker
* Knowledge and experience with Kafka-Connect
* Knowledge and experience with AWS or Azure
* Knowledge and experience with Streaming Analytics

Job Type: Full-time

Pay: $977,552.00 – $1,145,367.00 per year

Schedule:

* 8 hour shift

Work Location: Remote