Lead Engineer, Kafka
The Judge Group Inc.

Los Angeles, California

Location: Los Angeles, CA
Description: Our client is currently seeking a Lead Engineer, Kafka


•Work with the Manager - Kafka Engineering to assess the needs of Software Engineering within the Kafka ecosystem

•Establish, communicate, and advocate best practices and design patterns related to Kafka consumption

•Participate in and occasionally lead the daily, weekly, sprint cycle team ceremonies and ensure efficient activities of the team aligned to goals

•Provide mentoring to team members

•Assess and size effort associated with work backlog and participate in grooming

•Advise and inform a program of work to mature the streams processing service offering

•Collaborate with other operations team to ensure highly available service and response respective to developer support

•Interview and participate in building a team to establish a center of excellence and expertise in streams processing

•Participate in regular planning cycles to align business priorities to programs of work within your organization

•Inform recommendations, including resourcing, of strategic projects to mature and improve the service

•Lead proofs of concepts, engineering, and implementation projects


•Strong operational background running Kafka clusters at scale

•Knowledge of both physical/on prem systems and public cloud infrastructure

•Strong understanding of Kafka broker, connect, and topic tuning and architectures

•Strong understanding of Linux fundamentals as related to Kafka performance

oFilesystem tuning and related kernel tuning and troubleshooting

oStorage hardware and trade-offs

oNetwork TCP stack tuning and troubleshooting

•Background in both Systems and Software Engineering

•Competent developing software in 1 or more of high level language

•Competent with configuration management in code/IaC including Ansible and Terraform

•Competent operating Java Runtime Environment (JRE) in large scale environments - ( runtime settings, JMX, troubleshooting, garbage collection, etc... )

•Passionate about data driven operations; building and leveraging observability with tools such as Prometheus and Grafana

•Knowledge and experience of containers and Kubernetes cluster

•Hands on experience delivering complex software in an enterprise environment

•Experience working in a remote team across multiple regions and time zones

•Comfortable working with structured Change and Incident Management


•Autonomous and proactive.

•Passionate about the value of broad scale streams processing

•Passionate about providing greater transparency to health and status of our systems

•Keenly empathetic to the day to day experience of software development teams

•A transparent communicator

•Deeply concerned with the security and compliance implications of your services and solutions

•Capable of delivering and accepting empathetic, constructive criticism with reports, peers, leadership and stakeholders

•Conscious of the developers need for speed of delivery and the enterprise need for governance and cost management

Contact: dmillard@judge.com

This job and many more are available through The Judge Group. Find us on the web at www.judge.com

Job Alerts

Provide an email, zip code for jobs, and/or job category to subscribe to job alerts. Learn more now.

More IT jobs

Ann Arbor, Michigan
Posted about 5 hours ago
Boston, Massachusetts
Posted about 5 hours ago
Broomfield, Colorado
Posted about 5 hours ago
View recent jobs »

New post from our employment blog

Soft Skills Are What’s Missing From Otherwise Ideal Employees

Soft skills, such as reliability, punctuality, and honesty, are huge in a work environment. But, sadly, many otherwise perfect potential profe...

Read blog post
Share this inclusion job with the community

Click a community link below, and then social share the Lead Engineer, Kafka job.

Disability inclusion jobs logo
Asian inclusion jobs logo
Black inclusion jobs logo
Diversity inclusion jobs logo
LGBTQ inclusion jobs logo
Seniors inclusion jobs logo
Women inclusion jobs logo
Hispanic inclusion jobs logo