Kafka Engineer

Industry: Retail
Company size: 10K+

Apply as Kafka Engineer

Check out the best jobs for May 2024here

Find remote software jobs with hundreds of Turing clients

Job description

A US-based company that is home to the world's largest selection of guitars and musical equipment is looking for a Kafka Engineer. The engineer will play a critical role in modernizing the platform’s current infrastructure while building modern, robust, and scalable features. The company operates the world’s largest multichannel musical instrument retail services and is on a mission to develop and nurture lifelong musicians and make a difference in the musical world. They have managed to raise more than $30mn in funding so far. 


Job Responsibilities:

  • Help facilitate the implementation of Confluent Kafka streaming and enhance the middleware administration
  • Responsible for setting up Kafka brokers, Kafka Mirror Makers, and Kafka Zookeeper on hosts in collaboration with the Infrastructure team
  • Design, build and maintains Kafka topics 
  • Contribute to the tuning and architecture with a strong understanding of related Kafka Connect and Linux fundamentals 
  • Carefully observe Kafka health metrics and alerts, taking action in a timely manner
  • Implement a real-time and batch data input pipeline employing best practices in data modeling and ETL/ELT operations
  • Participate in technological decisions and work with smart colleagues
  • Review code, implementations, and provide useful input to assist others in developing better solutions
  • Develop documentation on design, architecture, and solutions
  • Provide assistance and coaching to peers and more junior engineers
  • Build good working relationships at all levels of the organization and across functional teams
  • Assume accountability for the project's timetables and deliverables
  • Create dataflows and pipelines ranging from simple to complicated
  • Support the investigation and resolution of production difficulties
  • Work to keep the system and data security at a high level, ensuring that the application's confidentiality, integrity, and availability are not jeopardized
  • Express stakeholder's needs into familiar language that can be adopted for use with Behavior Driven Development (BDD) or Test-Driven Development (TDD)
  • Build solutions that are stable, scalable, and easy to use while fitting into the broader data architecture
  • Assists in the formation of Communities of Practice
  • Utilize industry-standard approaches to continuously improve the performance of source code
  • Consistently enhance the performance of source code using industry-standard methodologies
  • Steer the technology direction and options by proferring suggestions based on experience and research
  • Encourages the creation of group norms and procedures

Job Requirements:

  • Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
  • 7+ years of direct expertise with data pipelines and application integrations
  • Experience in the design, development of Clusters, and Producers/Consumers 
  • Proficiency in enabling Cloud/hybrid Cloud using Confluent Kafka Data streaming through Kafka, SQS/SNS queuing, etc
  • Strong container expertise, especially Docker 
  • Prolific skills working with technologies such as Ansible, Puppet, Terraform, OpenShift, Kubernetes, AWS, AWS Lambda, and Event Streaming
  • Working experience in a public cloud environment as well as on-premise infrastructure
  • DataDog, Splunk, KSQL, Spark, and PySpark experience is a plus
  • Excellent knowledge of distributed architectures, including Microservices, SOA, RESTful APIs, and data integration architectures 
  • Familiarity with any of the following message/file formats: Parquet, Avro, ORC
  • Excellent understanding of AWS Cloud Data Lake technologies, including Kinesis/Kafka, S3, Glue, and Athena
  • It's advantageous to know RabbitMQ and Tibco Messaging technologies
  • Previous expertise in designing and implementing data models for applications, operations, or analytics
  • Track record of working with information repositories, data modelling, and business analytics tools is a strong suit
  • Be familiar with databases, data lakes, and schemas with advanced expertise and experience in online transactional (OLTP) and analytical processing (OLAP)
  • Experience in Streaming Service, EMS, MQ, Java, XSD, File Adapter, and ESB-based application design and development experience
  • Capable of working in a fast-paced team to keep the data and reporting pipeline running smoothly

Interested in this job?

Apply to Turing today.

Apply now

Why join Turing?

Elite US Jobs

1Elite US Jobs

Turing’s developers earn better than market pay in most countries, working with top US companies.
Career Growth

2Career Growth

Grow rapidly by working on challenging technical and business problems on the latest technologies.
Developer success support

3Developer success support

While matched, enjoy 24/7 developer success support.

Developers Turing

Read reviews from developers across the world and learn what it’s like working with top U.S. companies.
4.65OUT OF 5
based on developer reviews as of June 2024

How to become a Turing developer?

Work with the best software companies in just 4 easy steps
  1. Create your profile

    Fill in your basic details - Name, location, skills, salary, & experience.

  2. Take our tests and interviews

    Solve questions and appear for technical interview.

  3. Receive job offers

    Get matched with the best US and Silicon Valley companies.

  4. Start working on your dream job

    Once you join Turing, you’ll never have to apply for another job.


Learn how to create a perfect resume lists out the do’s and don’ts behind a great resume to help you find a top remote software developer job.

Frequently Asked Questions

We are a Palo Alto-based 'deep' jobs platform allowing talented software developers to work with top US firms from the comfort of their homes. We are led by Stanford alumni and successful A.I. entrepreneurs Jonathan Siddharth and Vijay Krishnan.

After uploading your resume, you will have to go through the three tests -- seniority assessment, tech stack test, and live coding challenge. Once you clear these tests, you are eligible to apply to a wide range of jobs available based on your skills.

It is the combination of our core business model and values that makes us different from others. We provide full-time, long-term projects to remote developers whereas most of our competitors offer more freelance jobs.

No, the service is absolutely free for software developers who sign up.

We, at Turing, hire remote developers for over 100 skills like React/Node, Python, Angular, Swift, React Native, Android, Java, Rails, Golang, PHP, Vue, among several others. We also hire engineers based on tech roles and seniority.

Communication is crucial for success while working with American clients. We prefer candidates with a B1 level of English i.e. those who have the necessary fluency to communicate without effort with our clients and native speakers.

View more FAQs

Latest posts from Turing


In a nutshell, Turing aims to make the world flat for opportunity. Turing is the brainchild of serial A.I. entrepreneurs Jonathan and Vijay, whose previous successfully-acquired AI firm was powered by exceptional remote talent. Also part of Turing’s band of innovators are high-profile investors, such as Facebook's first CTO (Adam D'Angelo), executives from Google, Amazon, Twitter, and Foundation Capital.

Equal Opportunity Policy

Turing is an equal opportunity employer. Turing prohibits discrimination and harassment of any type and affords equal employment opportunities to employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, age, disability status, protected veteran status, or any other characteristic protected by law.

Explore remote developer jobs

Check out the best jobs for May 2024here

Work full-time at top U.S. companies

Create your profile, pass Turing Tests and get job offers as early as 2 weeks.