A reputed, U.S.-based value creation, consultation, and performance improvement company that is operational across the globe in various fields, is looking for a Kafka Engineer. The selected candidate will be responsible for designing and implementing data pipelines using technologies such as Kafka, Spark, and Python. The company is dedicated to helping corporations, government organizations, foundations, and non-profits deal with complex business issues to improve operating performance and boost stakeholder value. This is an exciting opportunity for developers who are eager to work in an agile environment that encourages independent thinking, problem-solving, and growth.
Job Responsibilities:
- Take ownership of Kafka stream implementation design, make technical decisions, and define a data model, topology, etc
- Establish topology guiding principles and define how to transform raw data toward the target data model
- Take significant technical decisions with respect to the target database, Kafka setup, etc
- Provide expertise, guidance, and support to Kafka developers
- Effectively store large volumes of structured and unstructured data by building and maintaining data lakes
- Develop and maintain data pipelines; extract and process data effectively to and enable analytics and reporting in real-time
- Partake in cross-departmental collaboration to develop data-driven solutions for business-related issues
- Ensure data integrity, accuracy, and completeness, across all data systems
- Developing and maintaining data models to support business reporting and analytics needs
- Optimize existing data systems to enhance performance, reliability, and scalability
- Increase efficiency and reduce errors by automating data processing and quality assurance tasks
Job Requirements:
- Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
- At least 4+ years of relevant experience as a Kafka Engineer
- Strong understanding of Kafka streaming apps is a must
- Ability to transform data from a source system to target databases using Kafka Stream
- Understanding of working within a diverse team and a multiple-stakeholder environment
- Good English communication skills, both written and verbal