Lead Data Engineer

Industry: Retail
Company size: 251-10K

Apply as Lead Data Engineer

Check out the best jobs for May 2024here

Find remote software jobs with hundreds of Turing clients

Job description

A US-based company building a robust and comprehensive online platform that enables users to shop for organic food products is looking for a Lead Data Engineer. The selected candidate will be tasked with implementing state-of-the-art methods to work implementing data mining techniques across the platform. The company provides customers with a wide range of organic food, wellness, and household products at an affordable price. They have managed to secure $200mn+ in funding so far. This role requires 6-8+ hours overlap with the PST time zone. 


Job Responsibilities:

  • Lead multiple projects and efforts to orchestrate and deliver cohesive data engineering solutions in collaboration with various functional teams
  • Take ownership of the entire data services life cycle, from data ingestion to data processing and ETL to data delivery for reporting
  • Collaborate with other technical teams to deliver data solutions that meet both business and technical needs
  • Define technical requirements and implementation details for the underlying data lake, data warehouse, and data marts
  • Identify, troubleshoot, and resolve issues with production data integrity and performance
  • As the lead, collaborate with all aspects of data management to ensure that patterns, decisions, and tooling are implemented in accordance with enterprise standards
  • Conduct data source gap analysis and develop data source/target catalogs and mappings
  • Develop a thorough understanding of cross-system integration, interactions, and relationships in order to create an enterprise view of future data requirements
  • Design, coordinate, and carry out pilots/prototypes/proofs-of-concept to validate specific scenarios and provide an implementation roadmap
  • Recommend/ensure technical functionality for Data Engineering (e.g., scalability, security, performance, data recovery, reliability, and so on)
  • Organize workshops to define requirements and design data solutions
  • Decisions about enterprise and solution architecture should be applied to data architecture frameworks and data models
  • Keep track of all data architecture artifacts and procedures in a repository
  • Collaborate with IT teams, software providers, and business owners to forecast and design data architecture 

Job Requirements:

  • Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
  • At least 3-5+ years of relevant experience as a software engineer
  • Knowledge of data architectures, data pipelines, real-time processing, streaming, networking, and security is required
  • Programming experience in Python, Scala, or Java is required
  • RDBMS and Data Warehousing (Strong SQL) experience with Redshift, Snowflake, or similar
  • Expertise in logical/physical data architecture, design, and development experience implementing a data lake / big data analytics platform, either cloud-based or on-premise- AWS preferred
  • Extensive knowledge of development tools for CI/CD, unit and integration testing, automation, and orchestration, such as GitHub, Jenkins, Concourse, Airflow, and Terraform
  • Experience writing Kafka producers and consumers, or knowledge of AWS Kinesis
  • Hands-on experience building a distributed data processing platform using Big Data technologies such as Hadoop, Spark, and others
  • Have a talent for independence (hands-on) as well as teamwork 
  • Excellent analytical and problem-solving skills, particularly in the face of ill-defined issues or conflicting information
  • Experience with streaming data ingestion, machine learning, and Apache Spark would be advantageous
  • Capable of eliciting, gathering, and managing requirements in an Agile delivery environment
  • Excellent communication and presentation skills (verbal, written, and presentation) at all organizational levels
  • Capability to convert ambiguous concepts into concrete ideas

Interested in this job?

Apply to Turing today.

Apply now

Why join Turing?

Elite US Jobs

1Elite US Jobs

Turing’s developers earn better than market pay in most countries, working with top US companies.
Career Growth

2Career Growth

Grow rapidly by working on challenging technical and business problems on the latest technologies.
Developer success support

3Developer success support

While matched, enjoy 24/7 developer success support.

Developers Turing

Read reviews from developers across the world and learn what it’s like working with top U.S. companies.
4.6OUT OF 5
based on developer reviews as of April 2024

How to become a Turing developer?

Work with the best software companies in just 4 easy steps
  1. Create your profile

    Fill in your basic details - Name, location, skills, salary, & experience.

  2. Take our tests and interviews

    Solve questions and appear for technical interview.

  3. Receive job offers

    Get matched with the best US and Silicon Valley companies.

  4. Start working on your dream job

    Once you join Turing, you’ll never have to apply for another job.


Learn how to create a perfect resume lists out the do’s and don’ts behind a great resume to help you find a top remote software developer job.

Frequently Asked Questions

We are a Palo Alto-based 'deep' jobs platform allowing talented software developers to work with top US firms from the comfort of their homes. We are led by Stanford alumni and successful A.I. entrepreneurs Jonathan Siddharth and Vijay Krishnan.

After uploading your resume, you will have to go through the three tests -- seniority assessment, tech stack test, and live coding challenge. Once you clear these tests, you are eligible to apply to a wide range of jobs available based on your skills.

It is the combination of our core business model and values that makes us different from others. We provide full-time, long-term projects to remote developers whereas most of our competitors offer more freelance jobs.

No, the service is absolutely free for software developers who sign up.

We, at Turing, hire remote developers for over 100 skills like React/Node, Python, Angular, Swift, React Native, Android, Java, Rails, Golang, PHP, Vue, among several others. We also hire engineers based on tech roles and seniority.

Communication is crucial for success while working with American clients. We prefer candidates with a B1 level of English i.e. those who have the necessary fluency to communicate without effort with our clients and native speakers.

View more FAQs

Latest posts from Turing


In a nutshell, Turing aims to make the world flat for opportunity. Turing is the brainchild of serial A.I. entrepreneurs Jonathan and Vijay, whose previous successfully-acquired AI firm was powered by exceptional remote talent. Also part of Turing’s band of innovators are high-profile investors, such as Facebook's first CTO (Adam D'Angelo), executives from Google, Amazon, Twitter, and Foundation Capital.

Equal Opportunity Policy

Turing is an equal opportunity employer. Turing prohibits discrimination and harassment of any type and affords equal employment opportunities to employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, age, disability status, protected veteran status, or any other characteristic protected by law.

Explore remote developer jobs

Check out the best jobs for May 2024here

Work full-time at top U.S. companies

Create your profile, pass Turing Tests and get job offers as early as 2 weeks.