Data Pipeline Engineer

Industry: Advertising

Remote

Company size: 251-10K

Full-time

Apply as Data Pipeline Engineer

Check out the best jobs for May 2024here

Find remote software jobs with hundreds of Turing clients

Job description

A US-based company that is providing businesses with world-class next-gen data-oriented media solutions is looking for a Data Pipeline Engineer. The engineer will be in charge of improving the scalability, service reliability, and performance of the existing platform. The company's innovative technology enables clients to more effectively target and connect with their target audiences. This position requires at least 4 hours of overlap with the EST time zone.

Job Responsibilities:

Aggregate data from both internal and external data sources to build a data processing system
Create new pipelines and build reusable components at scale to support reporting & analytics data products
Write complex queries to transform raw data sources into accessible models by coding
Clean, prepare and optimize data at scale for integration and consumption
Implement data management projects and re-structure of current web architecture
Implement automated workflow using workflow scheduling processes like apache airflow
Solve complex data issues and perform root cause analysis to proactively resolve product issues
Own the data pipeline and support systems failure
Collaborate with relevant stakeholders taking learning and leadership opportunities

Job Requirements:

Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
At least 5+ years of relevant experience as a software engineer
Extensive experience in Python, SQL, AWS, Airflow, or Glue
Nice to have experience in Elasticsearch or Apache Druid, Kafka and Parquet, or Avro
A minimum of 3+ years of experience in SQL, Python, and Bash in a data-focused role
At least 3+ years of proven experience in engineering complex data pipelines with low latency and redundancy
Must have 3+ years of experience building cloud scalable and high-performance data warehouse solutions using AWS products, including S3, Athena, Redshift, EMR
Exposure to open source and proprietary cloud data pipeline tools such as Airflow and Glue
Solid understanding of data structures and algorithms
Understanding of code versioning tools such as Git
Passionate about data solutions
Nice to have familiarity with other distributed data stores (Elasticsearch, Apache Druid)
Familiarity with streaming data experience with Kafka
Demonstrable experience with binary data serialization formats such as Parquet, Avro
Fluent in verbal and written English

Interested in this job?

Apply to Turing today.

Apply now

Interested in this job? Apply now

Hadji, AlgeriaFull Stack Developer

Although I had worked at oDesk and Elance (now popularly known as Upwork) for more than 5 years, the pivotal moment in my career came when I joined the global team of Turing in 2020. I never imagine that the role I would be offered would come with such stability and prominence. Apply to be one among many Turing developers. It will change your life like it did mine!

Baah, GhanaFull-stack Developer

I am a full-stack developer from Ghana. I honestly felt a dramatic change in my life when I joined Turing. My financial health is better than ever and I feel I have made more progress as a developer in the 1 year I spent at Turing than all the years before. As a Turing developer, you will get to work on world-class projects with the top tech leaders.

Fahad, PakistánSoftware Developer

Even since I have become a remote developer at Turing, I’ve been enjoying the flexibility and other perks that this job offers. I would recommend interested developers to definitely apply for Turing. I am sure you'll enjoy working here and can give your own Turing review to your friends. All the best and hope you succeed in becoming a Turing developer soon.

Sebastian, ColombiaProduct Designer

When I started my journey as a freelance product designer, I had to invest most of my time into finding new clients and getting new projects. Luckily, while surfing the web, I came across a few Turing.com reviews and decided to apply there. Life has changed a lot after that. People at Turing not only find me outstanding tech projects that match my abilities and take care of all the agreement details but also follow my relationship with clients every step of the way.

Ermal, KosovoSoftware Developer

Before joining Turing, I was working as a software developer for almost 6 years with extensive experience in game development. But it is only after I became a Turing developer, I began to manage my time better, stayed focused on my career goals, became more adaptable. I also learned how to work with different technologies and global teams. If I were to ask to review Turing.com, I would say it has been a rewarding journey for me so far.

Share this job

Why join Turing?

1Elite US Jobs

Turing’s developers earn better than market pay in most countries, working with top US companies.

2Career Growth

Grow rapidly by working on challenging technical and business problems on the latest technologies.

3Developer success support

While matched, enjoy 24/7 developer success support.

Developers Turing

Read Turing.com reviews from developers across the world and learn what it’s like working with top U.S. companies.

4.65OUT OF 5

based on developer reviews as of June 2024

Chinonso, NigeriaSoftware Developer I had a hazy picture of my future in my mind, and Turing is making it clearer and better.

Rahul, IndiaJavaScript DeveloperI learn something new every time I work on a project here, which signifies that my career is growing!

David, BraziliOS DeveloperI now have to figure out new career goals for myself because, with Turing, I achieved all my previous goals well ahead of time!

Jose, MexicoSoftware DeveloperWorking with Turing offers me great learning along with really good earning.

Danail, PakistanData ScientistJob hunting has been revolutionized, and Turing is leading the way.

Feyzullah, TurkeySoftware EngineerBefore Turing, I had never tried remote work. Now, I want to retire remotely.

Mugisha, RwandaSoftware DeveloperAs Covid19 memories were still fresh, getting a permanent remote job made a lot of sense to me. Remote work exposes you to opportunities that would not be possible when working locally.

Find out why developers love Turing

See all Turing reviews

How to become a Turing developer?

Work with the best software companies in just 4 easy steps

Create your profile
Fill in your basic details - Name, location, skills, salary, & experience.
Take our tests and interviews
Solve questions and appear for technical interview.
Receive job offers
Get matched with the best US and Silicon Valley companies.
Start working on your dream job
Once you join Turing, you’ll never have to apply for another job.

Apply now

Learn how to create a perfect resume

Turing.com lists out the do’s and don’ts behind a great resume to help you find a top remote software developer job.

Learn more

Frequently Asked Questions

What is Turing?

We are a Palo Alto-based 'deep' jobs platform allowing talented software developers to work with top US firms from the comfort of their homes. We are led by Stanford alumni and successful A.I. entrepreneurs Jonathan Siddharth and Vijay Krishnan.

How many rounds do I need to clear before selection?

After uploading your resume, you will have to go through the three tests -- seniority assessment, tech stack test, and live coding challenge. Once you clear these tests, you are eligible to apply to a wide range of jobs available based on your skills.

How is Turing different from other remote based job providers?

It is the combination of our core business model and values that makes us different from others. We provide full-time, long-term projects to remote developers whereas most of our competitors offer more freelance jobs.

Do developers need to pay any fees for Turing's services?

No, the service is absolutely free for software developers who sign up.

What kind of developers does Turing hire?

We, at Turing, hire remote developers for over 100 skills like React/Node, Python, Angular, Swift, React Native, Android, Java, Rails, Golang, PHP, Vue, among several others. We also hire engineers based on tech roles and seniority.

What level English is necessary to get a job?

Communication is crucial for success while working with American clients. We prefer candidates with a B1 level of English i.e. those who have the necessary fluency to communicate without effort with our clients and native speakers.

View more FAQs

Latest posts from Turing

Progressive Web Apps vs Native Apps: What Should You Pick?

Progressive Web Apps vs Native Apps: PWAs are apps that work seamlessly on any device, regardless of the platform...

What Is Programmer Imposter Syndrome and How Can You Deal With It?

Programmer imposter syndrome is the feeling of self-doubt that developers experience, despite possessing the...

How to Build a Fancy Verification Code Component with React Custom Hooks?

This blog will help you build a verification code component in React by creating and using a React custom hooks l...

Things to Expect When Transitioning from an Individual Contributor to a Software Engineering Manager?

What to expect when transitioning from IC to software engineering manager: 1. A rearrangement of your priorities....

Leadership

In a nutshell, Turing aims to make the world flat for opportunity. Turing is the brainchild of serial A.I. entrepreneurs Jonathan and Vijay, whose previous successfully-acquired AI firm was powered by exceptional remote talent. Also part of Turing’s band of innovators are high-profile investors, such as Facebook's first CTO (Adam D'Angelo), executives from Google, Amazon, Twitter, and Foundation Capital.

Equal Opportunity Policy

Turing is an equal opportunity employer. Turing prohibits discrimination and harassment of any type and affords equal employment opportunities to employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, age, disability status, protected veteran status, or any other characteristic protected by law.

Explore remote developer jobs

Project Manager

About Turing

Turing is an AI-powered tech services company with a mission to accelerate AGI advancement and deployment by bridging the gap between global talent from 100+ countries and the world's best foundational LLM companies, by helping them improve performance through model evaluation, fine-tuning, feedback, factuality, and handling diverse data.

Role Overview

A US-based AI company that wants to create innovative commercial and research AI solutions is looking for a Project Manager. This opportunity is tailored for professionals who have proven leadership capability of managing large teams and are excited about working at the forefront of AI advancements.

Job Responsibilities:

Manage and supervise a team of Business Analysts, including 5+ Team Leads.
Identify training needs, conduct sessions, and ensure high-quality training datasets.
Perform regular QA checks, improve workflows, and oversee daily operations to ensure timely, within-budget project delivery.
Serve as the main contact for stakeholders and provide updates to senior management.

Job Requirements:

Proven leadership experience managing teams of 20+ members for at least 5 years.
Strong analytical and communication skills, with proficiency in English.
Experience in operations management, process improvement, and quality assurance.
Ability to incorporate feedback from LLM performance metrics into training data and processes.
Commitment to a full-time role, with immediate availability preferred.

Benefits:

Collaborate with globally renowned experts and build a network tailored to your career aspirations.
Experience the flexibility of remote work while breaking away from traditional office setups.
Receive industry-standard salaries in USD.
Contribute to innovative projects pushing the boundaries of technology, keeping you at the forefront of advancements.

Complete an automated analytical challenge, followed by an interview. Successful candidates can start immediately. Join us in leading a team at the forefront of AI innovation!

1-10 employees

Project Management

Operations Manager

About Turing

Role Overview

Job Responsibilities:

Manage and supervise a team of Business Analysts, including 5+ Team Leads.
Identify training needs, conduct sessions, and ensure high-quality training datasets.
Perform regular QA checks, improve workflows, and oversee daily operations to ensure timely, within-budget project delivery.
Serve as the main contact for stakeholders and provide updates to senior management.

Job Requirements:

Proven leadership experience managing teams of 20+ members for at least 5 years.
Strong analytical and communication skills, with proficiency in English.
Experience in operations management, process improvement, and quality assurance.
Ability to incorporate feedback from LLM performance metrics into training data and processes.
Commitment to a full-time role, with immediate availability preferred.

Benefits:

Collaborate with globally renowned experts and build a network tailored to your career aspirations.
Experience the flexibility of remote work while breaking away from traditional office setups.
Receive industry-standard salaries in USD.
Contribute to innovative projects pushing the boundaries of technology, keeping you at the forefront of advancements.

Complete an automated analytical challenge, followed by an interview. Successful candidates can start immediately. Join us in leading a team at the forefront of AI innovation!

1-10 employees

Project Management