Data Engineer

Industry: Media & Internet

Remote

Company size: 251-10K

Full-time/Part-time

Apply as Data Engineer

Check out the best jobs for May 2024here

Find remote software jobs with hundreds of Turing clients

Job description

A U.S.-based company that has managed to develop a beloved social platform that enables users to effortlessly connect with each other, is looking for a Data Engineer. The engineer will be responsible for enhancing the data pipelines that produce training datasets for the fundamental ranking models. The platform enables users to build and join communities for like-minded people and bond over common interests. The company has managed to secure more than $1.1bn during their Series F round of funding.

Job Responsibilities:

Create and implement data pipelines that quickly extract, convert, and load (ETL) information from a variety of sources into BigQuery
Using Apache Airflow, create and manage workflows
Create DAGs (Directed Acyclic Graphs) to organize and schedule data processing operations, guaranteeing timely and reliable operation of data pipelines
To speed up the process of adding new features to the datasets, create Python scripts
Drive the operations, architecture, and execution of relevant technical and product strategies for one of the biggest sites in the world
To ensure that data is structured appropriately for effective querying and analysis, create and maintain data models and schemas within BigQuery
Find and use performance-enhancing techniques, such as indexing, partitioning, and caching, for both BigQuery queries and Airflow processes
Implement data quality controls to assure the reliability and accuracy of the data
In order to proactively identify and address any pipeline or job issues, set up monitoring and alerting systems
Put access controls and security mechanisms in place to safeguard sensitive data in BigQuery
Establish permissions and roles for different teams and users
Add information to the data pipelines from many sources and platforms, such as APIs, databases, logs, and third-party services
Use Airflow and other automation tools to automate ETL processes to boost productivity and decrease manual involvement
Maintain data governance and adherence to pertinent data standards and legislation, which includes data anonymization, data retention guidelines, and data privacy protection
Collaborate closely with data analysts, scientists, and other key players to comprehend their data requirements and assist with data-related projects
Determine and fix any problems with the data pipeline, performance bottlenecks, and other potential technical difficulties
To promote knowledge sharing and the onboarding of new team members, keep documentation for data pipelines, ETL procedures, and workflow setups
Keep up with the most recent BigQuery and Airflow innovations and continually enhance your data engineering methods

Job Requirements:

Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
At least 5+ years of relevant experience as a data engineer
Extensive experience working with BigQuery, Airflow, and Python
Familiarity working with Spark is desirable
Strong understanding data sources, data transformation requirements, and data modeling
Extensive familiarity with BigQuery, including its architecture, recommended practices, and optimization methods
Prior experience crafting intricate SQL queries to quickly process and analyze huge datasets
Excellent spoken and written English communication skills

Interested in this job?

Apply to Turing today.

Apply now

Interested in this job? Apply now

Ahmed, PakistanFull Stack Developer

I’ve been working as a full-stack developer and solution architect with more than 10 years of experience. My experience as a Turing developer has been quite amazing. My onboarding process was super smooth. Although I had read a few Turing.com reviews about the onboarding process here, I never really expected it to be this awesome. My coordinator helped me in every single step- from getting hired by top Silicon Valley clients to making sure my needs were met at all levels.

Sateesh, IndiaSoftware Developer

I wanted to work with a US company and that's when I found Turing! The best part is the job flexibility. I don't need to follow the 9-5 routine. I also get to work with people from various cultures across the globe and grow with them.

Fahad, PakistánSoftware Developer

Even since I have become a remote developer at Turing, I’ve been enjoying the flexibility and other perks that this job offers. I would recommend interested developers to definitely apply for Turing. I am sure you'll enjoy working here and can give your own Turing review to your friends. All the best and hope you succeed in becoming a Turing developer soon.

Elvis, BosniaiOS Developer

I work as a Turing iOS developer. My experience with them has been really good. Guys at Turing matched me with a top client super quickly. I found the entire matching process to be very precise and smooth. It’s rare to find a company that delivers on its promises. But both Turing and the company I got matched with kept their promises. From my experience I can tell you once you get here, your work-life becomes easier and you can focus on doing what you love the most.

Software Developer Quang share his experience working with Turing jobs

Quang, VietnamSoftware Engineer

Before joining Turing, I had 7 years of software engineering experience in web development and ML and Data Mining. Turing allowed me to explore my passion for creating long-term value for customers. They also helped me in applying new technologies to increase product quality. Thanks to Turing, I have a very healthy work-life balance now. I really hope my Turing review will be helpful for you in some way.

Share this job

Why join Turing?

1Elite US Jobs

Turing’s developers earn better than market pay in most countries, working with top US companies.

2Career Growth

Grow rapidly by working on challenging technical and business problems on the latest technologies.

3Developer success support

While matched, enjoy 24/7 developer success support.

Developers Turing

Read Turing.com reviews from developers across the world and learn what it’s like working with top U.S. companies.

4.65OUT OF 5

based on developer reviews as of June 2024

Chinonso, NigeriaSoftware Developer I had a hazy picture of my future in my mind, and Turing is making it clearer and better.

Rahul, IndiaJavaScript DeveloperI learn something new every time I work on a project here, which signifies that my career is growing!

David, BraziliOS DeveloperI now have to figure out new career goals for myself because, with Turing, I achieved all my previous goals well ahead of time!

Jose, MexicoSoftware DeveloperWorking with Turing offers me great learning along with really good earning.

Danail, PakistanData ScientistJob hunting has been revolutionized, and Turing is leading the way.

Feyzullah, TurkeySoftware EngineerBefore Turing, I had never tried remote work. Now, I want to retire remotely.

Mugisha, RwandaSoftware DeveloperAs Covid19 memories were still fresh, getting a permanent remote job made a lot of sense to me. Remote work exposes you to opportunities that would not be possible when working locally.

Find out why developers love Turing

See all Turing reviews

How to become a Turing developer?

Work with the best software companies in just 4 easy steps

Create your profile
Fill in your basic details - Name, location, skills, salary, & experience.
Take our tests and interviews
Solve questions and appear for technical interview.
Receive job offers
Get matched with the best US and Silicon Valley companies.
Start working on your dream job
Once you join Turing, you’ll never have to apply for another job.

Apply now

Learn how to create a perfect resume

Turing.com lists out the do’s and don’ts behind a great resume to help you find a top remote software developer job.

Learn more

Frequently Asked Questions

What is Turing?

We are a Palo Alto-based 'deep' jobs platform allowing talented software developers to work with top US firms from the comfort of their homes. We are led by Stanford alumni and successful A.I. entrepreneurs Jonathan Siddharth and Vijay Krishnan.

How many rounds do I need to clear before selection?

After uploading your resume, you will have to go through the three tests -- seniority assessment, tech stack test, and live coding challenge. Once you clear these tests, you are eligible to apply to a wide range of jobs available based on your skills.

How is Turing different from other remote based job providers?

It is the combination of our core business model and values that makes us different from others. We provide full-time, long-term projects to remote developers whereas most of our competitors offer more freelance jobs.

Do developers need to pay any fees for Turing's services?

No, the service is absolutely free for software developers who sign up.

What kind of developers does Turing hire?

We, at Turing, hire remote developers for over 100 skills like React/Node, Python, Angular, Swift, React Native, Android, Java, Rails, Golang, PHP, Vue, among several others. We also hire engineers based on tech roles and seniority.

What level English is necessary to get a job?

Communication is crucial for success while working with American clients. We prefer candidates with a B1 level of English i.e. those who have the necessary fluency to communicate without effort with our clients and native speakers.

View more FAQs

Latest posts from Turing

Progressive Web Apps vs Native Apps: What Should You Pick?

Progressive Web Apps vs Native Apps: PWAs are apps that work seamlessly on any device, regardless of the platform...

What Is Programmer Imposter Syndrome and How Can You Deal With It?

Programmer imposter syndrome is the feeling of self-doubt that developers experience, despite possessing the...

How to Build a Fancy Verification Code Component with React Custom Hooks?

This blog will help you build a verification code component in React by creating and using a React custom hooks l...

Things to Expect When Transitioning from an Individual Contributor to a Software Engineering Manager?

What to expect when transitioning from IC to software engineering manager: 1. A rearrangement of your priorities....

Leadership

In a nutshell, Turing aims to make the world flat for opportunity. Turing is the brainchild of serial A.I. entrepreneurs Jonathan and Vijay, whose previous successfully-acquired AI firm was powered by exceptional remote talent. Also part of Turing’s band of innovators are high-profile investors, such as Facebook's first CTO (Adam D'Angelo), executives from Google, Amazon, Twitter, and Foundation Capital.

Equal Opportunity Policy

Turing is an equal opportunity employer. Turing prohibits discrimination and harassment of any type and affords equal employment opportunities to employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, age, disability status, protected veteran status, or any other characteristic protected by law.

Explore remote developer jobs

Remote Java Platform Engineer

A top-tier US-based company is on the lookout for experienced Java Engineers.

As a Java Engineer, your role will be central to crafting, designing, and launching new features while working in tandem with various teams. The organization is at the forefront of creating cutting-edge dialog agents with applications spanning education, entertainment, and general inquiry resolution. This is an outstanding chance for candidates eager to develop their skills in a vibrant environment.

Key Responsibilities:

Develop high-quality, reusable, and maintainable code.
Engage in code reviews to uphold stringent code quality standards.
Leverage Java knowledge across all stages of development.
Deliver clear, organized, and well-documented code.
Work with cross-functional teams to define, design, and implement new features.

Qualifications:

Open to applicants at all stages of their careers, from entry-level to experienced professionals.
Bachelor’s or Master’s degree in Engineering, Computer Science, or related field, or equivalent experience.
Experience in developing web applications with modular and scalable architectures.
Strong emphasis on code readability and security/stability, including thorough testing.
Proficient in Java syntax and conventions.
Excellent verbal and written English communication skills.
Preferred: Previous experience in software Quality Assurance and Test Planning.

Interview Stages:

Two internal interviews:

A 60-minute technical interview.
A 15-30 minute discussion covering cultural fit and offer terms.

Reasons to Join Us:

Work alongside globally recognized experts and expand your professional network.
Enjoy the flexibility of remote work, moving away from the traditional office environment.
Earn competitive salaries in USD.
Participate in groundbreaking projects that drive technological innovation, keeping you ahead of industry trends.

Seize the opportunity to elevate your career with us. Become a key player in our mission to transform the tech industry and be part of pioneering innovations.

1-10 employees

Java

Remote Java Application Developer

A leading US-based organization is on the lookout for experienced Java Developers.

As a Java Developer, you will be instrumental in shaping, designing, and deploying new features while working alongside cross-functional teams. The company is at the forefront of creating next-generation dialog agents, with uses in education, entertainment, and general question-answering. This opportunity is perfect for candidates who are enthusiastic about learning and developing in a fast-paced environment.

Job Responsibilities:

Develop clean, reusable, and maintainable code.
Engage in code reviews to maintain high standards of code quality.
Apply Java knowledge to all phases of development.
Produce clear, well-documented, and annotated code.
Work with cross-functional teams to shape, design, and deploy new features.

Job Requirements:

Open to candidates at all stages of their careers, from junior to senior levels.
Bachelor’s or Master’s degree in Engineering, Computer Science, or equivalent experience.
Knowledge of creating web applications using modular and scalable architectures.
Emphasis on code readability and security/stability, including testing.
Solid understanding of Java syntax and conventions.
Strong spoken and written English communication skills.
Nice to have: Experience in software Quality Assurance and Test Planning.

Interview Process:

Two internal interviews:

60-minute technical interview.
15-30 minute discussion on cultural fit and offer conditions.

Why You Should Join Us:

Work alongside globally renowned experts and expand your professional network.
Enjoy the flexibility of remote work and move away from traditional office environments.
Earn competitive salaries in USD.
Engage in groundbreaking projects that drive technological advancements, keeping you ahead of the curve.

Seize the opportunity to advance your career with us. Join our mission to innovate the tech industry and play a key role in pioneering new technologies.

1-10 employees

Java