Hamburger_menu.svg

Data Engineer

Industry: Business Services
Remote
Company size: 251-10K
Full-time/Part-time

Apply as Data Engineer

Check out the best jobs for May 2024here

Find remote software jobs with hundreds of Turing clients

Job description

A U.S.-based company that is using AI-powered technology to increase human productivity and automate operations around the globe, is looking for a Data Engineer. The engineer will be helping the team design, build, and maintain the mission-critical core data infrastructure and analytics platform. The company is building beautiful and useful machine learning-powered products while challenging and solving some complex problems. The company has managed to secure more than $378mn during their Series C round of funding. This position requires 3-4+ hours of overlap with the PST time zone. 

 

Job Responsibilities:

  • Build out the data infrastructure systems that can handle ever-growing volumes of data and the demands the team wants to make of it
  • Help design and build highly-available data processing pipelines that self-monitor and report anomalies
  • Shape the future of data infrastructure while improving the existing metric-driven development and machine-learning capabilities
  • Understand how to make the necessary trade-offs to ship without sacrificing quality
  • Improve the mission-critical production data pipeline, data warehouses, and data systems by designing and implementing the changes.
  • Recognize patterns and generalizations in the data flow, and automate as much as you can to boost efficiency.
  • Extend our logging and monitoring procedures to find abnormalities and problems early on and fix them
  • Create cutting-edge data and automation solutions using Python, Spark, and Flink
  • Maintain, manage, and keep an eye on the infrastructure's components, such as Kafka, Kubernetes, Spark, Flink, Jenkins, general OLAP and RDBMS databases, S3 objects buckets, and permissions
  • Boost the effectiveness, precision, and consistency of our ETL procedures

Job Requirements:

  • Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
  • At least 12+ years of relevant experience as a data engineer, software development, and/or dev-ops, SRE roles
  • 5+ years experience working with data engineering, data systems, pipeline, and stream processing
  • Extensive experience with SQL and related technologies like Redshift, PostgreSQL, MySQL, Presto, Spark SQL, and Hive
  • Proficient experience with high-level programming languages like Python, Scala, Java, Kotlin, and Go
  • Experience with CI/CD (continuous integration and deployment) and workflow management systems like Airflow, Oozie, Luigi, and Azkaban
  • Experience implementing data governance, i.e. access management policies, data retention, IAM, etc.
  • Prior experience operating in a DevOps-like capacity while working with AWS, Kubernetes, Jenkins, Terraform, etc.
  • Experience thinking about automation, alerting, monitoring, security, and other declarative infrastructure
  • Extensive experience with ETL processes and the various data stores that serve data rapidly and securely to all internal and external stakeholders
  • Experience with Kafka, Kubernetes, Python, Spark, Flink, Jenkins, general OLAP, and RDBMS databases, S3 objects buckets, and permissions
  • Prior experience with maintaining and managing Kafka is preferred
  • Nice to have some experience in maintaining and managing OLAP/HA database systems
  • Familiarity with handling Kubernetes clusters for various jobs, apps, and high throughput is desirable
  • Technical knowledge of data exchange and serialization formats such as Protobuf, Avro, or Thrift is nice to have
  • Some prior experience in either deploying and creating Spark Scala and/or Flink applications is preferred
  • Excellent English communication skills

Interested in this job?

Apply to Turing today.

Apply now

Why join Turing?

Elite US Jobs

1Elite US Jobs

Turing’s developers earn better than market pay in most countries, working with top US companies.
Career Growth

2Career Growth

Grow rapidly by working on challenging technical and business problems on the latest technologies.
Developer success support

3Developer success support

While matched, enjoy 24/7 developer success support.

Developers Turing

Read Turing.com reviews from developers across the world and learn what it’s like working with top U.S. companies.
4.6OUT OF 5
based on developer reviews as of April 2024

How to become a Turing developer?

Work with the best software companies in just 4 easy steps
  1. Create your profile

    Fill in your basic details - Name, location, skills, salary, & experience.

  2. Take our tests and interviews

    Solve questions and appear for technical interview.

  3. Receive job offers

    Get matched with the best US and Silicon Valley companies.

  4. Start working on your dream job

    Once you join Turing, you’ll never have to apply for another job.

Resume

Learn how to create a perfect resume

Turing.com lists out the do’s and don’ts behind a great resume to help you find a top remote software developer job.

Frequently Asked Questions

We are a Palo Alto-based 'deep' jobs platform allowing talented software developers to work with top US firms from the comfort of their homes. We are led by Stanford alumni and successful A.I. entrepreneurs Jonathan Siddharth and Vijay Krishnan.

After uploading your resume, you will have to go through the three tests -- seniority assessment, tech stack test, and live coding challenge. Once you clear these tests, you are eligible to apply to a wide range of jobs available based on your skills.

It is the combination of our core business model and values that makes us different from others. We provide full-time, long-term projects to remote developers whereas most of our competitors offer more freelance jobs.

No, the service is absolutely free for software developers who sign up.

We, at Turing, hire remote developers for over 100 skills like React/Node, Python, Angular, Swift, React Native, Android, Java, Rails, Golang, PHP, Vue, among several others. We also hire engineers based on tech roles and seniority.

Communication is crucial for success while working with American clients. We prefer candidates with a B1 level of English i.e. those who have the necessary fluency to communicate without effort with our clients and native speakers.

View more FAQs

Latest posts from Turing

Leadership

In a nutshell, Turing aims to make the world flat for opportunity. Turing is the brainchild of serial A.I. entrepreneurs Jonathan and Vijay, whose previous successfully-acquired AI firm was powered by exceptional remote talent. Also part of Turing’s band of innovators are high-profile investors, such as Facebook's first CTO (Adam D'Angelo), executives from Google, Amazon, Twitter, and Foundation Capital.

Equal Opportunity Policy

Turing is an equal opportunity employer. Turing prohibits discrimination and harassment of any type and affords equal employment opportunities to employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, age, disability status, protected veteran status, or any other characteristic protected by law.

Explore remote developer jobs

Check out the best jobs for May 2024here

Work full-time at top U.S. companies

Create your profile, pass Turing Tests and get job offers as early as 2 weeks.