Data Engineer

Industry: Business Services
Remote
Company size: 251-10K
Full-time/Part-time

Apply as Data Engineer

Check out the best jobs for November 2023here

Find remote software jobs with hundreds of Turing clients

Job description

A U.S.-based company that is using AI-powered technology to increase human productivity and automate operations around the globe, is looking for a Data Engineer. The engineer will be helping the team design, build, and maintain the mission-critical core data infrastructure and analytics platform. The company is building beautiful and useful machine learning-powered products while challenging and solving some complex problems. The company has managed to secure more than $378mn during their Series C round of funding. This position requires 3-4+ hours of overlap with the PST time zone. 

 

Job Responsibilities:

  • Build out the data infrastructure systems that can handle ever-growing volumes of data and the demands the team wants to make of it
  • Help design and build highly-available data processing pipelines that self-monitor and report anomalies
  • Shape the future of data infrastructure while improving the existing metric-driven development and machine-learning capabilities
  • Understand how to make the necessary trade-offs to ship without sacrificing quality
  • Improve the mission-critical production data pipeline, data warehouses, and data systems by designing and implementing the changes.
  • Recognize patterns and generalizations in the data flow, and automate as much as you can to boost efficiency.
  • Extend our logging and monitoring procedures to find abnormalities and problems early on and fix them
  • Create cutting-edge data and automation solutions using Python, Spark, and Flink
  • Maintain, manage, and keep an eye on the infrastructure's components, such as Kafka, Kubernetes, Spark, Flink, Jenkins, general OLAP and RDBMS databases, S3 objects buckets, and permissions
  • Boost the effectiveness, precision, and consistency of our ETL procedures

Job Requirements:

  • Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
  • At least 12+ years of relevant experience as a data engineer, software development, and/or dev-ops, SRE roles
  • 5+ years experience working with data engineering, data systems, pipeline, and stream processing
  • Extensive experience with SQL and related technologies like Redshift, PostgreSQL, MySQL, Presto, Spark SQL, and Hive
  • Proficient experience with high-level programming languages like Python, Scala, Java, Kotlin, and Go
  • Experience with CI/CD (continuous integration and deployment) and workflow management systems like Airflow, Oozie, Luigi, and Azkaban
  • Experience implementing data governance, i.e. access management policies, data retention, IAM, etc.
  • Prior experience operating in a DevOps-like capacity while working with AWS, Kubernetes, Jenkins, Terraform, etc.
  • Experience thinking about automation, alerting, monitoring, security, and other declarative infrastructure
  • Extensive experience with ETL processes and the various data stores that serve data rapidly and securely to all internal and external stakeholders
  • Experience with Kafka, Kubernetes, Python, Spark, Flink, Jenkins, general OLAP, and RDBMS databases, S3 objects buckets, and permissions
  • Prior experience with maintaining and managing Kafka is preferred
  • Nice to have some experience in maintaining and managing OLAP/HA database systems
  • Familiarity with handling Kubernetes clusters for various jobs, apps, and high throughput is desirable
  • Technical knowledge of data exchange and serialization formats such as Protobuf, Avro, or Thrift is nice to have
  • Some prior experience in either deploying and creating Spark Scala and/or Flink applications is preferred
  • Excellent English communication skills

Interested in this job?

Apply to Turing today.

Apply now

How to become a Turing developer?

Work with the best software companies in just 4 easy steps
  1. Create your profile

    Fill in your basic details - Name, location, skills, salary, & experience.

  2. Take our tests and interviews

    Solve questions and appear for technical interview.

  3. Receive job offers

    Get matched with the best US and Silicon Valley companies.

  4. Start working on your dream job

    Once you join Turing, you’ll never have to apply for another job.

Leadership

In a nutshell, Turing aims to make the world flat for opportunity. Turing is the brainchild of serial A.I. entrepreneurs Jonathan and Vijay, whose previous successfully-acquired AI firm was powered by exceptional remote talent. Also part of Turing’s band of innovators are high-profile investors, such as Facebook's first CTO (Adam D'Angelo), executives from Google, Amazon, Twitter, and Foundation Capital.

Equal Opportunity Policy

Turing is an equal opportunity employer. Turing prohibits discrimination and harassment of any type and affords equal employment opportunities to employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, age, disability status, protected veteran status, or any other characteristic protected by law.

Work full-time at top U.S. companies

Create your profile, pass Turing Tests and get job offers as early as 2 weeks.

Apply now

Apply now