Data Pipeline Engineer

Industry: Advertising
Remote
Company size: 251-10K
Full-time

Apply as Data Pipeline Engineer

Check out the best jobs for September 2023here

Find remote software jobs with hundreds of Turing clients

Job description

A US-based company that is providing businesses with world-class next-gen data-oriented media solutions is looking for a Data Pipeline Engineer. The engineer will be in charge of improving the scalability, service reliability, and performance of the existing platform. The company's innovative technology enables clients to more effectively target and connect with their target audiences. This position requires at least 4 hours of overlap with the EST time zone. 

 

Job Responsibilities:

  • Aggregate data from both internal and external data sources to build a data processing system 
  • Create new pipelines and build reusable components at scale to support reporting & analytics data products
  • Write complex queries to transform raw data sources into accessible models by coding 
  • Clean, prepare and optimize data at scale for integration and consumption
  • Implement data management projects and re-structure of current web architecture
  • Implement automated workflow using workflow scheduling processes like apache airflow
  • Solve complex data issues and perform root cause analysis to proactively resolve product issues
  • Own the data pipeline and support systems failure
  • Collaborate with relevant stakeholders taking learning and leadership opportunities

Job Requirements:

  • Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
  • At least 5+ years of relevant experience as a software engineer
  • Extensive experience in Python, SQL, AWS, Airflow, or Glue
  • Nice to have experience in Elasticsearch or Apache Druid, Kafka and Parquet, or Avro
  • A minimum of 3+ years of experience in SQL, Python, and Bash in a data-focused role
  • At least 3+ years of proven experience in engineering complex data pipelines with low latency and redundancy
  • Must have 3+ years of experience building cloud scalable and high-performance data warehouse solutions using AWS products, including S3, Athena, Redshift, EMR
  • Exposure to open source and proprietary cloud data pipeline tools such as Airflow and Glue
  • Solid understanding of data structures and algorithms
  • Understanding of code versioning tools such as Git
  • Passionate about data solutions
  • Nice to have familiarity with other distributed data stores (Elasticsearch, Apache Druid)
  • Familiarity with streaming data experience with Kafka
  • Demonstrable experience with binary data serialization formats such as Parquet, Avro
  • Fluent in verbal and written English

Interested in this job?

Apply to Turing today.

Apply now

How to become a Turing developer?

Work with the best software companies in just 4 easy steps
  1. Create your profile

    Fill in your basic details - Name, location, skills, salary, & experience.

  2. Take our tests and interviews

    Solve questions and appear for technical interview.

  3. Receive job offers

    Get matched with the best US and Silicon Valley companies.

  4. Start working on your dream job

    Once you join Turing, you’ll never have to apply for another job.

Leadership

In a nutshell, Turing aims to make the world flat for opportunity. Turing is the brainchild of serial A.I. entrepreneurs Jonathan and Vijay, whose previous successfully-acquired AI firm was powered by exceptional remote talent. Also part of Turing’s band of innovators are high-profile investors, such as Facebook's first CTO (Adam D'Angelo), executives from Google, Amazon, Twitter, and Foundation Capital.

Equal Opportunity Policy

Turing is an equal opportunity employer. Turing prohibits discrimination and harassment of any type and affords equal employment opportunities to employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, age, disability status, protected veteran status, or any other characteristic protected by law.

Work full-time at top U.S. companies

Create your profile, pass Turing Tests and get job offers as early as 2 weeks.

Apply now

Apply now