Developer

LoginCreate an Account

Client

Login
Hire DevelopersApply for JobsApply for Jobs

Remote Spark data engineer jobs

We, at Turing, are looking for talented remote Spark data engineers who will be responsible for cleaning, transforming, and analyzing vast amounts of raw data from various resources using Apache Spark to provide ready-to-use data to the developers and business analysts. Get a chance to work with the leading Silicon Valley companies while accelerating your career.

Apply as Spark data engineer

Check out the best jobs for November 2023here

Find remote software jobs with hundreds of Turing clients

Job description

Job responsibilities

  • Build and optimize Apache Spark ETL pipelines
  • Deliver scalable, cost-effective and flexible solutions to clients
  • Participate in iterative, end-to-end application development
  • Build and optimize Apache Spark ETL pipelines
  • Deliver scalable, cost-effective and flexible solutions to clients
  • Participate in iterative, end-to-end application development
  • Keep up with modern software development best practices and lifecycle management
  • Use ETL tools to load data from different sources into the Hadoop platform
  • Communicate regularly in an efficient manner with customers and stakeholders
  • Create Java-based Spark jobs for data transformations and aggregations
  • Conduct units tests for Spark transformations
  • Implement data processing pipelines with Spark

Minimum requirements

  • Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
  • At least 3+ years of experience data engineering (rare exceptions for highly skilled developers)
  • Expertise in established programming languages like Python, Java, Scala, etc.
  • Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
  • At least 3+ years of experience data engineering (rare exceptions for highly skilled developers)
  • Expertise in established programming languages like Python, Java, Scala, etc.
  • Mastery of Apache Spark and different Spark Frameworks/Cloud Services like Databricks, EMR, Azure HDI
  • Experience with technologies such as Storm, Apache Kafka, Hadoop, etc.
  • In-depth knowledge of Cloud (AWS, Azure) as well as CI/CD and data visualization
  • Practical experience with containerization technologies and container orchestration using Kubernetes, OpenShift, Docker, etc.
  • Knowledge of technologies like Spark and Hadoop HDFS, Hive, Hbase with deep expertise in Spark
  • Fluency in English language for effective communication
  • Ability to work full-time (40 hours/week) with a 4 hour overlap with US time zones

Preferred skills

  • Comfortable with ETL concepts, SQL (DDL, DML, procedural)
  • Hands-on experience on change capture and ingestion tools like StreamSets, Informatica
  • Strong experience in source code repositories like Git, SVN and Jenkins
  • Comfortable with ETL concepts, SQL (DDL, DML, procedural)
  • Hands-on experience on change capture and ingestion tools like StreamSets, Informatica
  • Strong experience in source code repositories like Git, SVN and Jenkins
  • Working knowledge of NRT and associated tech stack - Spark, MemSQL, etc.
  • Understands data architecture, data profiling, and data quality
  • Knowledge of data warehouse databases like Teradata, Oracle, etc.
  • Familiarity with Unix and Shell Scripting
  • Knowledge of diverse industry and tools and data warehousing technologies
  • Hands-on experience to build and administer VMs and containers
  • Working knowledge on HashiCorp Vault Consul is desirable
  • Excellent communication and organizational skills
  • Professional Certificates in AWS, RHCE, DevOps will be a plus

Interested in this job?

Apply to Turing today.

Apply now

How to become a Turing developer?

Work with the best software companies in just 4 easy steps

  1. Create your profile

    Fill in your basic details - Name, location, skills, salary, & experience.

  2. Take our tests and interviews

    Solve questions and appear for technical interview.

  3. Receive job offers

    Get matched with the best US and Silicon Valley companies.

  4. Start working on your dream job

    Once you join Turing, you’ll never have to apply for another job.

Apply now

Frequently Asked Questions

We are a Palo Alto-based 'deep' jobs platform allowing talented software developers to work with top US firms from the comfort of their homes. We are led by Stanford alumni and successful A.I. entrepreneurs Jonathan Siddharth and Vijay Krishnan.

After uploading your resume, you will have to go through the three tests -- seniority assessment, tech stack test, and live coding challenge. Once you clear these tests, you are eligible to apply to a wide range of jobs available based on your skills.

No, you don't need to pay any taxes in the U.S. However, you might need to pay taxes according to your country’s tax laws. Also, your bank might charge you a small amount as a transaction fee.

We, at Turing, hire remote developers for over 100 skills like React/Node, Python, Angular, Swift, React Native, Android, Java, Rails, Golang, PHP, Vue, among several others. We also hire engineers based on tech roles and seniority.

Communication is crucial for success while working with American clients. We prefer candidates with a B1 level of English i.e. those who have the necessary fluency to communicate without effort with our clients and native speakers.

Currently, we have openings only for the developers because of the volume of job demands from our clients. But in the future, we might expand to other roles too. Do check out our careers page periodically to see if we could offer a position that suits your skills and experience.

It is the combination of our core business model and values that makes us different from others. We provide full-time, long-term projects to remote developers whereas most of our competitors offer more freelance jobs.

No, the service is absolutely free for software developers who sign up.

Ideally, a remote developer needs to have at least 3 years of relevant experience to get hired by Turing, but at the same time, we don't say no to exceptional developers. Take our test to find out if we could offer something exciting for you.

View more FAQs

Leadership

In a nutshell, Turing aims to make the world flat for opportunity. Turing is the brainchild of serial A.I. entrepreneurs Jonathan and Vijay, whose previous successfully-acquired AI firm was powered by exceptional remote talent. Also part of Turing’s band of innovators are high-profile investors, such as Facebook's first CTO (Adam D'Angelo), executives from Google, Amazon, Twitter, and Foundation Capital.

Equal Opportunity Policy

Turing is an equal opportunity employer. Turing prohibits discrimination and harassment of any type and affords equal employment opportunities to employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, age, disability status, protected veteran status, or any other characteristic protected by law.

Work full-time at top U.S. companies

Create your profile, pass Turing Tests and get job offers as early as 2 weeks.

Apply now

Apply now