Remote Spark developer jobs

We, at Turing, are looking for talented remote Spark developers who will be responsible for cleaning, transforming, and analyzing vast amounts of raw data from various resources using Spark to provide ready-to-use data to the developers and business analysts. Here’s your chance to accelerate your career by working for top Silicon Valley companies.

Apply as Spark developer

Check out the best jobs for June 2023here

Find remote software jobs with hundreds of Turing clients

Job description

Job responsibilities

  • Create Scala/Spark jobs for data transformation and collection
  • Process huge amounts of unstructured and structured data
  • Write unit tests for data transformation
  • Create Scala/Spark jobs for data transformation and collection
  • Process huge amounts of unstructured and structured data
  • Write unit tests for data transformation
  • Install, configure and maintain enterprise Hadoop environment
  • Assign schemas using Hive tables and deploy HBase clusters
  • Design data processing pipelines
  • Use ETL tools to load data from different sources into the Hadoop platform
  • Develop and review technical documentation
  • Maintain the security and privacy of Hadoop clusters

Minimum requirements

  • Bachelor’s/Master’s degree in computer science (or equivalent experience)
  • 3+ years of experience working on Spark-based applications (rare exceptions for highly skilled developers)
  • Experience working on complex, large-scale big data environments
  • Bachelor’s/Master’s degree in computer science (or equivalent experience)
  • 3+ years of experience working on Spark-based applications (rare exceptions for highly skilled developers)
  • Experience working on complex, large-scale big data environments
  • Hands-on experience in Hive, Yarn, HDFS, HBase, etc.
  • Experience with technologies such as Storm, Apache Kafka, Hadoop, etc.
  • Well-versed in programming languages like Scala, Java, or Python
  • Experience in working in ETL products, like Ab Initio, Informatica, Data Stage, etc.

Preferred skills

  • Expertise in writing complex SQL queries, importing and exporting vast amounts of data using utilities
  • Ability to write abstracted, reusable code components
  • Communicate and coordinate across various teams
  • Expertise in writing complex SQL queries, importing and exporting vast amounts of data using utilities
  • Ability to write abstracted, reusable code components
  • Communicate and coordinate across various teams
  • A good team player with a strong attention to detail

Interested in this job?

Apply to Turing today.

Apply now

How to become a Turing developer?

Work with the best software companies in just 4 easy steps

  1. Create your profile

    Fill in your basic details - Name, location, skills, salary, & experience.

  2. Take our tests and interviews

    Solve questions and appear for technical interview.

  3. Receive job offers

    Get matched with the best US and Silicon Valley companies.

  4. Start working on your dream job

    Once you join Turing, you’ll never have to apply for another job.

Apply now

Frequently Asked Questions

A Spark developer works on cleaning, transforming, and analyzing huge amounts of raw data from different resources to prepare ready-to-use data for development and analysis purposes. It helps in both ad-hoc requests and also data-pipelines that are embedded in the production environment.

We, at Turing, hire remote developers for over 100 skills like React/Node, Python, Angular, Swift, React Native, Android, Java, Rails, Golang, PHP, Vue, among several others. We also hire engineers based on tech roles and seniority.

Communication is crucial for success while working with American clients. We prefer candidates with a B1 level of English i.e. those who have the necessary fluency to communicate without effort with our clients and native speakers.

Spark developers can work on a wide variety of projects. Using the Spark core data processing engine, you also get access to libraries for SQL, ML, Graph computation and stream processing which can all be used together in applications.

It is the combination of our core business model and values that makes us different from others. We provide full-time, long-term projects to remote developers whereas most of our competitors offer more freelance jobs.

No, the service is absolutely free for software developers who sign up.

We are a Palo Alto-based 'deep' jobs platform allowing talented software developers to work with top US firms from the comfort of their homes. We are led by Stanford alumni and successful A.I. entrepreneurs Jonathan Siddharth and Vijay Krishnan.

After uploading your resume, you will have to go through the three tests -- seniority assessment, tech stack test, and live coding challenge. Once you clear these tests, you are eligible to apply to a wide range of jobs available based on your skills.

No, you don't need to pay any taxes in the U.S. However, you might need to pay taxes according to your country’s tax laws. Also, your bank might charge you a small amount as a transaction fee.

View more FAQs

Leadership

In a nutshell, Turing aims to make the world flat for opportunity. Turing is the brainchild of serial A.I. entrepreneurs Jonathan and Vijay, whose previous successfully-acquired AI firm was powered by exceptional remote talent. Also part of Turing’s band of innovators are high-profile investors, such as Facebook's first CTO (Adam D'Angelo), executives from Google, Amazon, Twitter, and Foundation Capital.

Equal Opportunity Policy

Turing is an equal opportunity employer. Turing prohibits discrimination and harassment of any type and affords equal employment opportunities to employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, age, disability status, protected veteran status, or any other characteristic protected by law.

Work full-time at top U.S. companies

Create your profile, pass Turing Tests and get job offers as early as 2 weeks.

Apply now

Apply now