Cloud Data Engineer

Industry: Other
Company size: 51-250

Apply as Cloud Data Engineer

Check out the best jobs for March 2023here

Find remote software jobs with 400+ Turing clients

Job description

A national leader in rewards programs and loyalty solutions is looking for a Cloud Data Engineer. The engineer will be responsible for designing and developing cloud-scale data lakes. The candidate is expected to have significant experience ingesting disparate data sources, managing dataflows, and processing data into a data lakehouse environment. The company aids retail operators in building their brands, optimizing retail operations, and rewarding their customers with a suite of marketing solutions. Data engineers who are excellent at problem-solving, good at systems thinking, and can work with disparate systems to deliver quality data lakehouses, are well-suited for this position.


Job Responsibilities:

  • Design and build production data pipelines for ingesting consumptions in a big data architecture
  • Work with various AWS tools like Spark (PySpark), Glue, Hudi, Kinesis, DMS, EMR, and Lambdas for processing data.
  • Develop a Data lake on S3 with landing, raw, trusted, and curated zones
  • Configure AWS Redshift / Redshift Spectrum Data LakeHouse
  • Work on automating processes and infrastructure using Python CDK.

Job Requirements:

  • Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
  • At least 8 years of relevant experience in data engineering 
  • Experience in working with Apache Spark RDDs and building data frames along with the ability to create Spark jobs for data transformation and aggregation
  • Must be able to work withlue, PySpark, Kinesis, DMS, EMR, and Lambda
  • Knowledge of Kubernetes (EKS), AWS, Kinesis, Istio, and Jaegar is essential
  • Must possess an expertise to work with Python, Redshift/Redshift Spectrum, Athena, and also SQL
  • Understanding how to work with various file formats like Hudi, Parquet, Avro, ORC for large volumes of data
  • Experience in working with NoSQL databases like Cassandra, DocumentDB, DynamoDB is a plus
  • Should be well-versed with data warehousing, data lakes, and the data lakehouse concepts
  • Deep understanding of Git, Gitflow based workflows, and CI/CD
  • Well-versed with modern engineering best practices and design principles
  • Must have excellent communication, presentation, strongly analytical, and problem-solving skills

Interested in this job?

Apply to Turing today.

Apply now

How to become a Turing developer?

Work with the best software companies in just 4 easy steps
  1. Create your profile

    Fill in your basic details - Name, location, skills, salary, & experience.

  2. Take our tests and interviews

    Solve questions and appear for technical interview.

  3. Receive job offers

    Get matched with the best US and Silicon Valley companies.

  4. Start working on your dream job

    Once you join Turing, you’ll never have to apply for another job.


In a nutshell, Turing aims to make the world flat for opportunity. Turing is the brainchild of serial A.I. entrepreneurs Jonathan and Vijay, whose previous successfully-acquired AI firm was powered by exceptional remote talent. Also part of Turing’s band of innovators are high-profile investors, such as Facebook's first CTO (Adam D'Angelo), executives from Google, Amazon, Twitter, and Foundation Capital.

Equal Opportunity Policy

Turing is an equal opportunity employer. Turing prohibits discrimination and harassment of any type and affords equal employment opportunities to employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, age, disability status, protected veteran status, or any other characteristic protected by law.

Work full-time at top U.S. companies

Create your profile, pass Turing Tests and get job offers as early as 2 weeks.

Apply now

Apply now