Data Engineer
Industry: Business Services
Remote
Company size: 251-10K
Full-time/Part-time
Check out the best jobs for April 2024here
Find remote software jobs with hundreds of Turing clients
Job description
A U.S.-based company that is using AI-powered technology to increase human productivity and automate operations around the globe, is looking for a Data Engineer. The engineer will be helping the team design, build, and maintain the mission-critical core data infrastructure and analytics platform. The company is building beautiful and useful machine learning-powered products while challenging and solving some complex problems. The company has managed to secure more than $378mn during their Series C round of funding. This position requires 3-4+ hours of overlap with the PST time zone.
Job Responsibilities:
- Build out the data infrastructure systems that can handle ever-growing volumes of data and the demands the team wants to make of it
- Help design and build highly-available data processing pipelines that self-monitor and report anomalies
- Shape the future of data infrastructure while improving the existing metric-driven development and machine-learning capabilities
- Understand how to make the necessary trade-offs to ship without sacrificing quality
- Improve the mission-critical production data pipeline, data warehouses, and data systems by designing and implementing the changes.
- Recognize patterns and generalizations in the data flow, and automate as much as you can to boost efficiency.
- Extend our logging and monitoring procedures to find abnormalities and problems early on and fix them
- Create cutting-edge data and automation solutions using Python, Spark, and Flink
- Maintain, manage, and keep an eye on the infrastructure's components, such as Kafka, Kubernetes, Spark, Flink, Jenkins, general OLAP and RDBMS databases, S3 objects buckets, and permissions
- Boost the effectiveness, precision, and consistency of our ETL procedures
Job Requirements:
- Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
- At least 12+ years of relevant experience as a data engineer, software development, and/or dev-ops, SRE roles
- 5+ years experience working with data engineering, data systems, pipeline, and stream processing
- Extensive experience with SQL and related technologies like Redshift, PostgreSQL, MySQL, Presto, Spark SQL, and Hive
- Proficient experience with high-level programming languages like Python, Scala, Java, Kotlin, and Go
- Experience with CI/CD (continuous integration and deployment) and workflow management systems like Airflow, Oozie, Luigi, and Azkaban
- Experience implementing data governance, i.e. access management policies, data retention, IAM, etc.
- Prior experience operating in a DevOps-like capacity while working with AWS, Kubernetes, Jenkins, Terraform, etc.
- Experience thinking about automation, alerting, monitoring, security, and other declarative infrastructure
- Extensive experience with ETL processes and the various data stores that serve data rapidly and securely to all internal and external stakeholders
- Experience with Kafka, Kubernetes, Python, Spark, Flink, Jenkins, general OLAP, and RDBMS databases, S3 objects buckets, and permissions
- Prior experience with maintaining and managing Kafka is preferred
- Nice to have some experience in maintaining and managing OLAP/HA database systems
- Familiarity with handling Kubernetes clusters for various jobs, apps, and high throughput is desirable
- Technical knowledge of data exchange and serialization formats such as Protobuf, Avro, or Thrift is nice to have
- Some prior experience in either deploying and creating Spark Scala and/or Flink applications is preferred
- Excellent English communication skills
Interested in this job?
Apply to Turing today.
Why join Turing?
1Elite US Jobs
Turing’s developers earn better than market pay in most countries, working with top US companies.
2Career Growth
Grow rapidly by working on challenging technical and business problems on the latest technologies.
3Developer success support
While matched, enjoy 24/7 developer success support.
How to become a Turing developer?
Work with the best software companies in just 4 easy steps
Create your profile
Fill in your basic details - Name, location, skills, salary, & experience.
Take our tests and interviews
Solve questions and appear for technical interview.
Receive job offers
Get matched with the best US and Silicon Valley companies.
Start working on your dream job
Once you join Turing, you’ll never have to apply for another job.
Learn how to create a perfect resume
Turing.com lists out the do’s and don’ts behind a great resume to help you find a top remote software developer job.
Frequently Asked Questions
What is Turing?
How many rounds do I need to clear before selection?
How is Turing different from other remote based job providers?
Do developers need to pay any fees for Turing's services?
What kind of developers does Turing hire?
What level English is necessary to get a job?
Latest posts from Turing
Leadership
In a nutshell, Turing aims to make the world flat for opportunity. Turing is the brainchild of serial A.I. entrepreneurs Jonathan and Vijay, whose previous successfully-acquired AI firm was powered by exceptional remote talent. Also part of Turing’s band of innovators are high-profile investors, such as Facebook's first CTO (Adam D'Angelo), executives from Google, Amazon, Twitter, and Foundation Capital.
Equal Opportunity Policy
Turing is an equal opportunity employer. Turing prohibits discrimination and harassment of any type and affords equal employment opportunities to employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, age, disability status, protected veteran status, or any other characteristic protected by law.
Explore remote developer jobs
Check out the best jobs for April 2024here