Data Engineer ETL

A US-based tech startup harnessing cutting-edge technology to quickly generate and evaluate market ideas is looking for a Data Engineer ETL. The developer will be collaborating extensively with data scientists to support various experiments. The company's revolutionary machine learning algorithms detect patterns and connections and pave the way for the development of tools and techniques that allow computers to evaluate and generate insights into pressing problems. This will be a long-term, full-time role that requires an overlap of 4+ hours with the PST time zone. It is a great opportunity for developers with relevant ETL expertise and keen on setting up tools that others will rely on.

Job Responsibilities:

• Write well-documented, testable code and pay close attention to data integrity
• Analyze and organize raw data
• Build up a consistent data lake with staged, ready-to-use data
• Build data pipelines
• Prepare data for predictive modeling
• Build up various scripts that will serve as blueprints for various additional data ingestion 
• Explore ways to enhance data quality and reliability
• Improve existing features by identifying possible lag in performance
• Participate in all aspects of the company contribute to the roadmap

Job Requirements:

• Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
• At least 3+ years of relevant experience as a Data Engineer ETL
• Extensive experience working with PySpark, AWS Glue, S3, and Athena
• Familiar with staging data in parquet formats on S3
• Fluent in English communication
• The capability to function without hand-holding and micromanagement
• Great interpersonal and organizational skills