Senior Data Engineer

A U.S.-based company that operates a successful sports platform where users can watch videos, highlights, and replays of national amateur sports, is looking to hire a Senior Data Engineer. The engineer will be responsible for building data pipelines, organizing/preparing company data, and analyzing extracted data to enhance business outcomes and streamline operations. The company is revolutionizing sports broadcasting by allowing users unhindered access to amateur sports, athletes access to an array of game footage, and professional scouts the opportunity to recruit rookies and teams. This company has raised $1.3 Million in its series A funding round. 

Job Responsibilities:

• Develop and implement Python and C++ solutions using pre-existing Python and Bash scripts
• Manage AWS autoscaling instances and update them in collaboration with the engineering team
• Maintain a data-labeling pipeline and ensure the completion of data collection
• Collaborate with the offshore labeling team and provide necessary scripts as needed
• Ingest labeled data into Dolt
• Enhance and maintain the video streaming pipeline
• Interact with the SQL/Redshift database, managing tables, writing queries, and ensuring smooth data flow
• Work with the QA manager to implement QA best practices 
• Conduct data analysis for both the engineering team and other departments

Job Requirements:

• Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
• At least 3+ years of relevant experience as a Data Engineer
• Expert-level skills in Linux, Python, and Bash scripting
• Thorough understanding of FFmpeg and video pipelining processes (streaming servers, video players, SRT/RTMP) is a bonus
• Familiarity with SQL (PostgreSQL, Redshift), Dolt, and CUDA is a plus
• Previous experience with AWS (EC2, S3) or other cloud computing/storage services is advantageous
• Excellent communication skills and the ability to collaborate effectively with diverse individuals
• Strong inclination to understand ongoing projects and share insights
• Good English communication skills