Data Engineer

A fast-growing, venture-capital company that invests in information technology and event-driven hedge funds focused primarily on the health care and consumer sectors is looking for a Data Engineer. The selected candidate will be responsible for building data pipeline infrastructure/process and upgrading the current infrastructure. The platform manages and maintains critical position and portfolio level hedges, all to mitigate basis and market risks. This is a full-time, long-term opportunity that requires at least 6 hours overlap with EST.

Job Responsibilities:

• Build data pipeline infrastructure/process
• Upgrade the current data infrastructure
• Design database and data pipeline/ETL using emerging technologies and tools
• Drive the team to develop operationally efficient analytic solutions
• Define standards, methodologies for the Data Warehousing environment

Job Requirements:

• Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
• At least 3+ years of relevant experience as a data engineer
• Proficiency in Python and its common libraries
• Knowledge of Pandas and SQL connector
• Extensive experience in parsing files and can write classes
• Experience in writing queries to dedup and performing conditional aggregations using window functions
• Familiar with popular computing engines such as EC2, EMR, and Batch
• In-depth understanding of s3, EFS, awscli, and boto3
• Understanding of ETL processes can write modular code to facilitate better unit test of each module
• Experience with Apache airflow or Docker