Data Engineer

A U.S.-based company designing a unified platform for digital threat mitigation that makes cybersecurity seamless for everyone is looking for a Data Engineer. The selected candidate will be responsible for improving and updating the system that powers the analytics and data products. Customers are able to manage various cybersecurity requirements with simplicity and optimum efficacy thanks to the company's cutting-edge technologies. The company has managed to raise $450mn+ during their Series F round of funding. This position requires 4-5+ hours of overlap with the ET time zone. 

Job Responsibilities:

• Create, implement, and maintain scalable pipelines (scaling in both volume and variety of data sources)
• Develop best practices and frameworks for unit, functional, and integration tests for the team's test coverage and automation
• Promote data quality throughout the organization
• Set and maintain SLAs for production-ready data sets and processes
• Participate in improving the data governance
• Create prototypes of new data engineering technology and evaluate, suggest, and propose it
• Participate in peer code evaluations and discussions of technical architecture
• Maintain documentation for all data engineering processes

Job Requirements:

• Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
• At least 5+ years of relevant experience as a data engineer
• Prolific experience working with AWS, Python, SQL, and Spark
• Extensive experience with Airflow, Databricks, CI/CD, and API integration & ingestion
• Some knowledge of Scala, Terraform, and Kafka is desirable
• Nice to have some experience with containers
• Experience working with modern, cloud-hosted tech stacks, and Distributed Computing
• Demonstrable experience in architecting, designing, and deploying high-performance systems with reliable monitoring and logging practices
• Strong English communication skills 
• Ability to work asynchronously across multiple time zones
• Knowledge of version control and the command line
• Experience working with third-party APIs for ingestion and integration
• Nice to have some knowledge of container services like Docker and Kubernetes
• Experience with Stream-processing systems (Kafka, or equivalent) is desirable
• Knowledge of infrastructure as Code tools like Terraform is nice to have