Senior Data Engineer

A US-based company transforming the way businesses understand, improve, and communicate the dominant threat of cybersecurity risk to audiences, is looking for a Senior Data Engineer. The engineer will be working cross-functionally with the Data Science and Product teams to implement new analytics and manage the analytic pipeline. The company is building efficient SaaS products to help businesses understand their cybersecurity risk score and transform the way organizations understand, mitigate, and communicate these risks. The company has managed to securely raise $250mn+ during their Series E round of funding. 

Job Responsibilities:

• Work with cross-functional teams to implement solutions that bring value to the customer base
• Ensure the ongoing health of core products and analyze bottlenecks 
• Automate and document software processes to reduce the burden of existing features and accelerate the development of new ones
• Be responsible for the analytic pipeline using Big Data technologies like Spark, Airflow, Scala, etc. 
• Deploy cutting-edge technologies to support the existing services, new services, and processes
• Efficiently design and implement data features in an agile environment
• Drive data projects through all stages of development
• Improve the output of the engineering team by managing quality, identifying inconsistencies, and resolving issues 

Job Requirements:

• Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
• At least 5+ years of relevant software engineering experience 
• Must have at least 3+ years of experience in Scala and Spark
• Extensive experience working with cloud environments, preferably AWS
• Prolific experience working with NoSQL databases, preferably Cassandra / Scylla
• Passionate about working in a fast-paced, complex environment
• Solid understanding of software architecture principles and patterns
• Demonstrable experience working with SQL databases, preferably Postgres
• Comprehensive experience building and maintaining data pipelines, preferably with Airflow
• Proficiency with Kafka and event-based processing will be a plus
• Excellent communication and interpersonal skills
• Prolific system design skills