Senior Data Engineer

A well-established company that is providing state-of-the-art retail and institutional brokerage services to clients is looking for a Senior Data Engineer. The engineer will be working with system owners to develop, construct, and maintain data pipelines for various data sources. The company is building an innovative multi-asset trading platform that enables users to monitor, grow, and access their investments. This is an exciting opportunity for developers who are determined to break the mold and work with cutting-edge technologies. 

Job Responsibilities:

• Learn how to use Synapse, Databricks, Azure Events Hub, and Azure Data Lake, and contribute to the development of a data analytics platform and support that makes data sharing and access simple and standardized
• Demonstrate your ability to ingest and transform real-time data to serve our use cases
• Integrate governance, quality data capabilities, and technologies to ensure data consistency
• Ensure the transformation backlog is delivered for source systems, derived tables, and data products
• Work together with other senior and lead engineers to produce new products and support BAU activities
• Perform detailed data analysis and report results
• Debug BAU-related issues, create JIRA issues, and work on process improvement
• Support your ideas and share your knowledge with your teammates
• Participate in on-call situations to assist with any catastrophic failures
• Take part in the on-call schedule for production support
• Ensure that Ad hoc data requests and production difficulties are supported

Job Requirements:

• Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
• At least 8+ years of relevant experience as a data engineer
• 8+ years of experience working with Azure Databricks
• 5+ years of experience with SQL and Spark
• 9+ years of relevant experience working in the trading/financial services industry
• Familiarity working with ETL, Python, and Azure Data Lake is desirable
• Nice to have some experience working with PySpark and Azure Eventhub 
• Some Data Engineering certification like Azure Data Engineer or Google Certified Professional, is preferred
• Excellent design skills for data pipelines, ETL processes, data warehousing, and big data processing
• Possess practical knowledge of Azure Synapse and Azure SQL
• Extensive Python framework programming experience 
• Prior experience with business data processing and analytics systems.
• some familiarity with the fundamentals of enterprise data modeling
• In-depth knowledge of real-time development
• Excellent political knowledge, and communication abilities
• Outstanding ability to determine priorities 
• Excellent debugging and problem-solving abilities
• Fluent in spoken and written English