Data Engineer

A rapidly-growing company on a mission to build a one-of-its-kind decentralized analytics platform is looking for a Data Engineer. The selected candidate will be in charge of building the automated, intelligent, and highly performant query planner and execution engines among other more intricate tasks. The company is harnessing the benefits of collaborative AI-powered insights to provide high-performance, tamper-proof analytics, and data. This is a great opportunity for developers who enjoy working in a fast-paced, dynamic environment. 

Job Responsibilities:

• Develop hosted cloud analytics infrastructure (Apache Spark based)
• Build an automated, smart, and highly performant query planner and execution engines
• Build new SQL features and customer-facing functionality
• Develop novel query optimization techniques for a better performance
• Build a database that’s highly parallel, efficient, and smooth
• Report to the executive and senior management

Job Requirements:

• Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
• At least 6+ years of relevant experience as a software engineer
• 6+ years experience engineering software and data platforms / enterprise-scale data warehouses
• Knowledge of open source Apache stack (especially Apache Spark, Apache Arrow, Kafka, and others) is required
• 3+ years experience with Scala and Apache Spark or Kafka is a must
• A track record of recruiting and leading technical teams 
• Great engineering fundamentals that include query planning, optimizing, and distributed data warehouse systems experience is preferred
• Nice to have a knowledge of blockchain indexing, web3 compute paradigms, Proofs, and consensus mechanism
• Required experience with rapid development cycles in a web-based environment
• Strong scripting and test automation knowledge is required
• Passionate about Web3, blockchain, decentralization, and a base understanding of how data/analytics works with this is nice to have