Data Engineer

A US-based company that is using AI and ML technologies to predict the outcome of legal litigations, is looking for a Data Engineer. The selected candidate will lead a team that owns the AI self-service portal and the related set of microservices. The company provides customers with the necessary data and insights to make smart and informed decisions on the most important legal issues facing their organizations. This is the perfect opportunity for developers who thrive in a fast-paced environment where the solutions aren’t predefined. 

Job Responsibilities:

• Work directly with product owners and data experts to build products that solve complex client problems
• Build and support a distributed platform supporting all the existing data
• Work across the product, primarily on the data pipelines
• Interface directly with internal teams
• Evaluate software, implementation options, and document them for technical teams
• Work with data analysts to collect insight on possible data collection efficiencies and identify automation potential for manual workflows
• Integrate best qualitative practices in program design and development
• Develop technical architectures and specific implementations to meet business needs
• Guide the team’s software engineering best practices by documenting standards and completing code reviews
• Troubleshoot new and existing code and provide feedback/solutions to structural issues in the codebase as they arise
• Advise on the feasibility of nonfunctional requirements and ensure the successful implementation of features while meeting those requirements

Job Requirements:

• Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
• At least 3+ years of relevant experience as a data engineer
•  3+ years of knowledge of Spark, Python, or Scala
• 3+ years experience with RDBMS, T-SQL, NoSQL, and DataLakes
• Strong familiarity with map/reduce programming models
• Familiarity with Power BI Embedded, .NET Core, JavaScript/TypeScript, HTML5, and CSS3 is nice to have
• Proficiency in writing production-quality code
• Prior experience working with Azure cloud and Databricks
• Deep expertise in database schema design, optimization, and scalability
• Experience with Azure or AWS cloud-based service-oriented architecture
• Solid understanding of testing pyramid (unit, integration, black box, service)
• Experience working in an Agile/Scrum environment
• Strong analytical and problem-solving skills
• Good time management and organizational skills
• Ability to work on challenging issues independently or in a team environment
• Ability to learn and adapt quickly to new technologies and environments
• Strong communication skills