Data Engineer

A US-based modern API platform that delivers real-time verifications and powerful automation is looking for a Data Engineer. The selected candidate will be tasked with taking disparate data and making it useful while understanding database and storage technologies. The company is building an all-in-one platform that enables professionals to manage their data and workflows with their advanced network management solutions. They have managed to raise more than $18mn during their Series A round of funding. This will be a long-term, full-time role requiring some overlap with the EST time zone. 

Job Responsibilities:

• Partner with product and application engineering to build the data infrastructure to support the company’s new data platform
• Keep the management and technical support teams informed about the workflow
• Lay the architecture of new projects as well as select the associated tech stack 
• Lead the data engineering team and elevate their functionality to the next level
• Implement data solutions addressing a disparate set of business problems from entity resolution and data matching to business intelligence
• Document plan and features for other members of the team to use

Job Requirements:

• Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
• At least 8+ years of relevant experience as a data engineer
• Demonstrable experience working with Python, Java, and Spark
• Prolific experience with Bash, SQL, and Terraform
• Nice to have some knowledge of Kafka, CI/CD, and C++
• Familiarity with serverless solutions in AWS
• Expertise and industry experience working with data warehouses, data lakes, and reporting tools
• Experience building data pipelines and streaming/processing large amounts for product-oriented ETL asks
• Experience with Data matching, entity resolution, and de-dupe techniques
• Eager to research and try out new technologies