Data Engineer

A US-based company that connects beauty and wellness professionals virtually to clients, is looking for a Data Engineer. The developer will be collaborating with different teams for various project-related tasks. The company enables professionals to showcase their businesses and talents while enabling customers to discover new services, providers, and book appointments online. The company has managed to raise more than $35mn during their Series C round of funding. This role requires a 6+ hours overlap with the PST time zone and will be a full-time, long-term position.

Job Responsibilities:

• Contribute to new and existing Data and Infrastructure projects
• Should have an interest in Big Data technologies and services
• Develop and further develop Big Data processing pipelines for data sources containing structured and unstructured data
• Work on monitoring and optimizing  key infrastructure components like Databases, EC2 Clusters, Containers, and other aspects of the stack
• Actively try to implement best practices for Big Data development
• Function as a bridge between the Data Engineering department and the wider engineering organization
• Actively collaborate with Data Analytics and Data Science teams
• Adopt an agile approach for business users, data analysts, and data scientists for understanding and discovering the potential business value of new and existing Data Sets 
• Work on analyzing requirements and architecture specifications for creating detailed designs
• Keep researching on areas of interest help facilitate better solutions

Job Requirements:

• Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
• Must have at least 5 years of experience in back-end development using Python and other scripting languages
• Must possess a thorough knowledge of Python in a functional and modular capacity
• At least 2 years of experience working with AWS Data Infrastructure, including RDS, RedShift & S3
• Ability to design, develop, and own ETL pipelines building processes for delivering data with measurable quality under a pre-defined SLA
• Ability to build data pipelines in a high-ingestion environment utilizing different data infrastructure technologies
• Experience working with in-demand technologies like SQL to scale and optimize schemas, and performance-tuned ETL pipelines
• Extensive experience working with AWS Lambda and Docker
• Familiarity with technologies like Kinesis, RedShift, and more would be an added advantage
• The developer should be fluent in English to communicate efficiently with teammates and other stakeholders
• Should be able to monitor metrics and analyze data while partnering with team members to resolve critical problems
• Familiarity with data streaming technologies like Spark, Storm, and Flink along with message queue systems like Kafka and Kinesis will be a bonus advantage
• Familiarity with a message or file formats like Parquet, Avro, and Protocol Buffer would be a bonus
• Ability to work with Redis, Cassandra, MongoDB, or similar NoSQL databases is preferred