Senior Data Engineer

A U.S.-based company that is developing a live learning platform to connect students and professionals with specialized training for any subject, on demand, is looking for a Senior Data Engineer. The engineer will be responsible for improving the queries, tables, and indexes. The company's purpose-built proprietary platform connects students of all ages with subject matter experts while providing outstanding value on both sides of the network using technology, including ML and AI. The company was able to raise more than $105mn in their Series C funding. This position requires 6+ hours of overlap with the EST/PST time zones. 

Job Responsibilities:

• Take charge of designing and managing replication between various databases
• Advice on designing transactional databases for operational systems
• Address disaster recovery, high availability, and effective cluster sizing
• Utilize AWS RDS to manage our MySQL and PostgreSQL relational databases
• Manage our Redshift-based data warehouse and AWS DynamoDB tables
• Manage and automate safe database access for both people and machines.
• Take charge of building Redshift reporting tables 
• Using Kafka, create data eventing streams and ingestion pipelines
• Observe planned batch data jobs
• Establish and implement data governance throughout the ecosystem
• Configure databases automatically using infrastructure as code

Job Requirements:

• Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
• At least 3+ years of relevant experience as a data engineer
• Demonstrable experience working with RDBMS, Terraform, and Ansible
• Prolific experience with Puppet, Chef, and Data Warehousing
• Some knowledge of NoSQL, ETL, Big Data, and AWS is desirable
• In-depth knowledge of logical and physical database modeling
• Strong experience with Relational DBMS like MySQL/PostgreSQL/MS SQL/Oracle
• Familiarity working with SQL query design, optimization
• Extensive experience with Data Warehousing technologies like Redshift, Snowflake, etc.
• Solid understanding of Source code management technologies like Git/scm/mercurial/subversion
• Prior working knowledge of configuration like Terraform, CloudFormation, Puppet, Chef, or Ansible
• In-depth knowledge of software development technologies
• Nice to have some NoSQL technology experience including DynamoDB, MongoDB, Cassandra, Redis, HBase, or Cosmos
• Prior experience with Big Data like BigQuery/Hadoop/Spark/Presto is desirable
• Strong tiered data storage design experience is preferred
• Familiarity with Eventing technologies like Kafka (MSK, Confluent), SQS, and RabbitMQ is nice to have
• Some understanding of ETL technologies like Airflow, Pentaho, Upsolver, Blendo, and Etleap is desirable
• Nice to have some knowledge of programming languages like Python/Go/Ruby and reporting technologies like Looker, Tableau, Crystal, etc.
• Some understanding of how different ORMs convert code into SQL is preferred
• In-depth knowledge of Containerization technologies like Docker as well as AWS Services like RDS, Lambda, Kinesis, DMS, and Batch, is desirable
• Solid understanding of AWS IAM is nice to have
• Excellent spoken and written English communication skills