Data Engineer

A US-based company empowering brands and content creators to harness the data-science behind authentic storytelling is looking for a Data Engineer. The selected candidate will collaborate cross-functionally with the engineering, data science, product, management, and other teams. The company's AI engine assists creators in identifying relevant content partners and building brand relevance and reputation at scale through a compelling narrative. They have raised more than $3.5mn in funding so far. 

Job Responsibilities:

• Help to develop distributed data processing system using AWS
• Analyze performance and upgrade existing solutions to manage the increased load
• Build and scale architecture, and select the optimal technologies and methodologies
• Contribute to end data deployment processes from inception to consumption
• Work closely with data science engineers to provide data for ML components
• Develop best practices for data integration and streaming processes
• Help in shipping clean, maintainable, easy to support codes by following the engineering best practices like testing, documenting, rapid prototyping, providing modular and structured solutions
• Adopt an agile thinking approach and adopt changes fast
• Work with an attention to detail and passion to fully understand the pros and cons of different technologies
• Work as a good team player, clearly state your point of view and listen to others carefully
• Work with data and assist in data-driven decision-making processes
• Adopt a simplistic approach with enough knowledge to judge future requirements
• Take ownership of incidents that fall within your domain and help resolve errors or provide assistance to others for the same

Job Requirements:

• Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
• At least 4+ years of relevant experience as a Data / Back-End Engineer
• Thorough understanding of data structures and algorithms
• Must have a strong grasp over SQL and NoSQL databases, design, and data retrieval methods
• Expertise in working with languages like Java and Scala is required
• Should possess a thorough understanding of Big Data technologies and solutions like Hadoop, Spark, etc
• Ability to work with streaming services like Apache Kafka or Kinesis
• Proven experience in working with cloud services (AWS preferred)
• Knowledge of working infrastructure as a code using Terraform is preferred
• Familiarity with containerization technologies like Docker and Kubernetes will be helpful
• Knowledge of Workflow engines like Apache Airflow or similar solutions is preferred
• Ability to work with languages like Python will be a bonus