Are you an experienced Backend Data Engineer who wants to work at the cutting edge of engineering sustainability?
Our client is on a mission to empower engineers to use AI to overcome their most difficult physics and design challenges and build truly great products. With strong product-market fit, this company has doubled in size over the last four years, are growing globally (50 employees and counting), and have ambitious plans to expand.
In light of this, they are recruiting a Backend Data Engineer to continue their growth and improve the capabilities of their products.
This well-funded company was founded in 2016, and provides a no-code AI platform to engineers to help them improve and accelerate the process of design and development. Their current clients include Siemens, Honeywell, Michelin and Mercedes-Benz. The company has grown steadily year on year and fosters a passionate, engaging and collaborative culture. They are proud to be an equal opportunity employer, valuing diversity and inclusion. The company's office is based in London Bridge and most employees are in the office 2-3 days per week.
• **We are considering candidates who want to be on-site (1-2 days per week) AND fully remote candidates across the UK and Europe***
• **Candidates must speak fluent English and not require sponsorship from an employer to live & work in their current country***
The Backend Data Engineer will sit within the Data Science team. As part of this team, you’ll be at the forefront of innovation, working with their Modern Data Stack which includes a scale-out Engine (Trino), general-purpose distributed compute (Spark), and ad-hoc containerized compute. They utilize an S3 data lake and are soon incorporating dbt and Airbyte. Their cloud-agnostic architecture runs on AWS, with plans to expand to Azure, GCP and on-prem.
TECH STACK:
• Programming languages: Python, Flask, React
• Databases & Storage: Redis, Postgres, AWS Athena SQL, Athena & EMR Spark, ECS Fargate,
• Azure Synapse/Data Lake Analytics, HDInsight
• Tools & Platforms: Docker, Temporal, Plotly
KEY RESPONSIBILITIES
• Design and implement mid-to-low level data engineering systems
• Deliver hands-on implementation using various components of the data stack
• Foster a culture of best practices in modularity, scalability, version control and observability
• Break down complex data engineering practices into manageable tasks
• Proactively identify and address blockers within the team
• Provide thoughtful decision-making and clear communication around trade-offs and priorities
REQUIREMENTS
• 5-7 years’ experience as either a Backend Engineer or Data Engineer (at least 3 years as a Data Engineer)
• Proficiency in Python and SQL
• Experience with data-intensive products, either in terms of volume (Big Data) or workload
• scale
• Proven experience with data lakes/warehouses/lakehouses on cloud platforms (AWS, Azure,
• GCP)
• Proven ability to build scalable data pipelines
• Familiarity with modern workflow managers (eg. Airflow, Prefect, Dagster, Temporal)
• Ability to work autonomously whilst aligning with product requirements
• Excellent communication skills – capable of interacting with colleagues at all levels
• Strong focus on identifying and progressing on critical paths, both independently and as part of a team
PREFERRED BUT NOT REQUIRED:
• Experience with Spark or dbt
• Experience in deploying production systems on multiple cloud platforms
• Familiar with MLOps principles and practices in a production setting
COMPENSATION/BENEFITS:
• Competitive salary + equity
• 30 days annual leave + UK bank holidays
• Learning Budget of £500 per year, through Sunlight
• Pension with NEST
• Vitality health insurance
• Wellness budget of £40 per month through Heka
• A day off to volunteer per year
Please apply today or get in touch for more info! kelly@highersearch.co
Location: United Kingdom
Posted: Aug. 15, 2024, 9:03 p.m.
Apply Now Company Website