Job Description
About Magnetic
Magnetic is building next-generation agentic AI systems to manage complex workflows at scale—starting with the $3T global supply chain and procurement industry. Our mission is to make manufacturing supply chains more resilient in a rapidly changing world through safe, responsible, and impactful use of generative AI.
Our team combines deep expertise from OpenID, NASA, McKinsey, and top AI research institutions. We’re backed by leading venture funds and committed to developing AI systems that priorities human needs, ethical deployment, and real-world impact.
The Role Data Engineer
Data Engineers at Magnetic are the foundation of our AI-driven platform. You’ll build and maintain scalable data infrastructure that powers our intelligent agents. Working across ML, platform, and product teams, you’ll turn raw supply chain data into structured, actionable insights that drive critical decisions.
This is a high-impact role involving deeply technical work with global-scale implications.
Key Responsibilities
-
Build Scalable Pipelines: Design and manage high-throughput data pipelines ingesting global supply chain data.
-
Own Data Architecture: Develop and maintain data models, schemas, and catalogues—from raw ingestion to feature stores.
-
Ensure Data Quality: Implement observability tools to monitor data completeness, latency, lineage, and quality.
-
Secure & Govern Data: Apply best practices in data encryption, access control, and compliance (GDPR, etc.).
-
Collaborate Cross-Functionally: Work closely with ML, platform, and product teams to support analytics and AI development.
-
Drive Reliability: Improve infrastructure using CI/CD, testing frameworks, cost optimization, and incident reviews.
What We’re Looking For
You’re likely a strong fit if you have:
-
Cloud Data Engineering Experience: 3+ years building pipelines in AWS or Azure, using tools like Kinesis, Redshift, EMR, Data bricks, Glue, etc.
-
Strong Programming Skills: Proficiency in Python or similar, writing clean and scalable ETL code.
-
Modern Data Stack Knowledge: Familiarity with batch/stream processing (Spark, Flunk, Beam, Kafka), orchestration tools (Airflow, Prefect, Digester).
-
Data Modeling Expertise: Experience with OLAP/OLTP design, schema evolution, data contracts, and cataloguing.
-
API & Integration Experience: Ingesting from REST/grips APIs, Kafka, file drops, SaaS platforms, and ensuring robust error handling.
-
Database Fluency: Strong knowledge of RDBMS (PostgreSQL, MySQL), NoSQL (DynamoDB, Cassandra), and data lake formats (Parquet, ORC).
-
Observability & Testing: Experience with monitoring and validation tools (e.g., Great Expectations, Monte Carlo).
-
Security Awareness: Experience with RBAC, ABAC, encryption, secrets management, and regulatory compliance.
-
CI/CD & DevOps: Comfort with Git workflows, Terraform, testing pipelines, and automated deployments.
-
Team Player: Proven collaboration with product, ML, and platform teams in fast-paced environments.
Why Join Magnetic?
-
Competitive Salary: £110,000–£120,000
-
Equity Ownership: Meaningful stock options and upside.
-
Visa Sponsorship: We support international candidates, with a preference for those already in the UK.
-
Flexible Hybrid Work: Work from our London HQ 3–4 days/week, with some remote flexibility.
-
Annual Company Retreat: All-expenses-paid offsite to recharge and connect with the team.
Diversity & Inclusion
Magnetic is an equal opportunity employer. We believe a diverse team leads to better ideas and stronger outcomes. All qualified applicants will be considered regardless of race, gender, age, disability, religion, or background. If you require accommodations during the hiring process, please let us know.