Senior Data Fabric Engineer
Matchtech
Overview
In this role you will design and evolve an event-driven data fabric to support automation and AI-based systems within a defence context. You will work closely with cross-functional teams to enable governed data workflows, scalable ingestion and processing, and edge processing in DDIL environments. The position offers impact by shaping data architecture for reliable, secure operations at scale. Join a team focused on cutting-edge technology and robust data governance to meet mission-critical needs.
Pay / Benefits- Matched contribution pension with life assurance
- Generous holiday allowance
- Health Cash Plan and Private Medical Insurance
- Dental Insurance
- Employee discount portal
- Volunteering opportunities
- Design, implement, and evolve the event-driven data fabric architecture for ingestion, integration, storage, processing, metadata, governance, and access patterns
- Build and operate workflow automation to enable repeatable, governed analyst workflows
- Deliver configurable data integration via curated connectors and standard transformation patterns
- Engineer for Denied, Degraded, Intermittent, and Limited (DDIL) environments with local edge processing
- Create streaming ingestion, event pipelines, and batch/stream processing using Apache Flink and/or Apache Spark
- Implement metadata, lineage, catalogue capabilities with policy-based security and governance
- Extensive experience as a data/platform engineer on distributed production systems
- Hands-on experience with open-source data integration and streaming technologies
- Experience enabling workflow automation for technical users
- Strong understanding of data modelling fundamentals, data contracts, and schema evolution
- Experience designing for reliability, scalability, and operability
- Practical security mindset; knowledge of least privilege, auditability, and usable controls
- Open-source data integration and streaming technologies
- Data modelling fundamentals
- Schema evolution
- Distributed systems design
- Edge computing in constrained environments
- Policy-based security and governance
Reference: WJ-747_30169269