AI Validation Specialist

The Court’s mission

The Court of Justice of the European Union (CJEU) lies at the heart of European justice. As the judicial authority of the Union, it works in close collaboration with national jurisdictions of the Member States to ensure the consistent interpretation and application of the EU Treaties and law. As an employer, the CJEU strives for excellence and values multilingualism, inclusiveness, diversity, and collaboration.

Who will be your team?

The main mission of the Information Technology Directorate (ITD) is to define, based on the institution's orientations and priorities, the information technology strategies to be initiated, and to develop a modern, state-of-the-art infrastructure in the fields of computing, telecommunications, and multimedia.
The Information Systems Design unit is responsible for innovation, as well as the study and analysis of the solutions to be implemented. This unit also includes an innovation laboratory that handles Artificial Intelligence (AI) projects.

What impact will you make?

We are looking for an AI validation specialist who will help us ensure cutting-edge, reliable, and secure technological solutions for the institution. In this role, you will be required to:

• Rigorously verify the reliability, security, and compliance of the AI tools developed for the Court against the institution’s complete set of requirements, especially those pertaining to technical, legal, and ethical standards.
• Designing and executing relevant test scenarios to assess system performance, with a particular focus on Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) solutions.
• Proactively detecting anomalies and maintaining full traceability of evaluation results.
• Collaborating with development teams to ensure a high level of quality and the continuous improvement of deployed systems.

Are you who we are looking for?

Basic qualifications:

• University studies of at least 3 years attested by a diploma
• A thorough knowledge of one of the EU’s official languages and a satisfactory knowledge of another. For working reasons, good knowledge of French or English is required. These two languages are essential for coordinating between services and engaging with internal and external stakeholders.

Desirable qualifications:

• Degree in information science, data science, artificial intelligence, computer science, statistics, or a related field.
• At least 2 years of confirmed professional experience in software testing, quality assurance (QA), and the validation of complex systems.
• Specific experience or strong technical knowledge in the evaluation of artificial intelligence models, in particular LLMs and RAG architectures.
• Proficiency in concepts related to data security, algorithmic traceability, and AI ethics as applied in an institutional environment.