Evaluation Framework for Educational AI Chatbots (TUNED IN)
Division and unit: Academic Services / Teaching & Learning Center (TLC) -TUNED IN
Location: Tilburg
Full-time equivalent: 0.4 FTE (16 hours/week)
Monthly full-time gross salary € 3084 – € 3141
Duration of employment contract: 01/09/2026 – 31/12/2026
Tilburg University | Academic Services | TLC- TUNED IN
Is looking for a Student Assistant (0.4 FTE)
Your position
Your qualifications
In this project, you will contribute to the development of a practical evaluation framework for educational AI chatbots used in teaching contexts. Educational chatbots are increasingly integrated into courses, but existing evaluation methods do not adequately capture whether they function effectively within specific educational settings.
You will work at the intersection of AI, education, and evaluation design, collaborating with both the Teaching & Learning Center (TLC) and tilburg.ai. Your work will contribute to understanding how chatbots can provide accurate, pedagogically meaningful, and trustworthy support to students.
Your main tasks include:
- Conducting a structured literature review on educational AI chatbots, LLM evaluation, RAG systems, and educational technology
- Developing a draft evaluation framework, including dimensions such as faithfulness to course materials, explanation quality, hallucination behavior, and pedagogical alignment
- Applying the framework in a small-scale pilot using a concrete educational use case (e.g., testing chatbot behavior in Tilly)
- Contributing to deliverables such as an annotated bibliography, overview tables, and a pilot evaluation report
You will work in close collaboration with researchers and practitioners, and your work may serve as a basis for ongoing research within tilburg.ai, including collaboration with a postdoctoral researcher joining the project.
Your talents
You are a motivated and independent student with an interest in AI and education. You enjoy working in a structured way and are able to translate theoretical insights into practical evaluation approaches.
You have:
- A background in digital humanities, computational linguistics, educational technology, data science, AI & society, communication and information sciences, or a related field
- Experience with or interest in conducting literature reviews
- A basic understanding of research methods
- Familiarity with generative AI tools (e.g., ChatGPT or similar)
- The ability to work independently and communicate clearly
- Basic programming skills (e.g., Python)
Desirable (but not required):
- Experience with APIs or notebooks
- Interest in human-computer interaction or user evaluation
- Familiarity with LLMs, RAG systems, or chatbot evaluation
Our offer
Tilburg University offers excellent employment conditions in a pleasant working environment:
- A position based on 16 hours per week until 31 December 2026.
- The salary is a minimum of €3,084 and a maximum of €3,141 gross per month for full-time employment, based on the Student Assistant salary scale of the Collective Labour Agreement for Dutch Universities. This is an on-call contract in which holiday allowance, year-end bonus and leave entitlements are included in the hourly wage. Tilburg University applies a neutral remuneration system for salary placement. Salary placement depends on the number of study credits obtained.
- This is a vacancy for a Student Employee on an on-call basis who provides support for non-structural tasks and operational business tasks, in accordance with Article 2.3, paragraph 6, subparagraph f of the Collective Labour Agreement for Dutch Universities. The conditions for employment as a Student Employee are that you are enrolled as a student at Tilburg University and have obtained at least 60 ECTS credits. You will receive a temporary employment contract for a period of 4 months.
- If you are not entitled to student finance, you are eligible for reimbursement of sustainable commuting expenses: walking, cycling and public transport.
- A work culture in which we embrace differences, everyone is welcome and everyone is given equal opportunities.
Information and application
More information about the vacancy can be obtained from Marije Markus at
[email protected]
We invite you to apply for this position before Juli 15th, this can only be done online. Please address your motivation letter to Marije Markus and attach a CV and at least one reference (organization, contact person, phone number, and e-mail address). We will only approach referees for candidates who proceed to the second selection round.
Letter selection will take place on Juli 16th you will receive notification from us shortly thereafter. The selection interviews are scheduled on Juli 29th. The selection committee consists of:
- Matthijs van Gils, Product Owner Tilburg.ai
- Marije Markus, Innovation Manager & theme coordinator AI
You will ideally start working for Tilburg University on September 1st.
About Tilburg University | University Services
Service society and making it better for its citizens. That is what drives us. Tilburg University's founder, Martinus Cobbenhagen, believed that anyone who wants to understand society must be actively and consciously involved in it. These ideas still form the basis of our university.
Under the motto Understanding society, our more than 2,800 employees develop and transfer knowledge and bring people from different disciplines and organizations together. In this way, we want to contribute to solving complex social issues. In doing so, we work from the fields of economics, business and entrepeneurship, social and behavioral sciences, law and administration, humanities and digital sciences, and theology.
We educate our 20,000 students of 132 nationalities to become Tilburg University Shaped Professionals: responsible and entrepeneurial thinkers, driven by solidarity, a sense of responsibility and empathy, who are able to influence and give direction to a rapidly changing society in an innovative way.
University support is invested in University Services, organized into seven divisions:
1. Academic Services
2. Marketing & Communication
3. Human Resources
4. Finance & Control
5. Library & IT Services
6. Facility Services
7. Executive Services
Application code
Tilburg University applies the recruitment code of the Dutch Association for Personnel Management & Organization Development (NVP).
Disclaimer
The text in this job vacancy is the copyrighted property of Tilburg University. Use, distribution and further publication of the vacancy without the express permission of Tilburg University is not permitted and this expressly applies to use by recruitment agencies that do not act directly on behalf of Tilburg University. Responses to recruitment by non-contractors of Tilburg University will not be considered.
