# Labelled question set for the PB-RAG-11-01 dry-run (RAG-11-T03). # Corpus: the 5 open-licence policy documents in data/golden/A-policies/ (IDs as in data/manifest.csv). # Format: snippets/eval/question-types.yaml. score_by_type.py reads it; extra fields such as evidence are ignored. # Every expected answer was written from the documents themselves, not from the older questions.csv files. # evidence names the document and the section (or page) that backs the answer, so a reviewer can check it. # priority: connect-the-dots and summary questions are high, because they are what this dry-run tests. corpus: 'data/golden/A-policies (A-01 to A-05)' labelled_by: 'RAG-11 author (draft, for review)' labelled_on: '2026-11-11' # first labelled 6 Nov; CD03 and CD05-CD10 replaced, 7 summary answers corrected on 11 Nov types: one_place: The answer sits in one passage of one document. connect_the_dots: The answer links facts from two or more passages or documents. whole_corpus_summary: The answer needs themes or patterns from most of the corpus. questions: # ---------------------------------------------------------------- one place (10) - id: OP01 type: one_place priority: normal question: What are the core values of the Civil Service set out in the Civil Service Code? expected_answer: Integrity, honesty, objectivity and impartiality. source_documents: ['A-01'] evidence: ['A-01, Civil Service values (page 2)'] - id: OP02 type: one_place priority: normal question: Does a civil servant's duty not to disclose official information without authority end when they leave the Civil Service? expected_answer: No. The Civil Service Code says this duty continues to apply after you leave the Civil Service. source_documents: ['A-01'] evidence: ['A-01, Standards of behaviour, Integrity, You must not (page 3)'] - id: OP03 type: one_place priority: normal question: What are the minimum full-time working hours for members of the Senior Civil Service under the Civil Service Management Code? expected_answer: >- A minimum of 42 hours per week, including daily meal breaks of one hour. Staff who were in the Senior Civil Service on the day before 1 July 2013 keep a minimum of 41 hours in London or 42 hours elsewhere. source_documents: ['A-02'] evidence: ['A-02, Section 9.1 Hours of Work, Senior Civil Service'] - id: OP04 type: one_place priority: normal question: How long does a civil servant have to tell the Civil Service Appeal Board that they intend to appeal a refusal to allow political activities? expected_answer: >- Within 8 weeks of being told the department's or agency's final decision after any internal grievance appeal. The full written case must reach the Board within 4 weeks of lodging the appeal. source_documents: ['A-02'] evidence: ['A-02, Section 12.1 Appeals, Civil Service Appeal Board, Political activities'] - id: OP05 type: one_place priority: normal question: Within what time must an employer decide on a flexible working request? expected_answer: Within 2 months of the request, or longer if agreed with the employee. source_documents: ['A-03'] evidence: ['A-03, 3. Applying for flexible working; 4. After the application'] - id: OP06 type: one_place priority: normal question: How many flexible working applications can an employee make in a 12-month period? expected_answer: 2 applications in any 12-month period. source_documents: ['A-03'] evidence: ['A-03, 3. Applying for flexible working (page 4)'] - id: OP07 type: one_place priority: normal question: What is the statutory paid annual leave for most workers who work a 5-day week? expected_answer: At least 28 days' paid annual leave a year, the equivalent of 5.6 weeks. source_documents: ['A-04'] evidence: ['A-04, 1. Entitlement, Statutory annual leave entitlement'] - id: OP08 type: one_place priority: normal question: How many days of leave can a worker who gets 28 days' leave carry over into the next year? expected_answer: A maximum of 8 days. source_documents: ['A-04'] evidence: ['A-04, 2. Calculate leave entitlement, Carrying over leave'] - id: OP09 type: one_place priority: normal question: What is the maximum term of a telework agreement in the OPM guide? expected_answer: >- One year. Agencies may consider shorter terms, for example six months, renewable after confirming the terms still apply and performance and operations have not been diminished. source_documents: ['A-05'] evidence: ['A-05, III. Telework, Telework Agreement Contents (page 8)'] - id: OP10 type: one_place priority: normal question: Which two categories of federal employees are barred by statute from teleworking? expected_answer: >- An employee officially disciplined for being absent without permission for more than 5 days in any calendar year, and an employee officially disciplined for viewing, downloading or exchanging pornography, including child pornography, on a Federal Government computer or while performing official duties. source_documents: ['A-05'] evidence: ['A-05, III. Telework, Telework Eligibility (page 7)'] # ---------------------------------------------------------------- connect the dots (10) - id: CD01 type: connect_the_dots priority: high question: >- The Civil Service Code names a body to which a civil servant can report an unresolved concern. What does that same body issue that frames Civil Service recruitment under the Management Code? expected_answer: >- The body is the Civil Service Commission. It issues the Recruitment Principles; within them and the Constitutional Reform and Governance Act 2010, departments and agencies set their own recruitment practices. source_documents: ['A-01', 'A-02'] evidence: ['A-01, Rights and responsibilities (page 5)', 'A-02, Section 1.1 Recruitment, 1.1.1'] - id: CD02 type: connect_the_dots priority: high question: >- The Civil Service Management Code says departments must incorporate one code into their staff's conditions of service. What core values does that code set out? expected_answer: >- The Civil Service Code, which sets out the core values of integrity, honesty, objectivity and impartiality. source_documents: ['A-02', 'A-01'] evidence: ['A-02, Section 4.1 Conduct, Rules', 'A-01, Civil Service values (page 2)'] - id: CD03 type: connect_the_dots priority: high question: >- The Civil Service Code names one group of staff who are covered by it except for its requirements for objectivity and impartiality. Under the Business Appointment Rules in the Management Code, to whom must a member of that group submit an application for a job they want to take up after leaving, and for how long after leaving does this requirement apply? expected_answer: >- The group is special advisers. Under the terms of their contract they must submit the application to the head of their former Department. The requirement applies for two years after leaving to special advisers of equivalent standing to the Senior Civil Service, and for one year to other special advisers. source_documents: ['A-01', 'A-02'] evidence: ['A-01, footnote 4 (page 6)', 'A-02, Section 4.3 Annex A Business Appointment Rules, Special Advisers'] - id: CD04 type: connect_the_dots priority: high question: >- The Management Code describes reporting a matter to the Civil Service Commission under another code. What does that code say a civil servant must do if the matter still cannot be resolved and they feel they cannot carry out their instructions? expected_answer: >- The other code is the Civil Service Code. It says that if the matter cannot be resolved and you feel you cannot carry out the instructions you have been given, you will have to resign from the Civil Service. source_documents: ['A-02', 'A-01'] evidence: ['A-02, Section 12.1 Appeals, Appeals under the Civil Service Code', 'A-01, Rights and responsibilities (page 6)'] - id: CD05 type: connect_the_dots priority: high question: >- The flexible working guidance lists one type of flexible working for older workers that exists because a default rule has been phased out. What is that type, and under the Management Code may a government department still keep that kind of rule for its own staff? expected_answer: >- Phased retirement: the default retirement age has been phased out, so older workers can choose when to retire and can reduce their hours and work part time. The Management Code says departments should not have a mandatory retirement age for their staff, except where they have a sound business reason, supported by legal advice, to keep an upper age limit for certain groups. source_documents: ['A-03', 'A-02'] evidence: ['A-03, 2. Types of flexible working, Phased retirement (page 3)', 'A-02, Section 11.3 Retirement Age, 11.3.1'] - id: CD06 type: connect_the_dots priority: high question: >- The Civil Service Code says that a civil servant who would find it difficult to raise a concern with their line management chain should go to certain officials in their department. According to the Management Code, how can staff approach those officials, and who at the top of the department or agency is usually part of settling the matter inside the department? expected_answer: >- The officials are the department's nominated officers, appointed to advise staff on the Code. The Management Code says staff can approach a nominated official in confidence in the first instance, and the internal resolution procedures will normally involve the Permanent Head of Department or the Agency Chief Executive. source_documents: ['A-01', 'A-02'] evidence: ['A-01, Rights and responsibilities (page 5)', 'A-02, Section 12.1 Appeals, Appeals under the Civil Service Code, 12.1.3'] - id: CD07 type: connect_the_dots priority: high question: >- The Civil Service Code says civil servants working for two named governments, and their agencies, have their own versions of the code. Under the Business Appointment Rules in the Management Code, who makes the final decision on an application at Permanent Secretary or SCS3 level from a civil servant in those administrations? expected_answer: >- The governments are the Scottish and Welsh Governments. At Permanent Secretary and SCS3 level every application goes to the Advisory Committee on Business Appointments, which advises the Prime Minister, who decides. But for civil servants who serve or formerly served in the Devolved Administrations in Scotland and Wales, the Committee advises the relevant First Minister, who makes the final decision. source_documents: ['A-01', 'A-02'] evidence: ['A-01, footnote 1 (page 6)', 'A-02, Section 4.3 Annex A Business Appointment Rules, Permanent Secretaries and SCS3, footnote 2'] - id: CD08 type: connect_the_dots priority: high question: >- The OPM guide recommends that the official who oversees tracking and implementation of an agency's remote work programme should be similar to another agency role, which the guide names there only by its initials. What is that role, what is its main job, and in which office of the agency must it sit? expected_answer: >- The Telework Managing Officer (TMO). Each agency must designate one as the primary agency point of contact for OPM on telework matters. The TMO must be established within the agency office of the Chief Human Capital Officer (or a comparable office) and be a senior official with direct access to the head of the agency. source_documents: ['A-05'] evidence: ['A-05, IV. Remote work, Agency Roles and Responsibilities (page 16)', 'A-05, III. Telework, Agency Roles and Responsibilities (page 6)'] - id: CD09 type: connect_the_dots priority: high question: >- An agency reports an employee's telework or remote agreement type to OPM's Enterprise Human Resources Integration system with the code TP. What arrangement does that code stand for, what must normally be in place before an agency allows that kind of telework, and who decides it? expected_answer: >- TP is a Periodic Routine Telework Agreement: a written telework agreement for an ongoing regular schedule of 1-2 days per pay period. Generally, an agency should not permit routine telework unless it is authorised by a Governmentwide or agency-approved exemption or exception to in-person work, consistent with OPM and OMB policy guidance or specific legal authority. The agency head (or designee) determines the authorised exemptions and exceptions. source_documents: ['A-05'] evidence: ['A-05, VI. Appendices, Appendix 4 Telework/Remote Agreement Type, Current Values (page 33)', 'A-05, III. Telework, Permissible Types of Telework Arrangements, Routine Telework (page 10)'] - id: CD10 type: connect_the_dots priority: high question: >- Under the Management Code, departments must consult a named government department when a civil servant is offered a decoration or medal by a foreign government. In what other situation does the Management Code require something to go through that same department, and what must staff agree to in that situation? expected_answer: >- The department is the Foreign and Commonwealth Office. Where departments and agencies help their own staff make claims for riot compensation against an overseas government, the claims must be presented through the Foreign and Commonwealth Office, and staff must agree to repay any advance of salary from compensation received from the overseas government or any other source. source_documents: ['A-02'] evidence: ['A-02, Section 4.3 Conduct, Standards of Propriety, Rules', 'A-02, Section 8.6 Overseas Expenses, 8.6.7 Claims against overseas governments'] # ---------------------------------------------------------------- summary of everything (10) - id: SU01 type: whole_corpus_summary priority: high question: What topics do the documents in this collection cover, taken together? expected_answer: >- Key points: standards of behaviour and values for UK civil servants (A-01); terms, conditions and management of the UK Civil Service (A-02); the UK right to request flexible working (A-03); UK statutory holiday entitlement and pay (A-04); US federal telework and remote work policy (A-05). Together: rules on how public servants and workers are employed, in the UK and the US. source_documents: [] evidence: ['A-01 to A-05, titles and introductions'] - id: SU02 type: whole_corpus_summary priority: high question: Across the documents, which arrangements or agreements must be put in writing? expected_answer: >- Key points: a flexible working request by email or letter with set contents (A-03); a written statement of main terms within two months of starting work (A-02, Section 1.4); a written telework agreement, mandatory to telework (A-05); a written remote work agreement (A-05); money for excess leave can come off final pay only if agreed beforehand in writing (A-04). source_documents: [] evidence: ['A-03, Writing to the employer', 'A-02, Section 1.4', 'A-05, Telework Agreement; Remote Work Agreement', 'A-04, Taking more leave than the entitlement'] - id: SU03 type: whole_corpus_summary priority: high question: What routes for raising a concern or challenging a decision do the documents describe? expected_answer: >- Key points: line manager, nominated officers and then the Civil Service Commission (A-01); departmental complaint procedures and the Civil Service Appeal Board (A-02); a company appeal process or an employment tribunal, usually within 6 months (A-03); workplace dispute resolution and Acas for holiday issues (A-04); a duty to report fraud, waste and abuse to the agency's Office of the Inspector General (A-05). source_documents: [] evidence: ['A-01, Rights and responsibilities', 'A-02, Sections 2.1 and 12.1', 'A-03, 5. Appeals', 'A-04, Disputes; Holiday pay, More information', 'A-05, Fraud, Waste, and Abuse'] - id: SU04 type: whole_corpus_summary priority: high question: How do the documents treat working away from the usual workplace? expected_answer: >- Key points: in the UK, remote and hybrid working are types of flexible working that any employee can request from day one (A-03); the Management Code lets departments set part-time or other working arrangements (A-02); in the US, the starting presumption since January 2025 is full-time in-person work, telework is discretionary and should be used sparingly, and remote work generally needs an approved exemption or exception to in-person work (A-05). source_documents: [] evidence: ['A-03, 1-2', 'A-02, Section 1.2', 'A-05, II. Return to In-Person Work; III; IV'] - id: SU05 type: whole_corpus_summary priority: high question: What deadlines and time limits appear across the documents? expected_answer: >- Key points: flexible working decision within 2 months, contract changed within 28 days of approval, tribunal complaint usually within 6 months (A-03); leave notice at least twice the leave plus 1 day, and from 6 April 2026 holiday records kept for at least 6 years from the date they were made (A-04); written statement of terms within two months, recruitment records kept at least 12 months, Appeal Board notice within 8 weeks (A-02); telework agreements of at most one year, and, for locality pay, being scheduled to report to the agency worksite at least twice each bi-weekly pay period (A-05). source_documents: [] evidence: ['A-03, 3-5', 'A-04, Keeping records; 4. Booking time off', 'A-02, Sections 1.1, 1.4, 12.1', 'A-05, Telework Agreement Contents; Official Worksite and Pay'] - id: SU06 type: whole_corpus_summary priority: high question: What do the documents say about rights and duties when someone leaves their job? expected_answer: >- Key points: the duty not to disclose official information continues after leaving (A-01); departments must remind leavers of the Official Secrets Acts and their duty of confidentiality (A-02); a leaver may take remaining leave in the notice period and is paid in lieu of untaken statutory leave only when leaving, even if dismissed for gross misconduct (A-04); a remote worker removed for refusing a reassignment outside the commuting area may get severance pay, unless a written agreement provided for the reassignment (A-05). source_documents: [] evidence: ['A-01, Integrity', 'A-02, Section 4.2.1', 'A-04, 5. Taking holiday before leaving a job', 'A-05, Severance Pay'] - id: SU07 type: whole_corpus_summary priority: high question: Which bodies outside the employer play a role across the documents, and what do they do? expected_answer: >- Key points: the Civil Service Commission hears Code concerns and issues the Recruitment Principles (A-01, A-02); the Civil Service Appeal Board hears certain appeals (A-02); Acas publishes the code of practice and templates for flexible working and answers holiday pay questions (A-03, A-04); employment tribunals hear flexible working complaints (A-03); OPM and OMB issue telework guidance, and teleworking outside the continental United States needs approval from both the employee's agency and the Department of State (A-05). source_documents: [] evidence: ['A-01, Rights and responsibilities', 'A-02, Sections 1.1 and 12.1', 'A-03, 1 and 3', 'A-04, Holiday pay, More information', 'A-05, I; Domestic Employee Teleworking Overseas'] - id: SU08 type: whole_corpus_summary priority: high question: How do the documents support people with family or caring responsibilities? expected_answer: >- Key points: holiday keeps building up during maternity, paternity and adoption leave, and untaken leave can be carried over after family-related leave (A-04); Section 9.3 covers maternity, paternity and shared parental leave, and PIN 27 covers support for staff caring for dependants (A-02); job sharing and part time are flexible working options (A-03); military spouses and some Foreign Service spouses can be exempt from in-person work, and the Pregnant Workers Fairness Act can support telework as an accommodation (A-05). source_documents: [] evidence: ['A-04, 1-2', 'A-02, Sections 9.2 and 9.3', 'A-03, 2. Types of flexible working', 'A-05, Exceptions and Exemptions; Pregnant Workers Fairness Act'] - id: SU09 type: whole_corpus_summary priority: high question: How do performance and conduct affect working arrangements across the documents? expected_answer: >- Key points: an employer can refuse flexible working if it will affect quality or performance (A-03); telework must not diminish performance, and a telework agreement must be terminated after the statutory misconduct cases, if telework diminishes employee or agency performance, or if the employee does not comply with the written agreement (A-05); performance standards are the same wherever someone works (A-05); departments must have procedures for poor performance and poor attendance (A-02); civil servants must meet the Code's standards of behaviour (A-01). source_documents: [] evidence: ['A-03, Reasons for refusing', 'A-05, Telework Eligibility; Terminating a Telework Agreement; Performance Management', 'A-02, Section 6.3', 'A-01, Standards of behaviour'] - id: SU10 type: whole_corpus_summary priority: high question: What principles of fairness and equal treatment run through the documents? expected_answer: >- Key points: impartiality and a commitment to equality and diversity (A-01); equality of opportunity and no unfair discrimination, with complaint procedures (A-02); requests handled in a reasonable manner and no poor treatment for making one (A-03); paid annual leave is a legal right that an employer cannot refuse altogether (A-04); managers should provide fair performance management, not affected by where someone works, and reasonable accommodation for disability (A-05). source_documents: [] evidence: ['A-01, Impartiality', 'A-02, Section 2.1', 'A-03, 1 and 5', 'A-04, Disputes; 4. Booking time off', 'A-05, Performance Management; Reasonable Accommodation']