View current

Review of Institutes and Supervisory Centres Guideline

This is the current version of the approved document. You can provide feedback on this document to the Enquiries Contact - refer to the Status and Details tab from the menu bar above. To view historical versions, click the link in the document's navigation bar.

Section 1 - Purpose and Scope

(1) This Guideline applies to reviews of institutes under Organisational Structure Policy and Review of Institutes and Supervisory Centres Procedure. This Guideline is provided to assist in the preparation for and conduct of reviews.

(2) For the purpose of this Guideline, ‘institute’ is used to refer to all units within the scope of the Review of Institutes and Supervisory Centres Procedure.

Top of Page

Section 2 - Preparation for the Review

Timeline for institute review preparation

(3) Preparation for institute reviews begins approximately 15 months prior to the review. A timeline is provided on the Academic Board’s ‘Reviews’ website to give direction to institutes on the general timing of events for the pre-review, review, and post-review phases of the review process.

Structure of the Institute’s Submission

(4) The institute’s submission should be as short as possible to present all required information and future plans. While not being prescriptive of the exact format or length of the institute’s submission, the preferred approach is for the submission (excluding appendices) to be approximately 50 pages in length. Appendices should also be as concise as possible, only presenting essential information.

(5) The institute’s submission should comprise four parts, as follows:

Part 1 – Executive Summary

(6) The executive summary describes the contents of the institute’s submission, including comments from the Institute Director, and could include suggestions for areas of focus for the review committee.

Part 2 – The History of the Institute

(7) This brief section describes:

  1. the origins and histories of the disciplinary groups of the institute and the history of their organisational relationships (i.e. the precursors to the current institute);
  2. management structures and leadership positions (e.g. institute board and advisory committees, institute executive committees) established and the rationale for their creation;
  3. major outcomes of the previous review;
  4. any factors which might have had an impact since the previous review (e.g. restructures, changes in funding, changes in community perceptions); and
  5. any other significant changes since the previous review.

Part 3 – The Institute at Present

(8) This section includes an analysis of the institute’s current status and operations particularly with regard to research outcomes and impact. An overview of the institute's goals and priorities over the last few years should be provided with an analysis of the extent to which these goals and priorities are being achieved. Budget information should be provided to inform discussion.

(9) The institute should provide relevant data in the performance areas identified in the terms of reference. Performance must be explicitly linked to the University Strategic Plan and operating priorities as well as to the institute’s strategic plan, and any other relevant unit’s strategic or operational plans.

(10) The institute should decide how best to represent itself and its disciplines in its submission. The submission includes analysis of quantitative and qualitative data (data can be included in the appendices). This should align with the future direction of the institute and how the institute is contributing to that direction and/or realigning its activities in keeping with developments.

(11) The submission should highlight any particular strengths of the institute that are not covered by the core performance data, as well as data on established, nationally/internationally recognised, discipline-specific performance markers.

(12) Where quantitative data are available, comparable data for other relevant institutes and/or disciplines within and external to the University should be supplied.

(13) Where possible, the institute should benchmark its activities with two comparable institutions, nationally (preferably Group of 8) and/or internationally (for example, a member of Universitas 21). The primary purpose of benchmarking with international institutions is to assist in determining the direction of the discipline and the quality of the scholarship. However, it is recognised that Units vary in structure and emphasis of research such that benchmarking against any Unit may be neither useful nor informative.

(14) Where a comparable Unit does not exist, benchmarking of researchers/research groups against high quality researchers/groups nationally and internationally should be undertaken.

(15) The institute should identify benchmarking partners early in the preparation process and advise Academic Board Standing Committee once identified.

Part 4 – The Institute in the Future

(16) This section is the focus of the submission. It describes plans and strategies for the future development and improvement of the institute over the next three to five years. It is expected that the institute submission should include any relevant strategic or operational plans which show how the institute contributes to the University’s overall strategy and goals. If the submission includes strategic or operational plans then there is no need to rewrite or reproduce content of those plans within the review text.

(17) The review committee provides an objective assessment of the institute’s current and future directions and strategies, and to either confirm or recommend changes to those plans.

(18) Therefore, this section articulates goals and courses of action that are tied to:

  1. Performance indicated by the data given in the section ‘The institute at present’. Strategies for maintaining excellence and improving identified deficiencies should be included. An analysis of the data and an assessment of the institute's strengths as well as factors preventing progress is required.
  2. Areas of potential growth or deliberate refocus. Some of these areas might arise from the benchmarking exercise or involve predictions of future directions of areas of research.
  3. Contribution to the University's strategic and operational plans, including how the institute contributes to operationalising these plans.

(19) In each case, consideration should be given to the institute’s human, financial and physical resources to enhance performance, to meet the institute’s objectives and to achieve its targets. Key performance indicators should be identified clearly, alongside strategic priorities that link appropriately to specified timelines, milestones and resource allocations. For institutes, these may have been developed in the Institute-Based Performance Framework.

Appendices

(20) The appendices should include the institute’s future planning documents (such as the strategic and operational plans), budget, benchmarking data, and any additional data as relevant. The appendices should only include information that is likely to be of direct use to the review committee. It is not necessary to include details of all staff (such as photographs or brief biographies) or lists of published work.

(21) Where possible, appendices should be presented in a separate document to the submission.

Briefing Sessions

(22) A briefing session for Institute Directors and other senior members of institutes is held in the year prior to the review by the President of the Academic Board to explain the review process.

(23) A briefing session for staff and students of each institute being reviewed is held prior to the review (generally 4-8 months prior) by the Academic Board Standing Committee (ABSC) representative and the President of the Academic Board on the review committee to explain the review process, advise the institute of the review committee membership, and elaborate on the involvement of staff and students during the review week.

Review Timetable

(24) Organisation of the review timetable is developed by the Chair, the Review Committee, the Review Secretary and other stakeholders as required, and is guided by the following principles:

  1. Scheduled opportunities for committee members to discuss and reflect on issues that arise during interviews should be incorporated into the review timetable, including between interviews. It is not necessary that discussion occur only at the beginning and end of the day.
  2. Noting the limited time available, to the selection of stakeholders for interview should be focussed to seek contributions on key issues arising in the review. Interviews should not crowd the program.
  3. There should be sufficient time available in the program to enable follow-up discussion with those already interviewed, or to invite contributions from other identified stakeholders, if required.
  4. Staff, students and other stakeholders are provided the opportunity to express their views candidly to the committee through the written submission process and will be invited to interview at the discretion of the Review Committee.

(25) To support the review committee, it is recommended that:

  1. The Institute Director and supervisor of the institute provide a shortlist of staff members and external stakeholders recommended for interview.
  2. The secretariat meets with the internal members of the review committee to finalise stakeholders to be invited to interview.
  3. The secretariat seeks comment on the review timetable from the President of the Academic Board to ensure there is sufficient time provided to committee members to consider the input to the review.

(26) A sample timetable has been provided in the Appendix.

Reviews Conducted Online

(27) If the review is held online, or if a significant number of interviewees are not available to participate in interviews on campus, the secretariat will arrange for meetings to be held on a video conferencing tool (for example, Zoom or Microsoft Teams). Depending on preference, the review committee members on campus could meet in a meeting room on campus, or participate remotely.

(28) Adjustments can be made to the review timetable to make the process more comfortable and sustainable for the review committee members when the review is held online, including:

  1. Considering the time-zones of the review committee members and scheduling meetings during common business hours.
  2. Scheduling the review over more than four days, without increasing the total hours attributed to a four-day review.
  3. Scheduling longer interviews to allow for delays that might occur during online meetings.
  4. Scheduling adequate breaks during each day to allow members time to step away from meetings.
  5. Requesting more submissions or written comments instead of interviews, where appropriat
  6. Requesting filmed comments from relevant stakeholders which can be viewed before the review commences, where appropriate.
  7. Requesting the institute organise for the filming of a virtual walk-through of facilities, to introduce committee members to the site in advance.
  8. Coordinating key areas of focus in advance to ensure interviews are targeted.
Top of Page

Section 3 - Conduct of the Review

Review Committee Deliberations

(29) The review committee considers the submission prepared by the institute, together with other submissions made by interested persons and organisations, and consults with University staff, students and other persons as deemed appropriate, through interviews. Sample questions that the review committee might consider is available on the Academic Board’s ‘Reviews’ website.

(30) Following perusal of the institute submission and interviews with the Senior Executive officers, the committee determines whether there are additional questions to be asked that are relevant to the review, so that the terms of reference are addressed. The committee identifies those areas where more information is required and with support from the secretary, determine how best to obtain that information (e.g. interviews, visits, records, direct requests to the institute).

Initial Meetings with Senior Executives and Senior Staff

(31) The review committee initially meets with the following staff or their representatives, as relevant to the review:

  1. President of the Academic Board;
  2. Vice-Chancellor;
  3. Supervisor of the institute (if not the Provost);
  4. Institute Director;
  5. Provost;
  6. Deputy Vice-Chancellors;
  7. Deputy Vice-Chancellor (Indigenous Engagement);
  8. Dean, Graduate School; and
  9. Executive Dean and Associate Deans of the relevant faculty or faculties.

Interviews with Internal Stakeholders

(32) The review committee meets and interviews relevant internal stakeholders based on written submissions received or those identified by the review committee, including (but not limited to):

  1. Academic, research and professional staff of the institute;
  2. Undergraduate and postgraduate students of the institute, as relevant;
  3. Heads of units or representatives who frequently collaborate with the institute;
  4. Other staff or student representatives as relevant, and as determined by the Chair in consultation with members of the review committee.

(33) If a perceived or real conflict of interest exists with the secretary or member of the review committee, a confidential discussion with the President of the Academic Board may be requested via the Office of the President of the Academic Board, who will consult with the Chair or other members of the review committee as relevant.

(34) Internal stakeholders are able to request an interview with the review committee if required.

Engagement with External Stakeholders

(35) The review committee engages with relevant external stakeholders, including (but not limited to):

  1. representatives from industry;
  2. representatives from government;
  3. representatives from professional bodies;
  4. representatives from employer groups; or
  5. alumni who are relevant to the institute’s activities in research, learning, and engagement.

(36) External stakeholders may request an interview with the review committee via the Secretary.

(37) A stakeholder dinner, as set out in the Review of Institutes and Supervisory Centres Procedure, will be held on the evening of the second or third day of the review.

(38) If the review is held online, the secretariat can include other opportunities for engagement with external stakeholders, such as interviews with the review committee in groups or individually.

Visits to Facilities

(39) Brief visits to, and inspection of, institute facilities should be included in the program to provide the opportunity to clarify or illustrate points made in the submissions. Where institutes are multi-sited, the use of technologies such as video conferencing or filmed tours can be considered.

(40) If the review is held online, alternate approaches to share details about facilities can be adopted, such as for the internal members to visit the facilities and include a report to the full committee, or for an appropriate filmed tour to be organised by the institute in advance of the review. This can be determined by the Institute and secretary in planning for the review, and decided in advance where possible to allow time for filming and video editing if required.

Presentation of the Findings

(41) Prior to the finalisation of the recommendations on the final day of the review, the review committee meets with:

  1. the Institute Director and Director, Institute Operations – to learn of and respond to the recommendations before they are made public; the Institute Director may also be advised to communicate with individual staff who might be significantly affected by individual recommendations;
  2. the supervisor of the institute – to review the draft recommendations and advise the review committee on priorities, feasibility considerations, sensitivities, and other considerations that may be relevant to the crafting of the recommendations; and
  3. the President of the Academic Board and the Provost (if not the supervisor of the institute) – to discuss the recommendations.

(42) On the final day of the review, the review committee provides a general overview of the findings from the review and an outline of the recommendations to a full meeting of the institute. All review committee members should attend the institute presentation.

(43) At the same time, the ABSC representative should inform the institute about:

  1. the time-frame for completion of the report;
  2. the opportunity for the institute's consideration of and response to the recommendations;
  3. the deliberative process in the ABSC consideration of the report;
  4. the passage of the report through the Academic Board to the Vice-Chancellor; and
  5. the implementation and follow-up process.

(44) If the review is held online, or if a number of staff in the institute are not available to attend on-campus, the presentation can be held online.

Structure of the Review Report

(45) The review report is prepared by the members of the review committee with support from the Secretary. The Chair should discuss with members the division of responsibility for drafting individual sections of the report.

(46) It is anticipated that the review committee develops commendations and recommendations progressively throughout the review. It is expected that a penultimate draft of the report be completed prior to the departure of the external review committee members from the University.

(47) The report consists of the following sections:

  1. Membership of the Review Committee
  2. Terms of Reference
  3. Procedures
  4. Summary of Commendations and Recommendations
  5. Report of the Review Committee
  6. Appendices.

Commendations

(48) Commendations should be made in those areas where the institute has achieved outstanding outcomes, or has made significant progress towards doing so. Due recognition should be given to what the institute is doing well and should continue to do.

Recommendations

(49) Institutes are best able to benefit from and respond to concise recommendations under the themes of the terms of reference. Approximately ten recommendations will often be suitable, although this can vary depending on the review committee and circumstances of the institute.

(50) In formulating its recommendations, the review committee should take account of the resources available to the University and its collective goals and objectives, as expressed in its Strategic Plan and as advised by the President of the Academic Board and members of the Senior Executive.

(51) Every effort should be made to ensure that statements in the report are factually correct.

(52) Recommendations should not be directed toward senior officers of the University or to the University itself. They must be directed towards the Institute Director so that it is clear how the institute should proceed.

(53) All recommendations, particularly those proposing significant change or changes that impact on other organisational units or University policies, should be justified, substantiated by the evidence in submissions and from interviews, well-argued, and able to stand up to close scrutiny.

(54) Review committees are encouraged to include timeframes for implementation of recommendations.

Report of the Review Committee

(55) There is no mandatory format for the Report of the Review Committee section. One option is to structure the report around the major themes on which the review committee wishes to make recommendations, or to group commendations and recommendations under the terms of reference as headings.

(56) The report should not quote or identify any individuals who made a submission to the review or were interviewed.

(57) A suggested review report template is available online: Review of Institutes and Supervisory Centres - Report Template.

Appendices

(58) Appendix 1 to the review report must contain a list of names of all individuals who made written submissions to the review committee and all those interviewed by the review committee.

(59) Student submissions are confidential by default, unless a student requests to be identified. The appendix should list the number of student submissions without naming students who did not request to be identified.

(60) Students interviewed in the course of the review are listed in the appendix unless they request anonymity.

(61) Other appendices are to follow, if required. Written submissions are not included in the report.

Top of Page

Section 4 - Post-review

(62) Following the conclusion of the review, the review report with recommendations is finalised by the Chair in consultation with the Secretary and other members of the review committee.

(63) The response to the review report and implementation process is outlined in the Review of Institutes and Supervisory Centres Procedure.

Top of Page

Section 5 - Appendix

Sample Timetable

Evening preceding review • dinner for all members of the review committee, the secretary, and the supervisor of the institute (or nominee) to discuss review issues and orient external members to University procedures and protocols
Day 1 - morning • welcome by the President of the Academic Board (15 minutes)
• interview with the Vice-Chancellor (30 minutes)
• interview with the supervisor of the institute (30 minutes)
• interview with relevant Executive Dean/s about the procedures and protocols of the University, including its academic organisational structure and resource allocation processes (30 minutes)
Day 1 - afternoon • interviews with academic, professional and research staff, representatives of professional and other external bodies, and undergraduate and postgraduate students
Day 2 - morning • interview with the Provost (if not the supervisor of the institute) (30 minutes)
• interviews with Deputy Vice-Chancellors, Deputy Vice-Chancellor (Indigenous Engagement), Dean, Graduate School (or representatives) (15 minutes each)
• interviews with other University staff
Day 2 - afternoon • visit to institute, inspection of institute facilities, informal gathering to meet all institute staff
• report writing to commence
Day 2 - evening • if required, a stakeholder dinner for all review committee members, supervisor of the institute (or nominee), and representatives of industry, government, professional bodies and employer groups
Day 3 - morning • report writing, outstanding/unscheduled interviews
• meeting with supervisor of the institute to discuss draft recommendations
• meeting with Institute Director to discuss draft recommendations (60 minutes)
Day 3 - afternoon • meeting with President of the Academic Board and Provost (if not the supervisor of the institute) to discuss draft recommendations
• preparation for presentation to institute
• presentation of draft recommendations to all staff at the institute – all review committee members to be in attendance (60 minutes)
• finalisation of report in penultimate draft form.

(64) The supervisor of the institute and the Institute Director should aim to have some availability during the review in case the review committee requests to schedule further meetings to discuss specific issues.

(65) A sample timetable is also available for download on the Academic Board’s ‘Reviews’ website.