Ensuring continuous improvement: evaluations, reviews and continuing to build the evidence

Evaluations are an important element of the MARAM reforms to drive effective evidence collection and continuous improvement. The information gathered from reviews and evaluations will inform future MARAM alignment priorities.

As this is the first year of MARAM, it is too early to know the results of evaluations, and this report focuses on the frameworks in place.

Whole-of-government MARAM Monitoring and Evaluation Framework

FSV has commissioned the development of a MARAM Monitoring and Evaluation (M&E) Framework to inform ongoing project monitoring. Based on a clear theory of change, the M&E Framework will:

  • identify the key indicators of progress, measures for those indicators and methods for collecting and analysing the associated data
  • enable wide ranging data collection for the evaluation of outcomes and identify opportunities for continuous improvement across the system
  • allow for changes in implementation activities based on identified opportunities and obstacles
  • allow for a detailed understanding of the impact and effectiveness of the reforms over time

This will inform the legislated five-year review, to be conducted in 2023.

At the same time, FSV has commissioned an evaluation of the early implementation of MARAM. This is an effort to identify important early lessons from the roll-out of MARAM and the response to the requirement for a focus on systems, outcomes and continuous improvement under Pillar 4.

Victoria Police

To ensure continuous learning and improvement in police practices for managing family violence, an evaluation of the Case Prioritisation and Response Model will be completed by Swinburne University during the 2019–20 reporting period. The evaluation will be based on use of the CPRM in the Hobsons Bay, Maribyrnong, Wyndham, Brimbank and Melton areas.

DJCS monitoring and evaluation approach

The DJCS MARAM Alignment Strategy outlines a monitoring and evaluation approach that is consistent with the DJCS Family Violence Evaluation Policy. The evaluation approach will include performance-monitoring metrics, key evaluation questions, and performance indicators.

In addition to the evaluation and monitoring approach set out in the Strategy, there are other activities which complement it, including that Corrections Victoria will:

  • focus on ‘pulsing’ activities as part of the culture change project
  • a formal review of the practice guideline Managing Family Violence in Community Correctional Services implementation and trial
  • completing the family violence prisoner survey

Youth Justice has monitored the implementation of the MARAM screening and assessment tools within the Youth Justice Case Management Framework and will commence evaluation of the effectiveness of the tool during the next reporting period.

Victim Support is undertaking a number of reviews which will inform MARAM alignment plans for 2019–20. These include the Victim Services Review and evaluations of the Family Violence Restorative Justice Service and the Family Violence Perpetrator Intervention Grants pilots.