Veterans Affairs Canada's website is undergoing maintenance. If you are experiencing any issues, please contact us. We apologize for the inconvenience this may cause.

2.0 Scope and methodology

2.0 Scope and methodology

The Canada Remembers Program was last evaluated in 2017 and 2018 as part of the Evaluation of Public Recognition and Awareness and the Overarching Commemoration Evaluation. The Cemetery and Grave Marker Maintenance Program was included in the scope for the Evaluation of Funeral and Burial and Cemetery and Grave Marker Maintenance Programs that was completed in March 2022. The Honours and Awards component of the Canada Remembers Program was included in preliminary scoping for the Evaluation of the Funeral and Burial and the Cemetery and Grave Marker Maintenance Programs. Due to low risk (low yearly operating expenditures) and no identified concerns, this component was not evaluated.

2.1 Evaluation objective and scope

This evaluation was conducted in accordance with VAC’s Evaluation Plan 2020-21 to 2024-25. The evaluation meets the Financial Administration Act requirement to evaluate all grant and contribution spending every five years and fulfils the 2016 Treasury Board Policy on Results to periodically evaluate program spending.

The evaluation covered Ceremonies and Events, the Commemorative Partnership Program, Learning and Public Information, and Memorials.

VAC committed to consider the Métis Veterans Recognition Payment (MVRP) for review during the evaluation of the Canada Remembers Program; however, the expected timeline to achieve the outcomes of the Métis Veterans Recognition Payment is 2022-23, which is outside the scope period of this evaluation. Therefore, the MVRP was not part of this evaluation.

The evaluation covered the period April 1, 2017, to June 30, 2021. Some activities and results that occurred outside the evaluation period are considered where relevant. The past performance of the program was reviewed, along with its current activities and future plans.

2.2 Evaluation questions

Evaluation questions were developed during the planning phase of the evaluation. These questions help guide the review of program relevance and program performance (including efficiency, economy, and effectiveness). A list of evaluation questions, highlighting the key lines of inquiry, can be found in Table 1 below.

Table 1: Evaluation questions

Evaluation questions
Relevance
To what extent is the Canada Remembers Program responsive to the needs of Veterans, Canadians and stakeholders?
To what extent does the Canada Remembers Program align with Government of Canada priorities and with federal roles and responsibilities?
Performance
To what extent is the Canada Remembers Program achieving its objectives and outcomes?
Are there alternatives or modifications to the Canada Remembers Program that would help achieve the outcomes?
Are there opportunities to improve efficiencies and effectiveness within the Canada Remembers Program?
Are there any unintended impacts (positive or negative) of the Canada Remembers Program?

2.3 Multiple lines of evidence

The research methodology incorporated multiple lines of evidence to ensure reliability of collected information and reported results. Those used to evaluate the program’s relevance, performance, efficiency and economy are outlined below in Table 2.

Table 2: List of methodologies

Methodology Source
Departmental documentation and secondary research review The following departmental documents/information were reviewed to understand the program, their authorities and requirements and key issues: Legislation, Regulations and Orders in Council, Memorandums to Cabinet, Central Agency Documents, Minister Mandate Letters, previous VAC audits and evaluations, policies, business processes, records of decisions, strategic documents, performance reports, research papers, and survey results.
Non-departmental document Review Various non-departmental documents such as: Parliament reports, Budget Speeches, Speeches from the Throne, evaluations of commemoration programs in other federal departments, and program literature from other countries.
Interviews Interviews were conducted with VAC senior management, VAC employees involved in the delivery of the programs/initiatives, and external subject matter experts.
Data analysis Analysis was conducted on Canada Remembers Program financial and operational data for the evaluation period.
Site visits Virtual site visits took place to speak with employees, program delivery partners and stakeholders, and to observe war memorials and ceremonies. Members of the evaluation team attended two ceremonies during Veterans Week 2021. Further observation was not possible due to departmental travel constraints related to COVID-19 pandemic safety protocols

2.4 Considerations and limitations

The evaluation identified the following considerations and limitations:

  • Restrictions due to COVID-19 impacted the team’s ability to conduct in-person interviews and observations including site visits to memorials as in the last evaluation.
  • In spring 2021 the House of Commons Standing Committee on Veterans (ACVA) held meetings and consultations on Commemoration. This committee provides guidance and direction to VAC through studies, reports and government responses. As of spring 2022 there has not been a report issued. Any recommendations will require consideration by VAC.
  • The above noted information should be taken into consideration when reading this evaluation report.