ARCHIVE - 2008-2009 Summative Evaluation of the Joint Emergency Preparedness Program (JEPP)

Archived Content

Information identified as archived is provided for reference, research or record-keeping purposes. It is not subject to the Government of Canada Web Standards and has not been altered or updated since it was archived. Please contact us to request a format other than those available.

Adobe Acrobat version (PDF 440KB)

Executive Summary

In compliance with Treasury Board of Canada Secretariat (TBS) requirements, an evaluation of the Joint Emergency Preparedness Program (JEPP) was completed in January 2008. This report documents the evaluation.

Through the Joint Emergency Preparedness Program, the Government of Canada (GC) in consultation and cooperation with provincial and territorial governments contributes to projects that enhance Canada’s national capacity to address all types of emergencies.

Available funds over the past five years have averaged approximately $5 million annually.

Provincial and territorial governments are the targeted recipients of financial contributions provided through JEPP. A province or territory may submit a proposal whose originator is the provincial or territorial government, its agencies or a municipality. First Nations Reserves are also eligible to apply for JEPP funding through the respective province or territory. Beneficiaries are emergency management organizations and first responders as well as the Canadian public.

JEPP is administered by Disaster Financial Assistance and Preparedness Programs, Emergency Management Policy Directorate, Emergency Management and National Security (EMNS) Branch of the Department of Public Safety and Emergency Management, referenced within this document as Public Safety Canada (PS). The operational responsibility for the program lies with the Senior Assistant Deputy Minister (SADM) of the EMNS Branch.

Initial terms and conditions were approved on January 29, 1981 and amended on July 31, 1985. Current terms and conditions were approved in November 2004.

This is the second recorded evaluation of JEPP that has been completed during the life of the program. An initial evaluation was done in 2003 that considered the period from program inception in 1980 through to November 2003. This second evaluation focuses its analysis on the period starting in November 2003 through December 2007, although it may include references to the previous timeframe.

Key Findings

1. Rationale and relevance:

2. Success:

3. Cost-effectiveness and alternatives:

Recommendations

1. Fill open positions in the JEPP Program Office. A key priority of the Director, Disaster Financial Assistance and Preparedness Programs is to fill the open positions in the JEPP program office and obtain a commitment for their on-going funding. At the time of writing this report, the current JEPP human resources were almost exclusively utilized managing project applications and claims with little time left over for any other activities such as monitoring and improving performance, risk management, reporting, or stakeholder engagement. Until this recommendation is substantially completed, addressing other recommendations will be difficult.

2. Engage provincial, municipal and industry stakeholders. Stakeholders should be engaged for a number of reasons including:

Engagement should take the form of an annual conference in which stakeholders can physically meet in the same location rather than a teleconference which can limit participation and the sharing of information.

Engagement may also take the form of an advisory committee that would provide strategic advice to the program on standards, trends and future direction as well as daily operational issues such as governance and process improvements.

3. Review and update end-to-end application and claims processes. As noted in the findings, the end-to-end application and claims processes can be long and, across jurisdictions, can involve many duplicate tasks and approvals. Also, critical dates defined by the program can conflict with critical fiscal dates at the municipal level. The federal JEPP program office should take the lead in reviewing the processes, identify options for improvement (e.g. reducing duplication, increasing time to completion, mitigating municipal constraints), and facilitate implementation. Consideration should be given to:

4. Update program design. Findings identified a number of issues related to program design suggesting a comprehensive review is required which should ultimately result in an updated program design. During this exercise, consideration should be given to:

The updated program design should also consider the relationship of related initiatives including HUSAR and CIP, and how they should be integrated into the overall design.

The updated design should be used to inform an update of the RMAF/RBAF, the program terms and conditions, and the JEPP Manual.

5. Update terms and conditions. The program’s terms and conditions should be reviewed and updated. In particular, consideration should be given to the following.

6. Adjust the manner in which projects are promoted. The manner in which the program promotes its involvement in projects and why it promotes itself should be reviewed. Consideration should be given to:

Table of Contents

Revision History


Revision Date Title Purpose/Change
0.5 18-Dec-07 Summative Evaluation of the Joint Emergency Preparedness Program Initial draft. Does not include Executive Summary
1.0 28-Jan-08 Summative Evaluation of the Joint Emergency Preparedness Program Final draft including Executive Summary and feedback on initial draft

1. Introduction

In compliance with Treasury Board of Canada Secretariat (TBS) requirements, an evaluation of the Joint Emergency Preparedness Program (JEPP) was completed in January 2008. This report documents the evaluation.

The JEPP Summative Evaluation has been completed by Public Safety Canada (PS) and specifically the Disaster Financial Assistance and Preparedness Programs (DFAPP) Division which has responsibility for administering the program. The evaluation was done by an independent consultant under the direction of the Director, DFAPP. It was conducted with the guidance of the Guide for the Review of Evaluation Reports prepared by Treasury Board’s Centre of Excellence for Evaluation, January 2004.

This is the second recorded evaluation of JEPP that has been completed during the life of the program. An initial evaluation was done in 20031 that considered the period from program inception in 1980 through to November 2003. This second evaluation focuses its analysis on the period starting in November 2003 through December 2007, although it may include references to the previous timeframe.

1.1 Purpose and Scope of the Evaluation

The evaluation was undertaken to provide evidence-based answers to the Treasury Board evaluation policy questions related to:

  1. Relevance (i.e. is the program still consistent with department and government-wide priorities, and does it realistically address an actual need);
  2. Success (i.e. is the program effective in meeting objectives, within budget and without unwanted consequences);
  3. Cost-effectiveness/alternatives (i.e. are the most appropriate and efficient means being used to achieve objectives relative to alternative design and delivery approaches).

The evaluation will be used as an initial step in the renewal of the program, to action improvements, and as a basis for recipient and end-beneficiary consultation.

1.2 Audience

The audience for this report includes PS and TBS program officials and executives with roles and responsibilities associated with and impacting JEPP.

1.3 Structure of Report

This report has the following sections:

   Section 1 introduces this report and highlights the purpose and scope of the
   evaluation;

   Section 2 provides a description of the program;

   Section 3 discusses evaluation methodology and constraints;

   Section 4 presents findings;

   Section 5 summarizes conclusions;

   Section 6 presents recommendations;

   Appendices provide supporting materials for the body of the document.

1.4 Contact Information

Queries related to this evaluation can be directed to:

   Dave Neville, Director

   Disaster Financial Assistance and Preparedness Programs

   Emergency Management Policy Directorate, Public Safety Canada

   Telephone: 613-990-3110

   e-Mail: dave.neville@ps-sp.gc.ca

2. Program Profile

2.1 Overview

Through the Joint Emergency Preparedness Program, the Government of Canada (GC) in consultation and cooperation with provincial and territorial governments contributes to projects that enhance Canada’s national capacity to address all types of emergencies.

Provincial and territorial governments are the targeted recipients of financial contributions provided through JEPP. A province or territory may submit a proposal whose originator is the provincial or territorial government, its agencies or a municipality. First Nations Reserves are also eligible to apply for JEPP funding through the respective province or territory. Beneficiaries are emergency management organizations and first responders as well as the Canadian public.

Available funds are divided into three major allocations.

  1. JEPP Funds: The original funds provided since program inception in 1980 when JEPP was established. Available funds over the past five years have averaged approximately $5 million annually. On a yearly basis these funds are allocated based upon, but not limited to, projected provincial and territorial population, and national priorities identified annually by the JEPP program office.
  2. Critical Infrastructure Protection (CIP): Commencing in 2003-2004, $400,000 per year on-going was allocated to JEPP to fund CIP projects. National critical infrastructure comprises government and privately owned or managed physical and information technology facilities, networks and assets, which if disrupted or destroyed, would impact the health, safety, security or economic well-being of Canadians or the effective functioning of governments in Canada.2
  3. Heavy Urban Search and Rescue (HUSAR): Funding of $20 million over six years (2001-02 to 2006-07) with $3 million on-going was allocated in the 2001 federal budget through the Public Safety and Anti-Terrorism (PSAT) envelope to develop a national HUSAR capability for all hazards, including the consequences of terrorism.3

To receive JEPP funds, the recipient and GC enter into a cost-sharing agreement. The maximum percentage of sharing of eligible costs that PS will provide is 75 percent. Although the ratio is negotiated on an application by application basis and depends on the specifics of the project and the funds available, the usual ratio for JEPP funds is 50 percent federal and 50 percent provincial/territorial.

Other stakeholders can participate with the proviso that the combined contribution of other federal institutions to a project cannot exceed 25 percent of the non-federal share.

Eligible projects for JEPP funds are required to:

Projects must be completed in the fiscal year in which they are approved. Projects that require more than one year to complete must re-apply in each successive year for approval with the understanding that there is no guarantee of continued funding.

Subject to the maximum annual total amount of funding approved by Cabinet, the maximum amount payable to any province or territory is $4 million in any given fiscal year. The maximum payable for an individual project is $3 million in any given fiscal year.

2.2 Program Logic Model

The program logic model is included as Appendix ‘J’.

2.3 Governance

JEPP was established in October 19805. On April 4 2005, the Department of Public Safety and Emergency Preparedness Act came into force and the Department of the Solicitor General Act was repealed.

JEPP is administered by Disaster Financial Assistance and Preparedness Programs, Emergency Management Policy Directorate, Emergency Management and National Security (EMNS) Branch of the Department of Public Safety and Emergency Management, referenced within this document as Public Safety Canada (PS). The operational responsibility for the program lies with the Senior Assistant Deputy Minister (SADM) of the EMNS Branch.

Initial terms and conditions were approved on January 29, 19818.

2.4 Financial Signing Authority

Authority to approve, sign or amend contribution agreements is delegated by the Minister designated for the purposes of the Emergency Management Act (previously the Emergency Preparedness Act) to the PS Assistant Deputy Minister (ADM), EMNS or the ADM’s successor or delegate. Similarly, signing authority to approve payments by certifying they are in accordance with the applicable contribution agreement is delegated by the Minister.

2.5 Program Resources

The program has four approved full time equivalent (FTE’s) resources: one PM-06, two PM-04 and one PM-02. The program also uses a portion of an EX-01 (Director, DFAPP) and a portion of an AS-01 (Administrative Assistant, DFAPP).

2.6 Delivery

The program delivery described in this sub-section focuses on the GC delivery of contribution funds to provincial and territorial recipients, and specifically application, claims, and information dissemination and reporting activities. Although not described herein, each province and territory interacts with end-beneficiaries through similar, often equivalent, activities.

2.6.1 Application for Contribution

Potential recipients (provinces or territories) submit proposals to the GC using a standard JEPP application form. PS Regional Offices provide support to recipients during the application process. Completed applications are submitted to PS Regional Offices for initial review, assessment and recommendation for (or against) approval. The Regional Office forwards applications with its recommendations to the Director, DFAPP at PS headquarters in Ottawa.

The Director chairs a PS JEPP Review Committee that reviews, evaluates and recommends appropriate applications. Applications competing for funds are evaluated based upon agreed-upon criteria, including annual national priorities, and ranked. The PS JEPP Review Committee recommends approval to the SADM, EMNS in order of priority until all funds have been committed. Applications that are eligible but are not approved due to lack of funds are placed on a wait list. If funds become available throughout the year because approved projects are cancelled or do not spend their funding allotment, additional applications on the list may be recommended for approval.

2.6.2 Claim for Contribution Payment

Claims for payment (i.e. reimbursement) for approved projects are submitted by recipients to the PS Regional Office on a PS JEPP claim form. Claims forms include detail and proof (e.g. receipts) of the expenditures incurred and, to receive approval, must correspond to the estimated expenditures and details of the approved application and subsequent amendments.

Claim forms require the signature of the provincial or territorial Minister responsible for emergency preparedness or a delegated official. Claim forms for projects with a GC contribution of $50,000 or more also require an auditor’s signature; otherwise forms must be signed by a designated official with appropriate fiscal accountability under the respective provincial or territorial financial administration act. The PS Regional Director (RD) signs the form to recommend payment and forwards the claims to the Director, DFAPP at PS headquarters in Ottawa. JEPP program officials review the claims, ensure they are complete and forward to the SADM EMNS or designate to approve payment to the recipient. Subsequently, payment to recipients is processed by the Financial Operations Division.

Projects and the recipients accounting records are subject to audit at the discretion of PS.

2.6.3 Information Dissemination and Reporting Requirements

Table 1 identifies critical dates in the delivery process.

Date Activity
February 1 The PS Regional Office forwards the recommended applications to PS headquarters
April 1 The SADM ENMS approves applications and PS communicates the decision to recipients on all proposals received through the PS Regional Offices
April 10 Deadline for:
  • The submission of claims from the previous fiscal year
  • Advising PS of any funds that are to be protected under PAYE
April 30 Recipients are expected to submit a report to the respective PS Regional Director outlining progress on preparedness initiatives funded by JEPP from the previous fiscal year ending March 31.
June 15 Deadline for the receipt of claims from the previous fiscal year that were protected under PAYE
October 1 Recipients report to their PS Regional Office about approved projects identifying any funds that are no longer required and that can be reallocated to other applications

Table 1: Critical Dates in the Delivery Process

National priorities, funding arrangements and other changes to the program which affect its administration are described in Annual Update Instructions (AUIs). Changes usually take effect twelve months subsequent to the publication date. AUIs which are the primary means of disseminating information to recipients have tended to be communicated in November, although it has occurred as early as September.

Information about JEPP including manual, terms and conditions, RMAF/RBAF, and forms is found online at Joint Emergency Preparedness Program (JEPP).

3. Evaluation Methodology and Constraints

This evaluation has been informed by and follows, where possible, the Evaluation Strategy outlined in the Results-Based Management and Accountability Framework (RMAF) / Risk-Based Audit Framework (RBAF) for the Joint Emergency Preparedness Program (JEPP), dated November 2004.

3.1 Evaluation Questions

Nine specific evaluation questions have been addressed that are identified in the evaluation strategy.

Rationale and relevance:

1.    Is there a clear and relevant vision and objectives for JEPP?

2.    Does JEPP continue to be consistent with government-wide priorities relating to Emergency Preparedness?

3.    Is there a continued need for JEPP?

Success:

4.    Are planned activities actually being implemented and producing the expected outputs?

5.    Have the expected results/outcomes and reach been achieved through JEPP?

6.    Have there been any unexpected outcomes?

Cost-effectiveness and alternatives:

7.    Are there appropriate management and decision-making structures in place to meet JEPP objectives?

8.    Has there been an assessment and strategic use of lessons learned?

9.    Has there been consideration of options/alternatives to increase cost-effectiveness or efficiency in delivery?

3.2 Lines of Inquiry

The following types of data and methods were used to conduct the evaluation.

3.3 Evaluation Constraints

The Evaluation study encountered the following constraints.

3.4 Scope Constraints

The following related programs or initiative were not within the scope of the evaluation.

4. Findings

4.1 Rationale and Relevance

This section addresses the following issues:

4.1.1 Clear and Relevant Vision and Objectives

Although a clearly articulated vision could not be found in JEPP documentation, there are themes that suggest, and could be used to comprise, a relevant vision.

A comprehensive review of program documentation did not result in the finding of a defined vision or vision statement.

A vision can be defined as “a brief description of the ideal state. Due to its idealistic nature, it may in fact never be realized by the organization. Rather, the vision should serve to inspire the organization to move towards the ideal state.”9

A vision statement “outlines what [an organization] wants to be. It focuses on tomorrow; it is inspirational; it provides clear decision-making criteria; and it is timeless.”10

There are themes in program documentation that suggest the state that the program is working towards. These themes include:

JEPP has three defined objectives that could be more clearly articulated to define a preferred end-state.

The program has three stated objectives identified in the RMAF/RBAF:

The objectives could be better articulated. Usually, an objective relates to a “high-level, enduring benefit towards which effort is directed”16. The three objectives are more akin to identifying a means to an end (i.e. make, build, or lever) versus an end-state itself (e.g. adequately prepared emergency management organization or first-responder that is capable and has the capacity to protect Canadians against emergencies of all types).

The program has clearly identifiable strategies that are being followed.

Examples of strategies the program has implemented to achieve objectives include:

4.1.2 Consistency with Government-Wide Priorities

JEPP continues to be consistent with government-wide priorities related to emergency preparedness.

Public Safety Canada “advises, supports and assists the Minister in his responsibilities as they relate to …:

A departmental program priority is “protecting the security of Canada and Canadians”. A key initiative within this priority area is to “strengthen emergency management capacity, critical infrastructure protection, and federal emergency response capability”18. JEPP’s ultimate outcome, “national emergency preparedness capacity is enhanced to meet emergencies of all types”, directly contributes to this area.

The program also contributes to two other expected results within the department. Specifically:

4.1.3 Need for Contribution

There is evidence that there is a need for the federal government to continue contributions to build capacity and capability for emergency management organizations at the provincial and, especially, the municipal levels.

There is significant evidence that there is a continuing need for JEPP. Table 2 identifies on an annual basis the number of applications/proposals received and the number of projects completed.

  2003-
2004
2004-
2005
2005-
2006
2006-
2007
2007-
2008
21
Completed projects 277 360 349 318 11
Applications approved, approved in principle, sent for approval, under review         423
Not considered due to insufficient funds 30 114 96 138 140
Applications/projects withdrawn after submission or approval 69 63 73 66 27
Outstanding claims for payment (PAYE) 5 5 14 62 -
Applications not recommended, justified or approved 48 85 56 66 49
Total applications 429 627 588 650 650
Percentage of total not completed (excluding PAYE) 34% 42% 38% 42% -
Percentage of total not approved due to insufficient JEPP funds 7% 18% 16% 21% -
Percentage of total withdrawn after submission or approval 16% 10% 12% 10% -
Percentage of total not recommended, justified or approved 11% 14% 10% 10% -

Table 2: Project Summary by Year22

The table shows that on an annual basis, the program has been receiving in the range of 600 or more applications annually.

In the latest complete year (2006-2007), the program received 650 applications; only 10 percent were not approved based upon terms and conditions, but almost 21 percent were not approved because of insufficient funds. 318 projects were completed across the country by emergency management organizations in provinces and communities that were improving their emergency preparedness capacity or capabilities.

In the current year, another 650 applications had been received indicating there is still a continued need for the funds.

Emergency management officials across the country agree that emergency preparedness at the community level would be significantly and negatively impacted by the absence of JEPP.

In addition to the statistical evidence of a continuing need, emergency management officials at the provincial level participating in this review stated:

4.2 Success

This section addresses the following issues:

4.2.1 Activities and Expected Outputs

Table 3 is extracted from the project logic model in the RMAF/RBAF.

JEPP Activities Outputs
  1. Develop annual national priorities for JEPP projects
  2. Evaluate and approve JEPP proposals
  3. Contribute funds for cost-shared projects with provinces and territories in areas such as equipment purchases, emergency planning and training, etc.
  4. Monitor performance of JEPP projects through provincial/territorial annual progress reporting and periodic auditing
  5. Review and reimburse claims for JEPP projects
  6. Prepare press releases related to JEPP activities in order to provide federal visibility
  1. Annual Update Instructions (AUIs)
  2. JEPP Program Manual, with criteria and guidelines for project selection and processing
  3. JEPP projects
  4. Annual provincial progress reports
  5. Audit reports
  6. Press releases

Table 3, Program Logic Model Activities and Outputs

Planned activities have substantially been implemented and are largely producing the expected outputs.

There is evidence that each of the planned activities has been implemented and expected outputs have substantially been provided over the past five years.

There are improvements that could be made to enhance results.

There is evidence of some concerns or areas for improvement.

There are barriers that impact recipients’ and beneficiaries’ ability to participate in the program.

Participants in the evaluation identified a number of barriers experienced by recipients and beneficiaries including the following.

The program logic model which should form the basis for the monitoring, analysis and reporting of on-going performance does not reflect all activities and outputs.

The logic model does not reflect all JEPP activities. Conceptually, JEPP has three broad areas of activities – planning, provisioning and delivery – each having a number of sub-activities with related outputs. Appendix ‘J’ provides a summary of program activities observed during the evaluation. It identifies many additional activities that are not included in the existing logic model.

4.2.2 Achievement of Outcomes and Reach

Table 7 and Table 8 are extracted from the project logic model in the RMAF/RBAF.

Immediate Planned Outcome
  • Emergency preparedness equipment and personnel in place to respond to all emergencies
  • Emergency plans, partnerships and information available to facilitate emergency response
  • Appropriate public awareness of emergency management

Table 7, Program Logic Model Immediate Outcomes

Intermediate Planned Outcome
  • The provinces and territories, and through them the municipalities have made a wise investment in emergency preparedness capacity
  • Active partnerships exist between all levels of government and stakeholders to ensure emergency preparedness response

Table 8, Program Logic Model Intermediate Outcomes

There is evidence that the program has had a positive effect on ensuring emergency preparedness equipment and personnel are in place to respond to all emergencies (immediate outcome 1).

Appendix ‘D’ lists the number of completed or in progress projects by year and project type. Total projects completed that are related to emergency equipment (i.e. equipment, telecommunications, vehicle/trailer, vessel, and generators/wiring) number 915, and there may be other equipment related projects under the other project types. Provincial and territorial participants said that this equipment has been instrumental in helping first responders respond to emergency situations.

Appendix ‘D’ also identifies the total number of training projects completed or in progress: 141 in total. The majority of these projects resulted in the training of multiple emergency management personnel to better prepare and provide them with the capability to respond to emergencies.

There is evidence that emergency plans are available to facilitate emergency response (immediate outcome 2).

Appendix ‘D’ identifies over the past five years, 110 projects that have been completed or are in progress related to the development of emergency plans. In the same period, there were also 137 exercises completed or in progress. Many, if not all, of these projects would have focused on exercising emergency plans and personnel to ensure equipment and personnel are in place to respond to emergencies.

There is some evidence of public awareness of emergency management (immediate outcome 3).

Upon completion of a project, provincial/territorial and municipal officials try, in varying ways, to promote to the public JEPP projects and more particularly the involvement of the federal government. This is often done through a media release or a cheque presentation to municipal officials. The incidence, by total number of projects, of public promotion is not known. The program office reported concern that public awareness did not appear to be a high priority of recipients and end-beneficiaries, and to a degree this was confirmed by participants. The difficulty may lie in the fact that the purpose of “appropriate public awareness” is not well-defined and is stated as an outcome by itself and by itself, offers no apparent intrinsic value to recipients and end-beneficiaries. The value is derived primarily by the Canadian public that receives assurance their tax-dollars are being spent effectively and they are better protected. This value has not been reflected in the program logic model.

Determining whether the investment in emergency preparedness capacity by GC, provinces, territories and municipalities has been “wise” is difficult to ascertain (intermediate outcome 1).

There is limited data indicating how changes to emergency capacity and capability achieved through the various projects have impacted response and recovery to emergency situations. The only example provided was related to the 1998 ice storm in Ontario. The belief was that small communities in eastern Ontario responded and recovered in a more effective manner because they had emergency plans in place guiding their response. These plans were funded through JEPP and the implication is that a wise investment was made. There may be many examples of wise investment where, for example, a particular piece of equipment funded by JEPP was used to save a life or communication gear allowed a faster or more appropriate response to limit the scope of an emergency situation. Unfortunately, these examples have not been reported back to the JEPP program office and as a result data was not available during the evaluation.

There is evidence that active partnerships exist between levels of government and stakeholders to ensure emergency preparedness response (intermediate outcome 2).

Provinces and territories reported municipalities that are in close proximity with each other are partnering together to raise funds to participate in JEPP and to share in the resulting investment. JEPP has also resulted in the development of closer emergency management relationships between provinces/territories and their municipalities, evidenced by, for example, the application and proposal process at the local level. Another indicator is the amount of money the levels of governments have jointly spent on projects over the past five years, approximately $21 million (see: Appendix ‘G’) by the federal government and similar amount by the provincial/territorial and municipal governments through cost-sharing. Both provinces/territories and the PS Regional Offices report a close, cooperative and positive working relationship due in part to JEPP.

There is no partnership per se between federal and municipal governments. Working in cooperation with provincial officials, the program provides access by the federal government to municipalities. The program does allow the federal government to influence emergency preparedness at the local level and to ensure there is a level of consistency of emergency management capacity and capability across the country

There is considerable evidence of significant program reach and uptake.

All provinces and territories are participating in JEPP. Provincial and territorial participants in the evaluation reported that municipalities are aware and have been informed about the program. The larger provinces report a very high uptake among municipalities while the smaller provinces and territories report a lower uptake but still significant. Part of this lower uptake can be attributable to the small size of many municipalities in the respective province/territory and the difficulty in meeting cost sharing requirements.

4.2.3 Unexpected Outcomes

JEPP projects have resulted in the development of other projects that are not eligible for JEPP funds.

Provincial and territorial participants reported that related projects (not funded by JEPP) to those that had been funded by JEPP were initiated and completed. They stated this never would have happened without the completion of the JEPP funded project.

Recipients and end-beneficiaries have been known to limit their applications to avoid the requirement of a provincial/territorial project audit.

The claims process can be delayed substantially if the federal contribution is $50,000 or greater and a provincial/territorial audit is required. Provinces or territories have on occasion limited applications to less than $50,000 to avoid auditing. Participants suggested that the $50,000 audit threshold is too low and, considering the low-risk nature of the program, should be raised because it imposes needless burden on recipients or end-beneficiaries, and results in many projects being protected as PAYE for a significant period of time beyond the fiscal year.

Project cost-sharing is between the federal and municipal governments more so than between the federal and provincial/territorial governments even though all federal contributions flow through the provinces.

Program documentation lends itself to the perception that the cost-sharing of projects is between the federal and provincial governments (see: for example, the Introduction to the JEPP Manual). Although all JEPP contributions flow to provinces or territories, of the 318 completed projects in 2006-2007, about 12 per cent of projects were provincial/territorial and featured cost sharing between these two levels of government. About 88 percent of projects featured cost sharing between federal and municipal governments. Very few municipal projects receive any provincial funding. The role of provincial and territorial governments is heavily weighed to being administrative, rather than beneficiary.

JEPP provides a funding vehicle for other federal government initiatives to use to reach and affect emergency management capacity and capability at the provincial and local level.

JEPP has been and is being used as a vehicle to deliver other emergency management initiatives. These initiatives currently include the Critical Infrastructure Protection and the Heavy Urban Search and Rescue initiatives, and previously the Chemical, Biological, Radiological and Nuclear initiative. Without JEPP, these initiatives would have had to develop their own set of terms and conditions, management and operational vehicles and procedures. By using JEPP, these initiatives were quickly able to commence delivering services.

4.3 Cost-Effectiveness and Alternatives

This section addresses the following issues:

4.3.1 Management and Decision-Making Structures

JEPP has an established governance structure.

The Program Manager of JEPP is a direct report of the Director, Disaster Financial Assistance and Preparedness Programs, who reports to the Director General, Emergency Management and Policy Directorate, who reports to the Senior Assistant Deputy Minister (SADM), Emergency Management and National Security Branch.

Provincial and territorial participants stated that the PS Regional Offices and the JEPP program office have been very responsive and have provided high quality service in support of the program.

Regional Directors are reports of the Director General, Coordination Directorate, who reports to the SADM. RD’s have a major responsibility within the JEPP application and claim processes. They are required to formally recommend, by signing the respective forms, applications for project funding and claims for project expense reimbursement. They are also expected to provide information and advice about the program to provincial and territorial JEPP representatives. They are not, however, vested with any accountability for the results or outcomes of JEPP, or the quality and accuracy of applications and claims. The federal program office stated that they receive a significant number of claims that are incomplete or inaccurate, requiring additional information and delaying reimbursements.

The program has instituted controls to ensure that approved applications/proposals meet appropriate criteria, and terms and conditions are followed.

On an annual basis in the third week of March, the JEPP Review Committee convenes to review applications that have been submitted at the beginning of February by provinces/territories on behalf of municipalities and provincial/territorial EMOs for earmarked and regular funds. The committee is chaired by the Director, Disaster Financial Assistance and Preparedness Programs. It is also comprised of the Ontario and Quebec Regional Directors, one or two additional RDs, representatives of the Canadian Emergency Management College who advise on training and education applications, and the JEPP Program Manager. Input is also solicited from the PS National Exercise Division, other PS organizations and federal government departments and agencies as required.

Concern was expressed by regional offices about the inclusiveness of the JEPP Review Committee since it always includes Quebec and Ontario.

Each proposal is considered against:

The outcome of the JEPP Review Committee meeting is a list of recommended projects to be submitted to the SADM for approval.

Applications that are within the terms and conditions but cannot initially be approved due to insufficient funds are put on a waiting list for funding that may become available during the fiscal year. If the project is still feasible when funding becomes available, the application is recommended for approval.

The SADM directly approves all projects that feature a federal contribution of $75,000 to $250,00025. For projects less than $75,000, the DG Emergency Management and Policy Directorate has delegated authority.

Upon completion of a project, the applicable provincial/territorial government submits a claim, including required documentation, for payment to the Regional Office of Public Safety Canada. If the federal share is $50,000 or more, the claim must be certified by a designated provincial/territorial official with appropriate fiscal accountability under provincial/territorial financial administration acts. The PS RD recommends payment (or not) to the JEPP program office, who in turn, reviews the claim to ensure all conditions have been met. If so, payment is recommended to the SADM or delegate.

The program uses the completed and signed federal application form as the formal funding agreement between provincial/territorial recipient and the federal government.

The program does not create, for each approved project, a contribution agreement that is a formal written legal document setting out the obligations of the federal government and the recipient with respect to the transfer payment. Instead it considers the federal application form as a type of quasi contribution agreement. The form commits the recipient to complying with program terms and conditions and “JEPP guidelines”. The impact of the lack of a formal contribution agreement is difficult to assess given the success of the program, however, federal officials expressed concern about their lack of recourse when provinces/territories act in a way that does conflict with program terms and conditions.

The program is considering the implementation of contribution agreements. Provinces and territories expressed concern that the agreement may include a liability clause they are unable to accept because of their lack of control over projects that originate at the municipal level.

There is limited evidence that a risk-based approach has been taken to the management of projects or the program itself.

JEPP has been identified as a low-risk contribution program26. No evidence was collected during the evaluation process to suggest otherwise. However, there are still threats to program success and there is limited evidence that a risk-based management approach has been taken including the explicit identification of risk, mitigation strategies, and monitoring.

For example, the program lapses on average sixteen percent of funds on an annual basis even though the program is over-subscribed. Funds are committed to projects that are not started or completed. Provinces/territories and municipalities are allowed to retain scarce funding whether they have the actual ability to use it, to the detriment of other projects and ultimately with no consequences. This could represent a threat to current program funding levels and future potential increases.

National priorities are not approved by senior officials and do not include provincial or territorial input.

Although national priorities at one time during the program life cycle involved provinces and territories and were agreed to by Senior Officials Responsible for Emergency Management (SOREM), this is no longer the situation. National priorities are determined by the JEPP program office and rarely include the involvement of senior officials at the various levels of government, making questionable whether they are actual priorities in the broad national interest or criteria and guidance by the program office for the effective investment of limited funds.

The JEPP program office has limited direct contact with provinces or territories, or other organizations that could contribute independent advice, recommendations or guidance.

The JEPP program office is somewhat insular in the sense that its conduit for information is primarily the PS regional offices. There is limited direct contact with recipients meaning that information from these sources can be subject to a regional office filter prior to receipt. The program office has even less contact with municipal end-beneficiaries because the federal government is obligated to communicate to them through or with the cooperation of provincial or territorial governments. The program office has no direct way of communicating with the majority of end-beneficiaries to elicit input on priorities or feedback on funded projects or the program itself.

JEPP also does not have the benefit of an advisory organization that could contribute independent advice, recommendations or guidance that could, for example, help formulate annual priority investment decisions and provide input into the program renewal process.

The provincial/territorial governments have JEPP administrative organizations that carry out tasks and activities that are often equivalent to those completed by the federal JEPP program office.

Provinces and territories, especially the larger ones, have created program infrastructure that is very similar to the federal program office. They are staffed with emergency management personnel who have the responsibility to review, ensure compliance with JEPP terms and conditions, ensure completeness, and recommend applications and claims to their senior management for approval to submit to the PS regional office and ultimately to the JEPP program office. The JEPP program office processes the applications and claims and effectively duplicates many of the tasks and activities completed at the provincial level prior to submission to the SADM for approval.

Program outcomes are not well-formulated making it difficult to align with objectives and to measure performance.

Objectives should be closely aligned with outcomes. However, because objectives and program outcomes are not well-formulated the alignment and relationship is not obvious. For example, intermediate outcomes identify “wise investments” and the existence of “active partnerships”. The relationship between these statements and the objectives can be surmised, but it is open to interpretation and not clear.

Information and data about defined performance indicators is not collected, analyzed or used on an on-going basis.

Much of the data associated with performance indicators identified in the RMAF/RBAF is not collected or used on an on-going basis to manage the program or track actual versus expected results. Examples include:

4.3.2 Use of Lessons Learned

There is minimal evidence that the program makes use of lessons learned.

Some participants suggested that they informally consult with their counterparts in other provinces or territories to learn about lessons learned in other jurisdictions. The JEPP review Committee considers issues and concerns on an annual basis in the context of evaluating projects. The JEPP program office is in the process of documenting all facets of the program which may take into account lessons learned, however it is difficult to determine because the individual who was writing the documentation has since left the program office.

The program has not implemented formal processes or mechanisms for the identification, sharing and use of lessons learned across jurisdictions.

Participants consistently suggested that a formal mechanism to collaborate about JEPP and share lessons learned between federal JEPP program office, PS Regional Offices, and provincial and territorial JEPP organizations would be valuable. Possible mechanisms include an annual conference or regular teleconferences.

There was no consensus on the involvement of municipalities or whether an invitation should be extended for their participation.

4.3.3 Increased Cost Effectiveness or Efficiency

There has been some consideration of options/alternative to increase cost-effectiveness or efficiency in delivery.

Options and alternatives are considered during the creation of the AUI. Specific projects to improve the program are also considered for funding. For example, the program office has contributed to an Ontario project the purpose of which is to automate the application process at the municipal and provincial level.

The application and claims processes from end-beneficiary to federal government can be long, include a large number of approval points, and feature duplicative effort and activities.

The application process can be long and involved, especially those which originate at the municipal level. Municipalities complete an application and proposal with supporting documentation and the necessary approval of senior municipal officials. The application is often completed using a provincial/territorial JEPP form. In the larger provinces, there may be a provincial/territorial emergency management (EM) district office that helps the municipality complete the application and subsequently receives, reviews for program eligibility criteria and completeness, and provides a recommendation. The application is then forwarded, either directly by the municipality or through the EM district office, to the emergency management organization at the provincial/territorial level. The provincial/territorial EMO receives the application, reviews for program eligibility criteria and assesses completeness. If the application is not complete, the municipality will be asked to provide further information. The province/territory will convene its JEPP review committee to assess and prioritize applications that will be forwarded to the federal government. The assessment and prioritization is usually based upon criteria suggested by the federal government in AUIs (i.e. national priorities) but provinces/territories may also set their own priorities providing they are in accordance with program terms and conditions. During the review process, the province/territorial JEPP officials usually work closely with the PS Regional Office. The provincial/territorial EMO will transcribe the provincial/territorial application to a federal application form. Federal applications that are recommended by provincial/territorial JEPP officials are referred for signing by provincial/territorial senior officials. The application forms are subsequently forwarded to the PS Regional Office. The PS Regional Office receives the application, reviews for program eligibility criteria and assesses for completeness. If the application is not complete, the province will be asked to provide further information. The PS Regional Office will then sign each application providing its recommendation that the proposal should be considered for federal funding. Subsequently, the application will be sent to the federal JEPP program office. The JEPP program office receives, reviews for program eligibility criteria and completeness. If the application is not complete, the PS Regional Office will be asked to provide further information. Although no statistics are available and even though there have been at least two reviews of the application prior to its involvement, the federal program office indicates that they still receive a substantial number of applications that are incomplete and require further information, suggesting improvements can be made in the review process at either or both the PS Regional Office or the province/territory EMO. The JEPP program office will convene the JEPP Review Committee to assess and prioritize applications. Recommended applications will be forwarded to the PS SADM for final approval. Unlike previous steps in the process, the JEPP program office is not actually required to formally sign off on the application in a similar manner as the municipalities, provinces/territories or PS Regional Offices.

The claims process is similarly involved. Although it only happens for a small percentage of projects, claims can be delayed substantially if the federal contribution is $50,000 or greater and a provincial/territorial audit is required.

There are variations to the process depending upon the province or territory. Smaller provinces or territories may not have their own form and may not prescribe a proposal format. Provinces/territories may set there own criteria for prioritizing applications during the review process. They may also set contribution limits on specific items. Claims forms are submitted by municipalities directly to the provincial/territorial EMO and not, if it exists, through a provincial EM district office.

There are no statistical figures on the end-to-end cost of applications or claims as a percentage of the federal contribution so it is difficult to assess whether the onerous applications and claims processes are appropriate cost of business for the dollar amount. However, during the four years from 2003-2004 through 2006-2007, approximately 70 percent of completed projects received a federal contribution of less than $10,000 (see: Table 9). Many projects are in the hundreds of dollars.

Year Total Projects27 Projects with Federal Contribution of $9999.99 or less28 Percentage of Projects with Federal Contribution of $9999.99 or less
2003-2004 277 176 64%
2004-2005 360 265 74%
2005-2006 349 243 70%
2006-2007 318 231 73%

Table 9, Completed Projects with a Federal Contribution of less than $10,000.

The JEPP program appears to be efficient but, due to lack of personnel, this is accomplished at the expense of effective program monitoring and reporting, and strategic activities.

The JEPP program office has a head-count of four FTE’s. The program also uses a portion of an EX-01 and a portion of an AS-01. At the time this evaluation was completed, all positions were vacant with the exception of the EX-01, AS-01 and one PM-04 who, during the PM-06 vacancy, was acting as a PM-05. The result is that existing staff tend to focus on immediate, tactical, operational tasks, usually processing applications and claims. To the program office’s credit, the large numbers of applications are processed within a two month window. Claims tend to take longer to process; a sampling (see: Appendix ‘H’) suggests claims typically take three months to be processed at the federal level although some take considerably longer. As a result of resource constraints, minimal time is available to delegate to strategic activities such as planning, program review and improvement; performance and risk management; and promotion. The lack of resources also impacts the program office’s ability to advise, mentor and train Regional Offices about JEPP, and to facilitate regular collaborative events involving the program office, Regional officials, provincial EMO officials, and industry experts in which there can be a dialogue about, for example, lessons learned, program improvements, and national priorities.

5. Conclusions

5.1 Rationale and Relevance

Evidence suggests that the Joint Emergency Preparedness Program is still consistent with department and government-wide priorities related to emergency management, and it realistically addresses an actual need (i.e. the need for funds at both the provincial/territorial and municipal levels to enhance Canada’s national capacity to address all types of emergencies). Emergency management officials across the country agree that emergency preparedness at the community level would be significantly and negatively impacted by the absence of JEPP.

The clarity and design of the program could be improved. Articulating a vision and clarifying objectives to define a preferred end-state would be a first step.

5.2 Success

JEPP has achieved positive results:

The scope of success is difficult to determine because of a logic model that could be improved to better reflect the program and the limited availability of relevant performance data. There have also been some unexpected or negative consequences:

5.3 Cost-Effectiveness and Alternatives

There is evidence that efficient means are being used to achieve results and there are appropriate management and decision-making structures in place to meet objectives:

Management and decision-making structures could be strengthened. The lack of a contribution agreement leaves the program office with limited means to manage project risk. It also leaves the program office with minimal recourse when a project is not completed as planned. There is limited evidence that a risk-based approach has been taken to the management of projects or the program itself.

Overall, the JEPP program appears to be efficient but, due to lack of personnel, this is accomplished at the expense of effective program monitoring and reporting, and strategic activities. There is evidence that program design or delivery approaches should be updated and alternatives considered:

6. Recommendations

Recommendation 1: Fill Open Positions in the JEPP Program Office

A key priority of the Director, Disaster Financial Assistance and Preparedness Programs is to fill the open positions in the JEPP program office and obtain a commitment for their on-going funding. At the time of writing this report, the current JEPP human resources were almost exclusively utilized managing project applications and claims with little time left over for any other activities such as monitoring and improving performance, risk management, reporting, or stakeholder engagement. Until this recommendation is substantially completed, addressing other recommendations will be difficult.

Recommendation 2: Engage Provincial, Municipal and Industry Stakeholders

Engagement should take the form of an annual conference in which stakeholders can physically meet in the same location rather than a teleconference which can limit participation and the sharing of information.

Engagement may also take the form of an advisory committee that would provide strategic advice to the program on standards, trends and future direction as well as daily operational issues such as governance and process improvements.

Recommendation 3: Review and Update End-to-End Application and Claims Processes

As noted in the findings, the end-to-end application and claims processes can be long and, across jurisdictions, can involve many duplicate tasks and approvals. Also, critical dates defined by the program can conflict with critical fiscal dates at the municipal level. The federal JEPP program office should take the lead in reviewing the processes, identify options for improvement (e.g. reducing duplication, increasing time to completion, mitigating municipal constraints), and facilitate implementation. Consideration should be given to:

Recommendation 4: Update Program Design

Findings identified a number of issues related to program design suggesting a comprehensive review is required which should ultimately result in an updated program design. During this exercise, consideration should be given to:

The updated program design should also consider the relationship of related initiatives including HUSAR and CIP, and how they should be integrated into the overall design.

The updated design should be used to inform an update of the RMAF/RBAF, the program terms and conditions, and the JEPP Manual.

Recommendation 5: Update Terms and Conditions

The program’s terms and conditions should be reviewed and updated. In particular, consideration should be given to the following.

Recommendation 6: Adjust the Manner in which Projects are Promoted

The manner in which the program promotes its involvement in projects and why it promotes itself should be reviewed. Consideration should be given to:

Appendix ‘A’ – Documents Reviewed

Brenda Buchanan, “Joint Emergency Preparedness Program, Evaluation of the Federal Contribution Program”, Final Report, November 25, 2003

Disaster Financial Assistance and Preparedness Programs (DFAPP) Division, “Business Plan 2006-07” March 31, 2006.

Joint Emergency Preparedness Program, “Annual Update Instruction #1”, January 1995.

Joint Emergency Preparedness Program, “Annual Update Instruction #2”, November 1995.

Joint Emergency Preparedness Program, “Annual Update Instruction #3”, July 1996.

Joint Emergency Preparedness Program, “Annual Update Instruction #4”, September 1997.

Joint Emergency Preparedness Program, “Annual Update Instruction #5”, November 1998.

Joint Emergency Preparedness Program, “Annual Update Instruction #6”, December 1999.

Joint Emergency Preparedness Program, “Annual Update Instruction #7”, December 2000.

Joint Emergency Preparedness Program, “Annual Update Instruction #8”, December 2001.

Joint Emergency Preparedness Program, “Annual Update Instruction #9”, January 2004.

Joint Emergency Preparedness Program, “Annual Update Instruction #10”, November 2004.

Joint Emergency Preparedness Program, “Annual Update Instruction #11”, November 2005.

Joint Emergency Preparedness Program, “Annual Update Instruction #12”, January 2007.

Joint Emergency Preparedness Program, “Annual Update Instruction #13”, September 2007.

Joint Emergency Preparedness Program, “Joint Emergency Preparedness Program (JEPP)”.

Joint Emergency Preparedness Program, “Management Action Plan (MAP) – Joint Emergency Preparedness Program (JEPP) Evaluation”, February 2004.

Joint Emergency Preparedness Program, “Results-Based Management and Accountability Framework (RMAF)/Risk-Based Audit Framework (RBAF) for the Joint Emergency Preparedness Program (JEPP)”, November 2004.

Joint Emergency Preparedness Program, “Standard Operating Manual and Samples”, August 2, 2007.

Joint Emergency Preparedness Program, “Terms and Conditions for the Payment of Contributions under the Joint Emergency Preparedness Program (JEPP)”, November 2004.

“Memorandum of Understanding between Public Safety and Emergency Preparedness Canada and Audit Service Canada 2006-2007”, unsigned, undated.

Office of Critical Infrastructure Protection and Emergency Preparedness, “Information Note”, June 20, 2003.

Office of the Auditor General of Canada, “2004 Report of the Auditor General of Canada”, March 2004, chapter 3.

Office of the Auditor General of Canada, “2005 Report of the Auditor General of Canada”, April 2005, chapter 2.

Public Safety and Emergency Preparedness Canada, “Briefing Note for the Honourable Beverley Oda – Funding for Emergency Preparedness through the Joint Emergency Preparedness Program (JEPP)”, March 12, 2007.

Public Safety and Emergency Preparedness Canada, “Information Note”, December 2006.

Public Safety and Emergency Preparedness Canada, “Memorandum for the Minister, Joint Emergency Preparedness Program (JEPP)”, File No./TD No. 7210-1/338506”, undated.

Public Safety and Emergency Preparedness Canada, “Memorandum for the Senior Assistant Deputy Minister, Joint Emergency Preparedness Program (JEPP) Applications for 2005-2006”, File No. 7500-1/TD No. 326954”, undated.

Public Safety and Emergency Preparedness Canada, “Memorandum for the Senior Assistant Deputy Minister, Joint Emergency Preparedness Program (JEPP) Applications Over $75,000 for 2005-2006”, File No. 7500-1/TD No. 327228”, undated.

Public Safety and Emergency Preparedness Canada, Preparedness and Recovery Directorate, “Summative Evaluation for the Heavy Urban Search and Rescue (HUSAR) Initiative”, August 30, 2007.

Public Safety and Emergency Preparedness Canada, “Report on Plans and Priorities 2007 – 2008”.

Public Safety and Emergency Preparedness Canada (PSEPC), “Update on Audit Plans for FY 2005-2006 and Proposed Audit Plan for FY 2006-2007 to FY 2008-2009”, undated.

Public Safety Canada, “Briefing Note, Joint Emergency Preparedness Program”, April 16, 2007.

Public Safety Canada, Disaster Financial Assistance and Preparedness Program Division, “Joint Emergency Preparedness Program (JEPP), Contributions, A Practical Guide to Project Contribution Management”, August 2007.

Statues of Canada 2007, Chapter 15, “Bill C-12, An Act to provide for emergency management and to amend and repeal certain Acts”, 22nd June, 2007.

Appendix ‘B’ – Participants

The following individuals were consulted or interviewed in the preparation of the evaluation and provided information that has been used in this report.

Kay Agelakos, Senior Emergency Management Assistant, EMO, Province of Ontario

Robert Bégin, Regional Director, Quebec Regional Office, Emergency Management and National Security, Public Safety Canada

Nicole Bizai-Lévesque Program Officer Disaster Financial Assistance and Preparedness Programs, Public Safety Canada

Melissa Black, Coordinator, Disaster Recovery/Joint Emergency Preparedness Programs, Alberta Emergency Management Agency

Nadine Blackburn, Senior Communications Advisor, Quebec Regional Office, Emergency Management and National Security, Public Safety Canada

Wayne Brocklehurst, Regional Director, Ontario Regional Office, Emergency Management and National Security, Public Safety Canada

Cameron Buchanan, Acting Regional Director, Manitoba Regional Office, Emergency Management and National Security, Public Safety Canada

Teresa Ferguson, Coordinator, Recovery and Funding Programs, Provincial Emergency Program, Emergency Management British Columbia

Barry Folland, Program Officer, Office of Public Safety, Province of Prince Edward Island

Christine Hick, Senior Emergency Management Officer, Alberta Regional Office, Emergency Management and National Security, Public Safety Canada

Fred Hollett, Fire Commissioner/Director, Fire and Emergency Services Agency, Province of Newfoundland and Labrador

Colin King, Federal and Provincial Programs Supervisor, SaskEMO, Province of Saskatchewan

Colin Lloyd, Director of Community Programs, Alberta Emergency Management Agency,

Johanna Morrow, Manager, Recovery and Funding Programs, Provincial Emergency Program, Emergency Management British Columbia

Dave Neville, Director, Disaster Financial Assistance and Preparedness Programs, Public Safety Canada

Paul Pagotto, Manager, NCIAP, Strategy Implementation and Partnerships, Critical Infrastructure Policy, Public Safety Canada

Paul Peddle, Training Officer, Fire and Emergency Services Agency, Province of Newfoundland and Labrador

Randy Reid, Deputy Chief, Program Support, EMO, Province of Ontario

Adam Rostis, Senior Policy Advisor, Emergency Management Office, Province of Nova Scotia

Murray Sanders, Federal Programs Coordinator, SaskEMO, Province of Saskatchewan

Gord Settle, Emergency Planning Officer, Yukon Territory

Dennis Shea, Manager, Plans and Operations, Fire and Emergency Services Agency, Province of Newfoundland and Labrador

Mona Smith, Program Officer, Recovery and Funding Programs, Provincial Emergency Program, Emergency Management British Columbia

Appendix ‘C’ – Total Number of Applications29


  Earmarked Regular  
Funding Purpose 2003-
2004
2004-
2005
2005-
2006
2006-
2007
2007-
2008
Sub-
Total
2003-
2004
2004-
2005
2005-
2006
2006-
2007
2007-
2008
Sub-
Total
Total
Planning 41 33 25 12 11 122 6 5 11 7 10 39 161
EOC/Reception Centre 33 13 19 45 29 139 64 78 62 50 38 292 431
Equipment 9 8 27 40 44 128 18 42 35 70 46 211 339
Telecommunications 17 24 57 35 91 224 41 89 30 50 38 248 472
Vehicle/Trailer 5 4 5 4 6 24 19 30 32 37 40 158 182
Training/Education 5 21 45 61 32 164 7 15 3 3 9 37 201
CBRN 0 3 0 3 4 10 1 11 8 14 11 45 55
Public Information 5 0 1 1 4 11 0 0 1 0 1 2 13
Exercises 44 19 27 26 38 154 2 28 5 8 9 52 206
Informatics/
Computers/
Software
1 4 1 2 4 12 3 4 1 7 3 18 30
Vessel 0 2 0 2 0 4 2 1 4 4 2 13 17
Prototypical Initiative 0 0 0 0 3 3 0 0 1 3 0 4 7
Generators/Wiring 1 12 70 100 32 215 52 138 84 34 105 412 627
Other 11 9 19 14 13 66 5 6 13 11 22 57 123
CBRN - Pending 3 0 0 0 0 3 17 0 0 0 0 17 20
CIP 0 0 0 0 0 0 0 0 0 0 1 1 1
EMO Support Plan 5 2 0 3 4 14 0 0 0 0 0 0 14
Evaluation 0 0 0 3 0 3 0 0 1 0 0 1 4
HUSAR 0 0 0 0 0 0 0 0 0 1 0 1 1
Publication 0 0 0 0 0 0 0 0 0 0 0 0 0
Research and Development 0 0 0 0 0 0 0 0 1 0 0 1 1
Search and Rescue 0 1 0 0 0 1 0 0 0 0 0 0 1
USAR 0 0 0 0 0 0 12 25 0 0 0 37 37
Total per Fund Type 180 155 296 351 315 1297 249 472 291 299 335 1646 2943
Total per Year (Earmarked and Regular)             429 627 588 650 650    

Note: Characters in blue and bolded directly relate to national priorities for the given year.

Appendix ‘D’ – Total Number of Completed Projects
(Including PAYE)30


  Earmarked Regular  
Funding Purpose 2003-
2004
2004-
2005
2005-
2006
2006-
2007
2007-
2008
Sub-
Total
2003-
2004
2004-
2005
2005-
2006
2006-
2007
2007-
2008
Sub-
Total
Total
Planning 30 25 18 8 11 92 3 2 3 2 8 18 110
EOC/Reception Centre 28 13 17 41 27 126 53 59 56 10 36 214 340
Equipment 8 8 23 34 43 116 5 7 4 28 15 59 175
Telecommunications 13 23 55 33 90 214 29 59 21 25 32 166 380
Vehicle/Trailer 3 3 3 4 6 19 3 2 7 4 5 21 40
Training/Education 5 20 33 39 30 127 1 6 1 1 5 14 141
CBRN 0 3 0 3 4 10 0 8 6 13 8 35 45
Public Information 5 0 1 0 4 10 0 0 1 0 0 1 11
Exercises 21 13 17 23 36 110 2 14 2 1 8 27 137
Informatics/
Computers/
Software
1 2 1 1 2 7 0 0 0 2 1 3 10
Vessel 0 1 0 2 0 3 0 1 0 2 0 3 6
Prototypical Initiative 0 0 0 0 3 3 0 0 1 2 0 3 6
Generators/Wiring 1 10 50 82 31 174 35 69 24 4 8 140 314
Other 11 9 17 10 4 51 1 2 0 1 2 6 57
CBRN - Pending 2 0 0 0 0 2 8 0 0 0 0 8 10
CIP 0 0 0 0 0 0 0 0 0 0 0 0 0
EMO Support Plan 4 2 0 2 4 12 0 0 0 0 0 0 12
Evaluation 0 0 0 2 0 2 0 0 1 0 0 1 3
HUSAR 0 0 0 0 0 0 0 0 0 0 0 0 0
Publication 0 0 0 0 0 0 0 0 0 0 0 0 0
Research and Development 0 0 0 0 0 0 0 0 0 0 0 0 0
Search and Rescue 0 1 0 0 0 1 0 0 0 0 0 0 1
USAR 0 0 0 0 0 0 10 3 0 0 0 13 13
Total Per Year By Fund Type 132 133 235 284 295 1079 150 232 127 95 128 732 1811

Note 1: Characters in blue and bolded directly relate to national priorities for the given year.
Note 2: 2007-2008 figures reflect completed, in process or approved

Appendix ‘E’ – Percentage of Applications Approved
(Including PAYE)


  Earmarked Regular  
Funding Purpose 2003-
2004
2004-
2005
2005-
2006
2006-
2007
2007-
2008
Sub-
Total
2003-
2004
2004-
2005
2005-
2006
2006-
2007
2007-
2008
Sub-
Total
Total
Planning 73% 76% 72% 67% 100% 75% 50% 40% 27% 29% 80% 46% 68%
EOC/
Reception Centre
85% 100% 89% 91% 93% 91% 83% 76% 90% 20% 95% 73% 79%
Equipment 89% 100% 85% 85% 98% 91% 28% 17% 11% 40% 33% 28% 52%
Telecommu-
nications
76% 96% 96% 94% 99% 96% 71% 66% 70% 50% 84% 67% 81%
Vehicle/
Trailer
60% 75% 60% 100% 100% 79% 16% 7% 22% 11% 13% 13% 22%
Training/
Education
100% 95% 73% 64% 94% 77% 14% 40% 33% 33% 56% 38% 70%
CBRN 0% 100% 0% 100% 100% 100% 0% 73% 75% 93% 73% 78% 82%
Public Information 100% 0% 100% 0% 100% 91% 0% 0% 100% 0% 0% 50% 85%
Exercises 48% 68% 63% 88% 95% 71% 100% 50% 40% 13% 89% 52% 67%
Informatics/
Computers/
Software
100% 50% 100% 50% 50% 58% 0% 0% 0% 29% 33% 17% 33%
Vessel 0% 50% 0% 100% 0% 75% 0% 100% 0% 50% 0% 23% 35%
Prototypical Initiative 0% 0% 0% 0% 100% 100% 0% 0% 100% 67% 0% 75% 86%
Generators/
Wiring
100% 83% 71% 82% 97% 81% 67% 50% 29% 12% 8% 34% 50%
Other 100% 100% 89% 71% 31% 77% 20% 33% 0% 9% 9% 11% 46%
CBRN - Pending 67% 0% 0% 0% 0% 67% 47% 0% 0% 0% 0% 47% 50%
CIP 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0%
EMO Support Plan 80% 100% 0% 67% 100% 86% 0% 0% 0% 0% 0% 0% 86%
Evaluation 0% 0% 0% 67% 0% 67% 0% 0% 100% 0% 0% 100% 75%
HUSAR 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0%
Publication 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0%
Research and Development 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0%
Search and Rescue 0% 100% 0% 0% 0% 100% 0% 0% 0% 0% 0% 0% 100%
USAR 0% 0% 0% 0% 0% 0% 83% 12% 0% 0% 0% 35% 35%
Total  Per Year by Fund Type 73% 86% 79% 81% 94% 83% 60% 49% 44% 32% 38% 44% 62%

Note: Characters in blue and bolded directly relate to national priorities for the given year.

Appendix ‘F’ – Value of National Priority Applications Completed
(Including PAYE)31


  Earmarked Regular  
Funding Purpose 2003-
2004
2004-
2005
2005-
2006
2006-
2007
2007-
2008
Sub-
Total
2003-
2004
2004-
2005
2005-
2006
2006-
2007
2007-
2008
Sub-
Total
Total
Telecommu-
nications
$222 $209 $337 $418 $706 $1186 $205 $331 $84 $256 $543 $874 $2062
Training/
Education
$141 $317 $300 $255 $326 $1013 $9 $55 $1 $17 $140 $82 $1095
Exercises     $97 $200 $152 $292     $36 $10 $32 $46 $343
Prototypical Initiative $0 $0       $0 $0 $0       $0 $0
Total Allocated to Priorities $363 $526 $734 $873 $1184 $2496 $214 $326 $121 $283 $715 $1002 $3440
Funds Committed $2743 $2551 $2945 $2860 TBD $11099 $1436 $1603 $1136 $1650 TBD $5825 $16924
Percent of Funds Committed Allocated to Priorities 13% 21% 25% 31% TBD 22% 15% 20% 11% 17% TBD 17% 20%
Overall Total (Earmarked and Regular)   $577 $852 $855 $1156 TBD   $3440
Total Funds Committed (Earmarked and Regular)   $4179 $4154 $4081 $4510 TBD   $16924
Percent of Total Funds Committed Allocated to Priorities (Earmarked and Regular)   14% 21% 21% 26% TBD   20%

Note 1: All figures in $000s, amounts are federal contributions, Sub-Total and Total columns exclude 2007-2008
Note 2: Regular funds include moneys that have been allocated to a project but are unused during the year either because the project has been cancelled or the completed project came in under budget. As a result, the funds are available for re-distribution by the Federal JEPP Program Office to applications that have been kept on a waiting list.

Appendix ‘G’ – Total Federal Funds Contributed or Committed32


Province 2003-
2004
2004-
2005
2005-
2006
2006-
0007
2007-
2008
5 Year
Total
Total
Since
Inception
Alberta $387.9 $352.5 $283.5 $443.0 $462.7 $1,929.6 $9,346.0
British Columbia $363.3 $507.7 $484.6 $479.8 $489.3 $2,324.7 $8,959.4
Manitoba $232.5 $242.4 $241.5 $181.5 $232.3 $1,130.2 $9,484.8
New Brunswick $214.4 $172.4 $146.7 $188.0 $193.2 $914.7 $7,372.4
Newfoundland $166.5 $208.3 $178.2 $171.3 $146.8 $871.1 $4,620.8
Nova Scotia $167.1 $164.3 $197.5 $205.2 $205.2 $939.3 $5,657.4
Nunavut $137.5 $60.7 $127.3 $100.0 $102.5 $528.0 $1,128.0
Northwest Territories $155.5 $151.1 $157.0 $138.1 $132.6 $734.3 $4,461.0
Ontario $1,150.8 $1,279.0 $1,140.3 $1,369.2 $1,501.0 $6,440.3 $36,512.5
Prince Edward Island $159.0 $160.5 $162.0 $44.6 $104.4 $630.5 $5,635.0
Quebec $787.9 $466.0 $563.6 $837.2 $988.4 $3,643.1 $24,536.5
Saskatchewan $75.3 $207.5 $239.1 $208.9 $243.8 $974.6 $6,263.6
Yukon $181.3 $181.8 $159.8 $144.4 $112.4 $779.7 $3,872.4
Total $4,179.1 $4,154.2 $4,081.0 $4,510.5 $4,914.7 $21,839.5 $127,849.8

Note 1: All figures in $000s, rounding may introduce small variances with actual figures.

Appendix ‘H’ – Timeframe to Process Claims at the Federal Level33


File Number Province Date Claim Received or Recommended by PS Regional Office Date Cheque Issued by PS Finance Organization Approximate
Elapsed Time
(in Months)
7509-610 Alberta 21-June-07 18-September-07 3.00
7509-627 Alberta 3-October-2006 8-December-06 2.25
7509-638 Alberta 28-May-07 6-July-07 1.25
7501-213 Newfoundland and Labrador 22-June-07 22-September-07 3.00
7501-222 Newfoundland and Labrador 29-March-07 31-May-07 2.00
7501-232 Newfoundland and Labrador 22-May-07 27-September-07 4.25
7503-89 Nova Scotia 15-August-07 27-September-07 1.50
7503-100 Nova Scotia 10-April-07 31-May-07 1.75
7502-65 Prince Edward Island 9-November-06 8-December-06 1.00
7508-268 Saskatchewan 5-June-07 27-September-07 3.75
7512-97 Yukon 11-October-06 10-December-06 2.00
7510-873 British Columbia 22-May-07 27-September-07 4.25
7510-884 British Columbia 5-June-07 27-September-07 3.75
7510-895 British Columbia 13-June-07 27-September-07 3.50
7510-905 British Columbia 5-June-07 27-September-07 3.75
7510-917 British Columbia 22-May-07 27-September-07 4.25
7510-928 British Columbia 30-October-06 8-December-06 1.25
7510-941 British Columbia 30-October-06 8-December-06 1.25
7506-39-003 Ontario 25-May-07 24-August-07 3.00
7506-39-021 Ontario 8-December-06 12-August-07 7.25
7506-39-034 Ontario 19-February-07 24-August-07 6.25
7906-39-046 Ontario 18-June-07 3-October-07 3.50
7506-39-062 Ontario 23-March-07 2-August-07 4.25
  Average Elapsed Time 3.13

Appendix ‘I’ – Program Logic Model34

Program Logic Model

Appendix ‘J’ – Observed Activities


Activity Sub-Activity Output
Planning TPP Administration TBS Reports (including submissions, terms and conditions, RMAF/RBAF, evaluations, renewal, etc.)
Set performance targets. Performance targets
Monitor and measure performance targets through, for example, provincial/territorial annual progress reporting and periodic auditing Performance reports
Forecast risks/threats to delivery Threat/risk assessment with mitigation strategy
Estimate resource requirements Resource forecasts
Provisioning Develop annual national priorities, equip recipients so they are able to access and use the program, program promotion AUIs, Program Manual (including forms, templates, etc.), training, and other program information
Accept, analyze and respond to stakeholder issues and concerns Program information
Recruit and manage resources; train and equip as necessary Deployed resources
Develop, procure and maintain tools Tools including the JEPP database, program manual (including forms, templates, etc.) , etc.
Monitor risk Risk reports
Delivery Receive and assess JEPP applications Application decision
Receive and assess claims for JEPP projects Claim decision
Distribute funds for approved claims from cost-shared projects with provinces and territories Funds
Prepare press releases related to JEPP activities in order to provide federal visibility Program information

1 “Joint Emergency Preparedness Program, Evaluation of the Federal Contribution Program, Final Report”, Brenda Buchanan, November 25, 2003.

2 The CIP Initiative is not within the scope of this evaluation.

3 The HUSAR Initiative is not in the scope of this evaluation.

4 RD 418-80RD (c).

5 P.C. 2003-2086 issued under section 3 of the Public Service Rearrangement and Transfer of Duties Act, R.S.C. 1985, c. p-34.

6 TB Number 775116.

7 TB Number 799188.

8 TB Number 831600

9 http://www.gov.sk.ca/finance/accountability/2006/keyterms.htm

10 http://strategis.ic.gc.ca/epic/site/stco-levc.nsf/en/h_qw00037e.html

11 “Results –Based Management and Accountability Framework (RMAF) / Risk-Based Audit Framework (RBAF) for the Joint Emergency Preparedness Program (JEPP)”, November 2004, section 1.

12 Ibid.

13 JEPP Manual, modified: 2007-9-18.

14 Ibid.

http://www.tbs-sct.gc.ca/eval/pubs/rmaf-cgrr/rmafcgrr05_e.asp

http://www.gov.sk.ca/finance/accountability/2006/keyterms.htm

17 “Report on Plans and Priorities 2007-2008”, Public Safety and Emergency Preparedness Canada, p.11.

18 Ibid, p.15.

19 Ibid, p.24.

20 Ibid, p.25.

21 Year to date (November 2007). Some figures have not been included because they would be misleading or are only relevant once the year is complete.

22 Source: JEPP Program database.

23 Source: Annual Update Instructions for the respective year.

24 Source: JEPP Program Database

25 The Deputy Minister has signing authority up to $500,000, The Minister signs for amounts in excess of $500,000.

26 “Results –Based Management and Accountability Framework (RMAF) / Risk-Based Audit Framework (RBAF) for the Joint Emergency Preparedness Program (JEPP)”, November 2004, Preamble.

27 Source: JEPP Program Database.

28 Ibid.

29 Source: JEPP Program database

30 Source: JEPP Program database

31 Source: JEPP Program database

32 Source: JEPP Program database

33 Source: JEPP Program project files.

34 Source: “Results –Based Management and Accountability Framework (RMAF) / Risk-Based Audit Framework (RBAF) for the Joint Emergency Preparedness Program (JEPP)”, November 2004, section 2.

Date modified: