Competence Committee Terms of Reference

 

University of Toronto

Neurosurgery Residency Program

Competence Committee Procedures

 

OVERVIEW

All residency programs accredited by the College of Family Physicians of Canada (CFPC) or the Royal College of Physicians & Surgeons of Canada (Royal College) will establish a Competence Committee.

 

PURPOSE

The Competence Committee (CC) monitors and makes decisions about residents’ progress throughout the different stages of their residency education by:

  • Working within the processes outlined in “Guidelines for the Assessment of Postgraduate Residents of the Faculty of Medicine at the University of Toronto” (PGME Assessment Guidelines). See Appendix A.
  • Using data to make judgements about a resident’s progression through residency (e.g. competence stages, promotion from one year/level to next, identification of needed improvement or remediation, identification of needed enhancement, or enrichment).
  • Reviewing assessment and performance data patterns and trends (e.g. across residents, stages, sites, rotations, or assessment tools/approaches) to identify areas of excellence and areas needing improvement for individual residents and the residency program.

 

STRUCTURE & PROCESSES

  1. Each accredited Residency Program will have a Competence Committee
    1. There will be a documented Terms of Reference for the Competence Committee including, for example, committee name, membership process, selection of Chair, decision making process, reporting to residency committee and PGME office processes.

 

  1. Structure of Competence Committee
    1. For the Neurosurgery specialty program the title will be the Neurosurgery Competence Committee.
    2. The Neurosurgery Competence Committee Membership Processes are:
      • The Chair will be selected by the RPC.
      • The Program Director will be on the Competence Committee and is eligible to Chair.
      • Up to four faculty (in addition to the Chair) will serve as members, with representation from each of the 4 primary teaching site (Sick Kids, St. Michael’s, Sunnybrook, Toronto Western). The Residency Program Committee (RPC) will confirm membership. Terms of Reference are found in Appendix B.
      • Residents will not be members of the Competence Committee.
      • Members will be void of any conflict of interest (e.g. parent/partner of an active resident, etc.)

 

  1. Operational Process of Competence Committee
    1. The Competence Committee can meet face-to-face or by phone
    2. Quorum for decision is 3 members
    3. All members are active working members and will review and summarize a set of resident files
    4. Email votes and e-mail ratifications are accepted
    5. The Chair will vote in the case of a tied vote
    6. The RPC will ratify Competence Committee decisions (without resident members in attendance)

 

  1. Decision Making Process of Competence Committee
    1. Resident data will be collected by staff (e.g. Program Administrators, Program Assessment Directors, Site Directors, etc.) as appropriately determined by the Program Director. Resident data collected will be confidential and will not be disclosed nor distributed to parties outside the Competence Committee and/or staff responsible for handling the data.
    2. University policies on document storage and privacy will apply.
    3. See Appendix C for the schedule of Competence Committee decision/discussion meetings and the general agenda regarding which decisions/discussions are a part of each meeting (e.g. September Competence Committee agenda includes review of Transition to Discipline (TTD) data to confirm completion of TTD stage and/or identify needed additional educational supports for a specific resident, etc.).
    4. See Appendix C for the documents that will be considered by the Competence Committee. This information reflects the required educational experiences, established residency program assessment plan, and specialty and accreditation expectations.
    5. The Competence Committee will submit a written summary of de-identified outcomes and processes to the RPC following each Competence Committee meeting. This memo will outline decisions made by the Competence Committee regarding residents’ progress and/or confirmation of progress and/or promotion.

 

  1. The roles and responsibilities of the Competence Committee:
    1. Works confidentially
    2. Convenes as scheduled
    3. Considers concurrently multiple variables including established standards, patient safety, and resident performance
    4. Deliberates on the available information for each resident
    5. Works with the available information, understanding that the information may be incomplete
    6. Works collaboratively towards a consensus decision.
    7. Makes holistic judgements on the progress and performance of the resident.
    8. Documents individual resident judgements, including needed follow up activity (e.g. Appropriate disclosure of learner needs)
    9. Identifies information to be communicated (e.g. information for individual residents, sites, residency program, PGME office)
    10. Monitors and communicates issues arising in Competence Committee information, systems, or processes
    11. Monitors and communicates issues arising through reviewing residency program functioning, including assessment and performance data patterns and trends (e.g. across residents, stages, sites, rotations, assessment tools/approaches) to identify areas of excellence and areas needing improvement.
    12. Documents (e.g. per meeting and/or annually) Competence Committee functioning (e.g. decisions made) and residency program functioning (e.g. EPAs that may need revision, sites where EPA assessments were low/high).

 

  1. The decisions and judgments of the Competence Committee may include:
  • Progress between competence continuum stages:
  • Confirmation of progress/completion – Transition to Discipline
  • Confirmation of progress/completion – Foundations of Discipline
  • Confirmation of progress/completion – Core of Discipline
  • Readiness for certification examination
  • Confirmation of progress/completion – Transition to Practice
  • Promotion to next residency year:
  • Promotion from PGY1 to PGY2
  • Promotion from PGY2 to PGY3
  • Promotion from PGY3 to PGY4
  • Promotion from PGY4 to PGY5
  • Promotion from PGY5 to PGY6
  • Residency training program completion
  • Follow up activities identified include:
  • Identification of residents in need of program modifications for focused educational needs or performance gaps (e.g. additional or different educational experiences; enhanced coaching, service needs of rotations, different approaches to resident supervision)
  • Identification of residents in need of remediation to address sustained, repeated or significant educational needs or performance gaps educational. Specific needs for program modifications (e.g. additional or different educational experiences, intensity of coaching or intervention, service needs of rotations, different approaches to resident supervision)
  • Communication to PGME Associate Dean through Program Director regarding imminent patient or resident safety issues
  • Communication to PGME Wellness Office regarding concerns with respect to resident wellness needs
  • Identification of residents for program enhancements, enrichment, and/or an accelerated pathway.

 

  1. Competence Committee review material will include information about:
    • Resident performance for the period under consideration
    • Resident pattern of performance over time
    • Patient safety needs
    • Service needs of rotations
    • The need for different approaches to resident supervision
    • Individual committee member experience regarding resident performance may be included if there is a request to clarify the available assessment documentation

 

  1. Agenda for Competence Committee:
  • Each meeting will include:
    • Regularly timed resident reviews (e.g. annual, by stage, readiness for certification examination)
    • Special case(s) brought to Chair’s attention (e.g. a significant concern arising from one or more completed assessments; a pattern of performance is flagged)
    • Follow up activities from last meeting
    • Follow up activities planned arising from current meeting
  • As scheduled (e.g. annually, biannually, semi-annually)
    • Monitoring of Competence Committee information, systems, and processes
    • Monitoring of residency program (e.g. EPA plans that may need revision, sites where EPA assessments were low/high).

 

 

 

Appendix A: U of T PGME Resident Assessment Guidelines

 

Guidelines for the Assessment of Postgraduate Residents of the Faculty of Medicine at the University of Toronto, March 2017 (see link for document: http://pg.postmd.utoronto.ca/wp-content/uploads/2017/04/Guidelines_ASSESSMENT-OF-PG-RESIDENTS_Approved_17mar09SEND.pdf).

 

 

 

 

Appendix B: Terms of Reference – Neurosurgery Competence Committee

 

Purpose:

The Competence Committee monitors and makes decisions about residents’ progress throughout the different stages of their residency education by:

  • Working within the processes outlined in “Guidelines for the Assessment of Postgraduate Residents of the Faculty of Medicine at the University of Toronto” (PGME Assessment Guidelines).
  • Using data to make judgements about a resident’s progression through residency (e.g. competence stages, promotion from one year/level to next, readiness for certification examination, identification of needed improvement or remediation, or identification of needed enhancement or enrichment).,
  • Reviewing assessment and performance data patterns and trends (e.g. across residents, stages, sites, rotations, or assessment tools/approaches) to identify areas of excellence and areas needing improvement.

 

Membership:

Up to four faculty, plus a Chair, will serve as members, with representation from all 4 primary teaching sites (Sick Kids, St. Michael’s, Sunnybrook, Toronto Western). The Residency Program Committee (RPC) will confirm membership. Residents will not be members of the Competence Committee. Members will be void of any conflict of interest (e.g. parent/partner of an active resident, etc.).

 

Reporting:

Written summary of de-identified outcomes and processes to RPC following each Competence Committee meeting.

 

Meetings:

There will be 4 meetings a year, which can be via phone and include electronic voting. These will occur in September, December, March, and June each academic year.

 

Privacy & Security:

University policies on document storage and privacy apply.

 

COMPETENCE COMMITTEE GUIDELINES

  1. All committee discussions are strictly confidential and only shared on a professional need-to-know basis.

 

  1. Committee decisions will be based on the assessment information and documentation available for each resident at the time of the committee meeting.

 

  1. Individual committee member experience regarding resident performance is to be included if there is a request to clarify the available assessment documentation.

 

  1. Committee decisions will be timely to support fairness and appropriate sequencing of training experiences.

 

  1. Competence Committees will make decisions in consideration of:
    1. Resident recent performance
    2. Resident pattern of performance over time
    3. Patient safety needs
    4. Service needs of rotations
    5. The need for different approaches to resident supervision

 

  1. Residents may be selected for Competence Committee review based on any one of the following criteria:
    1. A regularly timed review (See Appendix C)
    2. A concern has been flagged on one or more recent completed assessments
    3. Completion of stage requirements and eligible for promotion or completion of training
    4. Requirement to determine readiness for the Royal College exam
    5. Where there appears to be a significant delay in the resident's progress or academic performance
    6. Where there appears to be a significant acceleration in the resident's progress

 

  1. Competence Committee members will share leading the review of resident files (i.e. being a primary reviewer). The primary reviewer is responsible to complete a detailed review of the progress of all assigned residents to:
  1. Consider each resident's recent performance on assessments (See Appendix C- Assessment Plan),
  2. Identify patterns of performance,
  3. Provide a succinct synthesis, and
  4. Recommend a decision.

 

  1. Types of decisions available to Competence Committees are:
  1. Confirmation of competence continuum:
    1. Confirmation of completion of Transition to Discipline
    2. Confirmation of completion of Foundations of Discipline
    3. Confirmation of completion of Core of Discipline
    4. Confirmation of completion of Transition to Practice
  2. Promotion to next residency year:
    1. Promotion from PGY1 to PGY2
    2. Promotion from PGY2 to PGY3
    3. Promotion from PGY3 to PGY4
    4. Promotion from PGY4 to PGY5
    5. Promotion from PGY5 to PGY6
    6. Residency training program completion
  3. Readiness for certification examination.
  4. Recommendation for:
    1. Program based remedial support (i.e. where there are focused educational needs/gaps)
    2. Formal Remediation (i.e. where there are significant or persistent needs/gaps)
    3. Access to enrichment opportunities (i.e. focused educational opportunities)
    4. An accelerated educational pathway

 

9.  Decisions will generally be made by consensus but a formal vote of approval will also be taken for each resident. In the event of a tie, the Chair will cast the deciding vote.

 

 

 

10. Decisions need to be documented to meet:

  1. Programmatic documentation requirements
  2. University documentation requirements
  3. Royal College documentation requirements

 

11.  The Program Director will meet with each resident to discuss the decision of the Competence Committee and to discuss needed adjustments to the educational program, assessments, or rotation schedule.

 

 

 

 

Appendix C:  Assessment Plan for Neurosurgery

 

PURPOSE

To provide an organized list of documents that will be considered by the Competence Committee. This information reflects the required educational experiences, established residency program assessment plan, and specialty and accreditation expectations.

  • Assessment Plan to be sequenced by calendar blocks
  • Assessment Plan to include all assessment information considered by the Competence Committee for discussion/decision for each PGY year

 

Mtg #

Type of Decision / Discussion

Meeting Block

Assessments / Training Experiences

Notes

1

 

 

 

 

 

 

 

 

2

 

 

 

 

 

 

 

3

 

 

 

 

 

 

 

4

 

 

 

 

 

 

 

 

 

 

 

Appendix D:  Assessment Schedule of Competence Committee Meeting Decisions / Discussions – Neurosurgery

 

PURPOSE

To provide an organized schedule and record of Competence Committee decision/discussion meetings and the general agenda regarding which decisions/discussions are a part of each meeting (e.g. September Competence Committee agenda includes review of Transition to Discipline (TTD) data to confirm completion of TTD stage and/or identify needed additional educational supports for a specific resident)

  • Schedule to be sequenced by calendar blocks
  • Schedule to include details on what type of decision/discussion is to be made for each PGY year

 

Mtg #

Month / Year

Block

Resident Year

Type of Decision / Discussion

Details

1

 

 

 

 

 

2

 

 

 

 

 

 

3

 

 

 

 

 

4

 

 

 

 

 

 

 

 

 

 

 

 

Appendix E:  Memo Report to Residency Program Committee

 

MEMO

 

To:                   Neurosurgery Residency Program Committee

From:             Neurosurgery Competence Committee

    – [List members]

                            –

Cc:                   [Insert, if applicable]

Date:               [mmm, dd, yyyy]

Re:                   Competence Committee Meeting #[X], on [mmm, dd, yyyy]

 

 

This memo is to inform the Residency Program Committee (RPC) that on [mmm, dd, yyyy], the Neurosurgery Competence Committee met to discuss and/or make decisions on residents’ progress in Neurosurgery.

 

Our agenda included:

  1. Decisions regarding Confirmation of Progress for:
    • [Resident #1]
    • [Resident #2]
    • [Resident #3]
    • [etc.]
  2. Discussions regarding:
    • [Resident #1]
    • [Resident #2]
    • [Resident #3]
    • [etc.]

 

The Competence Committee had sufficient data to make decisions and confirm that:

  • Resident [X] [Insert comment on decision]
  •  
  • [etc.]

 

They also noted that Resident(s) [YZ] did not have sufficient information for a decision at this time. The Program Director and Resident(s) [YZ] are working with (Site Director/Supervisor/Advisor) on the next X block(s) to ensure sufficient opportunity for additional assessments.

 

There are/ are not patterns of performance viewed needing program based remedial support nor consideration for formal remediation.

 

Respectfully submitted,

 

[Competence Committee Chair signature]