Versions Compared

Version Old Version 2 New Version Current
Changes made by

Ken Bour

Ken Bour

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 5.3

Working Group Self-Assessment Questionnaire

Infonote

Notes to SCI Members and Other Reviewers:

  1. In this Draft v2 version of the questionnaire, I am attempting to take into consideration
an evaluative element
  1. a dimension raised by Mikey O'Connor and
overlooked
  1. only partially accommodated in Draft v1.
In thinking broadly about any
  1. To evaluate any dynamic system, we
would normally examine three sub-systems:
Note

Notes to SCI Members and Other Reviewers:

  1. Initially, the questionnaire material is presented in plain text for the purposes of editing/finalizing the content. Once the design, structure, sequencing, and language have been approved, the intention is to enter the questions into an online tool (e.g., QuestionPro, SurveyMonkey, Wiki) to facilitate data collection, analysis, and reporting.
  2. I recommend a 5-point versus 7-point scale for this purpose. The principle advantage is that it is easier (less stressful) for respondents to make selections when the option set is smaller. The disadvantage is that the statistics will generally exhibit more central tendency (toward the mid-point or 3) because the scale is narrower.
  3. All of this material is submitted as DRAFT and I welcome the SCI's feedback, questions, and challenges. For example, you will notice that I did not insert a question to assess Leadership because I think it can be inferred based upon other dimensions (e.g., Participation, Behavior). If a Chair, or other leader, contributed to an ineffective and inhospitable climate, we would hope to see one or more supplementary text comments to that effect.
  4. I have not attempted to complete this questionnaire to determine length. It "feels" to be within an acceptable range based upon others I have designed; however, we should perform a test to ensure that it (a) can be completed in a reasonable period; and (b) is clear, comprehensible, and straightforwardcould subdivide it into three basic or core components: Inputs → Processes → Outputs. In Draft v1, we captured most of the processes, the outputs, but only a few of the inputs, namely, the team members, tools, and experts. I did not ask about the other resources that impinge upon the success of a WG, e.g., its charter and constraints (required processes, time horizon). In Draft v2, I have reconstituted the questionnaire (still five sections but renamed), reorganized some of the original questions, and added a few new ones. 
  5. This Draft v2 also shifts the rating scale to 7 points as suggested by Avri Doria.

...

Welcome and Introduction

Thank you for accepting the invitation to complete this questionnaire concerning your experiences with the __________________________ Working Group (WG). Your Chartering Organization (CO) and other ICANN stakeholders are keenly interested in learning about the effectiveness of its chartered teams by asking participants for their assessments, perspectives, and insights concerning various aspects of the Working Group's operations, norms, logistics, decision-making, and outputs. The results of your feedback will be used to identify improvement areas in the guidelines, tools, methods, templates, and procedures applicable to Working Groups. Summary reports will be shared not only with your Working Group, but the larger GNSO stakeholder community. 

...

Name: 
Email: 
Organization:

Please select one from the drop-down list:

    • Registry Stakeholder Group
    • Registrar Statkeholder Group
    • Business Constituency
    • Intellectual Property Constituency
    • Internet Services Provider Constituency
    • Non-Commercial Users Constituency
    • Not-for-Profit Operational Concerns Constituency
    • At-Large/ALAC
    • Other ICANN SO/AC
    • Representing Self
    • Other (please describe): _____________________
Working Group Role:

Please select one the most descriptive role that you fulfilled on the WG from the drop-down list:

    • Leader (Chair, Co-Chair, Vice-Chair, Other Officer)
    • Contributing Member
    • Background Contributor
    • Liaison
    • Observer
    • Advisor/Consultant
    • Support (e.g., secretary, technical, administrative)
    • Other (please describe): _____________________
Info

In the next three sections (II, III, and IV), you will be asked to rate the EFFECTIVENESS of each dimension; the scale interpretation will be provided appropriate to each element.

II

...

. Inputs ...includes the charter/mission, team members, tools, and resources.

Thinking about

...

the overall EFFECTIVENESS of the Working Group'

...

s Inputs, how would you rate each of the following elements on a scale

...

where 1=Highly Ineffective

...

 and 7=Highly Effective:

Participation climate within inhospitable, unilateral, frustrating, unproductive5 inviting, democratic, accepting, respectful, productive Behavior disruptive argumentative disrespectful hostile, domineering5 accommodating respectful collaborative consensus-building5Decision-Making Methodology (consensus) honored followed observed respected
Assessment CategoryRating

The

Charter/Mission of the WG where:
1-Highly Ineffective means

confusing, vague, ill-structured, unbounded, unrealistic (e.g., time, constraints), unachievable; and

7-Highly Effective means

understandable, clear, well-structured, bounded, realistic (e.g., time, constraints), achievable

1234567SKIP

The

Expertise of WG members where:
1-Highly Ineffective means

novice,

elementary,

inapplicable,

unusable; and

7-Highly Effective means

knowledgeable,

advanced,

applicable,

usable

1234567SKIP

The Representativeness of WG members where:
1-Highly Ineffective means narrow, skewed, selective, unbalanced; and

7-Highly Effective means broad, diverse, balanced

1234567SKIP

The

external Human Resources (e.g., briefings, experts, consultants, liaisons) provided to the WG where:
1-Highly Ineffective means inappropriate, inadequate, untimely, not helpful/useful; and
7-Highly Effective means appropriate, adequate, timely, helpful/useful 

1234567SKIP

The Technical Resources (e.g., systems, tools, platforms, templates) provided to and utilized by the WG where:
1-Highly Ineffective means broken, ignored, not observed, disrespected; and
5difficult, challenging, clumsy, awkward, tedious, slow, not helpful/useful; and
7-Highly Effective means easy, straightforward, clear, efficient, fast, helpful/useful 

1234567SKIP

The Administrative Resources (e.g., support, guidelines, documentation) provided to and utilized by the WG where:
1-Highly Ineffective means inappropriate, inadequate, untimely, not helpful/useful; and
7-Highly Effective means

appropriate,

adequate,

timely,

helpful/useful 

1234567SKIP
Comments about the WG's Inputs: (Free-form Text Box)
III

...

. Processes ...includes norms, operations, logistics, and decision-making.
Thinking about the overall EFFECTIVENESS of the Working Group's

...

Processes, how would you rate each of the following elements on a scale where 1=Highly Ineffective and

...

7=Highly Effective:
Communication/Collaboration Tools provided to and utilized by the WG difficult, challenging, clumsy, awkward, tedious, slow, not helpful/useful; and
5-Highly Effective means easy, straightforward, clear, efficient, fast, helpful/useful Briefings and Subject Matter Experts provided to the WG inappropriate, not helpful/useful5 appropriate, helpful/useful 
Assessment CategoryRating

The Session/Meeting Planning (Agenda) Participation climate within the WG where:
1-Highly Ineffective means disorganizedinhospitable, haphazardunilateral, unstructuredfrustrating, untimely noticeunproductive; and
57-Highly Effective means organizedinviting, inclusive, disciplinedaccepting, structuredrespectful, timely noticeproductive

1234567SKIP
The Behavior of WG members where:
1-Highly Ineffective means 		disruptive, argumentative, disrespectful, hostile, domineering; and
7-Highly Effective means accommodating, respectful, collaborative, consensus-building
1234567SKIP

The Decision-Making Methodology (consensus)where:
1-Highly Ineffective means broken, ignored, not observed, disrespected; and
7-Highly Effective means honored, followed, observed, respected

1234567SKIP

The

Session/Meeting Planning (Agenda) where:
1-Highly Ineffective means

disorganized, haphazard, unstructured, untimely

notice; and

7-Highly Effective means

organized, disciplined, structured, timely

notice

1234567SKIP
Comments about the WG's Processes:(Free-form Text Box)
IV. Products and Outputs

Thinking about the overall EFFECTIVENESS of the Working Group's Products and Outputs, how would you rate each of the following elements on a scale where 1=Highly Ineffective and 57=Highly Effective:

Assessment CategoryRating

The Working Group's primary Mission where:
1-Highly Ineffective means not achieved and/or accomplished per the Charter; and
57-Highly Effective means completely achieved and/or accomplished as directed

1234567SKIP
The Quality of the WG's outputs (a.k.a. deliverables) where:
1-Highly Ineffective means incomplete, inadequate, materially deficient/flawed, unsupported; and
57-Highly Effective means complete, thorough, exhaustive, reasoned, supported
1234567SKIP
Comments about the WG's Products and Outputs:(Free-form Text Box)
V. Personal Fulfillment and Demographics
Your Chartering Organization is interested to learn about your own

...

Participation and personal

...

Fulfillment as a result of having invested time and effort volunteering on a Working Group. In addition, we have included a few

...

Demographic questions that will assist in understanding and interpreting your feedback. 
Assessment CategoryRating

My personal Participation in helping the WG achieve its mission where:
1-Highly Ineffective means immaterial, negligible, insignificant, unimportant
57-Highly Effective means material, substantial, significant, important

1234567SKIP

My personal Fulfillment considering the time, energy, and work efforts I contributed to this WG:
1-Highly Unrewarding; and
57-Highly Rewarding

1234567SKIP
How did you learn about the WG?

 

Please select one from the drop-down list:

  • I was informed or invited by my SG/C or ICANN-affiliated organization
  • I was contacted by an ICANN Staff member
  • I was contacted by an individual seeking to recruit volunteers for the WG (e.g., GNSO Councilor, interim Chair)
  • I learned about the WG through one of ICANN's websites (or Wikis)
  • I learned about the WG from another organization not directly associated with ICANN
  • A professional colleague or associate informed me about the WG
  • Other (please describe): _________________________________
Approximately how long have you been involved with ICANN:

Please select one from the drop-down list:

    • Less than 1 year
    • 1 - 2 years
    • 2 - 4 years
    • 4 - 6 years
    • 6 - 8 years
    • More than 8 years
Considering the most recent twelve months, on average, approximately how many hours per week do you spend on ICANN-related activities:

Please select one from the drop-down list:

    • Less than 10 hours
    • 10 - 20 hours
    • 20 - 40 hours
    • 40 - 60 hours
    • 60 - 80 hours
    • More than 80 hours
Comments about Personal Fulfillment and Demographics:  (Free-form Text Box)
Additional Comments:
(Please feel free to provide any additional comments feedback about your Working Group experience,
this Self-Assessment, or any other matter not covered elsewhere in this questionnaire:)		(Free-form Text Box)

THANK YOU FOR YOUR FEEDBACK! 

...