home
  : Instruments : Curriculum Development





























home reports instruments plans
search

Curriculum Development Instruments

Return to Instrument Table

Student Focus Groups

Instrument 1: NSF Pilot Project Evaluation - Focus Group Discussion Outline

Project: Computer-Mediated Social Science Instructional Modules
San Francisco State University

Funding Source: NSF: Division of Undergraduate Education (DUE)

Purpose: To elicit in-depth feedback from students regarding effectiveness of treatment modules

Administered To: College students

Topics Covered:

  • Course Evaluation: organization, practical value, opportunity to learn, ease of use, content, skills, technology use, objectives, integration, areas for program improvement, expectations, importance, engagement, pace, satisfaction
  • Background Characteristics & Activities (Student): technology, experience

Format/Length: 16 open-ended items


NSF Pilot Project Evaluation
Focus Group Discussion Outline (30-40 minutes)

I. Introduction, Explanation, Ground Rules
(5 minutes)
 
diamond image
Hand out Informed consent forms — voluntary, take it seriously, confidential, candid, taking notes, no names attached to your responses
 
diamond image
Purpose of focus group
 
diamond image
Ground rules
 
  • Focus on module and not on the instructor
  • Nametags so can write a nickname if wish to use in the session
  • Please ask if you don't understand a question
  • Always welcome to add to what others have to say
  • Semi-structured, limited time
  • Respect each other, all have chance to speak
 
 
 
 
 

II. Group formation and discussion focusing
(5 minutes)
 
diamond image
Reasons for taking this class
  1. What is the number 1 reason you signed up for this class?


  2. Did you know beforehand this module was to be used in this class?

III. How well integrated was module with class
(10 minutes)
 
diamond image
Attitudes towards integration of the different components of the class
  1. What is the most important component of the class (lab, instruction, course materials)?
  2. arrow image PROBE FOR:
      * Why is this component important?

  3. How do you think the different components support each other?
  4. arrow image LISTEN FOR: integration of different components,
    arrow image PROBE FOR:
      * Do the different components support each other?
      * How well is the module integrated with the class?
      * Does the structure make sense?

 
diamond image
Attitudes towards relevance
  1. What part of module enables you to follow up on your personal interest within field?


  2. How do you think the focus on the computer will benefit your career?
  3. arrow image LISTEN FOR: student interest, if the module is able to be useful in different careers
    arrow image PROBE FOR:
      * Which of your expectations about the module have been fulfilled?
 
diamond image
Identification of barriers and potential benefits
  1. What concerns you the most about the way the module is structured?


  2. What would make the module more relevant to you?
  3. arrow image LISTEN FOR: disagreement on aspects to improve
    arrow image PROBE FOR:
      * What could you do differently to get more out of the module?

IV. Attitudes towards Content and Function
(15 minutes)

 
diamond image
Attitudes towards the content of the module
  1. What do you think of the quality of the material in the module?
  2. arrow image LISTEN FOR: components with different quality
    arrow image PROBE FOR:
      * Has the content motivated you to learn more about this field?
      * Which part of the module was most interesting to you?
      * What was least interesting?

  3. How has the module challenged you academically?
  4. arrow image LISTEN FOR: ability to challenge students (i.e. through load of home work, level of assignments or content), flexibility of the course.
    arrow image PROBE FOR:
      * Was the academic level appropriate?
      * Were you able to complete the Exercises on time?
      *Was your computer background sufficient to do the work?

  5. What were some of the important concepts presented in this module?
  6. arrow image LISTEN FOR: disagreement
    arrow image PROBE FOR:
      * How do you think you will use them?
      * Which sections/exercises were most useful to you?
      *Which were least useful?

 
diamond image
Attitudes towards function of the module
  1. Which relevant skills or tools have you learned by using the module?
  2. arrow image LISTEN FOR: disagreement on function among students
    arrow image PROBE FOR:
      * Are any irrelevant to you?
      * Does computer-aided learning help you think independently?

 
diamond image
Attitudes towards goals for the module
  1. The module is designed to teach you to access information. Did it live up to this goal?


  2. Another goal is to help teach analytical skills. Did it live up to this goal?


  3. How about helping you communicate information? Did it help you learn to do that?
  4. arrow image LISTEN FOR: agreement on goals achieved, importance of goals
    arrow image PROBE FOR:
      * Which goals are important to you?
      * How might the module be improved to meet your expectations?
      * Compare learning to class material presented without module?
      * If had option to take class with module component or without, which would you prefer, if all else the same?

V. Acknowledgements and Conclusions
(5 minutes)
 
diamond image
Are there any topics we haven't touched on or any issues you haven't yet expressed?
 
diamond image
Usefulness of the knowledge gained from this group.