Step 3: Looking back on the data you have collected on the first drafts from the pilot-test, you decide whether each question should be closed-response or open-response.

You decide to:

• Ask questions 1 and 2 in a closed format because you want to compare their opinions now with their opinions after the pilot.
  
  
• Ask questions 3 and 4 in a partially-open format. You already know most of the activities, so for comparability you want to constrain the responses. At the same time, you want to make it possible to mention activities you failed to anticipate. Hence you allow students to select "other" and write in a different activity type. If you find later on that some of the students' alternatives really belong in one of the choices, you can assign it to that choice in your coding. For example, if a student jots down "writing reports," you can assign the response to the "writing nonfiction" category.
  
  
• Ask questions 5 and 6 in an open format because you want to discover the breadth of students' responses. You do not know enough to impose response constraints yet. In the post-implementation questionnaire, however, you may consider some closed items because by then you will probably be able to collapse some of their likes and dislikes into categories.