Curriculum Development Instruments

Student Surveys

Instrument 5: Evaluation of Web-Based Mathematics Homework Tool

Project: Anonymous (Curriculum Development 13)

Funding Source: NSF - Undergraduate Education (DUE)

Purpose: To evaluate the strengths and weaknesses of a Web-based mathematics homework tool.

Administered To: Undergraduate and graduate students who used the Web-based homework tool in their math course.

Topics Covered:

• Background Characteristics & Activities (Student): academic level, prior coursework, current coursework, academic focus, academic habits, academic interests, technology access
• Comparisons: instructions methods, instructional approach, content, assessment, student/teacher interactions
• Demographics (Student): gender, ethnicity, age, academic status
• Impact on Outcomes: student/teacher interactions
• Impact Variables: instructional methods, content, technology/equipment use, usage patterns, collaboration, assignments, assessment, student participation, mentoring/support
• Implementation Activities: usage patterns
• Instructional Preference: assessment, technology, preparation, assignments
• Learning Environment: communication with professor, satisfaction with teacher, TA, course, software
• Perceptions (Student): content difficulty, ease of use, role, confidence
• Self Assessment (Student): confidence, content knowledge (expected grade), intelligence, usage patterns, academic habits, collaborative activities, support

Format/Length: 45 open- and closed-ended questions

Our records show problem 1 of Survey has not been attempted. (0 pts) Dear Student,
We would very much appreciate your help in evaluating [Product X]. We would like to hear about both the strengths and weaknesses of [Product X] as you see them and any suggestions that you have for improving the program or the way it is used. [Product X] has already benefited from past comments by students and we want to continue to improve it and make it as useful as possible as an educational tool. Submissions of this questionnaire are anonymous -- results are not recorded by the system using your name or ID. They are e-mailed directly to the [Product X] administrator. Thank you very much for your time. [Product X] developer.
Please select the best choice for each question.
A.	What mathematics course are you currently enrolled in? If you are in more than one, enter the one for which you are filling out this questionnaire.
	A.		MAT 194 College Algebra Plus
	B.		MAT 114
	C.		MAT 117
	D.		MAT 117 - Internet Section
	E.		MAT 170
	F.		MAT 119
	G.		MAT 210
	H.		MAT 270
	I.		MAT 271
	J.		MAT 272
B.	What is your gender? (optional)
	A.		Female
	B.		Male
C.	Is this your first time taking this course?
	A.		Yes
	B.		No
D.	What was the most recent previous math course, if any, that you were enrolled in at this university?
	A.		MAT 106
	B.		MAT 194 College Algebra Plus
	C.		MAT 114
	D.		MAT 117
	E.		MAT 170
	F.		MAT 119
	G.		MAT 210
	H.		MAT 270
	I.		MAT 271
	J.		MAT 272
	K.		None
	L.		Other (please specify)
E.	What was the content of your most recent high school math course?
	A.		Calculus
	B.		Pre-Calculus
	C.		Algebra
	D.		Geometry
	E.		Statistics
	F.		Other (please specify)
F.	What is your ethnicity? (optional)
	A.		Asian American/Pacific Islander
	B.		Black/African American
	C.		Caucasian/White
	D.		Latino/Hispanic American
	E.		Native American/Alaskan Native
	F.		Other (please specify)
G.	What is your academic status?
	A.		Freshman
	B.		Sophomore
	C.		Junior
	D.		Senior
	E.		Other (please specify)
H.	What is your intended major?
	A.		Social Sciences (i.e. Psychology, Economics, Political Science, History, etc.)
	B.		Humanities (i.e. English, Religion and Classics, Languages, etc.)
	C.		Natural Sciences (i.e. Physics, Chemistry, Biology, etc.)
	D.		Mathematics
	E.		Engineering
	F.		Business
	G.		Nursing
	H.		School of Architecture
	I.		Other (please specify)
I.	Do you plan to enroll in other mathematics courses at this university?
	A.		Yes
	B.		No
J.	What grade do you expect to receive for this class?
	A.		A
	B.		B
	C.		C
	D.		D
	E.		E
K.	Approximately how many days before weekly due dates do you typically begin to work on [Product X] assignments?
	A.		1
	B.		2
	C.		3
	D.		4
	E.		Other (please specify)
L.	How many hours per week do you typically spend on [Product X] problem sets?
	A.		Less than 1 hour
	B.		1 hour
	C.		2 hours
	D.		3 hours
	E.		More than 3 hours
M.	How would you rank yourself as a mathematics student?
	A.		Among the best
	B.		Above average
	C.		Average
	D.		Below average
	E.		Among the worst
N.	Have you used [Product X] in courses previous to this one?
	A.		Yes
	B.		No
O.	Do you have access to a computer in your dorm room or residence?
	A.		Yes
	B.		No
P.	Where do you typically work on [Product X] problem sets?
	A.		Your dorm room
	B.		Your off campus residence
	C.		A campus computing facility
	D.		The mathematics department
	E.		The library
	F.		Other (please specify)

0    1    2    3    4    5	1.	Use the email connection to get help with specific problems.
0    1    2    3    4    5	2.	Do [Product X] assignments with other students.
0    1    2    3    4    5	3.	Get an entire assignment correct.
0    1    2    3    4    5	4.	Seek help from your teaching assistant.
0    1    2    3    4    5	5.	Seek help from your instructor.
0    1    2    3    4    5	6.	Guess at problems you don't understand.
0    1    2    3    4    5	7.	Get frustrated with and give up on a particular problem due to mathematical difficulty.
0    1    2    3    4    5	8.	Get frustrated with the time it takes [Product X] to respond to answers you submit to it.
0    1    2    3    4    5	9.	Get frustrated with the syntactic requirements of answers you submit to [Product X].
Please rate the extent to which you agree with each of the following statements:
5 strongly agree, 4 agree, 3 neutral, 2 disagree, 1 strongly disagree, 0 no answer
0    1    2    3    4    5	10.	I prefer [Product X] over paper and pencil homework.
0    1    2    3    4    5	11.	[Product X] problems are challenging.
0    1    2    3    4    5	12.	Class lectures effectively prepare me to complete [Product X] assignments.
0    1    2    3    4    5	13.	The content of [Product X] problems is consistent with the material taught in lectures.
0    1    2    3    4    5	14.	The content of [Product X] problems is consistent with the material tested on exams.
0    1    2    3    4    5	15.	[Product X] effectively prepares me for course examinations.
0    1    2    3    4    5	16.	The immediate responses I get from [Product X] make me more persistent with assignments.
0    1    2    3    4    5	17.	The immediate responses I get from [Product X] help me learn the course material.
0    1    2    3    4    5	18.	Email access to professors is a useful component of [Product X].
0    1    2    3    4    5	19.	The email feedback mechanism has made it easy to communicate with my professor.
0    1    2    3    4    5	20.	I can successfully access [Product X] whenever I need to.
0    1    2    3    4    5	21.	I know where to go to get help when I am having trouble with course material or [Product X] problems.
0    1    2    3    4    5	22.	[Product X] makes mathematics courses more enjoyable.
Please rate your satisfaction with each of the following:
5 highly satisfied, 4 satisfied, 3 neutral, 2 dissatisfied, 1 strongly dissastisfied, 0 no answer
0    1    2    3    4    5	23.	Your course instructor
0    1    2    3    4    5	24.	Your course teaching assistant
0    1    2    3    4    5	25.	Your course
0    1    2    3    4    5	26.	[Product X]

27. Please tell us what you like about [Product X]?

28. Please tell us what you do not like about [Product X]?

29. Please use this space for additional comments regarding [Product X]?

Thank you very much.

 Show Correct Answers
Note: it is after the due date.