EDPS 581
Introduction to Evaluating Educational Research

May 11 - June 15, 2004
(Tuesday and Thursday: 6:00-9:00 p.m.) and
*Saturday May 15 (10:00 a.m. - 4:00 p.m.)

Education North 5-156


Department of
Educational Policy
Studies
 
Instructor: Dr. Rosemary Foster
Tel:  492-0760
FAX: 492-2024
E-mail: ryfoster@ualberta.ca
Office: 5-113A
Office hours: Tuesday and Thursday 4:00-6:00 p.m.
                      and by appointment.


Course Description:

This course offers an introduction to interpreting and evaluating educational research related to the specializations within the Department of Educational Policy Studies. Various orientations and approaches to research will be explored. The course will provide an overview of topics and issues related to the design, conduct, critical interpretation, and evaluation of research, including related technical and ethical considerations. The intent is to develop understanding that will enable students to analyze and critique, in a fair and thoughtful manner, a range of research reports. As well, in order to enhance students' skills in analysis and critique, they will be given activities designed to help them "experience" various aspects of "doing research." Students may not receive credit for both EDPS 508 and EDPS 581.

Course Objectives:

The assigned readings, class topics, guest speaker presentations, and assignments have been chosen to help students:

Course Content:

Class participants will be encouraged to work toward the attainment of the course objectives:

Organization of the Course:

The course is organized around four main topics expressed as the following questions:

Required texts:

The following required text is available in the University of Alberta bookstore:

As well, student will be required to obtain a package of prescribed readings. Readings in the course have been selected to address the above questions and draw on a variety of perspectives. Readings emphasize contemporary topics and issues in educational research.

Class Format:

The course is intended to build on students' experiences with, and understanding of research in the social sciences. Specifically, students will be encouraged to enhance their skill at evaluating educational research through (i) critical review of assigned readings, (ii) participation in class discussion, and (iii) completion of course assignments. Further, over the course of the term, students will be expected to generate original research questions, and come to an in depth understanding of their own research orientation (e.g., articulate assumptions/beliefs/values, and ground claims/arguments in theory, and scholarly and empirical research). Students will support one another in all of these endeavours by working in one of three study groups. In addition, two classes will be dedicated to individualized study. Specifically, Thursday May 27 and Tuesday June 1 there will be no structured class meetings. Instead, students will be encouraged to use these blocks of time to complete the assignments for the course. During the first meeting, the instructor will ask students to substitute for one of these classes a library meeting Saturday May 15 (9:00-12:00) where library personnel will present a seminar on how to conduct searches and research. This seminar will support students in the two major assignments for the course.

A variety of instructional approaches will be used including class discussion, guest speakers, lecture, and collaborative activities. There will be assigned readings for most class meetings. It is important that students prepare by critiquing all readings before the class. However, for each class meeting, each of the three study groups will be asked to examine one of the assigned readings "in depth," raise questions, and lead the whole class in a 10-15 minute discussion. Prior to the discussions based on the readings, 15-20 minutes will be provided for study groups to prepare and organize (e.g., discuss the assigned article, decide which questions to raise, select a discussion leader/timekeeper).
*NB: RG = Red Group; GG = Green Group; BG = Blue Group

Students will maintain an INDIVIDUAL set of one-page reviews of the assigned readings that documents their understanding and critique of ALL of the assigned readings (24 IN TOTAL). Each review should outline the perspective that is presented in the reading, key findings and arguments, and implications/provocative questions to be raised. These one-page reviews are intended (i) to prepare individuals for meaningful interaction in their groups, (ii) to assist students in developing original research questions and skill at scholarly critique, and (iii) to help students in clarifying their preferred research orientation. During the last class, class participants will be asked to make a 5 minute presentation based on their final assignment.

Schedule of Topics and Readings:

 

DATE
TOPIC 
PREPARATION
(RG = Red Group; GG = Green Group; BG = Blue Group)
Tues.
May 11
Course overview: organization and evaluation.
Topic 1: What is research in the social sciences and education? How do we judge research? - An introduction to educational research, research reports, and the review process
Study group presentations: modeled and explained. Assignment #3 (reviews of the readings): explained. Assignment #1 (article review): explained and studends assigned their article.
 
Thurs.
May 13
Topic 2: What are the various orientations and approaches to educational research?
- Library session #1
- Paradigms, terms, concepts.
Study group discussions and presentations.
- Assignment #1 - study groups discuss work in progress.
Readings: Wellington (2000), ch. 1, GG-Wellington (2000), ch. 2; RG- Mertens (1998) pp. 6-21; 180-186.
* Sat.
May 15
(10:00am-4:00pm)
Library Session - Coutts Library 
Tues.
May 18
Topic 2: What are the various orientations and approaches to educational research?
- Statement of research purpose/aims/ questions.
- Searching and reviewing the scholarly literature.
- Assignment #1
- study groups discuss work in progress.
Readings:
RG-Wellington (2000), ch. 3
BG-Wellington (2000), ch. 8
GG-Wellington (2000), ch. 12
Thurs.
May 20
Topic 2: What are the various orientations and approaches to educational research? - Designing research: sampling, selection, access, and ethics.
- Study group discussions and presentations.
- Assignment #1 - study groups discuss work in progress.
Readings:
(EVERYONE-Don't review)
Wellington (2000), ch. 4; samples; University of Alberta ethics application guidelines.
(REVIEW)
Readings:

BG-Wellington (2000), ch. 5;
GG-Wellington (2002), ch. 7;
RG-Gorard (2001)
Tues.
May 25
Topic 3: What are the various methodologies/ methods for conducting research in education? - Interviewing, surveying, observing
Study group discussions and presentations
- Assignment #2 (field activity): explained. Study groups assigned their methods.
Due: Assignment #1 (article review)
Readings 2:
GG-Davis (1997);
RG-Leschied, Dickinson &Lewis (2000);
BG-Bell (2000)
Thurs.
May 27
Individual work/library block - no class meeting  
Tues.
June 1
Individual work/library block - no class meeting  
Thurs.
June 3
Topic 3: What are the various methodologies/ methods for conducting research in education? - Analysing and presenting qualitative and quantitative data
Study group discussions and presentations.
Assignment #4(proposal for research funding): explained.
Due: Assignment #2 (field work)
Readings:
RG-Wellington (2000), ch. 10;
BG-Wellington (2000), ch.11
GG-Locke et al. (1998)/Gorard (2001), pp. 109-118
Tues.
June 8
Topic 3: What are the various methodologies/ methods for conducting research in education?
Case Studies
Study group discussions and presentations
- Assignment #4 discussion of work in progress
Readings:(EVERYONE-Don't review)
Wellington (2000), ch. 6 and Merriam; (Review these)
BG-Bachor (2002);
GG-Gaskell (2001);
RG-Carr & Klassen (1997)
Thurs.
June 10
Topic 3: What are the various methodologies/ methods for conducting research in education?
- Narrative and Interpretivist Studies
- Action Research and Emancipatory Studies
- Assignment #4
- discussion of work in progress
Readings 1:
GG- Clandinin & Connelly (1996);
RG-Baumgartner (2002);
BG-Taylor, Beck & Ainsworth (2001).
Readings 2:
RG-Elliott (1991),
BG-Lather (1991);
GG-Gallo (2001)
Due: Assignment #3 (reading reviews)
Tues.
June 15
Topic 4: What are contemporary topics and issues in educational policy and practice "worthy" of research/funding?
Student-led discussions on research questions/ topics
Due: Assignments #4 (research funding proposal)

Evaluation

Students are encouraged to ask questions as they work through their assignments. Instructor support will be provided prior to the dues dates only. Electronic communication is welcomed.

Assignment # 1: Article Review (30%)
Students will be asked to complete a written review of a scholarly article using the review protocol provided (to be distributed during the first class meeting). The second evening the class meets, students will "draw" their article from a set to be provided by the instructor. The article will be a primary source (research report written by the researcher/s). Although 2-3 people within the class will be assigned the same article to review and may work together as they complete the assignment, every student is required to submit their own original written paper/review. Copying another's work constitutes plagarism (see below).
Format: The written review must follow APA (5th ed.) style. It should include an abstract of no more than 500 words. The body of the review should be organized using headings that reflect as many of the criteria in the protocol as possible and appropriate. The review should be written using expository and argumentative prose. This means that the students should have a thorough understanding of the article and have developed a defensible position/thesis vis-à-vis the ideas/findings/arguments presented in the article. The tone of the written review should be "critical but fair." In support of the students' own position presented in the review, students should include a minimum of 6-8 scholarly and/or professional sources. Length of the written review: 12-15 double-spaced pages.
Due: Tuesday May 25, 2004

Assignment # 2: Field Work (10%)
Students will be asked to conduct a field activity (e.g., surveying, interviewing, observing). The belief here is that the experience of "doing research" will enhance students' skills at reading and evaluating research. On Thursday February 12, study groups will "draw" the method which their group will use in the conduct of the field activity. Although students are encouraged to support one another in this field activity, each student will be required to submit a two to three page summary that includes a description of their original research.
Format: Concise and precise summary of the experience using the following headings or equivalents: Objectives/Purpose of the Research, Context and/or Rationale, Methodology, Findings, Conclusion/Implications
Due: Thursday June 3, 2004

Assignment # 3: Reviews of the Readings (30%)
Students will be required to develop a set of reviews of the assigned readings that documents their understanding and the development of their skill at critiquing scholarly writing and formulating research questions. The completed set of reviews should include a one-page entry for each of the assigned readings (Total = 24).
Format: The entry should be like an abstract for a journal article -- concise and precise. It should be formatted using the headings: title/author; thesis/perspective/position presented; key findings, arguments, conclusions/implications; students' own critique of the reading expressed as questions. The log is intended (i) to prepare individuals for meaningful interactions in their groups, and (ii) to assist class students in the development of relevant topics/questions to guide their final assignment.
Due: Thursday June 10, 2004

Assignment #4: Application for Funding (30%)
Students are to respond to the attached "Request for Proposals" using the headings that have been given.
Format: The proposal must follow APA (5th ed.) style. It should include an abstract of no more than 500 words. The body of the proposal should be organized using headings given in the "Request for Proposals" (e.g., Objectives/Purpose of the Research, Context and/or Rationale, Methodology, Educational Significance/Implications for Policy and Practice). The proposal should be written using expository and argumentative prose. This means that the students should have conducted a search and review of the scholarly and empirical literature. Their research question should reflect a "gap" in literature. The proposal should emphasize the educational significance and importance of the proposed research. Rationale for selection of methodology (including theoretical/paradigmatic stance) and methods should be well developed, defensible, and compelling to potential funders. In support of the proposal, students should include a minimum of 6-8 scholarly and/or professional sources. Length of the proposal: 12-15 double- spaced pages.
Due: Tuesday June 15, 2004

N.B. Students are reminded that they are required to follow the University of Alberta Guidelines concerning:
Plagarism and Cheating (www.ualberta.ca/~unisecr/appeals.htm)
Copyright(www.library.ualberta.ca/copyright/index.cfm)
Inclusive Language (www.education.ualberta.ca/ed/L35?EQRSinnto)

Grading System:
Final letter grades will be assigned and official transcripts will include a numerical value based on the new University of Alberta four point system (see www.grades.ualberta.ca for more information).

RATINGGRADERECOMMENDED GRADE DISTRIBUTION IN GRADUATE CLASSES
ExcellentA+, A, A-40%
GoodB+, B33%
SatisfactoryB-, C+22%
Unsatisfactory   5%

Faculty of Education Equity Statement
The Faculty of Education is committed to providing an environment of equality and respect for all people within the University community, and to educating faculty, staff, and students in developing teaching and learning contexts that are welcoming to all.


Suggested Reference Texts

Web sites
www.learning.gov.ab.ca (Alberta Learning)
www.teachers.ab.ca (ATA)
www.caut.ca/english/issues/current/default.asp (Canadian Association of University Teachers).
www.ualberta.ca/~cafa/briefs.html (Faculty Associations: CAFA).
www.learning.gov.ab.ca/nativeed/nativepolicy/pdfs/Framework.pdf (Royal Commission on Aboriginal Peoples).
www.learning.gov.ab.ca/nativeed/nativepolicy/pdfs/Framework.pdf(First Nations, Métis, and Inuit Education Policy Framework).
www.library.ualberta.ca/catalogue (NEOS Libraries Catalogue/search)
www.library.ualberta.ca/subject/education/index.cfm (Coutts Library)


Assignment #4: Application for Funding (30%)

"Request for Proposals, 2004"

Seven-North Educational Policy Trust continues its investment in educational policy studies through funded research activities. The Trust's research interests are in the areas of educational administration and leadership, adult education, First Nations studies, and studies in theory, culture and international education. Proposals are invited from researchers in any of these areas. Maximum funding for a single project is $20,000.

Applicants should provide a thorough description of their proposed research under the headings:

Purpose and Objectives of the Research
Context/Rationale
Literature Review
Methodology (including theoretical/conceptual framework and methods)
Educational Significance (emphasizing how proposal makes and original contribution and potential
implications of the research for policy and practice, and/or future research).
The proposal must follow APA (5th ed.) style. It should include an abstract of no more than 500 words. The proposal should be written using expository and argumentative prose. Length of the proposal should be12-15 double- spaced pages (exclusive of references). Applicants should submit two copies of the proposal.

The deadline for submission is Tuesday June 15, 2004
Please direct submissions to:
Rosemary Foster, PhD
Assistant to the Funding Director, Margaret Haughey, PhD

April 2004