ANNUAL INSTRUCTIONAL PROGRAM REVIEW
AND PLANNING PROGRESS
FALL 2007
- What is the status of the objectives identified in the Program Action Plan (operational and new initiative) from section VII, Program Priorities.
|
Objective
|
Activity/Action
|
Status
|
|
Curriculum Branch: Continue to examine and redesign curriculum in the Math DE Program. In particular, work on Basic Skills, Geometry, and courses affected by the upcoming change to AA degree requirements
|
Basic Skills
Revise the basic skills offerings (Math 1/2/7, 4, and 9) based on the following information and goals:
· Determine the target population for each course to address the diversity of student needs (survey of student interest and educational goals)
· Meet the needs of service programs (survey and retreat with DSPS, Occ. Ed., VN Nursing, etc)
· Align courses with the DE Math Program SLOs
· Develop course-level SLOs that balance the role of “drill”/procedural skill acquisition, quantitative literacy skills, and problem-solving in a real world context
· Address best practice in the field of Developmental Education
· Investigate the way these courses are packaged (short-term intensive, “boot camp”, online quick review, etc.)
Use institutional research, program assessment, and math education research to determine which basic skills courses will continue to be offered.
If self-paced courses remain part of the DE program, redesign these course outlines (Math 1, 2, 7) to incorporate the DE program learning outcomes and align them with the DE program; develop criteria and instruments to assess revisions to course outlines; assess revisions
|
In progress. See description below.
|
|
Math 15: Determine the role of Math 15 given upcoming changes to the AA
If Math 15 continues to be part of the curriculum,revise the course outline, including incorporating the DE program learning outcomes and aligning this course with the DE Program; develop criteria and instruments to assess revisions; assess revisions.
|
No progress
|
|
Math 26: Update COOR to align course learning outcomes with the Math DE Program SLOs and to incorporate findings from the following:
· Survey of Math 26 students’ educational goals or reasons for taking Math 26
· Geometry course outlines from other colleges
· math education research
|
A detailed draft has been completed without the research described.
|
|
Student Support Branch: Assess student support services in the Math DE Program
|
· Clarify the goals of lab services
· Develop a systematic process for evaluating the effectiveness of lab services, including direct, indirect, and qualitative measures
· Work with faculty to meaningfully integrate lab services with classroom instruction
|
In progress. See description below.
|
|
Equity
|
· Conduct a retention study to understand why students drop their math classes
· Revise the DE Math Research agenda to include placement and persistence data broken down by ethnicity
· Research interventions to address equity issues (e.g. MESA)
· Obtain Title V funds (or other funding) to pilot initiatives identified in the research (e.g. Learning Communities, peer mentoring, tutoring for athletes, )
|
In progress. See description below.
|
|
Professional Development Branch: Implement a comprehensive and coherent professional development program for faculty teaching and other staff supporting DE courses
|
· Continue to implement a structured orientation for new DE Math faculty
· Continue to offer Teaching Communities (with an initial focus on Prealgebra) and Scholarship of Teaching and Learning Seminars
· Continue to offer Elementary Algebra retreats (with a focus on teaching to the DE Math Program SLOs, norming standards, and assessment of student work)
· Continue to offer flex activities (with a focus on assessment of student work for the purpose of program improvement, orientation to the Math DE Program)
· Rework scheduling policies so that instructors who participate in extensive staff development efforts connected to specific curriculum are allowed priority in teaching that curriculum.
|
In progress. See description below.
|
|
Program Assessment:
Conduct ongoing assessment of all three branches of the Math DE Program
|
· Continue to conduct assessment of student learning for course/program improvement
· Update the research agenda with Humberto
· Develop a plan for systematically assessing lab services and tutoring using direct, indirect, and qualitative data
· Develop a plan for systematically assessing professional development activities, including direct measures of implementation of program SLOs into teaching and learning
|
In progress. See description below.
|
Curriculum Branch: Basic Skills: In the spring, the Math DE Committee offered a series of four Basic Skills retreats with the goal of analyzing our current arithmetic courses and making a recommendation for updating these courses to reflect the Math DE Program Student Learning Outcomes and better serving our students. We currently offer five different arithmetic courses, each originally designed to address the needs of specific populations. Eight faculty attended the retreats, four of whom were adjuncts. They identified the following problems:
- Course descriptors in the catalog make this a confusing array of courses. Anecdotal evidence suggests that students do not end up in the right arithmetic course; for example, the Disabled Students Program advises students to take a course designed for students in occupational programs because it can be completed 0.5 units at a time.
- There has been significant curriculum “creep”; for example, the curricular materials and texts used by instructors in courses designed for occupational programs do not contain applications pertinent to those programs.
- For all courses except one, the course outlines are outdated and do not reflect Math DE Program SLOs for communication, problem-solving in real world contexts, use of multiple representations connected to quantitative literacy skills, and effective learning skills.
- We do not have recent OIR research on completion of any of the possible basic skills sequences. An earlier study of three small cohorts taking the popular computer-based variable-unit course showed that fewer than 20% of any cohort finished the 3 units required for the certificate. The study did not indicate whether students had moved into prealgebra after finishing 1.5 units of arithmetic review.
After interviewing faculty teaching in occupational programs, reviewing the math components of several certification and job-training entrance exams, and discussing how the Math DE Program SLOs could be achieved through an arithmetic course, the group recommended that the department
- consolidate the current course offerings into one arithmetic course and write a course outline aligned with the Math DE Program SLOs (the group drafted a set of course-level SLOs that reflected the program-level SLOs);
- design a “project-based” curriculum where students work in teams to use quantitative literacy skills and arithmetic reasoning to solve and present solutions to problems based in real-world and occupational contexts;
- integrate multiple modes of instruction into the course, including lecture, lab, computer-aided instruction, and mastery-based learning.
Math15
Given that in Fall 09 Math 15 will no longer qualify as a course that is sufficient for the AA degree requirement, it is questionable as to the future usefulness of this course.
Student Support Branch: Math lab
With respect to the objective of evaluating lab services, we conducted a math lab usage study to determine if students of color used lab services at rates comparable to white students. The data was shared with both the campus DE Committee and the Math Department with the goal of identifying areas of concern and developing action plans. Lab usage did not vary significantly by ethnicity, though we noticed that a smaller percentage of African American students who used the lab became moderate or heavy users. We plan to conduct another study to ascertain why students who are light users of the lab do not become moderate or heavy users.
With respect to the objective of working with faculty to integrate lab services into instruction, we conducted a flex activity in which instructors worked in groups to analyze data connected to math lab usage, such as headcount, number of visits, and average length of a visit. Since the data showed a wide variation in lab usage for different sections of the same course, we asked instructors to share strategies for getting students to the lab.
Equity:
Several members of the Math DE Committee participated in planning sessions for the MESA grant. Tue is teaching in the AVID Learning Community and attended an AVID conference.
Professional Development:
Prealgebra
We built on the work of a SP 06 Prealgebra Teaching Community, which is documented in the website
http://www.cfkeep.org/html/stitch.php?s=21223071051038&id=58310652392274. After reading LiPing Ma’s
Knowing and Teaching Elementary Mathematics, the SP 06 Teaching Community developed an appreciation for the conceptual richness of arithmetic and a realization that that we needed to do more to understand these concepts before we could teach them effectively. So in SP 07
and Fall 07 we sponsored weekly meetings for a group of seven instructors, two of whom were adjuncts, to read and discuss Susan Lamon’s
Teaching Fractions and Ratios for Understanding. For the first month we had the instructors do think-alouds with problems from the book, with the caveat that they could not resort to algorithms to solve the problems. This forced instructors to think about the concepts and to analyze their own reasoning. This introductory exercise brought many previously unexamined arithmetic reasoning skills to light. Each instructor then took responsibility for leading the discussion on an assigned chapter and produced the following:
(1) Summary of the key ideas from the chapter.
(2) Set of problems that address the key ideas (perhaps drawing heavily from the problem sets in the chapter but changing contexts to adult settings).
(3) Snapshot of Math 12 students’ thinking relative to the ideas in the chapter.
· Identify one assessment problem that reflects the key points (perhaps just use the opening problem from the chapter);
· Give the problem to prealgebra students and analyze their responses;
· Compare our prealgebra student responses to the examples of student work in the chapter.
(4) Framework for understanding developmental stages of student thinking (perhaps a rubric developed from our discussion of student work). We plan to use this framework as an instructional resource to help instructors make instructional decisions during class when they are using teaching this material.
The next steps for the Math 12 group is to provide some guiding principles in terms of what is really important for students to learn in a prealgebra class. There is a spectrum of emphasis, starting with learning arithmetic skills alone, learning arithmetic skills after having provided a foundation of understanding (such as indepth knowledge of proportional reasoning), or emphasizing exclusively the conceptual understanding as the end objective and the way of solving skills problems.
Elementary Algebra
In January, we assessed student work on final exams from 7 of the 10 sections of Elementary Algebra to gauge attainment of program-level SLOs. Relative to FA 03, we found significant decreases in the percent of students rated as proficient in communication and use of multiple representations, with no improvement in problem-solving. This contrasts with the sustained improvements in learning for Intermediate Algebra students. To understand this decline in learning, the Math DE Committee analyzed the activities written by Teaching Communities for alignment with these SLOs, surveyed instructors about the use of these activities, and reviewed exams given by Elementary Algebra instructors. See the attached “Measuring the Impact of Professional Development: Two Case Studies” for more analysis. The committee concluded that, in general, instructors were not teaching to the SLOs. In an attempt to improve learning, we implemented a three-step plan:
- SP 07: four retreats focused on pedagogy that promotes problem-solving; 16 instructors, 13 of whom were adjuncts, read and discussed case studies from Improving Algebra Instruction: Using Cases to Transform Mathematics Teaching and Learning and conducted a classroom-based project. See attached “Algebra Retreat Assignment;”
- SU 07: overhaul of the classroom activities to more fully integrate communication, problem-solving, and multiple representations along with the development of our first instructors’ manual;
- FA 07: weekly Japanese Lesson Study based on new classroom activities with instructors sharing set-up and implementation strategies used for each activity, analyzing student work on a previous activity, and preparing for the next activity by reviewing a draft of an instructors’ manual.
Outside initiatives associated with the Math Developmental Ed program
Recently there has been a large influx of campus initiatives that influence at least some of the Math Dev Ed program. For example, the AVID program will have a class (Math 25) which is directly connected to the student success class that AVID provides. The redoing of the campus tutoring program, including any changes in tutoring evaluation, Socratic questioning processand tutoring staff development will support our tutoring efforts. The creation of a Umoja Scholars program, similar to the Puente program except for African American males, might create a special section of veelopmental Math for their group. We are about to find out if MESA will be established on our campus. If so, then their students will be sprinkled throughout our Math 25 and Math 30 courses.
Program Assessment:
As discussed previously, we continue to conduct program assessment. We conducted a math lab usage study, in addition to our systematic tutor evaluation processes. We conducted an assessment of student learning using Elementary Algebra exams and used the results to focus our professional development activities. We also received the results of several persistence studies from OIR. The results showed that both the Elementary Algebra and Intermediate Algebra cohorts had respectable rates of persistence to and success in transfer-level math. We shared these results with 27 math faculty who attended a recent flex activity and facilitated a brainstorming session on strategies for encouraging persistence, e.g. requiring students to have an educational plan or meeting individually with students to choose their next math class.
- If some objectives were attained, how successful were the changes in improving program effectiveness?
This is a difficult question to answer. What are the measures of program effectiveness? We operate under the hypothesis that if we continue to implement all branches of the DE program, we will see improvements in student learning and student success over time.
- If some objectives were not attained, what were the impediments? Do you still believe these objectives will lead to program improvements?
One of the topics that the Math DE Committee has focused on is a series of new cohort pilots ("
Connecting Consecutive DE Math Courses") spearheaded by Jeannine Stein. This new focus has the interest and support of the Math DE Committee. We have not begun the difficult task of implementing the recommendations that came out of the Basic Skills Retreats in SP 07, though we continue to work toward a revamping of basic skills curriculum through the work of the Lamon group. The work of the Lamon group will probably also lead to a revision of the Math 12 course outline. In addition, the Math DE Lead continues to struggle with coordinating the wide range of projects that fall under his purview, so the ground work for some projects, such as the retention study, has been laid even if the projects were not completed. We are beginning to doubt that work on Math 15 will be useful. We still believe that revision of the Math 26 course outline to make it consistent with the DE program will be useful, but we have not had enough person-power to complete it yet. We also still believe that the following "in progress" objectives will be useful, but we have not had enough time and person-power to complete them yet:
- Student Support Branch: Assess student support services in the Math DE Program
- Equity
- Professional Development Branch: Implement a comprehensive and coherent professional development program for faculty teaching and other staff supporting DE courses
- Program Assessment: Conduct ongoing assessment of all three branches of the Math DE Program
- Review the feedback from the TLP on section III, Student learning Outcomes. Please summarize your progress on your assessment plan.
In SP 06, we conducted an assessment of student work on Elementary Algebra final exams. The results prompted a series of action plans outlined earlier.
- What have you learned from the program review and planning process that would inform future attempts to change and improve your program?
Program review and the subsequent annual updates, if done conscientiously, will help us focus our efforts and reflect on our actions. It should help us create a shared vision for our program that will keep us on track. Also, we noticed that we need to think about the measures of program effectiveness, and how we will obtain the resources to measure the impact of our unit plan on program effectiveness.
- The planning committee thought it was too early to see any impact on program data and therefore program data is not being generated this semester. However, if you would like to see an update of your program’s data, including 2005-2006, you can contact the research office at hsale@losmedanos.edu or look at data on COGNOS at http://siren.4cd.net/cognos
N/A
Comments (0)
You don't have permission to comment on this page.