Competitive Grants Program 2015-16 TitleIIA(3) Improving Teacher Quality

2015-16 TitleIIA(3) Improving
Teacher Quality
Competitive Grants
Program
Technical Assistance Webinar
October 23, 2015
1
NEEDS DATA
Teacher Needs Pre-Proposal Survey
& Other Data
2
Needs Data: Category 1 Projects
• Proposals with all new participants must include:
• Evidence at least 1 LEA partner meets federal
criteria
• Teacher Data
• Pre-proposal needs survey among potential teacher participants
• Student Data
• Indication of student needs based on available test scores or
other pertinent student data
3
Needs Data: Category 2 Projects
• Proposals with new and returning participants should
include:
• Evidence at least 1 LEA partner meets federal criteria
• Teacher Data
• Pre-proposal needs survey of potential new teachers; most recent
post-survey data from returning teachers
• Student Data
• Indication of student needs based on available test scores or other
pertinent student data
• Research/evaluation data from current project
• Briefly describe current project intervention (in existing and
previous pertinent projects) and value based on evaluation findings
• Provide summary of findings to date, from evaluation of current
project and previous pertinent projects, particularly data
representing effects on teachers (including comparison group data)
and their students
4
Needs Data: All Projects
• Teacher Participant Needs Survey Data
• Standard survey with option to add project-specific questions (do
not delete any existing items)
• Customize needs survey for targeted subject matter only; items
reflect State Board of Education approved standards at the time of
this grant cycle
• Available for five core subject areas:
•
•
•
•
•
English Language Arts (Common Core State Standards)
Mathematics (Common Core State Standards)
Science (Michigan Science Grade Level Content Expectations)
Social Studies (Michigan Social Studies Grade Level Content Expectations)
World Languages (Michigan Standards and Benchmarks)
• May be administered in paper/pencil or electronic form
5
Needs Data: All Projects (Cont.)
• Teacher Participant Needs Survey Data
• SAMPI can assist in customizing survey and compile and
return raw data for use in proposal/program development
• Data can be provided in Excel or Access
• Projects must submit a summary of needs survey data
(tables, graphs, summary statements, etc.) and any
additional data (student test scores, etc.) in the narrative
portion of the proposal
• Submit raw data with code numbers in database
(databases available for basic needs survey)
6
Example #1 From Needs Survey
PART A. INSTRUCTION AND ASSESSMENT PROFESSIONAL DEVELOPMENT NEEDS
Rate each of the following items based on your personal professional development instructional and assessment needs, with
1 = low need; 5 = high need; 0 = need has already been met. Indicate whether the item is a high priority for you (yes or no).
7
Example #2 From Needs Survey
8
Example #3 From Needs Survey
9
Other Needs Data
• Other Data
• Provide other data pertinent to partner needs if available
(such as needs from SIP, district-level tests, curriculum
needs, etc.)
• Previous Research/Evaluation Findings
• Describe previous actions taken by IHE partner in
comparable projects to address identified needs
• For continuing projects, describe value of proposed
intervention based on IHE partner research/evaluation
findings from current and previous projects
10
Teacher/School Commitment Forms
• Required “Memo of Understanding” for
teachers
• Required “Memo of Understanding” showing
partner school principal support and
commitments
• Reminders:
• Participation not duplication of effort in another project
• Avoid conflict of interest for teachers or school
• Signed copies attached to proposal
11
EVALUATION
12
Evaluation Goals
1) Improve programming through use of
evaluation data
2) Determine the impact of project and
statewide effort on new and returning
participants
3) Identify strengths and limitations of the
projects
13
Project-Level Evaluation
• Develop feasible evaluation plan that links to project goals
and objectives and interventions
• Suggested evaluation strategies for core goals:
•
•
•
•
•
Common cross-site pre/post surveys
Pre/post lesson observations
Interview sample of participants
Collect teacher artifacts
Gather evidence of impact on students
• Use additional instruments/procedures specific to project as
desired to determine impact or gather implementation data
14
Project-Level Evaluation continued
• Gather and report participation/activity data
• Support a person(s) with adequate time dedicated to
evaluation
• External or internal, with appropriate expertise and without
major program coordination duties, for data collection,
analysis, and reporting
• May want to provide support person time for data
management
15
Cross-Site State-Level Evaluation
• Assist with needs survey preparation during proposal stage
• Assist with preparation of pre-post cross-site survey and
compilation and analysis of data
• Coordinated by SAMPI-Western Michigan University
• Advise on local project use of data collection instruments
and procedures
• Advise on evaluation as requested
• Assist in coordinating cross-site meetings
• Conduct observation of sample of project PD activities
• Compile data from across projects
• Prepare periodic statewide reports
16
ELEMENTS OF THE EVALUATION
17
Determine Impact on
Teachers/Other Participants
• Pre/post cross-site surveys (option to add
items pertinent to specific project)
• Plus longitudinal analysis for continuing projects
• Pre/post lesson observations
• Plus longitudinal analysis for continuing projects
• Sample of interviews of participants
• Collect and analyze a sample of teacher
artifacts
18
Determine Impact on
Teachers/Other Participants (Cont.)
• Projects including both new and returning
teachers (Category 2) must also report on
differences observed
• Comparison group analyses between new
and returning participants
• Analyses may be quantitative, qualitative or
both from teacher surveys, classroom
observations, interviews, artifacts, student
assessments
19
Determine Impact on Students
of Participating Teachers
• Procedures to identify changes in student
learning
•
•
•
•
•
Pre/post tests
Pre/post surveys
Focus group interviews
Assessment of student work
Identify project-specific “opportunities to
learn”
• Collect sample of student artifacts to show
changes
20
Required Participation
in Cross-Site Activities
• Project directors and evaluators are expected to
participate in cross-site activities throughout the
entire duration of the grant
• Two face-to-face meetings in Lansing and three webinars
• Assist state-level evaluation in arranging projectlevel site visits
21
Required Common Reporting
• Required Common Reporting
• Participation levels and demographics, PD types,
overall assessment of progress toward goals
• Final evaluation report
• End of project participant-specific data consistent
with cross-site statewide data collection
• Sharing findings at cross-site sessions
22
End-of-Project Reporting
• Director Report
•Use standard report format available in
electronic version
•SAMPI can provide Access (or Excel)
database to projects to maintain
participation records and to facilitate
report preparation
23
Part #1 Sample Reporting Tables
24
Part #2: Director Perceptions
of Project Accomplishments
• Rate progress toward outcomes
• Provide evaluation/other evidence to
support rating
25
Part #2: Director Perceptions of Project
Accomplishments-Sample Form
Complete the following tables, one for each of your intended outcomes as per your
proposal. Outcomes are statements of intended impacts or results that will occur
as a result of your professional development programming or other project
interventions. Prepare this section in collaboration with project evaluator.
26
Part #3: Nature of Professional
Development/Interventions
• Hours, participants, schedule by type of
intervention
• Role of college faculty/content experts
• Problems planning, implementing project
• Problems recruiting teachers
27
Part #3 :Nature of Professional Development/Interventions
Sample Form
28
Part 3: Nature of PD/Interventions
Sample Form
PA RT I C I PAT I O N I N Y O U R P R O J E C T.
3. Use the chart below to describe higher education faculty (both content and
education faculty) or other external expert.
29
Part #4: Evaluation Report
Required Components
Prepared by evaluator in collaboration with project director
• All projects:
•
•
•
•
•
•
•
Data collection
Progress toward project outcomes
Lesson observation data
Teacher and student artifacts
Impacts on participating students
Effectiveness of project partnership
Other
• Category #2 Projects
• Results of comparison studies
30
Questions?
• SAMPI contact information:
•
Crystal Stein or Tessa Souers
[email protected]
[email protected]
•
Mark Jenness
[email protected]
•
Tel: (269) 387-3791
SAMPI is located at Western Michigan University in
Kalamazoo, MI
31