Program Evaluator #62248010 (Open Competitive)
Apply NowCompany: City of Buffalo, NY
Location: Buffalo, NY 14221
Description:
Salary : $106,797.00 Annually
Location : Buffalo Board of Education, NY
Job Type: Full-Time
Job Number: 62248010
Department: Board of Education
Opening Date: 03/26/2025
Closing Date: 4/15/2025 11:59 PM Eastern
Fee: $15.00
RESIDENCE: Residence is a requirement for all positions. In the absence of clear and convincing evidence to the contrary, an applicant shall be deemed a non-resident if he/she cannot show ninety (90) days of continuous and uninterrupted residence in the City of Buffalo prior to filing application.
PLEASE TAKE NOTICE THAT THE ORDINANCES OF THE CITY OF BUFFALO MANDATE CONTINUOUS RESIDENCY IN THE CITY DURING YOUR EMPLOYMENT, EXCEPT FOR POSITIONS SPECIFICALLY EXEMPT UNDER STATE LAW.
FEE: WHERE INDICATED, A NON-REFUNDABLE APPLICATION PROCESSING FEE MUST ACCOMPANY YOUR APPLICATION VIA CHECK, CASH OR MONEY ORDER (If using check for payment, your check must clear to complete processing.)
Check with Civil Service office for fee waiver info.
Distinguishing Features of the Class
Program Evaluator #62248010 (Open Competitive)
Exam Date: 05/17/2025
Final Filing Date: 04/15/2025
The Program Evaluator is responsible for overseeing the District's ongoing systemic program evaluation processes in order to provide information to decision-makers regarding program, curriculum, grants, and/or effectiveness of initiatives. Partial focus will be on evaluations involving Title I programs.
The Program Evaluator serves as lead and coordinates all phases of program evaluation research, from preparation through final dissemination. This includes conducting needs assessments; all aspects of survey methodology; analysis and interpretation of quantitative data; conducting, facilitating and/or interpreting results of interviews, focus groups, observations, document analyses; and developing/writing reports and/or providing presentations to meet the needs of various audiences.
The incumbent will work with appropriate District departments to obtain data on the District's educational programs and activities and will perform and monitor statistical analyses required for data reporting and interpretation of results. Independent judgment is exercised and supervision is exercised over staff assigned. The incumbent works directly under the Chief Accountability Officer and also answers to the Superintendent of the Buffalo Schools.
Examples of work (Illustration Only)
Minimum Qualifications
Master's degree in Education, Psychology, Sociology and/or related field from an accredited college or university and three years of experience with program evaluation and/or statistical assessment analyses;
OR
Bachelor's degree in Education, Psychology, Sociology and/or related field from an accredited college or university and five years of experience with program evaluation and/or statistical assessment analyses
OR
An equivalent combination within the limits of A and B
SUBJECT OF EXAMINATION - Written Test..........Relative Weight 100%
Points will be added to a successful candidate's score as follows:
SENIORITY..............................................For Each Year 0.2 Rating of Seniority is based on the length of continuous and permanent status in the classified civil service up to a maximum of twenty years.
EXAMINATION WILL TEST KNOWLEDGE, SKILLS AND/OR ABILITIES IN SUCH AREAS AS:
1. Preparing Written Material
2. Basic Statistical Concepts
3. Research Methods and Techniques
4. Understanding and Interpreting Tabular Material
5. Supervision
THE USE OF A CALCULATOR IS RECOMMENDED FOR THIS EXAMINATION
NOTE: Most Civil Service examinations do not require the use of a calculator. However, candidates have the option of bringing a hand-held, battery- or solar-powered calculator to the test room unless specifically notified that their use is prohibited. Devices with typewriter keyboards, spell checkers, personal digital assistants, address books, language translators, dictionaries or any similar devices are prohibited. You may not bring books or other reference material. Cell phones and any other electronic devices are also prohibited.
Additional Information
EXPANDED SUBTEST DESCRIPTIONS:
1. Preparing Written Material
These questions test for the ability to present information clearly and accurately, and to organize paragraphs logically and comprehensibly. For some questions, you will be given information in two or three sentences followed by four restatements of the information. You must then choose the best version. For other questions, you will be given paragraphs with their sentences out of order. You must then choose, from four suggestions, the best order for the sentences.
2. Basic Statistical Concepts
These questions test for knowledge of the analytical methods used to reduce and describe large sets of numerical data. The questions cover such areas as the organization and presentation of data, statistical terminology, central tendency, variability, the normal curve, and correlation.
You will not be required to do any substantial manipulation of data.
3. Research Methods and Techniques
These questions test for knowledge of the conceptual foundations for the collection and interpretation of data. The questions cover such areas as survey methods and techniques, sampling theory and techniques, and drawing conclusions from research results.
You will not be required to do any substantial manipulation of data.
4. Understanding and Interpreting Tabular Material
These questions test your ability to understand, analyze, and use the internal logic of data presented in tabular form. You may be asked to perform tasks such as completing tables, drawing conclusions from them, analyzing data trends or interrelationships, and revising or combining data sets. The concepts of rate, ratio, and proportion are tested. Mathematical operations are simple, and computational speed is not a major factor in the test. You should bring with you a hand-held battery- or solar-powered calculator for use on this test. You will not be permitted to use the calculator function of your cell phone.
5. Supervision
These questions test for knowledge of the principles and practices employed in planning, organizing, and controlling the activities of a work unit toward predetermined objectives. The concepts covered, usually in a situational question format, include such topics as assigning and reviewing work; evaluating performance; maintaining work standards; motivating and developing subordinates; implementing procedural change; increasing efficiency; and dealing with problems of absenteeism, morale, and discipline.
Test Guide:
The New York State Department of Civil Service has not prepared a test guide for this examination. However, candidates may find information in the publication 'General guide to Written Test' helpful in preparing for this test. This publication is available online at: https://www.cs.ny.gov/testing/testguides.cfm.
This written exam is being prepared and rated by the N.Y.S. Department of Civil Service in accordance with Section 23-2 of the Civil Service Law, and the provisions of the N.Y.S. Civil Service Rules and Regulations dealing with the rating and review of exams apply. (If not attached, expanded subtest descriptions may be obtained from the Civil Service office, Room 1001 City Hall.)
(The eligible list resulting from this exam may be used to fill comparable positions.)
MULTIPLE EXAMINATIONS SCHEDULED FOR THE SAME DAY:
If you have applied to take a written test announced by either one or several local jurisdictions (county, town, city) scheduled to be held on the same day as this written test, you must notify each of the local jurisdictions no later than two weeks before the test date, so they can make arrangements for taking all tests at one test site. All examinations for positions in State government will be held at a State examination center.
LOCAL GOVERNMENT EXAMS notify each civil service agency to make arrangements no later than two weeks before test date. You must notify each agency with whom you have filed. For this information, notify the Department of Human Resources, Division of Civil Service, Room 1001 City Hall, Buffalo, New York 14202 or call or come to the office.
IMPORTANT INFORMATION REGARDING WEATHER CONDITIONS ON THE DAY OF THE EXAMINATION -
In the event of severe weather conditions on the day of the examination, please listen to the following radio/tv stations for postponement or delay in the starting time of the administration of the examination: WBEN 550, WGR 930, WWW 1400, WWKB 1520- AM RADIO; WKSE 98.5, WLKK 102.5, WTSS 107.7-FM RADIO OR WIVB-TV (CH. 4) If no such announcement is made, you must presume that the examination will be administered as scheduled.
IMPORTANT INFORMATION FOR USE OF VETERAN'S CREDITS
If you are currently serving on active duty in the Armed Forces of the United States, you may apply for veteran's credits. These veteran's credits shall be granted on a conditional basis at time of establishment of the eligible list. You will be restricted from certification using these credits until you have received an honorable discharge or release under honorable conditions. Your DD214 must be presented as proof of service during war time, before you can be certified for appointment from the eligible list using these credits.
Special Requirement for Appointment in School Districts and BOCES
Per Chapter 180 of the Laws of 2000, and by Regulations of the Commissioner of Education, to be employed in a position designated by a school district or BOCES as involving direct contact with students, a clearance for employment from the State Education Department is required.
NOTICE TO EXAM PARTICIPANTS
Additional Points Available to Children of Police Officers and Firefighters Killed in the Line of Duty
(New Section 85-a, NYS Civil Service Law, effective 9/17/02)
On September 17, 2002, Governor Pataki signed into law a bill adding a new section 85-a to the Civil Service Law granting additional credit on civil service examinations for children of firefighters and police officers killed in the line of duty. This law is to take effect immediately.
"In conformance with Section 85-a of the Civil Service Law, children of firefighters and police officers killed in the line of duty shall be entitled to receive an additional ten points in a competitive examination for original appointment in the same municipality in which his or her parent has served. If you are qualified to participate in this examination and are a child of a firefighter or police officer killed in the line of duty in this municipality, please inform this office of this matter when you submit your application for examination. A candidate claiming such credit has a minimum of two months from the application deadline to provide the necessary documentation to verify additional credit eligibility. However, no credit may be added after the eligible list has been established."
Applicants claiming these points must do so in writing (you may enclose in application), indicating the name, title, relationship and place of employment of the deceased parent.
Eligibility for points will be reviewed and applicants may be required to submit additional information to verify the claim.
Additional points available to siblings of Firefighters and Police Officers killed in the line of duty as the result of the September 11, 2001 World Trade Center Attack (Chapter 500, Laws of New York 2003). For more information, check with the Department of Human Resources, Civil Service office.
This position is not eligible for benefits.
Location : Buffalo Board of Education, NY
Job Type: Full-Time
Job Number: 62248010
Department: Board of Education
Opening Date: 03/26/2025
Closing Date: 4/15/2025 11:59 PM Eastern
Fee: $15.00
RESIDENCE: Residence is a requirement for all positions. In the absence of clear and convincing evidence to the contrary, an applicant shall be deemed a non-resident if he/she cannot show ninety (90) days of continuous and uninterrupted residence in the City of Buffalo prior to filing application.
PLEASE TAKE NOTICE THAT THE ORDINANCES OF THE CITY OF BUFFALO MANDATE CONTINUOUS RESIDENCY IN THE CITY DURING YOUR EMPLOYMENT, EXCEPT FOR POSITIONS SPECIFICALLY EXEMPT UNDER STATE LAW.
FEE: WHERE INDICATED, A NON-REFUNDABLE APPLICATION PROCESSING FEE MUST ACCOMPANY YOUR APPLICATION VIA CHECK, CASH OR MONEY ORDER (If using check for payment, your check must clear to complete processing.)
Check with Civil Service office for fee waiver info.
Distinguishing Features of the Class
Program Evaluator #62248010 (Open Competitive)
Exam Date: 05/17/2025
Final Filing Date: 04/15/2025
The Program Evaluator is responsible for overseeing the District's ongoing systemic program evaluation processes in order to provide information to decision-makers regarding program, curriculum, grants, and/or effectiveness of initiatives. Partial focus will be on evaluations involving Title I programs.
The Program Evaluator serves as lead and coordinates all phases of program evaluation research, from preparation through final dissemination. This includes conducting needs assessments; all aspects of survey methodology; analysis and interpretation of quantitative data; conducting, facilitating and/or interpreting results of interviews, focus groups, observations, document analyses; and developing/writing reports and/or providing presentations to meet the needs of various audiences.
The incumbent will work with appropriate District departments to obtain data on the District's educational programs and activities and will perform and monitor statistical analyses required for data reporting and interpretation of results. Independent judgment is exercised and supervision is exercised over staff assigned. The incumbent works directly under the Chief Accountability Officer and also answers to the Superintendent of the Buffalo Schools.
Examples of work (Illustration Only)
- Functions as a project manager in the implementation of program evaluations of various district metrics, such as assessment data, enrollment, attendance/suspension, and college and career readiness;
- Develop complex and rigorous mixed methods research and evaluation designs to analyze data and synthesize information from education research and related areas;
- Perform complex statistical research analyses of district programs or activities, applying an analytical approach to the solution of a wide variety of problems, or applies specialized techniques or ingenuity in selecting and evaluating approaches to unforeseen problems;
- Performs and monitors statistical analyses required for data reporting and interpretation of results under general supervision;
- Conducts research and special analyses and contributes to the development of data interpretation materials and publications;
- Assists in planning, coordinating and conducting statistical work. Accountable for basic statistical design and analysis decisions;
- Prepare significantly complex reports, analyses and papers for publication, surfacing key policy questions based on underlying data and/or graphs, as appropriate;
- Present findings in a variety of formats, including narrative, charts, graphs, and data visualizations;
- Assists in developing, designing and documenting technical and operational procedures and statistical guidelines for assigned area;
- Design or identify appropriate qualitative or quantitative instruments and tools for research and evaluation studies;
- Works in collaboration with the Chief Accountability Officer to access school data, related data, and information to prepare and format presentations and related materials, while maintaining confidentiality and integrity of data, following federal laws, state laws, school board policies, and professional standards;
- Applies sufficient knowledge of statistical procedures, psychometric methods and statistical programming (e.g., SAS or SPSS) to work independently on most aspects of statistical analysis work, while receiving instruction and guidance in other aspects; and
- Performs related duties as required.
Minimum Qualifications
Master's degree in Education, Psychology, Sociology and/or related field from an accredited college or university and three years of experience with program evaluation and/or statistical assessment analyses;
OR
Bachelor's degree in Education, Psychology, Sociology and/or related field from an accredited college or university and five years of experience with program evaluation and/or statistical assessment analyses
OR
An equivalent combination within the limits of A and B
SUBJECT OF EXAMINATION - Written Test..........Relative Weight 100%
Points will be added to a successful candidate's score as follows:
SENIORITY..............................................For Each Year 0.2 Rating of Seniority is based on the length of continuous and permanent status in the classified civil service up to a maximum of twenty years.
EXAMINATION WILL TEST KNOWLEDGE, SKILLS AND/OR ABILITIES IN SUCH AREAS AS:
1. Preparing Written Material
2. Basic Statistical Concepts
3. Research Methods and Techniques
4. Understanding and Interpreting Tabular Material
5. Supervision
THE USE OF A CALCULATOR IS RECOMMENDED FOR THIS EXAMINATION
NOTE: Most Civil Service examinations do not require the use of a calculator. However, candidates have the option of bringing a hand-held, battery- or solar-powered calculator to the test room unless specifically notified that their use is prohibited. Devices with typewriter keyboards, spell checkers, personal digital assistants, address books, language translators, dictionaries or any similar devices are prohibited. You may not bring books or other reference material. Cell phones and any other electronic devices are also prohibited.
Additional Information
EXPANDED SUBTEST DESCRIPTIONS:
1. Preparing Written Material
These questions test for the ability to present information clearly and accurately, and to organize paragraphs logically and comprehensibly. For some questions, you will be given information in two or three sentences followed by four restatements of the information. You must then choose the best version. For other questions, you will be given paragraphs with their sentences out of order. You must then choose, from four suggestions, the best order for the sentences.
2. Basic Statistical Concepts
These questions test for knowledge of the analytical methods used to reduce and describe large sets of numerical data. The questions cover such areas as the organization and presentation of data, statistical terminology, central tendency, variability, the normal curve, and correlation.
You will not be required to do any substantial manipulation of data.
3. Research Methods and Techniques
These questions test for knowledge of the conceptual foundations for the collection and interpretation of data. The questions cover such areas as survey methods and techniques, sampling theory and techniques, and drawing conclusions from research results.
You will not be required to do any substantial manipulation of data.
4. Understanding and Interpreting Tabular Material
These questions test your ability to understand, analyze, and use the internal logic of data presented in tabular form. You may be asked to perform tasks such as completing tables, drawing conclusions from them, analyzing data trends or interrelationships, and revising or combining data sets. The concepts of rate, ratio, and proportion are tested. Mathematical operations are simple, and computational speed is not a major factor in the test. You should bring with you a hand-held battery- or solar-powered calculator for use on this test. You will not be permitted to use the calculator function of your cell phone.
5. Supervision
These questions test for knowledge of the principles and practices employed in planning, organizing, and controlling the activities of a work unit toward predetermined objectives. The concepts covered, usually in a situational question format, include such topics as assigning and reviewing work; evaluating performance; maintaining work standards; motivating and developing subordinates; implementing procedural change; increasing efficiency; and dealing with problems of absenteeism, morale, and discipline.
Test Guide:
The New York State Department of Civil Service has not prepared a test guide for this examination. However, candidates may find information in the publication 'General guide to Written Test' helpful in preparing for this test. This publication is available online at: https://www.cs.ny.gov/testing/testguides.cfm.
This written exam is being prepared and rated by the N.Y.S. Department of Civil Service in accordance with Section 23-2 of the Civil Service Law, and the provisions of the N.Y.S. Civil Service Rules and Regulations dealing with the rating and review of exams apply. (If not attached, expanded subtest descriptions may be obtained from the Civil Service office, Room 1001 City Hall.)
(The eligible list resulting from this exam may be used to fill comparable positions.)
MULTIPLE EXAMINATIONS SCHEDULED FOR THE SAME DAY:
If you have applied to take a written test announced by either one or several local jurisdictions (county, town, city) scheduled to be held on the same day as this written test, you must notify each of the local jurisdictions no later than two weeks before the test date, so they can make arrangements for taking all tests at one test site. All examinations for positions in State government will be held at a State examination center.
LOCAL GOVERNMENT EXAMS notify each civil service agency to make arrangements no later than two weeks before test date. You must notify each agency with whom you have filed. For this information, notify the Department of Human Resources, Division of Civil Service, Room 1001 City Hall, Buffalo, New York 14202 or call or come to the office.
IMPORTANT INFORMATION REGARDING WEATHER CONDITIONS ON THE DAY OF THE EXAMINATION -
In the event of severe weather conditions on the day of the examination, please listen to the following radio/tv stations for postponement or delay in the starting time of the administration of the examination: WBEN 550, WGR 930, WWW 1400, WWKB 1520- AM RADIO; WKSE 98.5, WLKK 102.5, WTSS 107.7-FM RADIO OR WIVB-TV (CH. 4) If no such announcement is made, you must presume that the examination will be administered as scheduled.
IMPORTANT INFORMATION FOR USE OF VETERAN'S CREDITS
If you are currently serving on active duty in the Armed Forces of the United States, you may apply for veteran's credits. These veteran's credits shall be granted on a conditional basis at time of establishment of the eligible list. You will be restricted from certification using these credits until you have received an honorable discharge or release under honorable conditions. Your DD214 must be presented as proof of service during war time, before you can be certified for appointment from the eligible list using these credits.
Special Requirement for Appointment in School Districts and BOCES
Per Chapter 180 of the Laws of 2000, and by Regulations of the Commissioner of Education, to be employed in a position designated by a school district or BOCES as involving direct contact with students, a clearance for employment from the State Education Department is required.
NOTICE TO EXAM PARTICIPANTS
Additional Points Available to Children of Police Officers and Firefighters Killed in the Line of Duty
(New Section 85-a, NYS Civil Service Law, effective 9/17/02)
On September 17, 2002, Governor Pataki signed into law a bill adding a new section 85-a to the Civil Service Law granting additional credit on civil service examinations for children of firefighters and police officers killed in the line of duty. This law is to take effect immediately.
"In conformance with Section 85-a of the Civil Service Law, children of firefighters and police officers killed in the line of duty shall be entitled to receive an additional ten points in a competitive examination for original appointment in the same municipality in which his or her parent has served. If you are qualified to participate in this examination and are a child of a firefighter or police officer killed in the line of duty in this municipality, please inform this office of this matter when you submit your application for examination. A candidate claiming such credit has a minimum of two months from the application deadline to provide the necessary documentation to verify additional credit eligibility. However, no credit may be added after the eligible list has been established."
Applicants claiming these points must do so in writing (you may enclose in application), indicating the name, title, relationship and place of employment of the deceased parent.
Eligibility for points will be reviewed and applicants may be required to submit additional information to verify the claim.
Additional points available to siblings of Firefighters and Police Officers killed in the line of duty as the result of the September 11, 2001 World Trade Center Attack (Chapter 500, Laws of New York 2003). For more information, check with the Department of Human Resources, Civil Service office.
This position is not eligible for benefits.