[2024]Digital Global Overview Report 2024 Meltwater.pdf
Government Program Performance Audit and Evaluation
1. AUDITING & EVALUATING
GOVERNMENT PROGRAM PERFORMANCE
September 27-30, 2010
Use Performance Information to Drive Decision Making
Arlington, VA
FEATURING TWO INTERACTIVE COURSES: Capture and
Utilize Accurate
PERFORMANCE AUDITING:
Achieving Maximum Impact Data to Prove
• Create successful strategies to improve performance auditing
that Government
• Develop relevant program measures to better improve program objectives
Programs are
PROGRAM EVALUATION:
Developing and Performing High-Priority Evaluation Activities
Achieving their
• Learn to determine if a program is accomplishing its intended outcomes Intended Outcomes
• Understand key steps to build an evaluation system within your organization
In Association with:
www.PerformanceInstitute.org/Audit
2. Day 1 PERFORMANCE AUDITING: ACHIEVING MAXIMUM IMPACT
Monday, September 27, 2010
AUDIT PERFORMANCE INFORMATION —
8:30 12:00
Conference Registration and Continental Breakfast Lunch Break
9:00 1:00
Understand Definitions and Phases of a Discuss and Understand How Vulnerability is Assessed
Performance Audit • Obtain an understanding of the program: Inputs,
• Define financial and performance audits under processes, outputs and outcomes
auditing standards • Assess vulnerability (the COSO/ERM and TX State
• Understand the phases and outputs of a performance audit Auditor models)
• Learn the importance of the planning phase in order to • Review audit-ability of high risk/high vulnerability programs
receive high impact auditing results
• Identify terms associated with risk and Case Study: Conduct a Risk and Vulnerability Assessment
vulnerability assessment • Identify high risk/high vulnerability issues
• Report out and reach consensus on selecting issues
Identify Risks Associated with Government Programs and for audit
Use Conceptual Models to Interpret and Assess the Risks • Summarize risk and vulnerability assessment
• Discover the inherent risk model and relationship to
program performance expectations or goals 4:00
• Identify and evaluate sources of program performance Adjourn
expectations or goals
• Review types of performance measures and understand
how inherent risks, performance expectations/goals and
performance measures are interrelated
“There is solid evidence
Examine How Inherent Risks Are Assessed
that each dollar spent on
• Review principles of risk
• Develop methods for evaluating and ranking risk using
program integrity…yields
risk factors $1.60 in savings and reduced
• Determine sources of risk information
• Learn how to document and report on risk assessment results erroneous payments.”
— Peter Orszag, Director,
Office of Management and Budget
WHO SHOULD ATTEND?
• Government Auditors • Project Managers • Division Managers
• Inspectors General • Program Analysts • Program Planners
• Program Managers • Strategic Planners • City and County Executives
2 www.PerformanceInstitute.org/Audit
3. PERFORMANCE AUDITING: ACHIEVING MAXIMUM IMPACT
Day 2
Tuesday, September 28, 2010
AUDIT PERFORMANCE INFORMATION —
8:30 Become a
Conference Registration and Continental Breakfast
Certified Government
Performance Manager
9:00
To ensure professional success, you must continually expand
Formulate Performance Audit Objectives and
your skills and education. The bar has been raised in
Sub-Objectives Based on Risks and Vulnerabilities
government agencies and organizations and managers
• Understand the importance of asking the right question want to hire, promote and work with the most skilled
• Examine the relationship between audit objectives and individuals possible.
performance aspects
• Apply steps for defining audit objectives and sub-objectives To address this need, The Institute offers a Certificate in
• Review relationships between audit objectives Government Performance Management. Completing a
and methodologies certification program is easy. Just attend the three “core”
courses and an additional three “elective” courses based
Case Study: Develop High Impact Audit Objectives and on the topics that meet your agency’s unique needs. The
Sub-Objectives Based On Risk and Vulnerability Assessment skills you acquire will then be used to complete a “capstone
project” on a particular issue that you and your department
• Select high risk/high vulnerability issues
are facing, which will then be evaluated by an expert
• Develop high impact objectives and sub-objectives
member of our staff.
• Report out and assess potential impacts
12:00 Customize a Program to Fit Your Needs
Lunch Break Working with Institute training managers, you can select courses
that will have direct application and impact to your work.
1:00 For more information about certification, please contact
Review and Understand How to Select Data Chris Hicks at 202-739-9548 or email him at
Collection/Analysis Methodologies Chris.Hicks@PerformanceInstitute.org
• Relate audit methodologies to appropriate and
sufficient evidence
• Review quantitative analysis (ratio analysis, trend and 5 REASONS TO ATTEND:
time-series analysis, regression analysis, cost-benefit,
cost-effectiveness and others)
• Examine qualitative analysis (survey/interview/focus groups,
1 USE data and evaluation to drive continuous
program performance
observation--participant observation, trained observer)
• Understand relationship of methodology selection to 2 EXAMINE the different types of program
evaluation and how to use them
audit-ability and audit project budgets
Discover Best Practices in Risk and Measurement Based
3 DETERMINE program relevancy to the
agency’s mission
Performance Auditing
• Learn to create a checklist which identifies successful
4 USE evaluation methods to discover program
strengths and weaknesses
strategies related to performance auditing
5 UNDERSTAND the relationships between
performance auditing, performance measurement,
program evaluation and organizational learning
4:00
Adjourn
www.PerformanceInstitute.org/Audit 3
4. Day 3 DEVELOPING & PERFORMING HIGH-PRIORITY EVALUATION ACTIVITIES
Wednesday, September 29, 2010
PROGRAM EVALUATION —
8:30
Conference Registration and Continental Breakfast
About the Trainers:
9:00 Stephen L. Morgan, CIA, CGAP,
Setting the Stage: A Federal Perspective on the Current CGFM, CFE, is the former city auditor of Austin, Texas,
State of Program Evaluation within Government Agencies who directed a full scope audit office that conducts
• Examine the Obama Administration’s “increased performance audits, fraud investigations, and
emphasis on program evaluation” and what new consulting engagements. Mr. Morgan played a key
processes may await Federal evaluators leadership role in helping the City of Austin evolve its
• Understand the relationship between evaluation and performance measurement and management system
performance auditing, performance measurement, into a model for other government organizations.
program evaluation and organizational learning Before joining the City Auditor’s Office, Mr.
• Review what key agencies have done to better improve Morgan was an evaluator in the U.S. Government
their evaluation practices Accountability Office’s National Productivity Group.
• Discuss what challenges await as new management His Institute of Internal Auditors’ offices have included
requirements are presented president and governor, Austin Chapter, chair of
the International Government Relations Committee,
TED KNIKER, Executive Consultant, Federal Consulting Group,
North American Director on the Global Board,
National Business Center, U.S. Department of the Interior
chair of the North American Board, and chair of the
North American Nominating Committee. In January
10:30 2001 Mr. Morgan was appointed (reappointed
Phase One of Learning Approach to Evaluation: in 2005) by the Comptroller General of the United
Focus the Inquiry States to the Advisory Council on Government
• Establish a common framework on basic evaluation terms Auditing Standards. He co-authored three textbooks:
• Review the impetus for evaluation Performance Auditing: A Measurement Approach (first
• Understand the organization’s context and second editions) and Auditor Roles in Government
• Develop the logic model Performance Measurement: A Guide to Exemplary
Practices at the Local, State, and Provincial Levels. In
12:00 May 2009, Mr. Morgan received the Victor Z. Brink
Lunch Break Memorial Award for Distinguished Service, the IIA’s
highest global audit leadership award. In May 2007,
Mr. Morgan accepted the National Intergovernmental
1:00
Phase One of Learning Approach to Evaluation: Audit Forum’s Excellence in Government Performance
Focus the Inquiry (continued) and Accountability Award from the Comptroller
General of the United States. Also, in March 2002,
• Clarify the purpose of the evaluation
Mr. Morgan became the fourth annual recipient of the
• Develop the evaluation’s key questions
Harry Hatry Distinguished Performance Measurement
• Think explicitly about the use of findings
Practice Award from the American Society of Public
Administration honoring his lifetime of contributions to
Phase Two of Learning Approach to Evaluation:
public service. Mr. Morgan holds a Bachelor of Arts
Carry out the Inquiry
degree in government (with honors) from the University
• Develop and implement the evaluation plan
of Texas at Austin; he was elected to Phi Beta Kappa.
He also holds an MPA from the Lyndon B. Johnson
4:00 School of Public Affairs of the University of Texas.
Adjourn
4
5. DEVELOPING & PERFORMING HIGH-PRIORITY EVALUATION ACTIVITIES
Day 4
Thursday, September 30, 2010
PROGRAM EVALUATION —
8:30
Conference Registration and Continental Breakfast
Rosalie Torres is a recent past board
member of the American Evaluation Association,
9:00
serves on the editorial boards of major evaluation Phase Three of Learning Approach to
journals and served as the staff director for the1994 Evaluation: Apply Learning
revision of the Joint Committee’s Program Evaluation
• Interpret the data and develop communications
Standards. With over 30 years experience conducting
and reports
program evaluation in human service settings, she
• Support the action plan based on evaluation findings
has taught graduate level research and evaluation
• Monitor and provide feedback on actions taken
courses at several universities, and routinely conducts
workshops on various topics related to evaluation
Build and Evaluation System Within
practice. She has authored/co-authored numerous
Your Organization
books and articles articulating practice-based
• Gather and review information about
theories of evaluation use; the relationship between
organization’s mission, purpose, strategic plan,
evaluation and individual, team and organizational
structure and staffing
learning; and effective strategies for communicating
• Diagnose status of organization’s infrastructure
and reporting evaluation findings. Among them
critical to organizational learning and design of
are: Evaluation Strategies for Communicating and
evaluation system
Reporting: Enhancing Learning in Organizations,
• Reach shared understanding on the organization’s
2nd edition (Sage, 2005), and Evaluative Inquiry
overall theory of change
for Learning in Organizations (Sage, 1999). Her
organization was recently awarded a National
Science Foundation grant to conduct research on
12:00
Lunch Break
logic model use in the design, implementation and
evaluation of complex, multi-year educational reform
systems. She earned her Ph.D. in research and 1:00
evaluation in 1989 from the University of Illinois. Build an Evaluation System Within Your Organization
(Continued)
• Use theory of change and logic models to identify
inquiry questions for informing organizational
“The instructor has an improvement and success
• Identify additional measures needed and complete
in-depth knowledge of plan for data collection, analysis, reporting and use
• Implement and evaluate the evaluation system
the subject matter as well
as a keen knowledge of 4:00
Training Adjourns
other resources useful
for my job.”
— MC, Program Analyst,
Internal Revenue Service
www.PerformanceInstitute.org/Audit 5
6. AUDITING & EVALUATING GOVERNMENT PROGRAM PERFORMANCE
In-House Training & Customization
One of the more popular vehicles for accessing the Institute’s educational offerings is the delivery of on-site trainings
and management facilitations. Bringing a training or facilitation in-house gives you the opportunity to customize a
program that addresses your exact challenges and provides a more personal learning experience, while virtually
eliminating travel expenses. Whether you require training for your department or for an organization-wide initiative,
the advanced learning methods employed by The Performance Institute will create an intimate training atmosphere that
maximizes knowledge transfer to enhance the talent within your organization.
Customization:
We realize that not all obstacles can be overcome by applying an “off-the-shelf” solution. While many training
providers will offer you some variation of their standard training, The Performance Institute’s subject matter experts will
work with you and your team to examine your programs and determine your exact areas of need. The identification of
real life examples will create a learning atmosphere that resonates with participants while at the same time providing
immediate return on your training investment. Using interactive exercises that employ actual projects or scenarios
from your organization, instructors can address specific challenges and align the curriculum of each session to your
objectives. While the majority of on-site trainings are focused on smaller groups, The Performance Institute also has the
ability to accommodate organization-wide training initiatives. Utilizing multiple instructors, the Institute has the capacity
to deliver courses to groups of up to 300 participants per day.
Areas of Expertise:
On-site delivery of single courses, certification programs and entire packages of specialized courses are available in
the following areas:
• Strategic Planning • Performance-Based Contracting
• Performance Measurement • Performance Reporting
• Project Management • Program Evaluation
• Lean Six Sigma • Administrative Management
• Workforce Management • Leadership and Change
• Performance-Based Budgeting
For more information about in-house training and certification options, please contact Jennifer Mueller at 202-739-9619 or
email her at Jennifer.Mueller@performanceinstitute.org.
Sponsorship Opportunities:
As a conference and training provider, The Performance Institute is an expert in bringing together leaders to share and discuss best
practices and innovations. We connect decision-makers with respected solutions providers.
The Institute offers four different pre-designed sponsorship packages:
• Event Co-Sponsor • Session Sponsor
• Luncheon Sponsor • Exhibit Booth Sponsor
For more information on sponsorships or to get started, contact Meredith Mason at 202-739-9707 or email her at
Meredith.Mason@PerformanceInstitute.org
6 www.PerformanceInstitute.org/Audit
7. AUDITING & EVALUATING GOVERNMENT PROGRAM PERFORMANCE
Venue & Hotel
Venue & Hotel: Quality Assurance:
Audit and Evaluate Program Performance will be held at The The Performance Institute strives to provide you with the most
Performance Institute in Arlington, VA, just one block east of the productive and effective educational experience possible. If
Courthouse Metro stop on the Orange Line. A public parking after completing the course you feel there is some way we
garage is located just inside of the building. can improve, please write your comments on the evaluation
form provided upon your arrival. Should you feel dissatisfied
The Performance Institute Conference Center with your learning experience and wish to request a credit or
1515 N. Courthouse Rd., Suite 600 refund, please submit it in writing no later than 10 business
Arlington, VA 22201 days after the end of the training to:
877-992-9521
The Performance Institute: Quality Assurance
A limited number of rooms have been reserved at the 805 15th Street, NW, 3rd Floor
Arlington Rosslyn Courtyard by Marriott at the prevailing Washington, DC 20005
rate of $229. This rate is based on the Government Per Diem
and is subject to change. Please call the hotel directly and Note: As speakers are confirmed six months before the
reference code “Audit and Evaluate Program Performance” event, some speaker changes or topic changes may occur
when making reservations to get the discounted rate. The in the program. The Performance Institute is not responsible
hotel is conveniently located three blocks from the Rosslyn for speaker changes, but will work to ensure a comparable
Metro station. Please ask the hotel about a complimentary speaker is located to participate in the program.
shuttle that is also available for your convenience.
If for any reason The Performance Institute decides to
Arlington Rosslyn Courtyard by Marriott cancel this conference, The Performance Institute accepts no
1533 Clarendon Blvd. responsibility for covering airfare, hotel or other costs incurred
Arlington, VA 22209 by registrants, including delegates, sponsors and guests.
Phone: 703-528-2222 / 1-800-321-2211
www.courtyardarlingtonrosslyn.com Discounts:
• All ‘Early Bird’ Discounts must require payment at time of
Tuition & Group Discounts: registration and before the cut-off date in order to receive
The tuition rate for attending Audit and Evaluate Program any discount.
Performance is as follows:
• Any discounts offered whether by The Performance Institute
Offerings Early Bird Regular Rate (including team discounts) must also require payment at the
Individual Course $769* $869 time of registration.
Attend Both and Save! $1499* $1599 • All discount offers cannot be combined with any other offer.
* For the Early Bird rate, register before: August 2, 2010. • Discounts cannot be applied retroactively
For more information on group discounts for Audit and Payment must be secured prior to the conference. If payment
Evaluate Program Performance please contact: is not received by the conference start date, a method of
Chris Hicks at 202-739-9548 or email him at payment must be presented at the time of registration in order
Chris.Hicks@PerformanceInstitute.org to guarantee your participation at the event.
www.PerformanceInstitute.org/Audit 7
8. AUDITING & EVALUATING GOVERNMENT PROGRAM PERFORMANCE
Registration Form
CALL FAX THIS FORM TO VISIT
877-992-9521 866-234-0680 www.PerformanceInstitute.org/Audit
Registration Form
Yes! Register me for Audit and Evaluate Program Performance
Yes! Register me for Auditing Performance Information
Yes! Register me for Program Evaluation
Please call me. I am interested in a special group discount for my team
Delegate Information
Name Title
Organization Dept.
Address
City State Zip
Telephone Fax
Email
Payment Information
Check Purchase Order/Training Form Credit Card
Credit Card Number Expiration Date Verification no.
Name on Card
Billing Address
Please make checks payable to: The Performance Institute
CANCELLATION POLICY: The Performance Institute will provide a full refund less a $399 administration fee for cancellations requested four weeks prior to
the event start date unless cancellation occurs within two weeks prior to the event start date. If a cancellation is requested less than two weeks prior to the
event start date, no refund will be issued. Registrants who fail to attend and do not cancel prior to the event will be charged the entire registration fee. All
cancellations must be requested through the cancellation link found in your attendance confirmation email. Please note that cancellation is not final until
you receive a cancellation confirmation email.
I have read and accepted the Cancellation Policy above.
ACKNOWLEDGED AND AGREED
By: ______________________________________________________________________________________________ Date: _______________________________________
Priority Code: P765-WEB