Annual conference papers

2009 AES International Conference Canberra - Program

Powerpoint presentations from the 2009 Conference can be accessed via the links below.

Please note: presentations are only available if the presenter has provided permission.

Wednesday 2 September 2009

9.00am - 10.30am

Session 1: opening plenary Audio (Mp3 82Mb) (Right click on the link to save.)

Keynote address:

Evidence and Evaluation Audio (Mp3 63Mb) (Right click on the link to save.)

Professor William Trochim, Cornell University

11.00am - 11.50am

Session 2: plenary

Keynote address:

Helping evidence inform policy: the use of eclectic approaches Audio (Mp3 47Mb) (Right click on the link to save.)

Terry O’Brien, Productivity Commission

11.55am - 12.35pm Session 3: concurrent sessions

Collecting or 'constructing' qualitative evaluation evidence addressing highly sensitive and marginalised issues? Lessons from evaluating Australian 'Clean Needle Programs'

Paul Aylward

Evaluation in the Australian Public Sector: After 25 years of Federal Government Departments’ involvement in evaluation – what have we learnt?

Professor Peter Bycroft

Assessing aid effectiveness in a changing world: the annual review of development effectiveness

John Davidson

Revolution for evolution – a new approach to road safety advertising and more significant role for social marketing research

Joan Young

Rethinking the evaluative process: exploring co-constructive research relationships

Tamara Cumming and Dr Sandie Wong

Indicators and public policies: the sunflower effect. The cases of the Millennium Development Goals and of the Paris Declaration

Luc Lefebvre

1.35pm - 2.15pm Session 4: concurrent sessions

Using standard setting to understand stakeholder perspectives of ‘How good is good enough?’

Dr Janet Clinton

Evaluating the implementation and outcomes of four State-wide policies

Sheila Matete-Owiti and Ann Porcino

Capturing the voice of children through photos in Lao PDR

Diane McDonald and Deborah Rhodes

Issues in the evaluation of programs for Indigenous communities in Australia

Anne Markiewicz

The road to resilience: signposts and maps

Professor Rick Cummings

Using participatory methods for researching violence against women: an experience from Melanesia and East Timor

Mary Ellsberg
2.20pm - 3.00pm Session 5: concurrent sessions

The use of Social Network Analysis in the evaluation of a complex Pacific health initiative

Faith Mahony

Bridging the performance gap between civil society organisations and international donors

Linda Kelly

Quantitative or qualitative indicators… What about both?

Mihaela Balan, Palen Ata and Rex Thomas

The use of beneficiary and other focus groups in the evaluation of empowerment programs – lessons from NGO programs in India

Dr Patrick Kilby

A concise framework for thinking about the types of evidence provided by monitoring and evaluation

Dr Paul Duignan

The evaluation of European Commission aid delivery through the UN Family, the Development Banks and the EIB

Dr Edwin Clerckx
3.30pm - 4.10pm Session 6: concurrent sessions

Evidence based policy and practice: meeting sampling challenges in evaluating national OHS interventions

Dr Robert Pedlow

Lifting the lens: using systems logic to make sense of a complicated policy

Mathea Roorda and Heather Nunns

Evaluating AusAID’s sub-national programs in PNG

Tony Land and Felecia Dobunaba

Usefulness of mixed methodologies in evaluation of a program for Indigenous clients

Jenny Williams

Simulation modelling as a tool for evaluation

Dr David Turner

What have we learned about RCTs, gold standards and credible evidence: moving beyond the debates to improve evaluation practice

Dr Stewart Donaldson

Long paper
4.15pm - 4.55pm Session 7: concurrent sessions

Evaluating the progress of complex programmes: a scoring procedure

Kathryn Cairns

Using the Delphi technique for assessing evaluation capability building needs

Julie McGeary

Using a logic model as the framework for an evaluation in Papua New Guinea

Kate Averill

Eyes on the horizon: evaluating the impact of the CSIRO National Research Flagship Program

Dr Tracy Henderson

Communicating during a crisis – choosing your words

David Bruce

Do evaluation forms have a future?

Dr John Owen and Professor Rick Cummings

5.00pm - 5.40pm Session 8: concurrent sessions

MSC: Misunderstandings, strengths & challenges

Fiona Kotvojs

Shaping a whole of organisation response to evaluation: achievements, challenges and learnings

Katrina Bredhauer

Leaving the microscope at home and taking a can opener instead – experiences in capacity assessment with civil society organisations in Papua New Guinea

Jessica Kenway and Martin Syder

Moving toward the fire: developing a tool to provide meaningful results to both government funders and to remote community members

Emma Williams and Eileen Cummings

How does stakeholder engagement in program evaluation really work?

Janet Clinton


Thursday 3 September 2009

9.00am - 10.05am

Session 9: plenary

Keynote address:

The “messy” world of development evaluation Audio (Mp3 61Mb) (Right click on the link to save.)

Cheryl Gray, Director, Independent Evaluation Group (IEG), World Bank

10.35am - 11.15am Session 10: concurrent sessions

Reconstructing program theory

Hannah Carlson

Doing evaluations in Papua New Guinea

Round table

So, what are we (were we) trying to achieve in the Madrasahs? Using evaluability assessment to identify changes in the quality of basic education in Islamic schools in Indonesia

Jeff Bost and Devi Miarni

Applying theories of the policy process to evaluation: the case of the 2009 evaluation of Australia’s National Drug Strategy

David McDonald

Working with economic evaluation: a dream or a nightmare?

Geoff Drysdale and Bernadette Swanson

Round table

How national and international agencies create confusion about what evidence is needed for evaluation

Jerome Winston

Long paper
11.20am - 12.00pm

Session 11: concurrent sessions

Discussion of the ‘success case methodology’

Associate Professor Eileen Piggot-Irvine 

Evaluating business assistance schemes with large longitudinal databases

Philip Stevens

A spatio-ethnographic methodology for strategic monitoring and evaluation

Dr Ian Scales

Building the evidence of the value of non-government drug and alcohol treatment – it’s not just about data collection

Jo Khoo and Tanya Merinda

Learning from the evidence about evidence-based policy and practice

Professor Patricia Rogers

Long paper

International development evaluation: Australasian aid agency perspectives

Penny Hawkins, Cate Rogers, Dan Ticehurst and Miranda Cahn


12.05pm - 12.45pm Session 12: concurrent sessions

‘It’s all a bit wishy washy’: the challenge of building partnerships for effective mental health evaluation

Greer Lamaro

The role of household panel surveys in evidence-based policy: a review

Dr Gaminiratne Wijesekere

Meeting the challenges: evolving evaluation processes in an AusAID funded program in Papua New Guinea

Jennifer Rush and Lisania Boletu

Developing quality guidelines for observational studies

Dr John Pfaff
1.45pm - 2.25pm Session 13: concurrent sessions

Skill building workshop for carers of people with eating disorders: evaluating the effects on the participants or evaluating the program?

Dr Genevieve Pepin

Good value: taking an evaluative approach in a field dominated by statistics and economics

Kathleen Palmer

A framework for evaluating capacity development programs in the international development sector

Fiona Kotvojs

The influence of program theory-based evaluation on the use of the evaluation information: a longitudinal study

Dr Sheri Hudson

Evaluating a complex intervention for people bereaved through suicide – challenges and considerations

Victoria Visser

Why do so many program evaluations systematically over-estimate positive impacts?

Michael Bamberger
2.30pm - 3.10pm Session 14: concurrent sessions

Proof of success – finding evidence in a world that forgets: valuing criteria for the evaluation of the National Dementia Support Program

Rosemary McKenzie

Management by objectives in the German Police force? Performance criteria, factors for success and failure from the employees point of view

Ellen Meissner

Evaluation of the European Union Competitiveness and Innovation Programme, Information and Communication Technologies Policy Support Programme

Dr Carlos Rodriguez-Casal

Understanding negative impacts of early intervention: realist methodologies

Dr Gill Westhorp

Did it make a difference? Trying to unravel the mystery of impact and the contribution made by a public initiative

Julie Hind, David Beckingsale and Judith Woodland

Extreme evaluation: evidence and community-level health activities in Afghanistan

Penny Haora

3.40pm - 4.30pm

Session 15: plenary

Panel discussion:

Hierarchy of Evidence Audio (Mp3 52Mb) (Right click on the link to save.)

Facilitator: Terry O’Brien

Professor William Trochim, Dr Phil Davies, Professor Andrew Leigh, Professor Patricia Rogers

Friday 4 September 2009

9.00am - 10.05am

Session 16: plenary

Keynote address:

The importance of evaluation for evidence-based policy and practice Audio (Mp3 61Mb) (Right click on the link to save.)

Dr Phil Davies

10.35am - 11.15am Session 17: concurrent sessions

From anecdote to evidence: a model for rigorous integration of qualitative information in evaluations

Associate Professor Barbara Pamphilon

Gathering evidence using data: the implications and advantages for undertaking evaluation research in-house

Narelle Fitzgerald

How to decide? Collecting evidence for evaluations

Dr Jenny Neale

Family outcome measures: pre and post intervention process to assess family functioning

Dr Terrence O’Brien, Helen Spark and Nic Telford

Evidence on a shoestring – what works for NGOs

Andrew Anderson and Annette Michaux

Round table 

What are these things called Program Logic and Program Theory: and how are they used?

Professor Patricia Rogers,

Anne Markiewicz,

Kate Averill and

Paul Duignan

11.20am - 12.00pm

Session 18: concurrent sessions

Analysis of causation in qualitative evaluation

Dr Darrel Caulley

Development of a monitoring, evaluation and reporting framework for the invasive pest plant and animal program in Victoria

Catriona King

How should an evaluator make judgments about the quality of research evidence from the social sciences?

Dr Angela O’Brien-Malone

Evaluating the impact of communities for children

Ben Edwards

How do NGOs gather evidence to show effectiveness?

Dr Francois Tsafack, Andrew Newmarch, Carolyn Kabore and Gabrielle Mahony


Addressing challenges in using realist synthesis to inform policy and practice

Kaye Stevens,

Margaret Cargo

12.05pm - 12.45pm Session 19: concurrent sessions

Issues teaching qualitative research and evaluation

Associate Professor Rosalind Hurworth

Using social software / Web 2.0 to gather evidence, two case studies in education for sustainability: CarbonKids 2009 Pilot and Global Communities for Sustainability

Larraine Larri, Angela Colliver and Prithi Nambiar

Meta evaluation to assess the quality of evidence – a case study

Chris Milne

Developing effective programs and services in a population health framework

Ian Down
1.45pm - 2.25pm Session 20: concurrent sessions

Facing the evidence: Chernoff faces in evaluation

Ken Lountain

Evaluation of natural resource management funding programs in South Australia (2000-2008)

Sarah Willmott

From institutions to community care in Victoria: what difference has evaluation made?

Bridget Roberts

Stakeholder network analysis: a case study to understand the spread of aquatic weeds

Byron Pakula

Clients’ perceptions of value drives evaluation

Rosemarie Tweedie and Mary Carey
Forum with the AES Fellows
2.30pm - 3.10pm Session 21: concurrent sessions

The role and challenges for official statistics in policy evaluation

Geoff Bascand

Signposts for Australian agriculture

Dr Jean Chesson

An argument for the adoption of a rigorous process of stakeholder analysis (SA) within evaluation practice

Paul Vance

'Evaluation Champions Network (ECN) Model' strengthening evaluation capacity of farm service delivery projects

Dr Riad Naji

3.15pm - 4.00pm

Session 22: closing plenary

Panel discussion and closing remarks Audio (Mp3 41Mb) (Right click on the link to save.)

Search site
© 2023 Australian Evaluation Society Limited 
ABN 13 886 280 969 ACN 606 044 624
Address: 425 Smith St VIC 3065, Australia

We acknowledge the Australian Aboriginal and Torres Strait Islander peoples of this nation. We acknowledge the Traditional Custodians of the lands in which we conduct our business. We pay our respects to ancestors and Elders, past and present. We are committed to honouring Australian Aboriginal and Torres Strait Islander peoples’ unique cultural and spiritual relationships to the land, waters and seas and their rich contribution to society.