International Workshop
Educational assessment in developing countries: the case of Mozambique

ILU, Uppsala University, April 26-28, 2000
Seminar rooms 1219 (Wednesday 26 through Friday 28)
and 3122 (Thursday 27, morning session)

<http://www.skeptron.uu.se/broady/sec/erdc-0004.htm>

Arranged by the Network for educational research in developing countries at ILU, Uppsala University
 <http://www.skeptron.uu.se/broady/sec/n-erdc.htm>

More information from:
Mikael Palme <mikael.palme@lhs.se>
Carol Benson <carol.benson@biling.su.se>
Donald Broady <broady@nada.kth.se>

Background

Educational assessment and pedagogical measuring potentially uphold important functions in education development in developing countries. Ideally, results from educational assessment would inform curriculum development and the design of teacher pre- and in-service training on pedagogical challenges that need to be addressed. They would also provide information to educational planners, politicians and the civil society on the performance of the education system generally, for example as regards gender inequalities and regional unbalance. For the individual teacher, an adequate evaluation of learning outcomes would be one of the means necessary for handling the discrepancy between curriculum demands and actual learning that often haunts primary teaching. Further, in education systems where few students reach higher levels, it is important that assessment instruments used for student selection are reasonably adequate.

In developed countries, educational assessment at a larger scale is a difficult and complex enterprise that often is subject to harsh criticism. For a number of reasons, large-scale educational assessment in developing countries is normally even more complex and risky. Often, little is known of the target population and to what extent it can be assumed to representative in specific respects. Since pupils are likely often to have different L1 and the local culture determining learning may be substantially different between regions, both the formulation of test items and the interpretation of test results may be particularly difficult. If test results are seen as indicators of complex learning processes that are determined by likewise complex cultural contexts of which often too little is known, the analysis of these results runs the constant risk of simplification and misinterpretation. Moreover, the organisational and economic conditions for schooling may differ between regions far more than what is normally the case in developed countries. An often poorly developed infra-structure in terms of transport and means of communication, in combination with an absence of traditions and skills for handling the administrative machinery required by large-scale assessment, also challenges attempts to develop national assessment programs.

At an international level, the IEA programme (International Association for the Evaluation of Educational Achievement) has since the 60’s carried through assessment tests in various countries for a comparative purpose.[1] As a continuation of the IEA studies, the TIMSS programme (The Third International Mathematics and Science Study) initiated in 1994-95 the carrying through of assessment tests at international level in mathematics and science.[2] As yet another extension of the IEA programme, the SACMEQ project (Southern African Consortium for Monitoring Educational Quality), linked to the Unesco institution IEPP, has in the 90’s monitored assessment test in various countries n Southern Africa.[3] The experiences from these internationally organised assessments of educational achievement have obviously been mixed. On the one hand, forms for transnational organisation of assessment programs have been developed and experiences have been gained on many of the difficulties related to the making and administration of tests in different national contexts and under varying conditions. On the other hand, tests have been criticised for not sufficiently reflecting the specific national, historic and cultural dimensions of the learning outcomes that have been measured and, hence, of being inadequate for the development of strategies for quality improvement in national contexts.[4]

In Mozambique, both the prior IEA and following-up SACMEQ tests have been administered. However, in 1997, the Ministry of Education initiated, through the national Institute for Education development (INDE), a properly national programme for educational assessment, funded by Finnish Finnida. In currently 3 provinces of the country, in a sample of schools, assessment tests in Portuguese, Mathematics and, more recently Science, have been administered and analysed by a group of researchers. In order to establish links with potential for giving a feedback to teacher education, test are worked out, administered and analysed in collaboration with Teacher Training Colleges. So far, the programme has produced two major reports on the first national assessment tests in the above mentioned subjects, including the proper tests, the presentation of test results and an analysis.

Most of the active members of the Network for educational research in developing countries at ILU, Uppsala University, have been actively engaged for many years in various kinds of research in Mozambique. This research includes an evaluation of teaching materials, assessment studies, studies of concept formation among pupils and teachers, as well as sociological analyses of schools, teachers and pupils in various parts of the country. This body of knowledge of Mozambican primary education represents an asset for the now ongoing national assessment project. It also represents a challenge, in the sense that it provides insights and an analysis of cultural and sociological aspects of teaching and learning, as well as of gender issues and region and social differences in the education system, that constitute an alternative basis for identifying and understanding the nature of problems related to the quality of primary education in the country. In other words, for the purpose of an in-depth analysis of problems related to educational assessment and pedagogical measuring in developing countries, a promising possibility exists to systematically and in detail relate this body of knowledge on Mozambican primary education to the design, carrying through and results of the on-going national assessment project. The arrangement of a workshop/conference with this objective has been made possible because of the willingness of the Finnida-funded assessment project in Mozambique to finance the participation both of the Mozambican experts working in the project and of the Finnish/Swedish consultants connected to it. The following application for funding regards the invitation of other African researchers and specialists in the area, as well as of Swedish researchers.

Aim

The workshop aims at discussing pertinent aspects of educational assessment and pedagogical measuring in developing countries, taking Mozambique as a case-study. The advantage of this approach is expected to be that penetrating into all the technical details of this projects, from sampling questions to the construction of specific items and the interpretation of results, and considering the theoretical dimensions of the questions dealt with, an in-depth approach to educational assessment and pedagogical measuring in a development context will be possible, as opposed to a discussion based on contributions from differing national contexts. However, through the participation by specialists with vast experience from other international assessment programmes (such as the SACMEQ programme or European programmes), the Mozambican project will contrasted to other similar assessment programmes. Further, the participation of researchers with various other research approaches to Mozambican primary education (linguistic, sociology and anthropology, didactics, conceptual studies, etc.) is expected to create the conditions for examining the role and contribution of educational assessment and testing to the understanding of the realities of primary education in the country.

discussion themes and agenda

Discussion themes

The workshop will address issues such as the following: 

1.      What different needs and demands does the assessment correspond to and what needs and demands could it realistically satisfy? Are these needs and demands potentially in conflict? What are the political uses of assessment? What trends and factors influence how assessment is shaped and how results are used? What would be the impact of the assessment administered by international organisations?

2.      What types of assessment tests are included and what are their differing objectives? To what extent can these objectives be combined and to what extent are they conflicting?

3.      The “operationalisation” of assessment: handling and administering the system from the national level to the local one; collecting the information on schools, teachers and the socio-cultural embedment of teaching; doing the tests and doing something with the them; working with reference groups; creating mechanisms for and feed-back from the teacher education system; the perception and role of assessment in the education system and in the local society.

4.      Over all dimensions of what is measured and should be taken into account in the selection and construction of test items: What should be measured and what can be measured? What are the gender-related dimensions of learning and skills and how can they be addressed and handled in assessment and measuring? What are the implications of the normally bi- or multilingual dimension of testing handled? How can skills and process-related abilities, as opposed to purely cognitive ones, be measured? What skills and abilities would that be? What are the implications for testing of the normally predominately oral culture to which the tested the target groups pertain? These aspects will be addressed in more detail in relation to the discussion of each one of the main subject areas.

5.      Sampling: relevant social, cultural and linguistic differences that potentially should be reflected; identification and use of indicators; classification of school-types; taking account of gender-related and regional differences.

6.      Assessment and measurement of primary mathematics: test items and test results analysis.

7.      Assessment and measurement of primary Portuguese learning: test items and test results analysis; the impact on bi- and multilingualism on language learning and language testing

8.      Science and skills testing: how can stages in cognitive development and skills be tested? What is the impact of the varying local regional cultures on children’s conceptual and skills’ development and how dependent is this development on the L1?

9.      Future staff development for the Mozambican group. International networking. Future collaboration with and links to Scandinavian educational research.

Agenda

Wednesday, April 26

 

9.00-9.15

Introduction, presentation of participants

 

 

9.15-10.00

The Mozambican National Assessment Programme
Zeferino Martins, Abel Assis, Carlos Lauchande

 

 

10.00-10.30

A synthesis of results
Jan-Erik Johansson

 

 

10.30-10.45

Coffee break

 

 

10.45-11.45

Political embedment; sampling; organisation of testing; procedures of data collection; reference groups; regional, social and gender differences
Carlos Lauchande and Jan-Erik Johansson
Discussant: Mikael Palme
 

 

 

11.45-12.30

Discussion

 

 

12.30-13.30

Lunch

 

 

13.30-15.45

Primary Portuguese testing.
Maria João Carrilho and Marcelo Soverano 
Discussants: Carol Benson and Mats Oscarsson

 

 

15.45-16.00

Coffee break

 

 

16.00-18.30

Continuation Primary Portuguese testing

 

 

19.00

Dinner

 

 

Thursday, April 27

 

9.00-9.45

Educational assessment in a historical and international perspective
Ulf P. Lundgren

 

 

9.45-10.30

Experiences from the SACMEQ assessment tests in developing countries
Ennie Molobe

 

 

10.30-10.45

coffee break

 

 

10.45-11.30

The Mozambican National Assessment Programme: background and main results
Zeferino Martins, Abel Assis, Carlos Lauchande, Jan-Erik Johansson

 

 

11.30-13.00

Discussion and synthesis: alternative strategies in educational assessment; comparison with other assessment projects in both developed and developing countries
Moderator: Staf Callewaert

 

 

13.00-14.30

Lunch

 

 

14.30-16.00

Primary Science and science skills testing 
Presentation: Antuia Mogne, Tuula Asula and Matti Pylvanainen
Discussant: Oleg Popov

 

 

16.00-16.15

Coffee break

 

 

16.15-17.30

continuation Primary Science and skills testing

 

 

19.00

Dinner

 

 

Friday, April 28

 

9.00-10.30

Primary Mathematics Testing
Carlos Lauchande, Dinis Guibundana and Jorma Asunta
Discussant: Wiggo Kilborn

 

 

10.30-10.45

Coffee

 

 

10.45-12.30

Contin. Primary Mathematics testing

 

 

12.30-14.00

Lunch

 

 

14.00-15.30

General discussion on the Mozambican educational assessment programme
Moderator: Donald Broady

 

 

15.30-15.45

Coffee break

 

 

15.45-17.00

Future perspectives: capacity building for the Mozambican assessment programme, institutional links
Moderator: Mouzinho Mário

 

 

17.00-17.30

Synthesis, conclusions, closing of the workshop

 

 

 

Participants

From Sweden:

Donald Broady, Prof of Education, ILU, Uppsala University

broady@nada.kth.se

Carol Benson, Centre for research on Bilingualism, Stockholm University

carol.benson@biling.su.se

Gustave Callewaert, Prof of Education, Copenhagen University

callew@swipnet.se

Holger Daun, lecturer, Dep. for Comparative Education, Stockholm University

holger.daun@int.ped.su.se

Kenneth Hyltenstam, Prof of Bilingualism, Centre for Research on Bilingualism, Stockholm University

kenneth.hyltenstam@biling.su.se

Gunilla Höjlund, Stockholm Institute of Education

gunilla.hojlund@lhs.se

Jan-Erik Johansson, Prof of Education, Oslo University

Jan-Erik.Johansson@lu.hioslo.no

Wiggo Kilborn, lecturer, Gothenburg University

wiggo.kilborn@ped.gu.se

Valdy Lindhe, lecturer, ILU, Uppsala University

valdy.lindhe@ilu.uu.se

Ulf P. Lundgren, Prof of Education, Uppsala University

Ulf.P.Lundgren@skolverket.se

Bent-Olov Molander, Stockholm Institute of Education

Bengt-Olov.Molander@lhs.se

Mikael Palme, Stockholm Institute of Education and ILU, Uppsala University

mikael.palme@lhs.se

Mats Oscarsson, lecturer, Gothenburg University

mats.oscarsson@ped.gu.se

Oleg Popov, lecturer, Umeå University

oleg.popov@educ.umu.se

Hans Persson, Sida

hans.persson@sida.se

From other Scandiniavian countries:

Ellen Carm, Hogskolen i Oslo

Elle.carm@lu.hioslo.no

Matti Pyivalainen, University of Jyväskylä

matti.pylvanainen@jyu.fi

Tuula Asunta, University of Jyväskylä

tasunta@edu.jyu.fi

Jorma Asunta, University of Jyväskylä

jasunta@jypoly.fi

Jette Steensen, University of Copenhagen

Jette_Steensen@nns.dk

Tuomas Takala, University of Tampere

katuta@uta.fi


From African countries:

Carlos Lauchande, Universidade Pedagógica and INDE, Mozambique

Carlos.Lauchande@mined.uem.mz

Abel Assis, Ministry of Education, Mozambique

 

Maria João Carrilho, INDE, Mozambique

 

Antuia Mogne, INDE, Mozambique

antuia@inde.uem.mz

Marcelo Soverano, INDE, Mozambique

 

Mouzinho Mário, University Eduardo Mondlane, Mozambique

mouzinho@zebra.uem.mz

Ennie Molobe, Ministry of Education, Botswana, SACMEQ

emolobe@gov.bw

Zeferino Martins, Ministry of Education, Mozambique

Zeferino.Martins@mined.uem.mz

Mubanga Kashoki, University of Zambia

Presently: mubanga.kashoki@biling.su.se

Calisto Ribeiro, UP, Mozambique

r_calisto@hotmail.com

 

[1] The IEA has produced a considerable amount of studies from the various testing programmes conducted throughout the years. A full list of publications can be found on the association’s offical WEB-site, http://www.iea.nl.

[2] See for example Albert E. Beaton et al: Science achievements in the Middle School Years: IEA’s Third International Mathematics and Science Study. Chestnut Hill, Mass: Center for the study of Testing, Evaluation and Educational Policy, Boston College, 1996, and subsequent study reports from TIMSS. See also http://timss.bc.edu

[3] See the reports from five Southern African countries (Mauritius, Namibia, Zimbabwe, Zanzibar, and Zambia) up till now published in the IIEP-series “SACMEQ National Policy Research Reports”, edited by Kenneth Ross

[4] See for example Vedder, P.: ‘Global measurement of the quality of education: a help to developing countries?’, International Review of Education, 40(1), 1994, pp 5-17, and the criticisms of education statistics made by Robert Serpell in his The Significance of Schooling. Life-journeys in an African Society. Cambridge: Cambridge University Press, 1993


URL of this page is http://www.skeptron.uu.se/broady/sec/erdc-0004.htm
Last updated 11 Aug 2011 

Back to SEC home page