NEWS

NEWS

This is your main NEWS category. Note that Joomla has another NEWS category built in. This one is for the plug-in called K2.

Each of the six participating countries achieved coding and data entry operations recently. National teams and operators applied standardised instructions and procedures for scoring students’ response into data sets template. The Australian Council for Educational Research (ACER) coordinated regional and national operations in collaboration with national teams and invited participants to ensure consistency within and across countries-languages versions. Experts supported intense national data entry workshops, verification and cleaning tasks for preparing initial survey’s data sets.

ACER’s experts are currently implementing a complex data process for setting sample weights, applying variance estimation and reporting methodologic outputs as another intermediate phase for preparing the final database. In the coming weeks up to mid-year, technical activities will focus on scaling cognitive and contextual responses for setting the new SEA-PLM regional scales, indicators and final database. During these important technical milestones, the national teams of SEA-PLM 2019 participating countries will continue to be closely consulted, informed and trained about the methodology. This particularly includes a regular annual National Team Regional workshop which is scheduled to be convened during July - August 2020.

SEA-PLM 2019 results reporting will start as soon as the final database is completed and documented, aiming to release the main regional report on 1 December 2020.

The SEA-PLM Regional Secretariat and experts acknowledge stakeholders for their continued technical and financial commitment and support on the SEA-PLM programme.

Saturday, 04 April 2020 17:10

Upcoming SEA-PLM events

  • National Team Regional Workshop – July - August, Bangkok

For discussing the data cleaning and psychometric operations, setting the final proficiency scales and training national teams to use the data sets.

  • 11thRegional Steering Committee – 25-27 August, Bangkok

For pre-launching SEA-PLM 2019 results and exchanging the SEA-PLM Programme short and long-term activities and opportunities. At distance consultation meeting may be organised earlier in the year for confirming SEA-PLM 2019 products and strategies on preparing the next round of assessment in 2023.

  • Launch of SEA-PLM 2019 Regional Report – 1 December, Bangkok

For publicly releasing initial SEA-PLM 2019 regional products and results at the regional level with the objectives to promote better learning policies and practices.

From left to right: Mr Antoine Marivin, Dr WahyudiMs Weerawan Theeraroungchaisri, Dr Ethel Pascua Valenzuela, Dr Salita Soongsawang, Mr Italo Dutra, Ms Erin Tanner, and Dr Orawan Sriboonruang

 

We are excited to introduce the 2020 SEA-PLM Secretariat team who will coordinate all SEA-PLM activities. The Secretariat is responsible for planning, programming and implementing the SEA-PLM work plan as approved by the Regional Steering Committee, and in collaboration with participating countries and key partners. 

Dr Salita Soongsawang joins the team as the new SEA-PLM Coordinator. She brings with her experience in managing human resource development programmes in Asia. She has recently obtained her doctoral degree in education, with a particular focus on ASEAN education cooperation, from the University of Melbourne, Australia. She is based at SEAMEO Secretariat in Bangkok to support the implementation, coordinate activities and oversee communications concerning the SEA-PLM programme. 

Under a new partnership agreement for 2020, SEAMEO Secretariat and UNICEF teams will continue to closely collaborate to support the SEA-PLM Secretariat. Dr Ethel Pascua Valenzuela, Dr Wahyudi, Dr Orawan Sriboonruang and Ms Weerawan Theeraroungchaisri will remain key persons to lead the SEA-PLM programme on behalf of the SEAMEO Secretariat. For the UNICEF side, Mr Francisco Benavides, Ms Erin Tanner and Mr Antoine Marivin will continue to oversee the management of SEA-PLM programme. For the implementation of the final stage of SEA-PLM 2019 assessment, the Secretariat will carry on working closely with the Australian Council for Educational Research (ACER) to analyse and release the results.

SEA-PLM Secretariat looks forward to a collaborative and productive year ahead of working together with the Regional Steering Committee, Technical Advisory Group, national teams and key partners to achieve the completion of SEA-PLM 2019 data analysis and preparation for the launch of SEA-PLM regional report on 1 December 2020. 

The 42nd SEAMEO High Officials Meeting (HOM) 2019 was successfully held in Berkeley Hotel Pratunam in Bangkok, Thailand from 26 – 28 November 2019. The meeting serves as a platform for SEAMEO High Officials of member countries and associate member countries to discuss key policies, initiatives and programmes from across the region, with a range proposals and financial and programme updates submitted for review and endorsement.

A new working paper on SEA-PLM was shared with member and affiliate countries and partners highlighting the significant progress achieved by SEA-PLM in 2019 and previous years, in particular the completion of data collection for SEA-PLM 2019 and the confirmation of a new regional governance structure. The paper also requested recognition and support for the 2020 release of results and reports and the identification of sustainable long-term strategies around the transition to the second assessment round.

Based on country requests for additional information a short presentation was made by UNICEF EAPRO Education Specialist Erin Tanner. Non-participating countries Singapore and Brunei Darussalam expressed their ongoing support for the programme as Honorary members of the Regional Steering Committee. All progress and recomendations were endorsed by High Officials and will move for review and final endorsement at the next SEAMEO Council Meeting (SEAMEC).

SEA-PLM is forged out of the SEAMEO political framework, ensuring a strong sense of program ownership and belonging. The SEAMEO HOM along with SEAMEC are the key regional mechanism where approval, commitment and support for the programme is gained.

Malaysia has completed school data collection for the Southeast Asia Primary Learning Metrics (SEA-PLM) despite many schools forced to close and reschedule testing due to a toxic haze over some states. Even with the challenges that the uncontrollable environmental situation presented, the team from the Ministry of Education charged with managing the regional learning assessment worked around the clock to see the assessment administered following correct protocol and within the planned timeline.

Malaysia is the sixth and final country to conduct data collection for the first assessment round of SEA-PLM, with 160 schools from sixteen states participating in the assessment. Unlike other countries Malaysia is administering the test in not one but three languages. Primary schooling in Malaysia uses a multilingual language approach with students attending three different types of schools depending on their mother tongue and family preference: National schools teach in Malay, Tamil schools in Indian and Chinese schools in Chinese. Data collection began on September 17th and finished on the 11th October.

hazeHowever, with the country having experienced the worst haze in five years the schedule of testing was severely affected. Measured by the Air Pollution Index (API), schools must close and send their students home if levels rise above 200, deemed to be an unhealthy level. Sadly, many schools, particularly in the states of Selangor, Kuala Lumpur, Pulau Pinang and Putrajaya and have seen just this. Some 1659 schools were closed in these states for the 19th and 20th of September. This included SEA-PLM sample schools.

Despite the difficult conditions the Technical Team from the Educational Planning and Research Division were highly organized with Plans A, B and C in place and ready to go. The coordinating central and district officers, along with school principals constantly checked government updates on school closures, making fast and efficient decisions around testing.

This was no easy feat. With a plethora of people involved in the coordination and implementation of the large-scale learning assessment, including government officers at the central, provincial and district level, school principals, test administrators, school coordinators, teachers and parents, communication needs to be swift and clear ensuring that all parties are informed on decisions.

school team malaysia

Zahirah Zulkefli, Assistant Director of Selangor State Education Department, a state badly impacted by the haze, explains how she regularly checks her phone, often staying up past midnight for updates on the Air Pollution Index (API). Once it is announced that a participating school will be closed she begins the process of contacting the relevant people and identifying a time to re-schedule the test. This process is often repeated multiple times.

As the haze slowly cleared, the team were hopeful that all sample schools would complete testing within the planned timeline. And they were correct – all tests were administered and questionnaires collected by the 11th of October as originally planned. There will be little time for rest for the team, with data set to be coded almost immediately. In early November a data coding workshop will be held in Malaysia that provides training delivered by the Australian Council of Educational Research on SEA-PLM coding standards. With Malaysia coding their tests booklets from three different languages it is essential that the guidelines are applied consistently.

Without the dedication and hard work of all people involved in SEA-PLM Malaysia, the hazy conditions might have disrupted the final data collection, potentially impacting an already tight regional schedule. As it were the Malaysian Technical Team set the bar high in ensuring that smooth implementation of all assessment procedures, even when it was at times difficult to see ahead.

Established mid-2019, the Technical Advisory Group (TAG) for SEA-PLM plays a technical consultative and advisory role for SEA-PLM activities. By providing independent advice on SEA-PLM methodology and results the TAG provides a broader perspective on technical issues around the learning assessment, incorporating the expertise and experiences of learning assessment experts from around the region and globe. Through adding this additional technical oversight, SEA-PLM further ensures the delivery of high quality and reliable data.

The Chairs and members of the TAG are mandated for one SEA-PLM cycle and are selected by the SEA-PLM Secretariat. Meet the experts who make-up SEA-PLM 2019’s TAG!

TAG Co-Chairs

Dr. Jimin Cho – Korean Institute for Curriculum and Evaluation

Jimin cho portraitDr. Jimin Cho is a senior researcher and currently the Vice president of the Division of Educational Evaluation at the Korea Institute for Curriculum & Evaluation (KICE) in the Republic of Korea. She has an academic background in education specializing in educational psychology, including a Ph. D. from Michigan State University majoring in educational measurement and evaluation. Her major experience has been in developing the framework for student assessments, specifically in scoring and reporting based on in-depth analysis of various major assessments. Currently she is in charge of all international and national level of student assessments at Korea such as OECD programs, IEA projects, and National Assessment of Educational Achievement. She also currently serves in various capacities as a member of international steering committees for international and national evaluation projects.

 

Dr. Andres Sandoval Hernandez – University of Bath

andresDr. Andres Sandoval is currently a Lecturer in Educational Research at the University of Bath in the UK. Prior to that, he worked as Head of the Research Unit at the International Association for the Evaluation of Educational Achievement (IEA) in Hamburg, Germany, and held different academic appointments at the Universidad Iberoamericana (UIA) and the Facultad Latinoamericana de Ciencias Sociales (FLACSO). Over the last few years, Dr Sandoval has also been a consultant for the ministries of education of several countries, for the World Bank, IADB, OECD, UNESCO, UIS, and other international organizations. His research interests include developing work around comparative analyses of educational systems using large-scale assessment data with a focus on educational inequalities and civic education.

 

Expert Members

Professor Esther Sui Chu Ho -  The Chinese University of Hong Kong and Hong Kong Institute of Educational Research

esther hoProf HO is the Professor of Education Administration and Policy and Director of the Hong Kong Centre for International Student Assessment in the Chinese University of Hong Kong. Prof HO was the Project Manager of HKPISA-2000 to 2015 for 6 cylces, a Consultant for a number of PISA studies in several Chinese societies, and a Fulbright Scholar at Johns Hopkins University (2010). Furthermore, she has been a teaching and research assistant in the University of British Columbia, Canada and a teaching consultant for the World Bank in the District Primary Educational Program in India. Prof HO was also Primary and Secondary School teacher in Hong Kong.

 

Professor Nordin Abd Razak – School of Educational Studies, Universit Sains Malaysia

nordinDr Nordin Abd Razak is a Professor at the School of Educational Studies, Universiti Sains Malaysia. His areas of research interests include international large-scale assessment data analysis (such as TIMSS, PISA), quantitative research methodology, measurement and evaluation and applied statistical data analysis. He is a proficient instructor for large-scale assessments for secondary data analysis on TIMSS and PISA and is member and advisor to a range of different committees and projects for large-scale learning assessment including the Student Outcome Measures (SOM) Project, Malaysia’s national level research committee, the Network on Education Quality Monitoring in the Asia Pacific (NEQMAP) and Hong Kong Centre for International Student Assessment (HKCISA). Currently, Dr Nordin is the Senior Research Advisor/consultant for Australian Council of Educational Research (ACER), Malaysia and at the university level is the Statistical Advisor for the Institute of Postgraduate Studies.

 

Dr. Eugenio Gonzalez – Education Testing Service Research Institute and International Association for the Evaluation of Educational Achievement

Dr. Eugenio Gonzalez, has a vast and varied experience in the field of large-scale assessments in education. He is a Principal Research Project Manager at ETS and the Director of the IEA-ETS Research Institute. His previous positions include Head of the IEA’s Research & Analysis Unit, and Director of Quality Control and Fi­eld Operations at the US National Assessment of Educational Progress (NAEP), and Director of Operations and Data Analysis for TIMSS and PIRLS.

Ministry of Education officials from across Southeast Asian nations came together in July 2019 at the 10th Regional Steering Committee meeting to discuss the first assessment round of Southeast Asia Learning Primary Learning Metric (SEA-PLM 2019). Looking ahead to 2020 in preparation for the final steps of this long-awaited assessment round, this meeting built regional consensus for the effective dissemination and use of results.

Consultation platforms such as the 10th Regional Steering Committee meeting are vital in aligning national and regional approaches, and to coordinate resources and efforts in the coming months to explore communication appraoches and reporting strategies. 

Enjoy watching this video about the proceeding of the 10th Regional Steering Committee for SEA-PLM to stimulate future discussion around results and create new learning opportunities.                                                             

A key distinguishing factor of the Southeast Asia Primary Learning Metrics (SEA-PLM) is that it is entirely embedded into existing national and regional systems and structures. At the centre of its governance structure sits the Regional Steering Committee (RSC). Composed of core and honorary members, core being those countries participating in SEA-PLM, and honorary being non-participating ASEAN and SEAMEO Countries and key partners, the RSC is responsible for the strategic direction of SEA-PLM.

RSC photo outsideIn July 2019, the 10th Regional Steering Committee for SEA-PLM was held in Bangkok. 2019 represents a significant milestone for SEA-PLM with data being collected for the first assessment round SEA-PLM (SEA-PLM 2019). The meeting focused on preparing countries for the analysis, dissemination and use of results in 2020. Held over two and half days, countries and participants shared their experiences of using national, regional and international large-scale learning assessments to improve learning policy, looking particularly at the possibilities for analysis and ways to maximise use of data. Reflecting on and integrating these experiences are essential for a new regional learning assessment such as SEA-PLM.

Hosted by SEAMEO Secretariat and UNICEF EAPRO, the meeting was attended by represetatives from the six participating countries Cambodia, Lao PDR, Philippines, Malaysia, Myanmar and Vietnam, as well as honorary representatives from Brunei Darussalam, Singapore and Thailand, and key partners, the Australian Council for Educational Research, UNESCO Bangkok and the UNESCO Institute for Statistics.

SEA-PLM is designed to create regional dialogue around quality learning in Southeast Asia, the RSC provides the platform for this exchange.

RSC speaker 2RSC speaker 1As well as these members, joining the Committee for the first time were Co-Chairs of the newly created Technical Advisory Group (TAG). Established for the purpose of providing independent scientific and technical advice on SEA-PLM methodology and data, Co-Chairs and learning assessment experts Dr Andres Sandoval from the University of Bath and Dr Jimin Cho, Director of the Korean Institute of Curriculum and Evaluation (KICE) proved themselves to be valuable additions to the discussion.

Along with other key partners, both Co-Chairs presented important insights into the realities of planning and implementing for the analysis, reporting and dissemination phases, supported countries to look towards the year ahead and deepen their understanding of the steps and issues that require national consideration and agreement.

SEA-PLM 2019 results will be captured in one main regional report and six country level reports. The process to developing, reviewing and releasing these reports is fraught with a multitude of variables with the potential to impact the use of results. It is vital to the success of SEA-PLM 2019 that all activities and potential barriers are mapped out and planned in detail.

As UNICEF Regional Education Advisor Francisco Benavides and Co-Chair of the Regional Steering Committee stressed, it is through the collective effort at the regional and national level that has both enabled the creation of SEA-PLM and will be central to its success. With 2020 to present increasingly more technical and logistical challenges on a constrained calendar, it is ever more important that these partnerships are maximized on to deliver the vision of SEA-PLM.

RSC podium

"Learning means knowledge, and getting a job", said 10-year-old Phoudthalith, sitting under the shade of a tree outside her small classroom in Vientiane.

For Phoudthalith, and many of her friends, the priority is getting good grades in Lao language and mathematics, learning by rote from the blackboard. When asked about what the most fun part of learning is, Phoudthalith looks uncertain about how to answer.

Across Southeast Asia, teachers, schools and governments are trying to move from a knowledge-based curriculum to one based on competency, with a focus on critical thinking and developing skills that can be transferred outside the classroom. Lao PDR is in the process of transforming its primary school curriculum, improving teacher training and placing resources where they can best help student learning outcomes.

But to do this, Governments need to know where they are at right now and how to develop strategies to improve.

One of the key tools for this is the Southeast Asian Primary Learning Metrics (SEA-PLM), being of UNICEF and Southeast Asian Ministers of Education Organisation (SEAMEO), in close collaboration with the Ministries of Education in the region. 

Put plainly, SEA-PLM is a regional learning assessment - the large-scale collection of data on student learning outcomes from schools across Southeast Asia, and the use of that information to inform curriculum development, teacher training and education policy.

Collecting this data in line with standardized practices in places like Lao PDR presents many challenges for the teams charged with coordination and communication.

From calling hundreds of schools to ask for up-to-date student lists to training and organising 216 test administrators to travel to schools across the country, the Lao technical team based at the Research Institute for Educational Sciences (RIES) in Vientiane have learnt many valuable lessons when it comes to planning and communication. These are skills that not only apply to SEA-PLM, but can be used in the design and management of national assessments.

SEA-PLM School Coordinator and Test Administrator Workshop

Just as a microscope is adjusted to the correct lens to see specific cells, so does the Southeast Asia Primary Learning Metrics (SEA-PLM) provide the tools and criteria to meet a more dynamic approach to learning. Students complete assessment booklets in the areas of reading, writing, mathematics and global citizenship, engaging in both knowledge and competency based questions.

But SEA-PLM goes deeper than this.

Test administrators also have parents, teachers and principals complete questionnaires to gain an understanding on the context in which children learn. What was the level of pre-reading before entering school? Is gender an issue? Are students being supported to do their homework and do they have access to learning material at home? SEA-PLM enables deeper level analysis of why students are and aren't learning well.

The Lao technical team have been working in collaboration with the UNICEF Lao Country Office and the Australian Council for Education Research (ACER) to prepare for the collection of data for many months now. From the 30th April until 8th May Lao PDR implemented data collection for SEA-PLM.

Now, the Lao technical team members will begin marking and coding the written answers in the booklets into a code that can be compared against tests in other countries and other languages. The results from all six Southeast Asian nations involved will be compiled in one unique and complex regional database to allow reliable analysis on the level of student outcomes and equity at the regional, national and sub-national level.

The learning assessment will give an empirical snapshot of how countries, schools, pupils are faring in specific areas according to their environment for instance, type of difficulties in reading comprehension between socio-economic backgrounds or how girls and boys are learning. 

For each country, the data will provide the opportunity to make informed decisions on how to shape policy and where to place resources.

For the individuals involved in the data collection and analysis, there will be specific skills learned that can translate to other areas of research and hopefully, a broadening of their understanding about what education could and should look like in cities and villages across Lao PDR.

And for children like Phoudthalith, and perhaps her children in the future, the idea of learning might be less about remembering what gets written on the blackboard, but how to learn and where that might take them.

From June 10th until12th the Cambodian Technical Team organised the training of over 250 Test Administrators and School Coordinators at Battambang University, Battambang. All SEA-PLM participant countries implement a standardized training to those selected to coordinate and administer the tests to students and questionnaires to students, parents, teachers and principals. This is to ensure the same steps and script is applied consistently across all schools.

mr ung chinngLearning assessment, described by Director of Education Quality Assurance Department (EQAD) Mr. Ung Chinna as the current "pop-star of education" in Cambodia, is receiving increased emphasis at the policy level, promoting the better use of information generated through assessment to form the basis of education reform across relevant departments and key stakeholders. SEA-PLM plays an important role in this transition. Through providing capacity development to EQAD staff in how to manage large-scale assessments at international standards, the team are able to apply these standards to national and international assessments, and increasingly advocate for the need of assessment from the national to school level.

It is also through the support of major partners such as UNICEF that this growing focus and capacity in using learning assessments to identify gaps and inform educational reform is achieved. UNICEF Cambodia is a vital partner for SEA-PLM in Cambodia, contributing both funding and organisational support to its implementation.

The training, mostly delivered by Technical Team Manager Mr. Sar Sarin, was attended by representatives from the Ministry of Education, Youth and Sports, UNICEF Country Office, SEAMEO Secretariat and the Australian Council for Education Research (ACER).

Page 4 of 4