Evaluation study of Training Workshops conducted for Health Workers on how to increase Measles vaccine coverage in Morang and Sunsari districts

Summary

Training workshops conducted in Morang and Sunsari districts have a consequence of measurable increase in coverage of measles vaccination that is significant statistically as well. District level training workshops for health workers were conducted with the aim of getting raised measles vaccine coverage. Researcher was coordinator for these workshops before 16 months. Now, researcher has also attempted an evaluation study of the training workshops with comparing mean coverage of before and after intervention of 24 months (12+12 months). Health Management Information System (HMIS) data from reports for last 8 years (7+1) years has also been analyzed in computer. Means were also compared with control districts. Similar and nearby districts Jhapa and Saptari are Control in the study.

Key words:

Evaluation study, training workshop, coverage, measles vaccination, Morang, Sunsari

Background: The ironic remark such as waste of resources on training workshops being conducted for health workers that have been consistently raised by critics is a growing concern in the field of Public Health in such a poor country like Nepal. Department of Health Services (DoHS) / Child Health Section (CHD) had provided budget sponsored by World Health Organization (WHO) to Eastern Regional Health Directorate (ERHD) for organizing the training workshops in low performing districts to increase their low Measles vaccine coverage. ERHD had assigned this researcher as a coordinator as well as facilitator for training workshops. Budget about NRs.40, 000.00 per district was made available. All Health Post/ Primary Health Care Centre Incharges, low performing Sub Health Post Incharges and Cold Chain Assistant were participants. With the help of District Health Office (DHO) / District Public Health Office (DPHO) staff two district level workshops were conducted on Poush 2058 in Sunsari and Morang districts.(1)

Study design:

It is a retrospective study of training workshops, with a

Pre-test Post-test Control group design.                                                                O1                                  X                      O2


                                                                                                                           O3                                                                       O4

Formulation of Hypothesis:

H0 = Training workshops do not make any difference (It is just waste of resources)

H1 = Training workshops do work making different (It is not just waste of resources)

Study Area:

Morang, Sunsari (Training/ Workshop Intervention districts), and Jhapa, Saptari (Control districts).

Rationale of the study: Firstly, Researcher learned what the achievement of regular EPI has been increased right after training workshops as reported by EPI supervisors of those training held districts during supervision. Secondly, sometime people and also even health workers perceived these training workshops as a fashion or waste of resources. Finally, there is no practice of having followed up and evaluation of training program. Organizations limit their target as far as just providing a training or workshop and leave it. So, all of these factors fascinated the researcher to have an evaluation study of those training workshops that were coordinated and facilitated by researcher-self before 16 months.

Objective of Study: To evaluate the consequences of training workshops conducted for health workers on how to raise measles vaccine coverage in Morang and Sunsari districts.

Specific Study:

Method and tools: Health Management Information System (HMIS) data, document study, interview, FGD and t-test.

Data Processing: Epi-Info-6, Excel computer software.

Major Findings and Discussion:

Table - 1

Indicates mean of coverage over last 7 years as well as mean of before and after intervention

Districts

Trend of Coverage of Measles Vaccine during past 7 years

Poush-2057 to Mangsir-2058

(before x)

Observations (Ox)

Magh-2058 to Poush-2059 (after x)

Observations (Ox)

052/53

053/54

054/55

055/56

056/57

057/58

058/59

Mean of last

7 years

Morang

81%

79%

78%

76%

77%

75%

82%

78%

74.02% (O1)

86.74% (O2) ­

Jhapa

93%

89%

91%

81%

76%

81%

89%

86%

85.47 % (O3)

84.81% (O4)

Sunsari

81%

90%

88%

77%

69%

77%

82%

81%

77.49% (O1)

88.42%(O2) ­

Saptari

97%

90%

105%

87%

80%

87%

91%

91%

88.26% (O3)

85.64% (O4)

Source: DoHS, Annual Reports, 2052/53 to 2058/59(2), ERHD, Annual Reports, 2052/53 to 2058/59(3).

Table 1 indicates as mean of coverage of measles vaccination over last 7 years is 78% which is 75% before intervention (Poush 2057 to Mangsir 2058) has significantly increased as 88% after intervention (Magh 2058 to Poush 2059) in Morang district. Similarly, in Sunsari district mean of coverage of measles vaccination over last 7 years in district is 81% which is 78% before intervention (Poush 2057 to Mangsir 2058) has significantly increased as 90% after intervention (Magh 2058 to Poush 2059). Whereas the mean coverage of Jhapa over last 7 last years is 86% that is also same as 86% over before and after intervention. Saptari is experiencing decreasing trend since the mean coverage over last 7 years is 91% and that came down as 88.26% during Poush 2057 to Mangsir 2058 and even came downward as 85.26% during Magh 2058 to Poush 2059.

Table 2 Illustrates target verses achievement over 24 months to make compare the same months' coverage between before and after the intervention in the following districts.

District

Y¯ M®

Poush

Magh

Falgun

Chaitra

Baishak

Jestha

Ashad

Shrawan

Bhadra

Aswin

Kartik

Mangsir

Morang

Achievement

Target

1978

1978

1978

1978

1978

1978

1978

2034

2034

2034

2034

2034

056/57

057/58

1603

1255

1470

1553

1617

894

1665

1776

1789

1596

1402

1167

Target

2034

2034

2034

2034

2034

2034

2034

2079

2079

2079

2079

2079

058/59

059/60

1928

1677

1586

1582

1540

1842

2101

1969

1956

1662

1514

2012

Jhapa

 

Achievement

Target

1639

1639

1639

1639

1639

1639

1639

1683

1683

1683

1683

1683

056/57

057/58

1412

1551

1448

1395

1124

1460

1371

1435

1574

1325

1249

1656

Target

1683

1683

1683

1683

1683

1683

1683

1729

1729

1729

1729

1729

058/59

059/60

1620

1533

1483

1427

1570

1536

1632

1265

1422

1375

1073

1377

Sunsari

 

Achievement

Target

1485

1485

1485

1485

1485

1485

1485

1531

1531

1531

1531

1531

057/58

058/59

1360

1377

1030

1202

1298

835

1448

1197

916

1060

881

1384

Target

1531

1531

1531

1531

1531

1531

1531

1577

1577

1577

1577

1577

058/59

059/60

1391

1324

1318

1091

1450

1406

1551

1497

1481

1319

1219

1401

Saptari

 

Achievement

Target

1260

1260

1260

1260

1260

1260

1260

1294

1294

1294

1294

1294

056/57

057/58

1265

1265

798

1021

1066

824

1423

1171

1310

1287

838

1228

Target

1294

1294

1294

1294

1294

1294

1294

1329

1329

1329

1329

1329

058/59

059/60

1235

287

975

990

1173

1281

1335

1210

1166

1114

1423

1260

Source: HMIS/ERHD

Table 3 illustrating result of Paired ç t ç test

 

Districts

Poush-2057 to Mangsir-2058 (before)

Observations(Ox)

Magh-2058 to Poush-2059 (after)

Observations(Ox)

Calculated

ç t ç value

at d.f.=11

Tabulated ç t ç value

at d.f.=11

Target

Achievement

Target

Achievement

Morang

24016

17777 (74.02%)

24633

21369 (86.74%)

2.32 ­

2.201 (at .05 level of

significance)

Jhapa

19888

17000 (85.47%)

20434

17313 (84.81%)

1.36

2.201

Sunsari

18050

13988 (77.49%)

18602

16448 (88.42%)

3.23 ­

3.106 (at .01 level of

significance)

Saptari

15290

13496 (88.26%)

15703

13449 (85.64%)

0.035

2.201

Source: HMIS/ERHD

Since the computed value of ç t ç in Sunsari district is 3.23 that is greater than its tabulated value for 11 d.f. is 3.106 at 1% level of significance; the null hypothesis is rejected. Similarly, since in Morang district the calculated value of ç t ç is 2.32 that is also greater than its tabulated value for 11 d.f. at 5% level of significance is 2.201. Therefore, there are significant differences between two means. That's why alternative hypothesis is accepted i.e. Training workshops have done works making differences (It is not just waste of resources).

Table - 4 Illustrates Probability (P-value)

Districts

Poush-2057 to Mangsir-2058 (before) Observations(Ox)

Magh-2058 to Poush-2059 (after)Observations(Ox)

P-Value

Morang

74.02% (O1)

86.74%(O2)

0.0203 ­

Jhapa

85.47%(O3)

84.81%(O4)

   1.00

Sunsari

77.49%(O1)

88.42%(O2)

0.0406 ­

Saptari

88.26%(O3)

85.64%(O4)

    0.6741

Source: HMIS/ ERHD(4)

The coverage of Measles vaccine during Poush-057 to Mansir-058 (Pre-intervention period, O1) and coverage during Magh-058 to Poush-059 (Post-intervention period, O2) in Morang district where training workshop had been conducted, was statistically significant (P=0.0203). Whereas in adjoining district Jhapa where training workshop was not conducted, the measles coverage between pre-intervention (O3) and post intervention period (O4) is almost static. Similarly, the coverage of Measles vaccine during Poush-057 to Mansir-058 (Pre-intervention period, O1) and coverage during Magh-058 to Poush-059 (Post-intervention period, O2) in Sunsari district where training workshop had been conducted, was statistically significant (P=0.0406). Whereas in adjoining district Saptari where training workshop had not been conducted, the measles coverage has been slightly decreased during post intervention period (85.64%) than pre-intervention (88.26%). The duration of 24 months (12+12) periods has been taken for evaluation purpose to avoid or minimize the confounding factors in the study.

Figure 1 shows trend of coverage before and after intervention in Sunsari (Case) & Saptari (Control) districts.

 

Figure 2 shows trend of coverage before and after intervention in Morang (Case) & Jhapa (Control) districts.

Limitation of Study:

Conclusion: Training workshops for health workers on how to increase measles coverage in Morang and Sunsari districts has done something works making measurably difference; since results findings having statistically significant in the study.

Recommendation: Such type of training workshops would be useful for those districts having poor EPI coverage.

Acknowledgement: I would like to extend my sincere thanks to all staff of DHO Sunsari and DPHO Morang and also to Statistical Assistants from Saptari and Jhapa districts for making available additional data.

References:

1. Subba NR, Report of training workshop on how to increase Measles vaccine coverage in Sunsari and
                Morang districts, 2058 (n.p.)
2. DoHS, Annual Reports, Department of Health Services Kathmandu Nepal F.Yrs. 2052/53 to 2057/58
3. ERHD, Annual Reports, Eastern Regional Health directorate Dhankuta Nepal, F.Yrs. 2052/53 to 2058/59
4. ERHD, HMIS Report, Eastern Regional Health directorate Dhankuta Nepal, F.Y. 2059/60 (n.p.)

©2003. Nawaraj Subba, MPH        e-mail: nrsubba@lycos.co.uk

Home