Evaluation study of Training Workshops conducted for Health Workers on how to increase Measles vaccine coverage in Morang and Sunsari districts
Nawaraj Subba, MPH
|
Summary Training workshops conducted in Morang and Sunsari districts have a consequence of measurable increase in coverage of measles vaccination that is significant statistically as well. District level training workshops for health workers were conducted with the aim of getting raised measles vaccine coverage. Researcher was coordinator for these workshops before 16 months. Now, researcher has also attempted an evaluation study of the training workshops with comparing mean coverage of before and after intervention of 24 months (12+12 months). Health Management Information System (HMIS) data from reports for last 8 years (7+1) years has also been analyzed in computer. Means were also compared with control districts. Similar and nearby districts Jhapa and Saptari are Control in the study. Key words: Evaluation study, training workshop, coverage, measles vaccination, Morang, Sunsari |
Background: The ironic remark such as waste of resources on training workshops being conducted for health workers that have been consistently raised by critics is a growing concern in the field of Public Health in such a poor country like Nepal. Department of Health Services (DoHS) / Child Health Section (CHD) had provided budget sponsored by World Health Organization (WHO) to Eastern Regional Health Directorate (ERHD) for organizing the training workshops in low performing districts to increase their low Measles vaccine coverage. ERHD had assigned this researcher as a coordinator as well as facilitator for training workshops. Budget about NRs.40, 000.00 per district was made available. All Health Post/ Primary Health Care Centre Incharges, low performing Sub Health Post Incharges and Cold Chain Assistant were participants. With the help of District Health Office (DHO) / District Public Health Office (DPHO) staff two district level workshops were conducted on Poush 2058 in Sunsari and Morang districts.(1)
Study design:
It is a retrospective study of training workshops, with a
Pre-test Post-test Control group design. O1 X O2
Formulation of Hypothesis:
H0 = Training workshops do not make any difference (It is just waste of resources)
H1 = Training workshops do work making different (It is not just waste of resources)
Study Area:
Morang, Sunsari (Training/ Workshop Intervention districts), and Jhapa, Saptari (Control districts).
Rationale of the study: Firstly, Researcher learned what the achievement of regular EPI has been increased right after training workshops as reported by EPI supervisors of those training held districts during supervision. Secondly, sometime people and also even health workers perceived these training workshops as a fashion or waste of resources. Finally, there is no practice of having followed up and evaluation of training program. Organizations limit their target as far as just providing a training or workshop and leave it. So, all of these factors fascinated the researcher to have an evaluation study of those training workshops that were coordinated and facilitated by researcher-self before 16 months.
Objective of Study: To evaluate the consequences of training workshops conducted for health workers on how to raise measles vaccine coverage in Morang and Sunsari districts.
Specific Study:
Method and tools: Health Management Information System (HMIS) data, document study, interview, FGD and t-test.
Data Processing: Epi-Info-6, Excel computer software.
Major Findings and Discussion:
Table - 1
Indicates mean of coverage over last 7 years as well as mean of before and after intervention
|
Districts |
Trend of Coverage of Measles Vaccine during past 7 years |
Poush-2057 to Mangsir-2058 (before x) Observations (Ox) |
Magh-2058 to Poush-2059 (after x)Observations (Ox) |
|||||||
|
052/53 |
053/54 |
054/55 |
055/56 |
056/57 |
057/58 |
058/59 |
Mean of last 7 years |
|||
|
Morang |
81% |
79% |
78% |
76% |
77% |
75% |
82% |
78% |
74.02% (O1) |
86.74% (O2) |
|
Jhapa |
93% |
89% |
91% |
81% |
76% |
81% |
89% |
86% |
85.47 % (O3) |
84.81% (O4) |
|
Sunsari |
81% |
90% |
88% |
77% |
69% |
77% |
82% |
81% |
77.49% (O1) |
88.42%(O2) |
|
Saptari |
97% |
90% |
105% |
87% |
80% |
87% |
91% |
91% |
88.26% (O3) |
85.64% (O4) |
Source: DoHS, Annual Reports, 2052/53 to 2058/59(2), ERHD, Annual Reports, 2052/53 to 2058/59(3).
Table 1 indicates as mean of coverage of measles vaccination over last 7 years is 78% which is 75% before intervention (Poush 2057 to Mangsir 2058) has significantly increased as 88% after intervention (Magh 2058 to Poush 2059) in Morang district. Similarly, in Sunsari district mean of coverage of measles vaccination over last 7 years in district is 81% which is 78% before intervention (Poush 2057 to Mangsir 2058) has significantly increased as 90% after intervention (Magh 2058 to Poush 2059). Whereas the mean coverage of Jhapa over last 7 last years is 86% that is also same as 86% over before and after intervention. Saptari is experiencing decreasing trend since the mean coverage over last 7 years is 91% and that came down as 88.26% during Poush 2057 to Mangsir 2058 and even came downward as 85.26% during Magh 2058 to Poush 2059.
Table 2 Illustrates target verses achievement over 24 months to make compare the same months' coverage between before and after the intervention in the following districts.
|
District |
Y¯ M® |
Poush |
Magh |
Falgun |
Chaitra |
Baishak |
Jestha |
Ashad |
Shrawan |
Bhadra |
Aswin |
Kartik |
Mangsir |
|
Morang Achievement |
Target |
1978 |
1978 |
1978 |
1978 |
1978 |
1978 |
1978 |
2034 |
2034 |
2034 |
2034 |
2034 |
|
056/57 057/58 |
1603 |
1255 |
1470 |
1553 |
1617 |
894 |
1665 |
1776 |
1789 |
1596 |
1402 |
1167 |
|
|
Target |
2034 |
2034 |
2034 |
2034 |
2034 |
2034 |
2034 |
2079 |
2079 |
2079 |
2079 |
2079 |
|
|
058/59 059/60 |
1928 |
1677 |
1586 |
1582 |
1540 |
1842 |
2101 |
1969 |
1956 |
1662 |
1514 |
2012 |
|
|
Jhapa
Achievement |
Target |
1639 |
1639 |
1639 |
1639 |
1639 |
1639 |
1639 |
1683 |
1683 |
1683 |
1683 |
1683 |
|
056/57 057/58 |
1412 |
1551 |
1448 |
1395 |
1124 |
1460 |
1371 |
1435 |
1574 |
1325 |
1249 |
1656 |
|
|
Target |
1683 |
1683 |
1683 |
1683 |
1683 |
1683 |
1683 |
1729 |
1729 |
1729 |
1729 |
1729 |
|
|
058/59 059/60 |
1620 |
1533 |
1483 |
1427 |
1570 |
1536 |
1632 |
1265 |
1422 |
1375 |
1073 |
1377 |
|
|
Sunsari
Achievement |
Target |
1485 |
1485 |
1485 |
1485 |
1485 |
1485 |
1485 |
1531 |
1531 |
1531 |
1531 |
1531 |
|
057/58 058/59 |
1360 |
1377 |
1030 |
1202 |
1298 |
835 |
1448 |
1197 |
916 |
1060 |
881 |
1384 |
|
|
Target |
1531 |
1531 |
1531 |
1531 |
1531 |
1531 |
1531 |
1577 |
1577 |
1577 |
1577 |
1577 |
|
|
058/59 059/60 |
1391 |
1324 |
1318 |
1091 |
1450 |
1406 |
1551 |
1497 |
1481 |
1319 |
1219 |
1401 |
|
|
Saptari
Achievement |
Target |
1260 |
1260 |
1260 |
1260 |
1260 |
1260 |
1260 |
1294 |
1294 |
1294 |
1294 |
1294 |
|
056/57 057/58 |
1265 |
1265 |
798 |
1021 |
1066 |
824 |
1423 |
1171 |
1310 |
1287 |
838 |
1228 |
|
|
Target |
1294 |
1294 |
1294 |
1294 |
1294 |
1294 |
1294 |
1329 |
1329 |
1329 |
1329 |
1329 |
|
|
058/59 059/60 |
1235 |
287 |
975 |
990 |
1173 |
1281 |
1335 |
1210 |
1166 |
1114 |
1423 |
1260 |
Source: HMIS/ERHD
Table 3 illustrating result of Paired ç t ç test
|
Districts |
Poush-2057 to Mangsir-2058 (before)Observations(Ox) |
Magh-2058 to Poush-2059 (after)Observations(Ox) |
Calculated ç t ç value at d.f.=11 |
Tabulated ç t ç value at d.f.=11 |
||
|
Target |
Achievement |
Target |
Achievement |
|||
|
Morang |
24016 |
17777 (74.02%) |
24633 |
21369 (86.74%) |
2.32 |
2.201 (at .05 level of significance) |
|
Jhapa |
19888 |
17000 (85.47%) |
20434 |
17313 (84.81%) |
1.36 |
2.201 |
|
Sunsari |
18050 |
13988 (77.49%) |
18602 |
16448 (88.42%) |
3.23 |
3.106 (at .01 level of significance) |
|
Saptari |
15290 |
13496 (88.26%) |
15703 |
13449 (85.64%) |
0.035 |
2.201 |
Source: HMIS/ERHD
Since the computed value of ç t ç in Sunsari district is 3.23 that is greater than its tabulated value for 11 d.f. is 3.106 at 1% level of significance; the null hypothesis is rejected. Similarly, since in Morang district the calculated value of ç t ç is 2.32 that is also greater than its tabulated value for 11 d.f. at 5% level of significance is 2.201. Therefore, there are significant differences between two means. That's why alternative hypothesis is accepted i.e. Training workshops have done works making differences (It is not just waste of resources).
Table - 4 Illustrates Probability (P-value)
|
Districts |
Poush-2057 to Mangsir-2058 (before) Observations(Ox) |
Magh-2058 to Poush-2059 (after)Observations(Ox) |
P-Value |
|
Morang |
74.02% (O1) |
86.74%(O2) |
0.0203 |
|
Jhapa |
85.47%(O3) |
84.81%(O4) |
1.00 |
|
Sunsari |
77.49%(O1) |
88.42%(O2) |
0.0406 |
|
Saptari |
88.26%(O3) |
85.64%(O4) |
0.6741 |
Source: HMIS/ ERHD(4)
The coverage of Measles vaccine during Poush-057 to Mansir-058 (Pre-intervention period, O1) and coverage during Magh-058 to Poush-059 (Post-intervention period, O2) in Morang district where training workshop had been conducted, was statistically significant (P=0.0203). Whereas in adjoining district Jhapa where training workshop was not conducted, the measles coverage between pre-intervention (O3) and post intervention period (O4) is almost static. Similarly, the coverage of Measles vaccine during Poush-057 to Mansir-058 (Pre-intervention period, O1) and coverage during Magh-058 to Poush-059 (Post-intervention period, O2) in Sunsari district where training workshop had been conducted, was statistically significant (P=0.0406). Whereas in adjoining district Saptari where training workshop had not been conducted, the measles coverage has been slightly decreased during post intervention period (85.64%) than pre-intervention (88.26%). The duration of 24 months (12+12) periods has been taken for evaluation purpose to avoid or minimize the confounding factors in the study.
Figure 1 shows trend of coverage before and after intervention in Sunsari (Case) & Saptari (Control) districts.

Figure 2 shows trend of coverage before and after intervention in Morang (Case) & Jhapa (Control) districts.
Limitation of Study:
Conclusion: Training workshops for health workers on how to increase measles coverage in Morang and Sunsari districts has done something works making measurably difference; since results findings having statistically significant in the study.
Recommendation: Such type of training workshops would be useful for those districts having poor EPI coverage.
Acknowledgement: I would like to extend my sincere thanks to all staff of DHO Sunsari and DPHO Morang and also to Statistical Assistants from Saptari and Jhapa districts for making available additional data.
References:
1. Subba NR, Report of training workshop on how to increase Measles vaccine
coverage in Sunsari and
Morang districts, 2058 (n.p.)
2. DoHS, Annual Reports, Department of Health Services Kathmandu Nepal F.Yrs.
2052/53 to 2057/58
3. ERHD, Annual Reports, Eastern Regional Health directorate Dhankuta Nepal,
F.Yrs. 2052/53 to 2058/59
4. ERHD, HMIS Report, Eastern Regional Health directorate Dhankuta Nepal, F.Y.
2059/60 (n.p.)
©2003. Nawaraj Subba,
MPH e-mail: nrsubba@lycos.co.uk