# I. INTRODUCTION Full routine immunization for children below 24 months now costs between US$37 and US$101 across different settings in low-and middleincome countries as more and costlier vaccines are being introduced into national immunization programs [1]. The rising cost of vaccine and vaccine distribution, global supply shortages, and the introduction of new vaccines have provided the impetus to deploy a real-time management system to negate the uneven distribution of vaccines, improve efficiencies and allow better visibility of the vaccine supply chain [2,3]. A robust vaccine cold chain and logistics system including storage and transportation is the London Journal of Medical and Health Research cornerstone of all immunization programmes [4]. Rigorous supply planning based on accurate data should enable such a system to have the right vaccines in the right place, at the right time, in the right quantities, in the right condition, and at the right cost [3]. The 2021 Multiple Indicator Cluster Survey-National Immunization Coverage Survey (MICS-NICS) report showed that only about 44.2% of all children between 12-23 months old have received all basic vaccination doses in Nigeria; while only about 40% of those aged between 24-35 months had received all the recommended vaccines on the national immunization schedule in Nigeria in 2021 [5]. These indicators for measuring RI performance have shown slow progress in full immunization coverage in Nigeria despite huge investments and improvements in supply chain and distribution of vaccines in the last 5 years. However, the increasing incidence of stockouts and disrupted access to vaccines is of growing concern [3]. The majority of these stockouts are a result of internal issues such as inaccurate forecasts, stock management issues and restock delays [6]. Vaccine supply chain management systems have been prominent features of the Expanded Programme on Immunization (EPI) plans from the onset [7]. System requirements have expanded dramatically over the past several years with the introduction of new vaccines and the frequent mass campaigns to control, eliminate, or eradicate specific diseases, such as polio, measles, rubella, tetanus. While such initiatives tend to be well-funded, the strain they place on the supply chain system are substantial and often not acknowledged, particularly at state levels [7]. The most visible impact of new vaccine introduction is an increase in the volume of products that need to be stored, transported, and tracked, as well as the need for more storage capacity due to the increased use of single-dose vials [8]. These further exacerbates existing and new challenges in vaccine supply chain management like poor cold chain equipment inventory and status; poor vaccine stock, distribution and utilization data collection and management; lack of skilled and properly trained workers in vaccine management operations; poor vaccine storage facility; and unreliable micro-plan data which leads to wastage, stock-outs and overstock, and inequitable distribution of products [9,10,11]. It is important to note these challenges and many other vaccine supply chain management problems are related to inefficient database management systems and innovative digital tools [9,12]. In 2016, the Ministerial Conference on Immunization in Africa laid the groundwork for the landmark Addis Declaration on Immunization (ADI), including 10 commitments to achieve universal and equitable access to immunization in Africa. The ADI was endorsed by Heads of State from across Africa at the 28th African Union Summit in early 2017, signaling political support for immunization on the continent at the highest possible level [13]. Real-time data and digital tools were identified as a powerful instrument to advance these efforts. Digital platforms make it easy to assess progress and to revisit decisions along the way, instead of waiting for quarterly reports or midline assessments. Digital tools also democratize learning and decision-making, so that stakeholders at all levels of the health system can make meaningful use of data. In response to these assertions, eHealth Africa, a non-governmental organization (NGO) was funded by the Bill and Melinda Gates Foundation (BMGF) and the Kano State Primary Health Care Development Agencies (KSPHCDA) to conceptualize, design and roll out an electronic logistic management information system, LoMIS Suite to strengthen accountability and data-driven management in vaccine supply chain management in 2014. The Suite consists of an offlinecapable mobile application "LoMIS Stock'' and a web application and "LoMIS Deliver." LoMIS Stock was designed to help health care workers (HCWs) bypass the traditional paper-based reporting system and submit reports instantly using an app on their mobile device. The app was also built to enable supervisors to get near real-time visibility of stock inventory, consumption rate (vaccine wastage, stock out, utilization), cold chain status and cascade London Journal of Medical and Health Research deliveries from all locations where vaccines are stored. LoMIS Stock answers three critical questions "Where are my Vaccines? ""Are they sufficient?" and "Are they potent?" LoMIS Deliver on the other hand aggregate these reports on stock levels, equipment status, and vaccine utilizations into a single web dashboard for real-time data visualization of field operations. Both applications are based on the structure and workflows of the KSPHCMB system. # Evaluation Questions This study was conducted to answer the following research questions: 1. Is the LoMIS stock tool being used by the proposed users to report routine immunization vaccine supplies? 2. What is the effect of its use on the duration in reporting stock out and the turnaround time? 3. What is the impact of the tool on facility stock out experiences? 4. How has the tool supported the routine immunization stakeholders to plan for vaccine distribution? # Evaluation Objectives In line with the research questions, we were guided by the objective of understanding the impact of using digital data management tools in vaccine supply chain management against the traditional paper-based systems in Kano state. Specifically, # Research Limitations The main limitation encountered in this paper is the quality of data and data availability in the DHIS2 data. Especially in Kano state, we were unable to conduct robustness checks on stock out by vaccines due to the unavailability of data. # II. STUDY DESIGN AND METHODS # Study Design We employed the quasi-experimental design using a mix of quantitative and qualitative research methods to determine what would have been the outcomes in Kano state if the digital tool (intervention) had not been utilized. In this study, we identified Bauchi State vaccine supply chain management system as the comparison group based on validated evidence that Bauchi state was utilizing the paper-based reporting tools for vaccine stock inventory as of the period of this study. # Sampling techniques Our study respondents were selected by using a three multi-stage sampling technique to select and recruit sixty (60) and forty (40) Ward Technical Officers/Routine Immunization Officers (10) for the intervention (Kano state) and the comparison (Bauchi state). We stratified all the state LGAs under the three senatorial zones in both Kano and Bauchi States and used a purposive sampling approach to select 6 LGAs under the 6 Administrative Zones of Routine Immunization in the Kano State, and 4 LGAs under the 2 Administrative Zones of Routine Immunization in Bauchi State based on their geographical proximity to each other. Ten ( # Data Collection and Analysis Methodology Primary data for this study were collected using the evaluation tools (structured questionnaires and Key in-depth interviews) while secondary data was collected from records on the LoMIS Dashboard and District Health Information System Software (DHIS2). LoMIS dashboard is a platform that enables near-real-time visibility, storage, and retrieval of vaccine stock inventory while DHIS2 enables the collection, storage, retrieval and management of case-based data records. The primary data sources provided information on duration of reporting vaccines, duration of response to reports, and the benefits of LoMIS. The secondary data sources also provided information on the duration of vaccine reports and duration of response to those reports. The secondary data sources provided more information including the usability of LoMIS, availability of stock or stock-out. # III. RESULT AND DISCUSSION # Respondent's Demographics In this study, it was found that males are the predominant staff working within the routine immunization areas across Kano (73%) and Bauchi (90%) states (Figure 4). # Research Question 2: Duration of reporting RI vaccine stock inventories and turnaround time The findings related to the amount of time it takes to report RI vaccine inventories via LoMIS Stock in Kano state and the paper-based tools in Bauchi state were compared. In Kano state, it was found that 67% of respondents reported that it takes Pop more than 10 minutes to complete the process of reporting vaccine stock inventories via the paper-based tools while 100% of the respondents reported an average of 5 minutes to complete a report via LoMIS Stock. This is consistent with the findings from the comparison group (Bauchi State) where 63% of them reported spending more than ten minutes whilst reporting through paper-based tools. Findings from the tool dashboard validates the duration of reporting via LoMIS. Users of LoMIS application tool used an average duration of less than 5 minutes on any stock inventory form as illustrated in Figure 6. # State Partner, Bauchi In Kano state, it was found that out of the 39 respondents that provided answer to the question of average response time to stock out reports, 34 (57%) reported that all stock-out reports done through the LoMIS tool got response under 24 hours as compared with 20% that got response under 24 hours prior the use of LoMIS stock. Twenty-two (59%) of 37 responses revealed that Cold Chain Equipment breakdown through LoMIS got a response within 24 hours as compared to 10% who got a response in 24 hours before the use of LoMIS (Figure 7). Source: Study survey data # Research Question 3: The Impact of LoMIS Stock on experiences of RI vaccine stock-out at facilities Another major finding from this assessment study is reduction in stock-out experiences in health facilities. It was found that 60% of facilities had at least reported an event of stock-out from January experiencing stock-out reduced with time in Kano state. Within 3 years of using the LoMIS tool, the number of facilities experiencing stock out reduced by 92% in Kano (LoMIS) as compared to only 42% reduction in Bauchi (paper-reporting tool) within the same period (Figure 8). 8). In addition, the differences in stock out outcomes in Kano and Bauchi states were confirmed as the Analysis of Variance (ANOVA) showed that the effect of the reporting tool on stock-out was significant (F (1,70,) = 215.506, p = 0.000). The comparison analysis using a paired-sample t-test showed that the mean difference in facility stock-out between a 3-year period prior and after LoMIS was found to be statistically significant (p=0.000) (Table 1). This implies that LoMIS significantly contributed to reduced experiences of vaccine stock-out in health facilities. The independent sample T-test also revealed a huge significant difference between the means of facility stock-out in Kano (use of LoMIS) and Bauchi (Paper-tool) with a large effect size. Again, this result further validates the contribution of LoMIS to reduced vaccine stock-out in Kano (Table 2). 9). This further validates the effect of LoMIS on reduced stock-out occurrences in Kano state. # London Journal of Medical and Health Research # IV. DISCUSSION We conducted a comprehensive assessment of the impact of LoMIS Stock reporting tool on vaccine stock management in Kano state. The results showed that LoMIS Stock has contributed to effective vaccine management in terms of real-time reports, vaccine visibility and accountability. These have led to timeliness of report, increased response rate, reduction in facilities experiencing stock-out and eventually availability of adequate stock at the last-mile facilities. The findings from this study further corroborates the results of several studies on the impact on the use of digital tools as an effective approach to public health interventions globally [15,16,17,18]. In Nigeria, one of the challenges of vaccine stock management occurs because of poor vaccine stock visibility at health facilities [19]. Our study has shown that this challenge can be significantly addressed with a digital tool as we found that the use of LoMIS Stock for reporting vaccine stock inventory enhanced access to vaccine stock distribution across the focal facilities. The usability rate (82%) of LoMIS Stock shows that the use of digital tools is a prioritized solution to the challenges of public health interventions in low-and middle-income countries like Nigeria. study where it was found that digital technology is a feasible and acceptable approach for public health interventions [20]. Specifically for immunization interventions, a recent study reported high acceptability rating amongst vaccinators and district managers for an iterative mobile-app that was developed to track immunization encounters in Pakistan which shares similar public health demographics with Nigeria [21]. In another study in Malawi, end-users assessed the usability of two digital tools for community case management of under-five children-highlighting that although both tools are useful in gathering important intervention data, their usability differs by a wide margin and this determined the overall success of the tool in supporting health interventions in the study setting [22]. This implies that the ease-of-use that was recorded with the end-users of the LOMIS Stock App contributed significantly to the success of the tool in managing vaccine supply chain management in Nigeria. We found that the amount of time needed to complete a report of RI vaccine inventory significantly reduced using a digital health tool. This corroborates the findings of a digital health responses were consistent with pre-LoMIS findings in Kano State. In another study, the results also posits that the use of digital technology for reporting routine immunization data is feasible and can provide real-time updates to RI performance indicators such as vaccine availability [23] . In addition, this study sought to assess the impact of the digital tool on facilities experiencing stock-out; and we found that the stock-out experiences reduced over time in Kano state. Within 3 years of using the LoMIS tool, the facilities experiencing stock out reduced by 92% in Kano (LoMIS) as compared to only 42% reduction in Bauchi (paper-reporting tool) within the same period. The implication of this result is that there was sufficient stock of death-preventing vaccines at health facilities in the study location. This finding strengthens the discussions around the value of developing and implementing digital health tools in public health interventions [24]. Furthermore, the impact of the tool, LoMIS Stock on vaccine planning and management was significant as our results showed that the LoMIS dashboard tool enhanced the vaccine operations visibility-providing near real-time data that enabled key decision makers to respond to stock-outs, CCE breakdown, and vaccine over-stock in record time, and ensure that immunization efforts meet expectations. Improved planning and management organization is another notable impact of the LOMIS dashboard on decision makers in the study location as we recorded in this study. This further contributes to existing evidence that data dashboards in public health tools provide reliable information to inform and support policy makers and project managers in iterating public health interventions [25]. Several sources show that a wide range of COVID-19 response interventions utilized many dashboards to collect data on time series, geographic maps, case incidents, contact tracing, community surveillance and clinical trials to refine intervention approach, outputs and outcomes [26,27,28,29]. A similar result was obtained by another researcher where a proactive infection prevention and control (IPC) monitoring tool was pioneered to provide reliable data for real-time response to emerging risks to COVID-19 infection amongst healthcare workers in Guangdong Second Provincial General Hospital in China. The study showed that the worrisome rate of healthcare workers infection prior to the deployment of the tool was reduced; and future plans to integrate artificial algorithms to the tool for improved outcomes are already being muted [30]. 1![Figure 1: Map Showing Study Locations in Kano and Bauchi States, Nigeria](image-2.png "Figure 1 :") 26![Figure 2: Trend of Penta 3 Coverage (%) in Kano State, Nigeria](image-3.png "Figure 2 : 6") 3![Figure 3: Trend of Penta 3 Coverage (%) in Bauchi State, Nigeria](image-4.png "Figure 3 :") 4![Figure 4: Sex of Participants Across the Study Locations](image-5.png "Figure 4 :") 5![Figure 5: Users of LoMIS Application Overtime](image-6.png "Figure 5 :") 6![Figure 6 Impact of Lomis Stock Tool on Ri Vaccine Inventory Reports and Turnaround Time Source: Study Qualitative Finding](image-7.png "Figure 6") 6![London Journal of Medical and Health Research 24 © 2023 Great ] Britain Journals Press Volume 23 | Issue | Compilation 1.0 Analyzing the Effectiveness of Digital Technology in Vaccine Supply Management in Kano State, Nigeria 2014 through December 2017. The trend analysis further showed that the percentage of facilities](image-8.png "6") 7![Figure 7: Comparing the Reported Improvement in 24-Hour Response to Stock Out and Cce Reports via Lomis and Paper-Based Tool in Kano State](image-9.png "Figure 7 :") 8![Figure 8: Trend of Stock Out Experiences in Kano and Bauchi State Prior and After the Use of LoMIS At baseline, stock-out experiences in health facilities in Kano and Bauchi States were of similar figures. However, stock-out occurrences in Kano experienced drastic reduction over time as compared to Bauchi State (Figure8). In addition, the differences in stock out outcomes in Kano and Bauchi states were confirmed as the Analysis of Variance (ANOVA) showed that the effect of the reporting tool on stock-out was significant (F (1,70,) = 215.506, p = 0.000). The comparison analysis using a paired-sample t-test showed that the mean difference in facility stock-out between a](image-10.png "Figure 8 :") 9![Figure 9: Time Series Analysis: 12 Months Forecast of Stock-Out if LoMIS was Not Introduced](image-11.png "Figure 9 :") ![The paper-based responses in Bauchi State validates improvement in duration of response time using LoMIS Stock in Kano State as the London Journal of Medical and Health Research 15 27 © 2023 Great ] Britain Journals Press Volume 23 | Issue 6 | Compilation 1.0 Analyzing the Effectiveness of Digital Technology in Vaccine Supply Management in Kano State, Nigeria Data Sourse: DHIS2](image-12.png "") All quantitative data was entered, analyzed usingStatistical Package for Social Science (SPSS,).Analysis of Variance (ANOVA) was employed to determine the effect of the LoMIS tool on stock-out data in Kano. Paired and independent t-tests were used to determine the significance of the mean difference between stock-out data between pre/post-LoMIS and to compare London Journal of Medical and Health ResearchNon-current users (40%) of LoMIS Stock havehad experience of its use but issues related tonetwork and faulty/missing phones stopped themfrom using LoMIS in reporting vaccine stockFindings from the desk reviews revealed that 484inventories. The LoMIS web dashboard furtherfacility personnel had been trained on how to userevealed increased use of the tool over time. As ofLoMIS Stock app for vaccine stock inventory.December 2017, the usability rate had improvedfrom 105 (22%) (January 2015) to 304 (63%)resulting in 190% increase in usage rate (Figure5). As expected, the survey findings affirmed that22Volume 23 | Issue | Compilation 1.0 6© 2023 Great ] Britain Journals Press Source: Study Survey data 3.2 Analysis of findings by Research Questions 3.2.1 Research Question 1: The Utilization of LoMIS Mobile Application Tool in Reporting Vaccine Stock Inventory in Kano State (Usability Rate) Analytics from LoMIS Dashboard showed 82% usage rate, that is, 397 of 484 Ward Technical Officers had used LoMIS application to report at least one stock inventory. Among all (60) users of the tool interviewed 60% are current users of LoMIS Stock as of the period of study. Analyzing the Effectiveness of Digital Technology in Vaccine Supply Management in Kano State, Nigeria 1PeriodMeanSDSEP ValuePre-LoMIS(January 2012 -246.5861.6810.28June 2014)0.000**Post-LoMIS(July 2014 -79.2241.576.9December 2017)Mean DifferencePaired DifferencesMeanSDCITP ValuePre-post stock-out167.3648.40150.98 -183.7320.740.000 * London Journal of Medical and Health Research 15 25 © 2023 Great ] Britain Journals Press Volume 23 | Issue 6 | Compilation 1.0 Analyzing the Effectiveness of Digital Technology in Vaccine Supply Management in Kano State, Nigeria Source: DHIS2 2Post-LoMIS (Bauchi)MeanSDSEtMDClP ValueKano (LoMIS)Bauchi90.0252.778.14-8.01-91.09Lower: -113.710.000*Upper: -68.47(Paper-basedTool)3.2.4 Research Question 4: The Impact of LoMIS3.2.5 ResearchQuestion5:PredictedStock on Data-Driven RI Vaccine Supply Planningoccurrence of facility stock-out with Paper-and Managementreporting tools in KanoIn this study, it was found that LoMIS Stock hasenabled near-real time RI vaccine reports, andthis has led to improved visibility to the status ofRI vaccines across health facilities in Kano state.Enhanced vaccine visibility has enabled most ofthe decision makers to respond to stock-outs, CCEbreakdownandover-stockofvaccinesimmediately. The planning RI vaccine supply hasbeen influenced by the distribution data of RIvaccine status across the facilities."With LoMIS Dashboard, the status of thevaccine has been visible, that is visibility ofstock availability. This helps me to takedecisions in time.""I use LoMIS Dashboard weekly to ensurethere is no Stock Out in any facility. I alsoidentify any CCE breakdown for replacementor repair. Recently, I saw Stock-out of BCG ina facility on the Dashboard and called thefacility immediately."State Partner, KanoLoMIS is really an engine room, it's a bank forinformation on vaccine management. At a go,it is easy to see the status of CCE and makedecisions at a go too. Non-functional CCEreceives speedy repair.Development Partner, Kano"LoMIS is real time, for me, I see the status ofvaccines immediately and I also have thecontact of service providers and I just call. Ithelps my daily plan. For me, I go on LoMISevery day.Development Partner, Kano © 2023 Great ] Britain Journals Press Volume 23 | Issue 6 | Compilation 1.0 Analyzing the Effectiveness of Digital Technology in Vaccine Supply Management in Kano State, NigeriaSource: DHIS2 © 2023 Great ] Britain Journals Press Volume 23 | Issue | Compilation 1.0 Analyzing the Effectiveness of Digital Technology in Vaccine Supply Management in Kano State, Nigeria ## Funding No Funding ## V. CONCLUSION The implication of this result is that there was sufficient stock of death-preventing vaccines at health facilities in the study location. This finding strengthens the discussions around the value of developing and implementing digital health tools in public health interventions [24]. Furthermore, the impact of the tool, LoMIS Stock on vaccine planning and management was significant as our results showed that the LoMIS dashboard tool enhanced the vaccine operations. ## Declarations Consent for publication ## Not Applicable ## Availability of data and materials The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request. ## Competing interests The authors declare that they have no competing interests" in this section. ## Ethical Consideration All methods were performed in accordance with the guidelines and recommendations specified within the Helsinki declaration. Official permission was sought and obtained from the participating vaccine stock management stakeholders in Kano and Bauchi states where the study was conducted. Ethical ## Informed Consent All participants provided written informed consent before participating in the study. ## Competing interests The authors declare that they have no conflicts of interest. * United Nations Children's Fund, Costs of vaccinating a child 2020. August 2020 UNICEF New York * Vaccine supply chains need to be better funded and strengthened, or lives will be at risk. Health Aff (Millwood) JRKaufmann RMiller JCheyne 10.1377/hlthaff.2011.0368 21653965 2011 Jun 30 * The imperative for stronger vaccine supply and logistics systems MZaffran JVandelaer DKristensen BMelgaard PYadav Antwi-AgyeiKo HLasher 10.1016/j.vaccine.2012.11.036 23598495 Vaccine 31 2013 Apr 18 Suppl 2: B73-80 * Literature review: The vaccine supply chain LottyEvertjeDuijzer WillemVan Jaarsveld RommertDekker 10.1016/j.ejor.2018.01.015 European Journal of Operational Research 0377-2217 268 1 2018 * Multiple Indicator Cluster Survey 2021 August, 2022 National Bureau of Statistics and United Nations Children's Fund Abuja, Nigeria Survey Findings Report * Scoping review of interventions for vaccine stock management in primary health-care facilities CJIwu AJaca LHAbdullahi NJNgcobo CSWiysonge 10.1080/21645515.2019.1607130 Hum Vaccin Immunother 15 11 2019 * Expanded Immunization Programme: Supply chain and logistics 2022. November 2022 World Health Organization * Factors affecting vaccine handling and storage practices among immunization service providers in Ibadan DMDairo OEOsizimete 10.4314/ahs.v16i2.27.PMID:27605974 PMC4994548 Afr Health Sci 16 2 2016 Jun Oyo State, Nigeria * The Challenges of Nigeria Vaccine Supply Chain, a Community of Practice Perspective TimilehinOmole Issue III 2321-2705 VI 2020. March 2019 * Vaccine management practices among healthcare workers in Morogoro, Tanzania: a cross-sectional study BNestory MAnasel JBNyandwi 10.1186/s40545-022-00496-y J of Pharm Policy and Pract 15 95 2022 * Achieving immunization targets with the comprehensive effective vaccine management (EVM) framework WhoUnicef WHO/UNICEF Jt. statement 2016. 2014 * Assessing technological impact on vaccine supply chain performance. Industrial Management & Data Systems PRai SBera PRay 10.1108/IMDS-08-2021-0488r 2022 122 * Strategic Advisory Group of Experts on Immunization. The Global Vaccine Action Plan 2011-2020 WHO/IVB/19.07). Licence: CC BY-NC-SA 3.0 IGO 2019 World Health Organization Geneva Review and lessons learned * Use of a district health information system 2 routine immunization dashboard for immunization program monitoring and decision making DDTchoualeu HEElmousaad LUOsadebe OJAdegoke CNnadi SAHaladu SMJacenko LBDavis PBBloland HSSandhu 10.11604/pamj.supp.2021.40.1.17313 36157564 PMCID:PM C9474830 Pan Afr Med J 40 Suppl 1 2 2021 Nov 12 Kano State, Nigeria * The Use of Real Time Monitoring Approaches and Tools for Immunization Campaigns: Good Practices and Lessons Learned New York: United Nations Children's Fund (UNICEF), 2021 London Journal of Medical and Health Research * End-user perspectives of two mHealth decision support tools: Electronic Community Case Management in Northern Malawi GriphinBaxter Chirambo AdamsonSMuula MatthewThompson VictoriaEHardy CiaraHeavin Yvonne O'Connor NikolaosMastellos BoAndersson O'John Donoghue 10.1016/j.ijmedinf.2020.1043 International Journal of Medical Informatics 1386-5056 145 2021 * 10.1016/j.ijmedinf.2020.104323 * Improving routine immunization data quality using daily short message system reporting platform: An experience from Nasarawa state AAkerele BUba MAduloju SEtamesor JAUmar OBAdeoye 10.1371/journal.pone.0255563 PLoS ONE 16 8 255563 2021 Nigeria * Lessons Learned From Implementing Digital Health Tools to Address COVID-19 in LMICs C LazenbySStuhldreher RKimball MBartlein R 10.1371/journal.pone.0255563 Front. Public Health 10 859941 2022 * Digital technologies in the public-health response to COVID-19 JBudd BSMiller EMManning 10.1038/s41591-020-1011-4 Nat Med 26 2020 * Latest situation of novel coronavirus infection in Hong Kong 10.1038/s41591-020-1011-4 The Government of the Hong Kong Special Administrative Region Centre for Health Protection, Department of Health 2022. November 2022 * Updates on COVID-19 (coronavirus disease 2019) local situation 2022 Ministry of Health Singapore * A real-time dashboard of clinical trials for COVID-19 KThorlund LDron JPark GHsu JIForrest EJMills The Lancet Digital Health 2 6 2020 * World Bank Education and COVID-19 London Journal of Medical and Health Research 30 0 2022. 2023 Britain Journals Press Issue | Compilation * Analyzing the Effectiveness of Digital Technology in Vaccine Supply Management in Kano State, Nigeria of Digital Technologies to Support Vaccination Programmes in Europe: State of the Art and Best Practices from Experts' Interviews. Vaccines (Basel) 10.3390/vaccines9101126 34696234 PMC8538238 2021 Oct 3 9 1126 * The use of technology to promote vaccination: A social ecological model based framework ChelseaAKolff VanessaPScott MelissaSStockwell 10.1080/21645515.2018.1477458 Human Vaccines & Immunotherapeutics 14 7 2018 * Implementing the routine immunisation data module and dashboard of DHIS2 in Nigeria FShuaib ABGarba EMeribole SObasi ASule CNnadi NEWaziri OBolu PMNguku MGhiselli OJAdegoke SJacenko EMungure SGidado IWilson EWiesen HElmousaad PBloland LRosencrans FMahoney AMacneil RFranka JVertefeuille 10.1080/21645515.2018.1477458 32694218 PMC7375433 BMJ Glob Health 5 7 2203 2014-2019. 2020 Jul * MBuilding strong health supply chain systems: the visibility and analytics network approach to improving the Nigerian immunisation supply chainBMJ COttih KCussen Mustafa 10.14236/jhi.v25i4.944 Health & Care Informatics 25 2018 * Acceptability and Potential Effectiveness of eHealth Tools for Training Primary Health Workers From Nigeria at Scale: Mixed Methods, Uncontrolled Before-and-After Study JPHicks MJAllsop GOAkaba RMYalma ODirisu BOkusanya JTukur KOkunade DAkeju AAjepe OOkuzu TMirzoev BEbenso JMIR Mhealth Uhealth 2021 Sep 16 * 10.2196/24182 345 PMC8485189 28891 * Operability, Acceptability, and Usefulness of a Mobile App to Track Routine Immunization Performance in Rural Pakistan: Interview Study Among Vaccinators and Key Informants SZaidi SAShaikh SSayani AMKazi AKhoja SSHussain RNajmi 10.2196/16081.bank-education-and-covid-19 JMIR Mhealth Uhealth 8 2 16081 2020. November 2022