MSI Project Indicators  3.1.1   PDO Indicator 1 What: Size/number and productivity (measured by publications, patent applications, and number of students trained) of researchers and research groups doubles; This indicator should demonstrate the extent to which research in Uganda is increasing while showing whether the research produced by Ugandans is resulting in new technologies, via patents and partnerships with technology-developers. How: Establish a baseline number of researchers active in science and technology in Uganda by conducting one or more surveys annually to elicit the following information: a.     In what field is the researcher active? b.     With what institution is the researcher affiliated c.     List of patents, publications, and citations* d.     List of institutional partnerships and affiliations (private sector firms, universities, research institutes) e.     Number of postgraduate students supervised/Number of theses supervised  f. Number of colleagues (FT, PT, PIs, junior researchers, by discipline) Number and nature of partnerships with private sector firms by discipline Information should be gathered through a combination of email, phone and in-person interviews. When: The survey shall be repeated annually to monitor indicators and measure progress. The elicited survey data shall be presented in a narrative and tabular format and submitted to the   Technical Committee and the UNCST Secretariat. Who: Likely candidates for performance of the annual researcher survey include UNCST, UNCHE, or others   Outstanding Issues: a.     Number and nature of surveys as well as data and cost estimates b.     An authoritative source that lists science and engineering disciplines must be selected to use in determining eligible programs for inclusion (sources might include either NSF or OECD) c.     Citations: It is very rare that researchers themselves calculate and track the frequency of their research cited in others' publications. The ISI is the authoritative source internationally that provides such data at the aggregate national level. It may be considered useful for the purposes of tracking progress on PDO Indicator 1 if access to the ISI Public Citation and Impact Analysis is procured d.     A determination of counting FTEs versus research staff totals will need to be made   3.1.2   PDO Indicator 2 What: Pipeline of science, technology, and engineering undergraduates and postgraduates increases by 50% in key disciplines; This indicator should demonstrate the extent to which both undergraduate and postgraduate study in science, technology and engineering is increasing. In particular, attention will be given to those disciplines of most critical importance to national development goals (e.g., agriculture sciences, mechanical and electrical engineering, chemistry, biology, soil science, etc.). The following indicators form the core of that information required to measure the size and impact of Uganda's S&T training system. How: Establish a baseline number of enrollees and graduates in science, engineering, and technology-related programs in Uganda by conducting one or more surveys annually to elicit the following information: a.     Number of S&T enrollees b.     Number of S&T graduates (at BS, MS, and Ph.D. level) annually c.     Number of active researchers per discipline (FT, PT, PIs, and junior researchers, by discipline) d.     Number of patents annually by discipline e.     Number of publications and citations* per discipline f.      Number and nature of partnerships with private sector firms by discipline Information should be gathered through a combination of email, phone and in-person interviews. When: The survey shall be repeated annually to monitor indicators and measure progress. The elicited survey data shall be presented in a narrative and tabular format and submitted to the Technical Committee and the UNCST Secretariat. Who: Likely candidates for performance of the annual university survey include the UNCHE and UNCST   Outstanding Issues: a.     Number and nature of surveys as well as data and cost estimates b.     An authoritative source that lists science and engineering disciplines must be selected to use in determining eligible science, technology, and engineering disciplines for inclusion (sources might include either NSF or OECD) c.     A determination of those key disciplines for targeted monitoring shall be made by the Technical Committee on Appraisal 3.1.3    PDO Indicator 3 What: Firms active in technology development/evaluation employ more S&T talent and profitably use more technology; This indicator should serve as a measure of firms' technology use in Uganda, allowing for measurement of growth from one year to the next. Also, this indicator allows for tracking of firms' inclusion of science, technology and engineering-focused students involved in the Technology Internship program as well as ascertaining the degree to which internship participants indeed serve as conduits for technological learning and linkage creation between academia and industry.   How: Establish a baseline number of firms productively using technology and making productive use of the internship program by conducting one or more surveys annually to elicit the following information: a.     Principle technology constraints facing the firm b.     In what ways does the firm draw on relevant research created by universities and public research institutes? c.     In what S&T areas does the firm face the most severe human resources constraints? d.     Has the internship program helped relieve this shortage? e.     Has the proportion of staff with S&T training increased over the past year? f.      In what areas has involvement in the MSI begun to help ameliorate technology-related constraints? g.     How has interaction with universities/research institutes changed? h.     Has the firm engaged non-firm partners in developing research agendas of use to the firm (i.e., to help the firm make better products or more efficient processes)? i.      Has the firm's use of technology changed or increased? Using the RPED data as a starting point, the consultant(s) hired to conduct these surveys should rely heavily on in-person contact with the sample firms through email, phone and in-person interviews   When: The survey shall be repeated annually to monitor indicators and measure progress. The elicited survey data shall be presented in a narrative and tabular format and submitted to the Technical Committee and the UNCST Secretariat.   Who: Appropriate candidates will be identified through the proper CFP process  Outstanding Issues:   Number and nature of surveys as well as data and cost estimates   3.1.4    PDO Indicator 4 What: Survey of clients reveals that UNCST and UIRI provide effective services; This indicator should serve as a measure of both the UNCST's and the UIRI's migration toward becoming more impacting, effective, and efficient. The project includes components to restructure UNCST and UIRI to better carry out their mandates and serve their clients. This indicator should allow for an assessment toward that objective. An array of pointed questions should be included in the survey and those listed constitute a mere first cut at a survey. How: Establish an understanding of clients' satisfaction with UNCST/UIRI services by conducting one or more surveys to elicit the following information: a.     Has UNCST/UIRI provided your institution with all of the necessary services implied in its mandate? b.     Are there any areas in which UNCST/UIRI has come up short in providing the services that you feel it should? c.     How would you rate your satisfaction with UNCST/UIRI? d.     Do you have any areas for improvement and strengthening you would wish UNCST/UIRI to take up? When: Baseline data will be drawn in year 1 so that follow-on data may allow for comparison and appreciation of progress. The elicited survey data shall be presented in a narrative and tabular format and submitted to the Technical Committee and the UNCST Secretariat.   Who: Appropriate candidates to perform the survey/study will be identified through the proper CFP process. Targeted constituencies to be interviewed for survey data include: a.     Firms, public research institutes (for UIRI) b.     Parliamentary Committee on S&T, Office of the President, District Governments, Ministries, Government Agencies involved in S&T (for UNCST)   Outstanding Issues: Number and nature of surveys as well as data and cost estimates   3.1.5    PDO Indicator 5  What: Positive impressions of careers in science and technology increase; this indicator is designed to ascertain whether more Ugandan A-level students will plan careers in S&T fields as a result of the various MSI activities. This indicator should benchmark students' attitudes and eagerness toward pursuing careers in S&T and allow for tracking changes in this regard. An array of pointed questions should be included in the survey and those listed constitute just a few of those to include in the final survey.   How: Establish an understanding of students' enthusiasm for, fear of, and willingness to explore careers in science, technology and engineering by conducting one or more surveys to elicit the following information:   a.     How attractive does a career in science and technology sound to you? b.     Do you have many examples of friends or family succeeding in science- and technology-related careers? c.     Do your S&T studies seem adequate to prepare you for a happy and successful career? d.     In relation to your other studies, how difficult does your science coursework seem to you? e.     Who is your favorite scientist? f.      How easy/difficult would you rate S&T studies? g.     What are your reasons for (not) choosing to pursue a degree in S&T? When: Baseline data will be drawn in year 1 so that follow-on data may allow for comparison and appreciation of progress. The elicited survey data shall be presented in a narrative and tabular format and submitted to the Technical Committee and the UNCST Secretariat. Who: Appropriate candidates to perform the survey/study will be identified through the proper CFP process. Targeted constituencies to be interviewed for survey data include: a.     Students enrolled in science, technology, and engineering programs b.     Students graduating from science, technology, and engineering programs c.     Secondary school students   Outstanding Issues: Number and nature of surveys as well as data and cost estimates Table 2. Summary of MSI Project Indicators PDO Project Outcome Indicators Use of Project Outcome Information Universities and research institutes produce more and better qualified S&T graduates and generate and transfer higher quality and more relevant research. Firms productively utilize more trained human resources and more technology (generated and/or transferred). PDO Indicator 1: Size/number and productivity (measured by publications, patent applications, and number of students trained) of researchers and research groups doubles PDO Indicator 2: Pipeline of science, technology, and engineering undergraduates and postgraduates increases by 50% in key disciplines PDO Indicator 3: Firms active in technology development/evaluation employ more S&T talent and use more technology PDO Indicator 4:   Survey of clients shows that UNCST and UIRI provide effective services PDO Indicator 5:  More Ugandan A-level students plan careers in S&T fields  as positive impressions of careers in science and technology increase   Data from these indicators will be provided to the MSI Executive Committee.  They will help to confirm whether the PDO is on track to being achieved. PDO Indicators 1-5 are aimed at measuring program impacts YR1: Assure that transparent processes have led to effective allocation of research, training, and linkage resources YR 2-3: Assure that physical and organizational inputs are leading toward expected subproject goals YR 4-5: Measure the extent of the change in system performance and assess option for consolidating S&T funding and innovation system Intermediate Outcomes Intermediate Outcome Indicators Use of Intermediate Outcome Monitoring   PDO Project Outcome Indicators Use of Project Outcome Information Intermediate Result A: MSI Funding Facility established, grantees selected through transparent, merited based competition. Indicator A1: MSI Technical Committee seated; call for proposals issued Indicator A2: Ratio of  applicants to fundable proposals 3:1 or greater for Windows A & B Indicator A3: 10% of top 50 technologically-active firms in the process of establishing internship programs and participating in the Technology Platforms Indicator A4:  UIRI completes service demand assessment YR 1- 1.5:   Data from these indicators consolidated into an annual report from the MSI Technical Committee and the UNCST Secretariat to the Executive Committee. Report puts MSI progress within the context of progress on related policy areas, using sectoral data gathered by the UNCST, the UNCHE, and the UIRI. Sectoral and program report disseminated to stakeholders in S&T-related Ministries and agencies Intermediate Result B: Senior Research Teams (SRTs) and Research Teams (RTs) fully staffed, equipped and operational; undergraduate programs admitting students; Technology Platform activities lead to transfer of specific technologies and to follow on research by firms and partners. Indicator B1: Assessment of research progress by independent visiting teams reveals research and training goals on track in 80% of SRTs and RTs.  Postgraduate theses topics identified Indicator B2: New Undergraduate programs admitting students for full-time study; Upgraded undergraduate programs expand enrollment and implement revised curricula Indicator B3: Technology Platform activities lead to acquisition of new technology in some participating firms.   Technology Platforms result in increases in cooperative research. 15% of basic science and engineering students participating in internship programs YR 2-3: As project approaches midterm review, independent assessments determine whether project inputs are fully employed in ways that are likely to lead to outcomes and impacts.  MSI Technical Committee makes recommendation for restructuring of any grants where implementation delays imperil ability to achieve outcomes. Intermediate Result C: Research results leading to planned publications; students progressing towards undergraduate and postgraduate degrees; firms demonstrate greater technology use as a result of participation in the MSI; firms hire interns upon graduation.   Indicator C1: Publications, patent applications, and postgraduate theses in draft, submission dates identified Indicator C2: New program enrollment at 70% of capacity; independent assessment rates curricula at internationally-acceptable levels of quality Indicator C3: Cost-effectiveness of acquired technologies/new processes and products is measured via increases in revenue; 15% of internship participants receive employment offers from participating firms upon graduation. Indicator C4: UIRI generating fees for technological services offered to firms YR 4-5 Preliminary measurement of impact in program and sectoral reports forms the basis of dialogue on the size and format of follow on funding/replenishment of the MSI Funding Facility and linkage programs .

Top                                        Top                                          Top                  Top                              Top                              Top                      Top                                              Top

The Uganda National Council for Science & Technology Publication. All Rights Reserved. Comments for this publication may be sent to the Executive Secretary Please state your name and country.