Korean Journal of Policy Studies
Graduate School of Public Administration, Seoul National University
Article

A Study on the Ex-ante Evaluation on Government R&D Programs Using Fuzzy Reasoning

Yoon Been Lee1
1R&D Feasibility Analysis Center, Korea Institute of S&T Evaluation and Planning, 9F Dongwon Industries Bldg. 68 Mabang-gil, Seocho-gu, Seoul, 137-717, Korea. E-mail: yblee@kistep.re.kr.

© Copyright 2013 Graduate School of Public Administration, Seoul National University. This is an Open-Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Received: Oct 10, 2013; Revised: Oct 20, 2013; Revised: Dec 16, 2013; Accepted: Dec 18, 2013

Published Online: Dec 31, 2013

Abstract

In 2007, the Korean government officially introduced an ex-ante evaluation system, the preliminary feasibility study (PFS), for supporting the decision making process that informs R&D investment budgets, which uses economic, policy, and technological criteria to evaluate prospective R&D programs. From an analytical perspective, this kind of balanced assessment is very important in budget allocation decision making and thus the need for objective quantitative values that can lead to a conclusive judgment on the status of an R&D investment has been growing.

However, owing to measurement problems and a lack of information, PFSS as well as economic feasibility assessments, a critical subdimension of PFSS, have faced difficulties in deriving a satisfactory single assertive conclusive value. Furthermore, the emphasis on expected economic returns of the R&D investment from the perspective of long-term national strategy in PFSS seems to contradict the original intention of ex-ante evaluation system, which is supposed to take not only economic but also technological and policy dimensions into account independently.

The aim of this study is to investigate the question of independency in PFSS, especially in the assessment of economic feasibility raised by many critics. If there are some systematic connections between assessments of other dimensions of feasibility and the economic one, it becomes hard to sustain the basic assumption of the PFS, and we need to explicitly take this linkage into account in performing PFSS. To verify the existence of this connection, I propose a method to derive pseudovalues that provide an economic assessment of the R&D program from those originally derived via analyses: a method of a fuzzy reasoning approach that converts experts' judgments into systematic calculations. Furthermore, I suggest that the results generated by fuzzy reasoning can be used to complement a traditional economic analysis, since fuzzy reasoning can inform the development of a comprehensive structure for ex-ante evaluation for government programs.

Keywords: government R&D program; ex-ante evaluation; preliminary feasibility study; fuzzy reasoning; multi-criteria analysis