科学基金项目立项评估:综合评价信息可靠性的多指标证据推理规则研究

doi:10.16381/j.cnki.issn1003-207x.2016.10.016

中国管理科学 ›› 2016, Vol. 24 ›› Issue (10): 141-148.doi: 10.16381/j.cnki.issn1003-207x.2016.10.016

科学基金项目立项评估:综合评价信息可靠性的多指标证据推理规则研究

朱卫东¹, 刘芳², 王东鹏³, Jian-Bo Yang^2,4

1. 合肥工业大学经济学院, 安徽合肥 230009;
2. 合肥工业大学管理学院, 安徽合肥 230009;
3. 杭州电子科技大学, 浙江杭州 310018;
4. 曼彻斯特大学商学院, 英国曼彻斯特 M15 6PB

收稿日期:2015-01-28 修回日期:2015-09-02 出版日期:2016-10-20 发布日期:2016-12-27
通讯作者: 刘芳(1988-),女(汉族),安徽界首人,合肥工业大学管理学院博士生,研究方向:决策分析,E-mail:fangliu.hfut@gmail.com. E-mail:fangliu.hfut@gmail.com
基金资助:
国家自然科学基金资助项目（71071048）

Research Project Evaluation and Selection in the NSFC: An Approach Based on the Evidential Reasoning Rule with Reliability

ZHU Wei-dong¹, LIU Fang², WANG Dong-peng³, Jian-Bo Yang^2,4

1. School of Economics, Hefei University of Technology, Hefei 230009, China;
2. School of Management, Hefei University of Technology, Hefei 230009, China;
3. School of Management, Hangzhou Dianzi University, Hangzhou 310018, China;
4. Manchester Business School, the University of Manchester, Manchester M15 6PB, UK

Received:2015-01-28 Revised:2015-09-02 Online:2016-10-20 Published:2016-12-27

摘要/Abstract

摘要： 公正合理的科研项目立项评估与选择是国家自然科学基金管理活动的关键环节。综合考虑科研项目的评估指标体系和选择流程，提出了利用历史评估准确性度量专家提供信息可靠性的方法，进而提出了一种系统性的基于证据推理规则的科学基金项目评估决策模型。该模型使用证据推理合成规则对多专家多指标评估信息进行集结。在集结过程中：充分考虑评估指标的权重以及评估等级的多样性；鉴于参与项目评估的专家具有不同的知识背景和经验，提出利用历史评估结果的准确性衡量专家提供的评价信息可靠性的方法；应用信度分布表征项目的整体评价结果，包含了更丰富的信息。国家自然科学基金项目评估的实例分析证明了该评估决策模型的有效性。

关键词: 科学基金项目, 立项评估选择, 证据推理, 可靠性

Abstract: Research project evaluation and selection is one of the core research management activities in the National Science Foundation of China (NSFC). Through taking into consideration evaluation criteria and selection procedure, a systematic method of implementing the evidential reasoning rule is presented to aggregate evaluation information on multiple criteria by multiple experts. The proposed method has the following strengths:1) combine evaluation information with different weights and reliabilities effectively, 2) employ a confusion matrix for generating experts' evaluation reliabilities, as experts may have different knowledge background and expertise, and 3) use a belief distribution to represent the overall performance profile of research projects in a more informative way. The belief distribution can be further transformed as utilities which are used to support the decision making of project selection. A case study on the project evaluation and selection of the National Science Foundation of China (NSFC) demonstrates the applicability and effectiveness of the proposed method.

Key words: research project in the NSFC, evaluation and selection, evidential reasoning, reliability

中图分类号:

C931

朱卫东, 刘芳, 王东鹏, Jian-Bo Yang. 科学基金项目立项评估:综合评价信息可靠性的多指标证据推理规则研究[J]. 中国管理科学, 2016, 24(10): 141-148.

ZHU Wei-dong, LIU Fang, WANG Dong-peng, Jian-Bo Yang. Research Project Evaluation and Selection in the NSFC: An Approach Based on the Evidential Reasoning Rule with Reliability[J]. Chinese Journal of Management Science, 2016, 24(10): 141-148.

参考文献

[1] 陈媛,樊治平.基于研究领域匹配度的科研项目评审指派方法[J].中国管理科学,2011,19(2):169-173.

[2] 张洪涛,朱卫东,王慧,等.多维框架证据推理的科研项目立项评估方法[J].科研管理,2013,34(6):122-128.

[3] 杨列勋.R&D项目评估研究综述[J].管理工程学报,2002,16(2):60-65.

[4] Poh K L,Ang B W,Bai F.A comparative analysis of R&D project evaluation methods[J].R&D Management,2001,31(1):63-75.

[5] Amiri M P.Project selection for oil-fields development by using the AHP and fuzzy TOPSIS methods[J].Expert Systems with Applications,2010,37(9):6218-6224.

[6] Feng Bo,Ma Jian,Fan Zhiping.An integrated method for collaborative R&D project selection:Supporting innovative research teams[J].Expert Systems with Applications,2011,38(5):5532-5543.

[7] Jung U,Seo D W.An ANP approach for R&D project evaluation based on interdependencies between research objectives and evaluation criteria[J].Decision Support Systems,2010,49(3):335-342.

[8] 王凭慧.科学研究项目评估方法综述[J].科研管理,1999,20(3):18-24.

[9] 陈媛,樊治平.科技类评审中项目选择的两阶段综合集成方法[J].中国管理科学,2010,18(2):127-133.

[10] Khalili-Damghani K,Sadi-Nezhad S,Tavana M.Solving multi-period project selection problems with fuzzy goal programming based on TOPSIS and a fuzzy preference relation[J].Information Sciences,2013,252:42-61.

[11] Huang Chicheng,Chu Pinyu,Chiang Y H.A fuzzy AHP application in government-sponsored R&D project selection[J].Omega,2008,36(6):1038-1052.

[12] Heidenberger K,Stummer C.Research and development project selection and resource allocation:A review of quantitative modelling approaches[J].International Journal of Management Reviews,1999,1(2):197-224.

[13] Thamhain H J.Assessing the effectiveness of quantitative and qualitative methods for R&D project proposal evaluations[J].Engineering Management Journal,2014,26(3):3-12.

[14] Silva T,Jian Ma,Chen Yang.Process analytics approach for R&D project selection[J].ACM Transactions on Management Information Systems (TMIS),2015,5(4):21.

[15] Yang Jianbo,Xu Dongling.Evidential reasoning rule for evidence combination[J].Artificial Intelligence,2013,205:1-29.

[16] Chen Yue,Chen Yuwang,Xu Xiaobin,et al.A data-driven approximate causal inference model using the evidential reasoning rule[J].Knowledge-Based Systems,2015,88:264-272.

[17] Yang Jianbo,Xu Dongling.On the evidential reasoning algorithm for multiple attribute decision analysis under uncertainty[J].IEEE Transactions on Systems,Man and Cybernetics,Part A:Systems and Humans,2002,32(3):289-304.

[18] 杜元伟,杨娜.大数据环境下双层分布式融合决策方法[J].中国管理科学,2016,24(5):127-138.

[19] Xu Dongling.An introduction and survey of the evidential reasoning approach for multiple criteria decision analysis[J].Annals of Operations Research,2012,195(1):163-187.

[20] Yang Jianbo,Xu Dongling.A study on generalising Bayesian inference to evidential reasoning[M].Belief Functions:Theory and applications.Switzertand:Springer International Publishing,2014:180-189.

[21] 朱卫东,张洪涛,张晨,等.基于两维语义的科学基金立项评估方法[J].系统工程理论与实践,2012,32(12):2697-2703.

[22] Shafer G.A mathematical theory of evidence[M].Princeton:Princeton University Press,1976:74-78.

[23] Yang Jianbo.Rule and utility based evidential reasoning approach for multiattribute decision analysis under uncertainties[J].European Journal of Operational Research,2001,131(1):31-61.

[24] Provost F,Kohavi R.Guest editors' introduction:On applied research in machine learning[J].Machine Learning,1998,30(2):127-132.

[25] 陈晓田.国家自然科学基金与我国管理科学(1986-2008)[M].北京:科学出版社,2009.

[26] 王雄,吴庆田.基于模糊语言的科研基金项目立项评估研究[J].科技进步与对策,2007,24(9):61-63.

[27] 肖人毅,王长锐.科研基金项目立项评估方法的研究与改进[J].系统工程理论与实践,2004,5:66-71.

[28] 王东鹏,朱卫东,陈波,等.认知视角的科学基金项目专家评议意见分析-基于ER规则的研究[J].科学学与科学技术管理,2015,36(04):22-35.

科学基金项目立项评估:综合评价信息可靠性的多指标证据推理规则研究

Research Project Evaluation and Selection in the NSFC: An Approach Based on the Evidential Reasoning Rule with Reliability

PDF (PC)

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

Metrics

本文评价

推荐阅读 0

[1]	汤兆平, 秦进, 孙剑萍. 基于非概率可靠性的铁路应急设施选址-路径鲁棒优化[J]. 中国管理科学, 2022, 30(9): 206-216.
[2]	黄河, 胡旻卉. 不对称信息下信息技术服务外包合同设计[J]. 中国管理科学, 2022, 30(4): 144-154.
[3]	王旭, 王应明, 王亮, 蓝以信, 张兴贤. 基于证据推理和前景理论的交叉效率排序方法研究[J]. 中国管理科学, 2022, 30(11): 250-259.
[4]	邱慧, 闫相斌, 翟庆庆, 彭锐. 具有多阶段任务需求的温备份系统可靠性分析[J]. 中国管理科学, 2021, 29(2): 99-107.
[5]	刘培德, 滕飞. 基于证据推理和广义Shapley值的扩展概率语言多属性群决策方法[J]. 中国管理科学, 2020, 28(11): 206-218.
[6]	潘和平, 张承钊. FEPA-金融时间序列自适应组合预测模型[J]. 中国管理科学, 2018, 26(6): 26-38.
[7]	方志耕, 王欢, 董文杰, 曹颖赛. 基于可靠性基因库的民用飞机故障智能诊断网络框架设计[J]. 中国管理科学, 2018, 26(11): 124-131.
[8]	周瑜, 寇纲, 尔古打机. 某大型装置现场可靠性的贝叶斯分析[J]. 中国管理科学, 2016, 24(11): 170-176.
[9]	张敏, 张玲. 基于失效情景的应急设施选址评估指标体系与模型[J]. 中国管理科学, 2016, 24(11): 129-136.
[10]	吴六三, 谭清美, 张跃辉. 网络弧生长对网络可靠性的影响[J]. 中国管理科学, 2015, 23(1): 65-72.
[11]	祝硕, 许保光, 刘世骞. 周转件构成的可修复系统的可靠性分析[J]. 中国管理科学, 2014, 22(7): 67-75.
[12]	温源, 肖勇波. 面临汇率和供应风险的双渠道采购决策研究[J]. 中国管理科学, 2013, 21(4): 35-43.
[13]	侯立文, 谭家美. 城市交通中利用Gram-Charlier分布估计行程时间可靠性[J]. 中国管理科学, 2009, 17(6): 139-146.
[14]	王坚强, 孙超. 不完全确定信息的群体语言指派问题的求解方法[J]. 中国管理科学, 2007, 15(1): 74-79.
[15]	龚哲君. SCEM-UA算法在混合Weibull分布参数估计中的应用[J]. 中国管理科学, 2006, (6): 66-70.