Education, Employment, Experience
Gretchen B. Jordan, Ph.D.
360 Innovation LLC
Pacific Grove, California USA
Email: [email protected]
Professional Preparation
Economics Ph.D. University of New Mexico
Economics M.A. University of South Dakota
Mathematics B.A. University of Colorado
PROJECTS
Projects as an Independent Consultant 2012 to date
- Drafted Terms of Reference for External Review of the portfolio of programs of the Consultative Group on International Agricultural Research, a global scientific research-for-development partnership. The work was commissioned by the evaluation unit for the CGIAR Advisory Services Secretariat.
- Senior advisor on a multi-year project for the California Energy Commission to identify potential benefits of the Electric Program Investment Charge (EPIC) Program across the technology development and deployment continuum and to develop methods to forecast these benefits, working with Industrial Economics, Incorporated.
- Team Leader for an evaluation of the Marine Microbiology Initiative of the Gordon and Betty Moore Foundation.
- Consultant to the Canadian Institute for Advanced Research, developing a performance management strategy.
- Member of team for U.S. DOE-funded evaluation studies on two DOE National Laboratory pilot projects to increase technology transfer (Energy I-Corps) and Small Business Voucher program.
- Senior member of team that develop empirical measurement of the impact of technology transfer from federal laboratories for NIST. Led the case studies.
- Team member on an evaluation of the impact of the California Solar Initiative R&D Program.
- Assisted the Canadian Health Services and Policy Research Alliance, a collaboration of Canadian research funders, with development of "Making an Impact: a shared framework for evaluating the impact of health services and policy research on decision-making", recognizing that collective action on evidence-based decisions leads to desired health outcomes.
- Provided expert advice on RTD logic modelling, performance measurement and evaluation and management techniques to Alberta Innovates (Canada).
- Developed an evaluation framework for assessing the impacts of large-scale research infrastructure for Canadian research agencies.
- Team leader on project that developed a program theory-based evaluation plan for the U.S. Department Energy to assess process and intermediate impacts of programs that aim to accelerate innovation in technology development, manufacturing, supply chains, and early markets.
- Developed program theory logic models and indicators for Advanced Buildings Technology Development and Clean Energy Business Development Programs, as well as a protocol for evaluability assessment for the New York State Energy Research and Development Authority.
- Wrote and presented a commissioned white paper on Evaluation of the Outcomes of Team Science, for a National Research Council study on team science.
Projects While at Sandia National Laboratories
- Team Leader and senior technical advisor on numerous program and organizational evaluation frameworks and process and impact evaluations spanning the continuum of basic and applied research, technology development, and deployment.
- Planned and managed program evaluations and developed strategies and innovative methods for both evaluation and performance monitoring for science and technology development and deployment (RTD) programs beginning in 1993 for the U.S. Department of Energy (DOE).
- Lead program evaluation contractor for fourteen years for the Office of Planning, Budget, and Analysis in the Office of Energy Efficiency and Renewable Energy; co-authored guides on evaluation of market transformation programs, for in-progress peer review, R&D evaluation methods, and benefit-cost studies for technology programs.
- Planned and managed evaluations for the DOE Office of Science Office of Planning and Analysis that responded to the requirements of the Program Assessment Rating Tool (PART).
- Developed logic models, diagrams and text designed, for many different programs and organizations in the DOE and elsewhere in the U.S. and other countries. These models often include performance indicators and are developed in a group process that aids in program design, bringing together theory and practice.
- Have a body of work funded by the DOE Office of Science from 1994 to 2007 aimed at assessing and improving the organizational environment for research. We developed and tested hypotheses about the relationships of organization structure and management strategies and innovation for different research profiles and contexts.
- Have an extended network of contacts among RTD evaluators worldwide. Advised the European Research Area-net on Science Knowledge for Environmental Protection, the European Court of Auditors, the Canadian Academy of Health Sciences, Canadian Council of Academies, Chinese Academy of Sciences, National Science and Technology Agency of Thailand, MEXT, METI and AIST in Japan, and Korean Institute of Science and Technology Policy.
EMPLOYMENT
Independent Consultant, 2012 to date
Principal Member of Technical Staff, Sandia National Laboratories, Albuquerque, New Mexico September 1993 to December 2011, and Consultant, 1991 to 1993, Sandia National Laboratories. Washington, DC office 1991-2006, Albuquerque, New Mexico 2006 to 2011. Sandia is one of the U.S. Department of Energy (DOE) national research laboratories.
Senior Research Scientist, University of Maryland Center for Innovation, 2002 to date. Advising on projects related to the science of science and innovation policy, including two National Science Foundation grants, one related to the research environment, the other to metrics for outcomes of health research.
College of Santa Fe, Santa Fe, New Mexico, Acting Dean, Graduate and External Programs, 1989; Chairman, Business Administration Department, 1987 to 1990; Director, MBA Program, 1986 to 1990; Assistant Professor of Business Administration, 1985 to 1990.
U.S. Senate Staff, Washington, D.C., Budget Committee, Special Projects Analyst, 1983 to 1984 and Executive Assistant to Senator Pete V. Domenici, 1981 to 1983.
SELECTED PROFESSIONAL AWARDS AND ACTIVITIES
Member of the Management Group, The HIBAR (Highly Integrative Basic and Responsive) Research Alliance, 2020
Program Committee Member, Atlanta Conference on Science and Innovation Policy, 2017, 2019.
Founder in 1995 and current Chair Emeritus, Research Technology and Development Evaluation Topical Interest Group of the American Evaluation Association (AEA)
Fellow, American Association for the Advancement of Science (AAAS), elected in 2007 “for measuring performance and diversity within organizational structures and developing innovative methods for assessing the effectiveness of research programs.” (Societal Impacts Section)
North American Editor, Research Evaluation, 2008 to 2015. Research Evaluation is an interdisciplinary journal covering the emerging methods, experiences and lessons for appraising and evaluating research. http://rev.oxfordjournals.org/
GUIDES and SELECTED PUBLICATIONS
Logical Frameworks for Evaluation
Jordan, G.B. and Steve Montague, 2015. Study of Large-Scale Research Infrastructure Impact Assessment: Current Practices and Proposed Way Forward, a report to the National Research Council of Canada, March.
Jordan, Gretchen B and other members of the American Evaluation Association Research, Technology and Development Topical Interest Group, 2015. Evaluating Outcomes of Publicly Funded Research, Technology and Development Programs: Recommendations for Improving Current Practice, February, available at http://tinyurl.com/RTDTIGWhitePaper2015.
Jordan, Gretchen B and Jane Peters, 2014. Advanced Buildings Technology Development: Program Theory Logic Model Final Report Prepared for: The New York State Energy Research and Development Authority Albany, New York.
Jordan, Gretchen B and Jane Peters, 2013. CLEAN ENERGY BUSINESS DEVELOPMENT Final Initiative Level Logic Model Report, prepared for The New York State Energy Research and Development Authority. Nyserda.ny.gov search on logic model.
Jordan, Gretchen, Jonathan Mote, Rosalie Ruegg, Thomas Choi, and Angela Becker-Dippmann. 2014. A Framework for Evaluating R&D Impacts and Supply Chain Dynamics Early in a Product Life Cycle: Looking inside the black box of innovation, prepared for the U.S. Department of Energy. http://www1.eere.energy.gov/analysis/pdfs/evaluating_rd_impacts_supply_chain_dynamics.pdf
Jordan, Gretchen B (2013). A Logical Framework for Evaluating the Outcomes of Team Science, prepared for the Workshop on Institutional and Organizational Supports for Team Science, National Research Council, Board on Behavioral, Cognitive and Sensory Sciences, Committee on the Science of Team Science, October.
Jordan, G. 2010. A Theory-Based Logic Model for Innovation Policy and Evaluation, Research Evaluation, 19(4), October 2010, 263-274.
Jordan, Gretchen, Pete Oelschlaeger, Alan Burns, Randy Watkins, and Tim Trucano. 2010. Description of the Sandia National Laboratories Science, Technology & Engineering Metrics Process, SANDIA REPORT Unlimited Release, SAND2010-0388, April.
Reed, John H, G. Jordan. 2007. Using Systems Theory and Logic Models to Define Integrated Outcomes and Performance Measures in Multi-program Settings, in Research Evaluation, Volume 16 Number 3 September.
Reed, John H., and Gretchen Jordan. 2007. Impact Evaluation Framework for Technology Deployment Programs, U.S. DOE, July.
How to Guides on Logic Models, Evaluation, and Performance Measurement
Mc Laughlin, John A. and Gretchen B Jordan. 2015. Using Logic Models, Handbook of Practical Program Evaluation, 4th Edition, Newcomer, K., Hatry, H., and Wholey, J., Eds., Jossey Bass, 62-87.
Jordan, Gretchen B. 2013. Logic Modeling: A Tool for Designing Program Evaluations, in Handbook on the Theory and Practice of Program Evaluation, Albert N. Link and Nicholas S. Vonortas, Editors, Edward Elgar Publishing, April.
Ruegg, Rosalie and Gretchen B. Jordan, 2011, Guide for Conducting Benefit-Cost Evaluation of Realized Impacts of Public R&D Programs, Prepared for U.S. Department of Energy, Office of Energy Efficiency and Renewable Energy, Revised working draft, August.
McLaughlin, John A., and Jordan, Gretchen B. 1999. “Logic Models: A Tool for Telling Your Performance Story”, Evaluation and Program Planning, Elsevier Science: New York, Vol. 22, Issue 1, February, 65-72.
Ruegg, Rosalie, and Gretchen Jordan, 2007. Overview of Evaluation Methods for R&D Programs, U.S. DOE, March.
Office of Energy Efficiency and Renewable Energy, 2006. Guide for Managing General Program Evaluation Studies, U.S. DOE, February.
Office of Energy Efficiency and Renewable Energy Task Force (G. Jordan member), 2004. EERE Peer Review Guide: Based on a Survey of Best Practices for In-Progress Peer Review and Appendices, U.S. DOE, August.
Lee, Russell, Jordan, Gretchen, Leiby, Paul N., Owens, Brandon, Wolf, James L. 2003. “Estimating the Benefits of Government-Sponsored Energy R&D,” Research Evaluation, Vol. 12 No. 3 (Dec.): 189-195.
Jordan, Gretchen, 2001. “Measuring the Performance of American Science and Technology Laboratories”, in Government Laboratories: Transition and Transformation. NATO Science and Series, Amsterdam: IOS Press Ohmsha.
Innovation, Evaluation of Innovation, Research Profiles and Environment
Mote, Jonathan, Gretchen Jordan, Jerald Hage, Wilbur Hadden, Aleia Clark. 2016. Too big to innovate? Exploring organizational size and innovation processes in scientific research, Science and Public Policy, Volume 43, Issue 3, 1 June, Pages 332–337.
Jordan, G.B., J. Mote, J. Hage. 2012. Research Profiles: Prolegomena to a New Perspective on Innovation Management, in "Technological, Managerial and Organizational Core Competencies: Dynamic Innovation and Sustainable Development," Eds. F.S. Nobre, D.S. Walker, and R.J. Harris, Business Science Reference (IGI Global), USA.
Hage, J., Jordan, G., Mote, J.; Whitestone, Y. 2008. Designing and facilitating R&D collaboration: The balance of diversity and integration. Journal of Engineering and Technology Management 25(4): 256-268.
Jordan, G. B., Hage, J., & Mote, J. 2008. A theories-based systemic framework for evaluating diverse portfolios of scientific work, part 1: Micro and meso indicators. In C.L.S. Coryn & Michael Scriven (Eds.), Reforming the evaluation of research. New Directions for Evaluation, 118, 7–24.
Mote, J., Y. Whitestone, G. Jordan and J. Hage. 2008. Innovation, Networks and the Research Environment: Examining the Linkages. International Journal of Foresight and Innovation Policy 4(3): 246-264.
Hage, Jerry, G.B. Jordan and J. Mote. 2007. A Theories-Based Innovation Systems Framework for Evaluating Diverse Portfolios of Research: Part Two - Macro Indicators and Policy Interventions. Science and Public Policy, 34(10): 731-741.
Mote, J., G. Jordan and J. Hage. 2007. Measuring Radical Innovation in Real Time. International Journal of Technology, Policy and Management, 7 (4): 355-377.
Jordan, G.B. 2006. Factors Influencing Advances in Basic and Applied Research: Variation Due to Diversity in Research Profiles. In Innovation, Science, and Institutional Change: A Handbook of Research, J. Hage and M. Meeus (eds). Oxford University Press: Oxford, 173-195.
Jordan, G.B. 2005. What is Important to R&D Workers. Research Technology Management, 48 (3): 23-32.
Jordan, G.B. and L.D. Streit. 2003. Recognizing the Competing Values in Science and Technology Organizations: Implications for Evaluation. In Learning from Science and Technology Policy Evaluation, P. Shapira, Philip and S. Kuhlman (eds.). Edward Elgar: Cheltenham, UK.
Mote, J., G.B. Jordan, J. Hage, and Y. Whitestone. 2007. New Directions in the Use of Network Analysis in Research and Product Development Evaluation. Research Evaluation, Volume 16 Number 3 September.