Measuring Creativity – A CogSci 2019 Workshop

The workshop “Measuring Creativity” is part of the CogSci 2019 – the 41st Annual Meeting of the Cognitive Science Society, to be held in Montreal, Canada on Wednesday, July 24th – Saturday, July 27th, 2019 (Wednesday, July 24th is the Tutorials and Workshops day).

Links to the Measuring Creativity 2019 workshop <>, CogSci 2019 <>, our CFP webpage <> are here.


Various methods exist for measuring creativity, most of them in the form of creativity tests, like the Remote Associates Test, the Alternative Uses Test, TTCT, the Wallach-Kogan tests, insight problems, etc.

However, the feasibility and dependability of various types of psychometric assessment and administration of measures, as pertaining to various creativity tasks, have recently been questioned and enriched. The thought and work on the measurement of creativity are witnessing a new revival.

Recently, new methods of computationally creating stimuli for greater measurement accuracy have been developed, inspired by artificial cognitive systems that solve creativity tests. Such computational psychometrics methods have already shown to provide designs with greater control and the computational resurrection of tests which were initially proposed theoretically.

This workshop will focus on building a red thread of discussion on the current state of creativity psychometrics, integrating topics on existing classic and novel, manual and computational methods of testing and measuring creativity. The following questions will be addressed:

What creativity measuring methods exist and what are their strengths and weaknesses?
Which creativity factors are measured by the existing creativity methods? Is there an overlap of measuring methods for different factors? Are they the factors for which no methods exist or current methods are not yet up to the task?
What is the suitability of existing current methods for empirical testing versus computational modelling?
How can comparability be ensured across creativity test item sets?
What creativity metrics and methods can be used in evaluating the computational modelling of creativity?
What is the impact of artificial cognitive systems and their evaluation on creativity metrics? Of computational creativity systems and their evaluation?
What are the new computational and automatized measures of creativity, and what is their role in the ecosystem of measures?
Subjective and objective measures of creativity.
The workshop will involve three elements:
Three invited speakers from different backgrounds (Cognitive Psychology, Cognitive Neuroscience, Cognitive Systems – Computer Science) will present existing creativity measuring methods
Short presentations of papers and posters will be accepted on the topic.
The workshop will end with a panel discussion, focused on establishing future directions for methods and systems aimed at supporting creativity and problem-solving.

Measuring Creativity welcomes papers on one or more of the general topics of Cognitive and Computational methods, creative problem solving and computational creativity. Both theoretical, computationally applied and empirical papers will be accepted. We especially welcome papers which aim to bring together some of these topics.

Creative cognition
Creativity measures and Tests
Psychometrics for Creative Cognition
Computational methods for measuring creative cognition
Computational modelling
Artificial creative cognitive systems
Creative problem solving
Computational Creativity
Evaluation of natural and computational cognitive systems
Associativity and Conceptual Spaces
Semantic networks and semantic graphs
Ill-structured problem solving and Structured representations
Knowledge discovery
Creativity modelling approaches and their relation to evaluation, including Case-based reasoning, Neural networks, Evolutionary algorithms
Analogy and Metaphor
Creative assistive systems


Two types of papers are welcome:
Full research papers – up to 10 pages in LNCS format + references.
Poster abstract submissions – up to 5 pages in LNCS format (including references).
For formats, please visit our workshop’s Call For Papers webpage.

Submission is open now via EasyChair ( <>).

For any problems related to submission please contact Ana-Maria Olteteanu (email: ana-maria dot olteteanu at fu-berlin dot de).


The papers submitted for this workshop will be published as a CEUR-WS volume. If enough high-quality papers are received, a Special Issue will be proposed by the organizer to the Cognitive Systems Research journal, or a topic proposal will be made to TopiCS in Cognitive Science.

Important Dates

Submission of abstracts for full research papers (optional) – 7th of June, 2019.
Submission of full papers and poster abstracts – 15th of June, 2019.
Notification of acceptance – 21st of June, 2019.
Camera-ready version – 1st of July, 2019

Richard Hass, Thomas Jefferson University, US
Evangelia Chrysikou, Drexel University, US
Ana-Maria Olteteanu, Freie Universität Berlin, Germany

Program Committee (more to be added soon!)

Aenne Brielmann, New York University
Antonio Lieto, University of Turin
Ashok K. Goel, Georgia Institute of Technology, School of Interactive Computing
Boris Forthmann, University of Münster
Carlos Leon, Complutense University of Madrid
Evangelia Chrysikou, Drexel University
Kai Wang, Kean University
Karolina Rataj, Adam Mickiewicz University
Liane Gabora, University of British Columbia
Richard Hass, Philadelphia University
Sebastien Helie, Purdue University