AI Surpasses Average Humans in Creativity Contest, Study Reveals

A comprehensive study has revealed that advanced generative AI systems can outperform average human creativity on specific tasks. Conducted by a team led by Professor Karim Jerbi from the Université de Montréal, the research involved over 100,000 human participants and assessed the capabilities of leading AI models like GPT-4.

The findings indicate a significant milestone in the field of artificial intelligence. Certain AI systems demonstrated superior performance on tasks designed to gauge original thinking and idea generation, surpassing the average human score on these assessments. While AI has made impressive strides, the most creative individuals consistently outshine AI, particularly in complex creative endeavors such as poetry and storytelling.

Measuring Creativity: Humans vs. AI

To ensure a fair evaluation of creativity, researchers employed the Divergent Association Task (DAT), a psychological test widely recognized for assessing divergent thinking. This test measures the ability to generate diverse and original ideas from a single prompt. Participants were asked to list nouns that are as unrelated in meaning as possible, showcasing their capacity for creative thought.

According to the study, “Our study shows that some AI systems based on large language models can now outperform average human creativity on well-defined tasks,” explained Professor Jerbi in the research brief. Despite these advancements, he emphasized that even the best AI systems still lag behind the creativity levels achieved by the top 10% of human creators.

Extending AI Creativity Beyond Basic Tasks

The research progressed to evaluate whether AI’s success on simple word association tasks could translate to more intricate creative activities. The team compared AI systems and human participants in creative writing challenges, including composing haikus, writing movie plot summaries, and producing short stories.

Results showed a consistent trend: while AI sometimes outperformed average humans, the most skilled human creators delivered work that was not only stronger but also more original. This disparity highlights the unique qualities of human creativity that remain difficult for AI to replicate.

Another intriguing aspect of the study examined whether AI creativity is fixed or adjustable. The research revealed that AI creativity could indeed be influenced by modifying technical settings, particularly the model’s temperature. Lower temperature settings lead to predictable outputs, while higher settings encourage more varied and exploratory responses. This flexibility suggests that human input is crucial in shaping AI creativity, making the interaction between human prompts and AI responses a central component of the creative process.

AI as a Creative Assistant, Not a Replacement

The implications of this research challenge concerns about artificial intelligence replacing creative professionals. While AI can match or exceed average human creativity on certain tasks, its limitations remain clear, and it continues to rely on human guidance.

“Even though AI can now reach human-level creativity on certain tests, we need to move beyond this misleading sense of competition,” stated Professor Jerbi. He posits that generative AI has become a powerful tool to enhance human creativity rather than a replacement for it.

The findings suggest a future where AI serves as a creative assistant, amplifying human imagination and opening new avenues for exploration. The study appears in the journal Scientific Reports, titled “Divergent creativity in humans and large language models.”

As AI continues to evolve, its role in the creative landscape may transform how individuals approach artistic endeavors, emphasizing collaboration between human creators and advanced technology.