Study: ChatGPT's creativity gap
AI can generate a larger volume of creative ideas than any human, but those ideas are too much alike, according to research newly published in Nature Human Behavior.
Why it matters: AI makers say their tools are "great for brainstorming," but experts find that chatbots produce a more limited range of ideas than a group of humans.
How it works: Study participants were asked to brainstorm product ideas for a toy involving a brick and a fan, using either ChatGPT, their own ideas, or their ideas combined with web searches.
Ninety-four percent of ideas from those who used ChatGPT "shared overlapping concepts."
Participants who used their own ideas with the help of web searches produced the most "unique concepts," meaning a group of one or more ideas that did not overlap with any other ideas in the set.
Researchers used ChatGPT 3.5 and ChatGPT-4 and reported that while ChatGPT-4 is creating more diverse ideas than 3.5, it still falls short ("by a lot") relative to humans.
Case in point: Nine participants using ChatGPT independently named their toy "Build-a-Breeze Castle."
The big picture: Wharton professors Gideon Nave and Christian Terwiesch and Wharton researcher Lennart Meincke found that subjects came up with a broader range of creative ideas when they used their own thoughts and web searches, compared to when they used ChatGPT.
Groups that used ChatGPT tended to converge on similar concepts, reducing overall idea diversity.
"We're not talking about diversity as a DEI type of diversity," Terwiesch told Axios. "We're talking about diversity in terms of the ideas being different from each other....like in biology, we need a diverse ecosystem."
Zoom in: A 2024 study found similar results.
Participants were asked to write short fiction with and without ChatGPT.
Generative AI–enabled stories were found to be more similar to each other than stories by humans.
Yes, but: ChatGPT can be used as part of the brainstorming process. Terwiesch says idea variance comes from using ChatGPT to generate ideas, while also coming up with your own ideas and collecting original ideas from others.
Terwiesch also recommends "chain of thought prompting," which means asking your chatbot to generate several ideas, but also specifically asking the bot to make those ideas different from each other.
"If I just sit back and let ChatGPT do the work, I'm not taking the full advantage of what this tool has to offer. I can do better than that," Terwiesch told Axios.
A spokesperson from OpenAI shared best practices for prompting ChatGPT, advice from writers on how to use the tool and a student's guide to writing with ChatGPT.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Wall Street Journal
37 minutes ago
- Wall Street Journal
Malaysia Probing Reports of Chinese Firm's Use of Nvidia AI Chips
Malaysia said it is looking into media reports that a Chinese company in the country used servers equipped with Nvidia NVDA -0.39%decrease; red down pointing triangle and artificial-intelligence chips to train large language models. The Ministry of Investment, Trade and Industry is 'in the process of verifying the matter with relevant agencies if any domestic law or regulation has been breached,' it said in a statement Wednesday.
Forbes
38 minutes ago
- Forbes
Our New AI-Native Generation
SAN FRANCISCO - SEPTEMBER 20: Getty Images For as long as we humans can remember, we've been obsessed with the concept of youth. Young people are typically faster, stronger, more agile, and more adaptable than their more elderly associates. The fountain of youth was the holy grail of early explorers, and many of us still chase the idea of eternal youth and beauty. However, in the world of vocation and technology, youth was always seen as a disadvantage - until today. There's a new generation of AI-native people – those who grew up coexisting with the technologies that we see rivaling us in terms of work and nearly everything else. What will this AI-native generation be like? Presumably, they will be more capable in terms of technology literacy, and more adaptable to the reality that we're going to be coexisting with intelligent machines. In some surveys of youth, you can get some numbers about how young people feel about AI. For example, in this report from the United Nations Office of Information and Communications Technology titled A Future with AI: Voices of Global Youth Report Launched, authors reveal that two thirds of the AI-native generation trust AI, with 93% favorable about its impact. That, presumably, is not the kind of sentiment that you would get from a room full of Gen-Xers. And then there's this from UNICEF, where a research team asked a third of a million (roughly 330,000) young people about AI, and got some mixed results, with many admitting their unfamiliarity with the tech. On the whole, though, we see quite exuberant responses from many young people who have a positive outlook on the future. Here's more from an interview that I did with Forbes editor Randall Lane starting out the Imagination in Action event this April. We were talking about Forbes's 30 under 30 initiative, and how the magazine stays relevant in a quickly changing world. 'You see a lot of nascent startups, and you see disruptive startups and native-AI companies going from zero to multi-billion(s), and that's great, but … you see every organization saying, 'how do we integrate AI and change what we do?' So we learned. The good part was we eventually figured out you have to stitch these things back together. And Forbes was very successful early, and remains very successful in terms of making the Internet part of the DNA.' Comparing today's advances to the printing press, he said one of the differences is that now, we realize what we're doing. 'It's just so amazing to realize that we're in this moment, and that we all realize we're in that moment,' Lane said. 'Here we are, right now. It's happening so fast, and we know it's happening. We know it's big, and we recognize it in the moment. That's nuts.' As I talked with my friend about how older folks feel, I was reminded of the times when computers were set apart, first with mainframes, and then with the personal computer, which was so new and foreign that it occupied its own space as a household appliance. For sure, we weren't carrying them everywhere in our pockets. As I pointed out during the conversation, in our schools, the computer room was separate. The PCs were not yet integrated into the general curriculum. It sounds strange, now, and will forever be weird to the AI-native generation. Forbes 30 under 30, Lane explained, was initiated 14 years ago, and was, in his words, 'a monster right out of the gate.' Indeed, looking at the numbers, the program, which celebrates young entrepreneurs, is Forbes' most profitable list, with robust sponsorship. 'It was the right time,' he said. 'Youth is valuable now.' Comparing this age to the days when young people had to apprentice for trades, building knowledge and resources slowly, he painted a picture of a new world where someone can drop out of school, start their own business, and be well off by 30. Here's more of what Lane recommended for business: building brands. Using the right tools, and over all, being transparent. 'Change is coming,' he said, stressing the need for innovators to tell an audience about when they are using AI, and when they're not. It was a good conversation, and it goes back to that contrast – between traditional business models, and what we're encountering now. We have never in human history had to co-exist with another set of entities that have the cognitive tools AIs are endowed with. We have to change with the times. So in some ways, this is an appeal to youth – that we have to learn from a younger generation empowered to accept the realities that we live with. It implies some humility on the part of older folks who may feel like the change is coming too quickly. But like Bob Dylan famously said: 'get out of the new road if you can't lend a hand, cause the times they're rapidly changing.'
Forbes
44 minutes ago
- Forbes
Graduating Into Uncertainty: Why Skills-Based Hiring Matters
As organizations continue to face growing skills gaps, HR teams are starting to rethink what a 'qualified' candidate looks like. By Lara Albert, Chief Marketing Officer, SAP SuccessFactors Graduation season is here, and for the Class of 2025, the usual mix of excitement and anticipation comes with an added layer of anxiety. These grads are entering one of the toughest job markets in recent memory, marked by economic uncertainty, hiring slowdowns, and rising competition for junior roles as AI displaces entry-level positions at an accelerated rate. But uncertainty is nothing new for the Class of 2025. These students applied to colleges during a global pandemic, spent formative years learning in hybrid or remote classrooms, and are now witnessing AI reshape the future of work in real time. According to research, of the 57% of seniors who entered college with a 'dream job,' fewer than half have that same goal today, and more than half report feeling pessimistic about starting their careers in the current economy. This wave of uncertainty presents an opportunity for both employers and graduates to adapt. For HR teams, it's a chance to rethink how early talent is identified and supported, shifting the focus from traditional credentials to skills and long-term potential. For graduates, it means continuing to build new skills post-graduation, especially those that AI can't easily replicate, and staying agile in a fast-changing job market. As organizations continue to face growing skills gaps, HR teams are starting to rethink what a 'qualified' candidate looks like. Traditional markers like degrees, GPA, or prior experience don't always reflect someone's true potential and can unintentionally screen out capable candidates, especially those who've followed nontraditional paths. That's why leading organizations today, like Capgemini, Grundfos, Frit Ravich, and SAP are investing to adopt skills-based hiring. By evaluating candidates based on their capabilities—what they can do, not just what they have done—organizations can uncover hidden potential, expand their talent pools, and open doors for candidates who may not follow a conventional path but offer tremendous value. In turn, skills-based hiring helps organizations build a workforce that's resilient and future-ready. In fact, two-thirds (64.8%) of employers surveyed by NACE reported that they already use skills-based hiring practices for new entry-level hires. By focusing less on resumes and more on real-world potential, grads gain a better shot at landing roles where they can grow and thrive, and organizations benefit from employees who can adapt and drive ongoing innovation and business success. A skills-first approach creates a more equitable and effective way to identify talent —highlighting ability over background, and uncovering value both externally and within your existing workforce. Here's how to get started: Rethink job requirements: Start by identifying the core skills needed for success in open roles. Many job listings include degree or experience requirements that may unintentionally exclude qualified candidates. Focus on must-have skills that will drive performance. Use skills-based assessments: Integrate practices like case study exercises or skills assessments into interviews rather than relying solely on candidates' resumes, educational background, or screener interviews. Increase skills visibility: Equip hiring managers with technology that makes it easy to see the skills a candidate has and where they align with organizational needs at scale. This allows for faster and more strategic hiring decisions. If you're graduating this year, don't let uncertainty hold you back. You may be entering a shifting job market, but your resilience, adaptability, and fresh perspectives are skills and qualities employers value. Here are a few ways to stand out: Lead with transferable skills: Communication, critical thinking, adaptability, and collaboration are among the most valued and transferable skills. These skills are in high demand and are often hard for AI to replicate. Show, don't tell: Use internships, job assignments, or volunteer work to demonstrate real world applicability of your skills. Portfolios, personal websites, or even social media content can bring your experience to life and give employers a tangible sense of what you can do. Embrace life-long learning: Learning doesn't stop when you graduate. Show prospective employers you're committed to growth by taking advantage of free or low-cost courses that help you build valuable new skills. Be flexible: Your first job is a steppingstone, but it doesn't define your career path. Stay open to opportunities that help you gain experience, even if they don't perfectly align with your dream job aspirations. This year's graduates are entering a job market in flux, but with the right tools and mindset, both HR teams and early talent can turn uncertainty into opportunity. Discover how SAP SuccessFactors helps organizations adopt skills-based hiring strategies.
