AI Showcase Showdown: Ranking AI Accuracy on Project Management Basics
08 July 2025
BY SCOTT M. GRAFFIUS | ScottGraffius.com
Introduction
On 17 June 2025, Scott M. Graffius assessed multiple artificial intelligence (AI) platforms by testing their performance with the same prompt on fundamental information on project management. Among the AIs evaluated, the Project Management Institute’s (PMI) Infinity AI produced such problematic results that Graffius wrote about the experience with that singular AI. That day, he published “PMI’s Infinity AI Gets the Basics of Team Development Alarmingly and Repeatedly Wrong.”
The Pants-on-Fire Index for AI
The performance of PMI Infinity AI, which repeatedly fabricated facts and got project management basics wrong, stressed the need for a simple way to spotlight the impact of misinformation generated by AI. Based on that, Graffius created the “Pants-on-Fire Index for AI” and wrote about it on 25 June 2025. The index is a satirical yet candid gauge of the frequency and significance of the misrepresentation and fabrication of facts by AI (a phenomenon called AI hallucinations). The index exposes and scores AI’s related errors, holding AI accountable.
The Pants-on-Fire Index for AI ranges from 0 to 10, where 0 represents no issues and 10 indicates total fabrication. The performance of PMI Infinity AI is shown below.
For details on the above, see Graffius’ 17 June 2025 and 25 June 2025 articles.
Audience Response and Expanded Analysis
Complementing the published articles, Graffius also disseminated the material through multiple social media networks. The audience responded.
Reader feedback included inquiries and requests for a comparative analysis. Some respondents suggested that, although PMI Infinity AI performed poorly, it might still be comparable to—or even outperform—other AI tools. To address these perspectives and provide greater clarity, this article presents the results of testing the same prompt across four additional generative AI platforms: OpenAI’s ChatGPT, Google Gemini, Anthropic Claude, and Microsoft Copilot. These findings benchmark PMI Infinity AI’s performance—on project management basics—against other AIs.
PMI Infinity’s Expected vs. Actual Performance
The PMI is widely recognized as the global authority on project management. When the PMI released the Infinity AI tool under its banner, the tool carried an implicit expectation of accuracy—at least on core project management topics. PMI Infinity AI should at least meet the accuracy of PMI’s materials, especially on core topics. Unfortunately, it did not. Specifically, it scored a 9 out of 10 on the Pants-on-Fire Index for AI (where 10 is the worst).
Comparative Results
While the PMI Infinity AI got project management basics wrong (scoring: 9), all four of the other tools got it right (scoring: 0). The report for PMI Infinity AI was shown earlier in this article. Reports for ChatGPT, Gemini, Claude, and Copilot follow.
Here's the one for ChatGPT.
The report for Google Gemini is next.
Here's the report for Claude.
And, finally, here's the report for Microsoft Copilot.
As shown, ChatGPT, Gemini, Claude, and Copilot all got project management basics right; each scored 0 on the Pants-on-Fire Index. For comparison, PMI Infinity AI repeatedly got project management basics wrong; it scored 9 on the Pants-on-Fire Index.
Implications and Cautions
Until significant improvements are made, PMI Infinity AI should be approached with extreme caution—and only exercised if users independently verify its outputs against trusted sources. This evaluation highlights a broader issue: when reputable institutions back AI tools, the stakes are even higher. Accuracy is vital.
Each of the other AIs successfully addressed the prompt on project management basics, while PMI Infinity AI repeatedly ignored or fabricated facts. For professionals who rely on accurate information, such breakdowns represent a failure of trust.
Conclusion
In this AI showcase showdown, ChatGPT, Gemini, Claude, and Copilot were winners. Unfortunately, PMI Infinity AI did not achieve the same status.
This article is shared in the interest of transparency—to support informed decision-making and to encourage the responsible advancement of AI tools for the public good.
If there's an update after this article is published, the information will appear in the Post-Publication Notes section.
More
Continue reading for:
About OpenAI's ChatGPT
ChatGPT is a conversational AI developed by OpenAI, based on the GPT (Generative Pre-trained Transformer) architecture. It is designed to understand and generate human-like text, enabling applications from chatbots to content creation. Since its launch, ChatGPT has been widely adopted for its versatility and ease of use. For more information, visit https://openai.com/chatgpt.
About Google Gemini
Google Gemini is Google’s next-generation large language model and AI system, aiming to combine advanced language understanding with multimodal capabilities like image and video processing. It is part of Google’s broader AI strategy to integrate powerful AI into search, productivity tools, and more. Gemini is positioned to compete with leading AI platforms by enhancing context awareness and reasoning. Learn more at https://ai.google/.
About Anthropic Claude
Claude is an AI assistant created by Anthropic, a company focused on building reliable, interpretable, and steerable AI systems. Claude emphasizes safety and ethical considerations while delivering powerful natural language understanding and generation capabilities. It is designed to assist with a variety of tasks such as summarization, coding help, and conversational engagement. Visit https://www.anthropic.com/ for details.
About Microsoft Copilot
Microsoft Copilot integrates advanced AI capabilities into Microsoft 365 applications like Word, Excel, and Outlook, enabling users to generate text, analyze data, and automate workflows seamlessly. Built on OpenAI’s GPT technology and enhanced with Microsoft’s productivity tools, Copilot aims to boost efficiency and creativity in professional environments. Discover more at https://www.microsoft.com/en-us/microsoft-365/copilot.
About PMI and PMI Infinity
Founded in 1968, the Project Management Institute (PMI) is a globally recognized professional organization dedicated to advancing the practice, science, and profession of project management. It provides resources, certifications, and networking opportunities to empower professionals in managing projects effectively across various industries. Its flagship certifications are widely respected and sought after for demonstrating expertise in project leadership. Through its standards, publications, and global community, PMI fosters best practices and drives innovation in project, program, and portfolio management. Visit https://www.pmi.org to learn more about the PMI.
On January 22, 2024, the PMI announced the launch of PMI Infinity™, marketed as an AI-powered assistant designed for project professionals. It claims to offer smart navigation through "over 14,000 vetted project‑management resources." Although its failure to correctly answer a prompt about project management basics—as delineated in this article—is problematic.
About Scott M. Graffius
Scott M. Graffius is an AI, Agile, and Project Management/PMO leader, researcher, author, and speaker. Along the way, he spearheaded initiatives that have generated over $2.3 billion in impact for organizations across tech, entertainment, finance, healthcare, and beyond. The following sections provide additional information on his experience, contributions, and influence.
Experience
Graffius heads the professional services firm Exceptional PPM and PMO Solutions, along with its subsidiary Exceptional Agility. These consultancies offer strategic and tactical advisory, training, embedded expertise, and consulting services to the public, private, and government sectors. They help organizations enhance their capabilities and results in agile, project management, program management, portfolio management, and PMO leadership, supporting innovation and driving competitive advantage. The consultancies confidently back services with a Delighted Client Guarantee™.
Graffius is a former VP of project management with a publicly traded provider of diverse consumer products and services over the Internet. Before that, he ran and supervised the delivery of projects and programs in public and private organizations with businesses ranging from e-commerce to advanced technology products and services, retail, manufacturing, entertainment, and more.
He has experience with consumer, business, reseller, government, and international markets.
Award-Winning Author
Graffius has authored three books.
International Public Speaker
Organizations worldwide engage Graffius to present on tech (including AI), Agile, project management, program management, portfolio management, and PMO leadership. He crafts and delivers unique and compelling talks and workshops. To date, Graffius has conducted 94 sessions across 25 countries. Select examples of events include Agile Trends Gov, BSides (Newcastle Upon Tyne), Conf42 Quantum Computing, DevDays Europe, DevOps Institute, DevOpsDays (Geneva), Frug’Agile, IEEE, Microsoft, Scottish Summit, Scrum Alliance RSG (Nepal), Techstars, and W Love Games International Video Game Development Conference (Helsinki), and more.
With an average rating of 4.81 (on a scale of 1-5), sessions are highly valued.
The speaker engagement request form is here.
Thought Leadership and Influence
Prominent businesses, professional associations, government agencies, and universities have showcased Graffius and his contributions—spanning his books, talks, workshops, and beyond. Select examples include:
Graffius has played a key role in the Project Management Institute (PMI) in developing professional standards. He was a member of multiple teams that authored, reviewed, and produced:
Additional details are here.
He was also a subject matter expert reviewer of content for the PMI’s Congress. Beyond the PMI, Graffius also served as a member of the review team for two of the Scrum Alliance’s Global Scrum Gatherings.
Acclaimed Authority on Teamwork Tradecraft
Graffius is a renowned authority on teamwork tradecraft. Informed by the research of Bruce W. Tuckman and Mary Ann C. Jensen, over 100 subsequent studies, and Graffius' first-hand professional experience with, and analysis of, team leadership and performance, Graffius created his 'Phases of Team Development' as a unique perspective and visual conveying the five phases of team development. First introduced in 2008 and periodically updated, his work provides a diagnostic and strategic guide for navigating team dynamics. It provides actionable insights for leaders across industries to develop high-performance teams. Its adoption by esteemed organizations such as Yale University, IEEE, Cisco, Microsoft, Ford, Oracle, Broadcom, the U.S. National Park Service, and the Journal of Neurosurgery, among others, highlights its utility and value, solidifying its status as an indispensable resource for elevating team performance and driving organizational excellence.
The 2025 edition of Graffius' "Phases of Team Development" intellectual property is here.
Expert on Temporal Dynamics on Social Media Platforms
Graffius is also an authority on temporal dynamics on social media platforms. His 'Lifespan (Half-Life) of Social Media Posts' research—first published in 2018 and updated annually—delivers a precise quantitative analysis of post longevity across digital platforms, utilizing advanced statistical techniques to determine mean half-life with precision. It establishes a solid empirical base, effectively highlighting the ephemeral nature of content within social media ecosystems. Referenced and applied by leading entities such as the Center for Direct Marketing, Fast Company, GoDaddy, Pinterest Inc., and PNAS, among others, his research exemplifies methodological rigor and sustained significance in the field of digital informatics.
The 2025 edition of Graffius "Lifespan (Half-Life) of Social Media Posts" research is here.
Education and Professional Certifications
Graffius has a bachelor’s degree in psychology with a focus in Human Factors. He holds eight professional certifications:
He is an active member of the Scrum Alliance, the Project Management Institute (PMI), and the Institute of Electrical and Electronics Engineers (IEEE).
Advancing AI, Agile, and Project/PMO Management
Scott M. Graffius continues to advance the fields of AI, Agile, and Project/PMO Management through his leadership, research, writing, and real-world impact. Businesses and other organizations leverage Graffius’ insights to drive their success.
Thought Leader | Public Speaker | Agile Protocol Book | Agile Scrum Book | Agile Transformation Book | Blog | Photo | X | LinkedIn | Email
Here's the answer to the question posed by Oliver: No. To date, the PMI has not responded.
Update on 22 July 2025
Graffius created and released the supplement, Pants-on Fire Index for AI: How It's Calculated. It's shown below.
The formula for the Pants-on Fire Index for AI (abbreviated as PoF) can also be expressed as:
PoF = 10 × ( Σ (eᵢ × sᵢ) ) ÷ ( n × Sₘₐₓ )
Where:
For details, refer to the visual, "Pants-on-Fire Index for AI: How It’s Calculated."
Copyright
Copyright © Scott M. Graffius. All rights reserved.
Content on this site—including text, images, videos, and data—may not be used for training or input into any artificial intelligence, machine learning, or automatized learning systems, or published, broadcast, rewritten, or redistributed without the express written permission of Scott M. Graffius.
Introduction
On 17 June 2025, Scott M. Graffius assessed multiple artificial intelligence (AI) platforms by testing their performance with the same prompt on fundamental information on project management. Among the AIs evaluated, the Project Management Institute’s (PMI) Infinity AI produced such problematic results that Graffius wrote about the experience with that singular AI. That day, he published “PMI’s Infinity AI Gets the Basics of Team Development Alarmingly and Repeatedly Wrong.”
The Pants-on-Fire Index for AI
The performance of PMI Infinity AI, which repeatedly fabricated facts and got project management basics wrong, stressed the need for a simple way to spotlight the impact of misinformation generated by AI. Based on that, Graffius created the “Pants-on-Fire Index for AI” and wrote about it on 25 June 2025. The index is a satirical yet candid gauge of the frequency and significance of the misrepresentation and fabrication of facts by AI (a phenomenon called AI hallucinations). The index exposes and scores AI’s related errors, holding AI accountable.
The Pants-on-Fire Index for AI ranges from 0 to 10, where 0 represents no issues and 10 indicates total fabrication. The performance of PMI Infinity AI is shown below.
For details on the above, see Graffius’ 17 June 2025 and 25 June 2025 articles.
Audience Response and Expanded Analysis
Complementing the published articles, Graffius also disseminated the material through multiple social media networks. The audience responded.
Reader feedback included inquiries and requests for a comparative analysis. Some respondents suggested that, although PMI Infinity AI performed poorly, it might still be comparable to—or even outperform—other AI tools. To address these perspectives and provide greater clarity, this article presents the results of testing the same prompt across four additional generative AI platforms: OpenAI’s ChatGPT, Google Gemini, Anthropic Claude, and Microsoft Copilot. These findings benchmark PMI Infinity AI’s performance—on project management basics—against other AIs.
PMI Infinity’s Expected vs. Actual Performance
The PMI is widely recognized as the global authority on project management. When the PMI released the Infinity AI tool under its banner, the tool carried an implicit expectation of accuracy—at least on core project management topics. PMI Infinity AI should at least meet the accuracy of PMI’s materials, especially on core topics. Unfortunately, it did not. Specifically, it scored a 9 out of 10 on the Pants-on-Fire Index for AI (where 10 is the worst).
Comparative Results
While the PMI Infinity AI got project management basics wrong (scoring: 9), all four of the other tools got it right (scoring: 0). The report for PMI Infinity AI was shown earlier in this article. Reports for ChatGPT, Gemini, Claude, and Copilot follow.
Here's the one for ChatGPT.
The report for Google Gemini is next.
Here's the report for Claude.
And, finally, here's the report for Microsoft Copilot.
As shown, ChatGPT, Gemini, Claude, and Copilot all got project management basics right; each scored 0 on the Pants-on-Fire Index. For comparison, PMI Infinity AI repeatedly got project management basics wrong; it scored 9 on the Pants-on-Fire Index.
Implications and Cautions
Until significant improvements are made, PMI Infinity AI should be approached with extreme caution—and only exercised if users independently verify its outputs against trusted sources. This evaluation highlights a broader issue: when reputable institutions back AI tools, the stakes are even higher. Accuracy is vital.
Each of the other AIs successfully addressed the prompt on project management basics, while PMI Infinity AI repeatedly ignored or fabricated facts. For professionals who rely on accurate information, such breakdowns represent a failure of trust.
Conclusion
In this AI showcase showdown, ChatGPT, Gemini, Claude, and Copilot were winners. Unfortunately, PMI Infinity AI did not achieve the same status.
This article is shared in the interest of transparency—to support informed decision-making and to encourage the responsible advancement of AI tools for the public good.
If there's an update after this article is published, the information will appear in the Post-Publication Notes section.
More
Continue reading for:
- About OpenAI ChatGPT,
- About Google Gemini,
- About Anthropic Claude,
- About Microsoft Copilot,
- About PMI Infinity,
- About Scott M. Graffius,
- How to Cite This Article,
- and more.
About OpenAI's ChatGPT
ChatGPT is a conversational AI developed by OpenAI, based on the GPT (Generative Pre-trained Transformer) architecture. It is designed to understand and generate human-like text, enabling applications from chatbots to content creation. Since its launch, ChatGPT has been widely adopted for its versatility and ease of use. For more information, visit https://openai.com/chatgpt.
About Google Gemini
Google Gemini is Google’s next-generation large language model and AI system, aiming to combine advanced language understanding with multimodal capabilities like image and video processing. It is part of Google’s broader AI strategy to integrate powerful AI into search, productivity tools, and more. Gemini is positioned to compete with leading AI platforms by enhancing context awareness and reasoning. Learn more at https://ai.google/.
About Anthropic Claude
Claude is an AI assistant created by Anthropic, a company focused on building reliable, interpretable, and steerable AI systems. Claude emphasizes safety and ethical considerations while delivering powerful natural language understanding and generation capabilities. It is designed to assist with a variety of tasks such as summarization, coding help, and conversational engagement. Visit https://www.anthropic.com/ for details.
About Microsoft Copilot
Microsoft Copilot integrates advanced AI capabilities into Microsoft 365 applications like Word, Excel, and Outlook, enabling users to generate text, analyze data, and automate workflows seamlessly. Built on OpenAI’s GPT technology and enhanced with Microsoft’s productivity tools, Copilot aims to boost efficiency and creativity in professional environments. Discover more at https://www.microsoft.com/en-us/microsoft-365/copilot.
About PMI and PMI Infinity
Founded in 1968, the Project Management Institute (PMI) is a globally recognized professional organization dedicated to advancing the practice, science, and profession of project management. It provides resources, certifications, and networking opportunities to empower professionals in managing projects effectively across various industries. Its flagship certifications are widely respected and sought after for demonstrating expertise in project leadership. Through its standards, publications, and global community, PMI fosters best practices and drives innovation in project, program, and portfolio management. Visit https://www.pmi.org to learn more about the PMI.
On January 22, 2024, the PMI announced the launch of PMI Infinity™, marketed as an AI-powered assistant designed for project professionals. It claims to offer smart navigation through "over 14,000 vetted project‑management resources." Although its failure to correctly answer a prompt about project management basics—as delineated in this article—is problematic.
About Scott M. Graffius
Scott M. Graffius is an AI, Agile, and Project Management/PMO leader, researcher, author, and speaker. Along the way, he spearheaded initiatives that have generated over $2.3 billion in impact for organizations across tech, entertainment, finance, healthcare, and beyond. The following sections provide additional information on his experience, contributions, and influence.
Experience
Graffius heads the professional services firm Exceptional PPM and PMO Solutions, along with its subsidiary Exceptional Agility. These consultancies offer strategic and tactical advisory, training, embedded expertise, and consulting services to the public, private, and government sectors. They help organizations enhance their capabilities and results in agile, project management, program management, portfolio management, and PMO leadership, supporting innovation and driving competitive advantage. The consultancies confidently back services with a Delighted Client Guarantee™.
Graffius is a former VP of project management with a publicly traded provider of diverse consumer products and services over the Internet. Before that, he ran and supervised the delivery of projects and programs in public and private organizations with businesses ranging from e-commerce to advanced technology products and services, retail, manufacturing, entertainment, and more.
He has experience with consumer, business, reseller, government, and international markets.
Award-Winning Author
Graffius has authored three books.
- Agile Scrum: Your Quick Start Guide with Step-by-Step Instructions, his first book, earned 17 awards.
- Agile Transformation: A Brief Story of How an Entertainment Company Developed New Capabilities and Unlocked Business Agility to Thrive in an Era of Rapid Change, his second book, was named one of the best Scrum books of all time by BookAuthority.
- Agile Protocol: The Transformation Ultimatum, his third book and his first work of fiction, was released in April 2025. The book trailer is on YouTube.
International Public Speaker
Organizations worldwide engage Graffius to present on tech (including AI), Agile, project management, program management, portfolio management, and PMO leadership. He crafts and delivers unique and compelling talks and workshops. To date, Graffius has conducted 94 sessions across 25 countries. Select examples of events include Agile Trends Gov, BSides (Newcastle Upon Tyne), Conf42 Quantum Computing, DevDays Europe, DevOps Institute, DevOpsDays (Geneva), Frug’Agile, IEEE, Microsoft, Scottish Summit, Scrum Alliance RSG (Nepal), Techstars, and W Love Games International Video Game Development Conference (Helsinki), and more.
With an average rating of 4.81 (on a scale of 1-5), sessions are highly valued.
The speaker engagement request form is here.
Thought Leadership and Influence
Prominent businesses, professional associations, government agencies, and universities have showcased Graffius and his contributions—spanning his books, talks, workshops, and beyond. Select examples include:
- Adobe,
- American Management Association,
- Amsterdam Public Health Research Institute,
- Bayer,
- BMC Software,
- Boston University,
- Broadcom,
- Cisco,
- Coburg University of Applied Sciences and Arts - Germany,
- Computer Weekly,
- Constructor University - Germany,
- Data Governance Success,
- Deimos Aerospace,
- DevOps Institute,
- Dropbox,
- EU's European Commission,
- Ford Motor Company,
- Gartner,
- GoDaddy,
- Harvard Medical School,
- Hasso Plattner Institute - Germany,
- IEEE,
- Innovation Project Management,
- Johns Hopkins University,
- Journal of Neurosurgery,
- Lam Research (Semiconductors),
- Leadership Worthy,
- Life Sciences Trainers and Educators Network,
- London South Bank University,
- Microsoft,
- NASSCOM,
- National Academy of Sciences,
- New Zealand Government,
- Oracle,
- Pinterest Inc.,
- Project Management Institute,
- Mary Raum (Professor of National Security Affairs, United States Naval War College),
- SANS Institute,
- SBG Neumark - Germany,
- Singapore Institute of Technology,
- Torrens University - Australia,
- TBS Switzerland,
- Tufts University,
- UC San Diego,
- UK Sports Institute,
- University of Galway - Ireland,
- US Department of Energy,
- US National Park Service,
- US Soccer,
- US Tennis Association,
- Verizon,
- Wrike,
- Yale University,
- and many others.
Graffius has played a key role in the Project Management Institute (PMI) in developing professional standards. He was a member of multiple teams that authored, reviewed, and produced:
- Practice Standard for Work Breakdown Structures—Second Edition.
- A Guide to the Project Management Body of Knowledge—Sixth Edition.
- The Standard for Program Management—Fourth Edition.
- The Practice Standard for Project Estimating—Second Edition.
Additional details are here.
He was also a subject matter expert reviewer of content for the PMI’s Congress. Beyond the PMI, Graffius also served as a member of the review team for two of the Scrum Alliance’s Global Scrum Gatherings.
Acclaimed Authority on Teamwork Tradecraft
Graffius is a renowned authority on teamwork tradecraft. Informed by the research of Bruce W. Tuckman and Mary Ann C. Jensen, over 100 subsequent studies, and Graffius' first-hand professional experience with, and analysis of, team leadership and performance, Graffius created his 'Phases of Team Development' as a unique perspective and visual conveying the five phases of team development. First introduced in 2008 and periodically updated, his work provides a diagnostic and strategic guide for navigating team dynamics. It provides actionable insights for leaders across industries to develop high-performance teams. Its adoption by esteemed organizations such as Yale University, IEEE, Cisco, Microsoft, Ford, Oracle, Broadcom, the U.S. National Park Service, and the Journal of Neurosurgery, among others, highlights its utility and value, solidifying its status as an indispensable resource for elevating team performance and driving organizational excellence.
The 2025 edition of Graffius' "Phases of Team Development" intellectual property is here.
Expert on Temporal Dynamics on Social Media Platforms
Graffius is also an authority on temporal dynamics on social media platforms. His 'Lifespan (Half-Life) of Social Media Posts' research—first published in 2018 and updated annually—delivers a precise quantitative analysis of post longevity across digital platforms, utilizing advanced statistical techniques to determine mean half-life with precision. It establishes a solid empirical base, effectively highlighting the ephemeral nature of content within social media ecosystems. Referenced and applied by leading entities such as the Center for Direct Marketing, Fast Company, GoDaddy, Pinterest Inc., and PNAS, among others, his research exemplifies methodological rigor and sustained significance in the field of digital informatics.
The 2025 edition of Graffius "Lifespan (Half-Life) of Social Media Posts" research is here.
Education and Professional Certifications
Graffius has a bachelor’s degree in psychology with a focus in Human Factors. He holds eight professional certifications:
- Certified SAFe 6 Agilist (SA),
- Certified Scrum Professional - ScrumMaster (CSP-SM),
- Certified Scrum Professional - Product Owner (CSP-PO),
- Certified ScrumMaster (CSM),
- Certified Scrum Product Owner (CSPO),
- Project Management Professional (PMP),
- Lean Six Sigma Green Belt (LSSGB), and
- IT Service Management Foundation (ITIL).
He is an active member of the Scrum Alliance, the Project Management Institute (PMI), and the Institute of Electrical and Electronics Engineers (IEEE).
Advancing AI, Agile, and Project/PMO Management
Scott M. Graffius continues to advance the fields of AI, Agile, and Project/PMO Management through his leadership, research, writing, and real-world impact. Businesses and other organizations leverage Graffius’ insights to drive their success.
Thought Leader | Public Speaker | Agile Protocol Book | Agile Scrum Book | Agile Transformation Book | Blog | Photo | X | LinkedIn | Email
Sign up for Miro—it's free!
(Want more features? You can always upgrade to a paid plan.)
How to Cite This Article
Graffius, Scott M. (2025, July 8). AI Showcase Showdown: Ranking AI Accuracy on Project Management Basics. Available at: https://scottgraffius.com/blog/files/ai-showcase-showdown-ranking-ai-accuracy-on-project-management-basics.html. 
Digital Object Identifier (DOI)
DOI: (coming soon)
Content Acknowledgements
All names, marks, and content are the property of their respective owners.
ChatGPT name, mark, and content are the property of OpenAI, L.L.C.
Google and Google Gemini names, marks, and content are the property of Alphabet Inc.
Anthropic and Anthropic Claude names, marks, and content are the property of Anthropic Public-Benefit Corporation (PBC).
Microsoft and Microsoft Copilot names, marks, and content are the property of Microsoft Corporation.
PMI and PMI Infinity names, marks, and content are the property of the Project Management Institute, Inc.
"Pants-on-Fire Index for AI" is copyright © Scott M. Graffius. All rights reserved.
Top 5 Hashtags
#ArtificialIntelligence
#AI
#ProjectManagement
#ProjectManagers
#PMIInfinity
Post-Publication Notes
If there are any supplements or updates to this article after the date of publication, they will appear here.
Supplement on 8 July 2025
[Unsolicited feedback received a few hours after the article was published; feedback reproduced with permission, with personal details omitted]
Mr. Graffius,
You seem to take your readers’ feedback seriously, so here’s my review of your AI Showcase Showdown article, prioritising what I found particularly engaging and distinctive.
The piece is compelling. What stood out as original and valuable was your introduction of the Pants-on-Fire Index for AI, which I found to be a witty and memorable device for quantifying a growing concern that, until now, has lacked a straightforward metric. The name keeps it accessible, while still addressing the serious issue of AI misinformation.
What surprised me most was the stark disparity in performance uncovered in the comparative analysis. It’s quite striking that PMI Infinity AI, offered by the very organisation regarded as the worldwide authority on project management, fared so poorly on fundamental concepts, particularly when all four competitors (ChatGPT, Gemini, Claude, and Copilot) managed the same prompt without issue. It creates a fascinating paradox: the AI tool backed by the most authoritative body in the field turns out to be the weakest performer.
Methodologically, for a non-scientific paper, I found your approach thoughtful and robust. Rather than singling out PMI Infinity for criticism, you broadened the scope to include data on other AI platforms under identical conditions. That comparative angle adds important context and avoids the appearance of an unfair or isolated critique.
The article also raises significant questions about institutional credibility and the responsibilities that come with it. When a respected body such as PMI puts its name behind an AI tool, users are naturally inclined to expect a higher standard of reliability, which makes its underperformance all the more concerning.
Your writing strikes a commendable balance between professional rigour and approachability, making complex AI evaluation concepts digestible for practitioners who rely on this information to choose their tools wisely.
It would have been interesting to note whether PMI had liaised with you regarding their Infinity. If they had, it might suggest a receptiveness to constructive input and a pledge to improvement.
Yours sincerely,
Oliver H.
—————
Scott M. Graffius delineated and shared findings on PMI Infinity via:
- Article published on 17 June 2025;
- Feedback provided to PMI via their provide feedback mechanism — this is detailed in the Post-Publication Notes section of the 17 June 2025 article;
- Posts on social media, which included, as noted in the Post-Publication Notes section of the 17 June 2025 article, a post on LinkedIn where Graffius tagged the PMI and the CEO of the PMI;
- Article published on 25 June 2025;
- This 8 July 2025 article.
Here's the answer to the question posed by Oliver: No. To date, the PMI has not responded.
Update on 22 July 2025
Graffius created and released the supplement, Pants-on Fire Index for AI: How It's Calculated. It's shown below.
The formula for the Pants-on Fire Index for AI (abbreviated as PoF) can also be expressed as:
PoF = 10 × ( Σ (eᵢ × sᵢ) ) ÷ ( n × Sₘₐₓ )
Where:
- n = total number of assertions
- eᵢ = error indicator flag of 0 if assertion i is true, 1 if false
- sᵢ = severity of false claim (1 to Sₘₐₓ, where higher = worse)
- Sₘₐₓ = maximum possible severity (value of 10)
For details, refer to the visual, "Pants-on-Fire Index for AI: How It’s Calculated."
Copyright
Copyright © Scott M. Graffius. All rights reserved.
Content on this site—including text, images, videos, and data—may not be used for training or input into any artificial intelligence, machine learning, or automatized learning systems, or published, broadcast, rewritten, or redistributed without the express written permission of Scott M. Graffius.