Empowering Employees
GenAI as a Productivity and Quality Booster for Knowledge Workers
This article not only reveals the immense potential of GenAI to enhance human performance in certain areas but also highlights the challenges and dangers of over-reliance on GenAI in tasks that exceed its current capabilities.
A groundbreaking study conducted by Harvard Business School with the Boston Consulting Group has explored the impact of Generative AI (GenAI), particularly models like GPT-4, on the productivity and quality of management consultants' work. This experiment, involving 758 consultants, revealed a "complexity" frontier of GenAI, where certain tasks are easily accomplished by GenAI, while others, seemingly similar in difficulty, exceed its current capabilities.
Participants were divided into three groups: without GPT-4 access, with access to GPT-4, and with access to GPT-4 plus a prompt engineering overview. The tasks assigned included designing new products and solving business problems, reflecting typical professional activities.
The results showed that GenAI use led to a significant increase in productivity and quality. Consultants using GenAI were on average 12.2% more productive and completed tasks 25.1% faster, while producing results over 40% better in quality compared to the control group. Additionally, consultants significantly benefited from GenAI augmentation, regardless of their initial skill level.
However, for tasks outside this complexity frontier, the results were less promising. A task specifically designed to exceed the capabilities of GenAI showed that consultants using GenAI were less likely to produce correct solutions compared to those not using GenAI. This finding underscores the importance for professionals to understand and skilfully navigate this fluctuating frontier to maximize GenAI benefits while avoiding its pitfalls.
This cutting-edge study sheds light on the intricate and ever-changing landscape of weaving Generative AI (GenAI) into the fabric of knowledge work. Imagine ChatGPT as a BCG junior consultant, boasting an impressive IQ of 147, fluency in over 90 languages, and a vast reservoir of knowledge pulled from millions of books and the expanse of the internet, according to recent findings from Lifearchitect.ai. Its intellectual prowess is beyond doubt.
Yet, despite this formidable intellect, ChatGPT mirrors a bright but green BCG newbie - adept at gathering information but less seasoned in untangling the knots of complex problems. It’s like having a brilliant mind that still needs a guiding hand. To level up, infusing ChatGPT with tailored corporate data could be the game-changer, sharpening its acumen and aligning its capabilities more closely with the real-world corporate milieu it operates in.
By blending ChatGPT's vast intellect with specific knowledge - ranging from intricate accounting standards to the nuances of internal procedures - we stand on the brink of creating the ultimate corporate intellect. This hybrid powerhouse, a fusion of GenAI's broad-spectrum intelligence and the finely-tuned specifics of company lore, could very well emerge as the most knowledgeable and efficient worker any company has ever seen. This isn't just a leap in productivity; it's a bold stride into the future of work.
Discover our other business insights
