O’Reilly Releases 2023 Generative AI in the Enterprise Report

BOSTON, Nov. 21, 2023 — O’Reilly, the premier source for insight-driven learning in technology and business, today released the findings of a global survey of more than 2,800 technology professionals on the realities of generative AI in the enterprise.

Credit: O’Reilly

The Generative AI in the Enterprise report explores how companies use generative AI, the bottlenecks holding back adoption, and the skills gaps that should be addressed to move these technologies forward. The full report is now available for free download.

“Generative AI is a gateway to a new era of opportunity for businesses, with the potential to drive growth, optimize operations, and deliver exceptional customer experiences that set them apart from the competition,” said Mary Treseler, chief content officer at O’Reilly. “But without the proper talent in place to manage it, this rapidly evolving technology can quickly outpace enterprise resources. As this groundbreaking report unveils, we are far from reaching the peak of what generative AI can achieve, and organizations still have time to invest in the critical skills development required to be at the forefront of the AI revolution.”

Generative AI has seen a more rapid adoption than any other technology in recent history. Two-thirds (67%) of those surveyed report that their companies are currently using generative AI, and over a third of this group (38%) report that their companies have been working with AI for less than a year. While some firms like Gartner have proposed that AI might be at the top of its hype cycle, the results of the survey suggest there’s a lot more headroom. As generative AI technology evolves, training models and developing complex applications on top of these models is becoming easier, and many open-source models—leveraged by 16% of those surveyed—require fewer resources to run. Also fueling the rush to adoption are the generations of tooling released within just a single year. Tools that automate complex prompts, tools that allow for archiving and indexing prompts for reuse, and vector databases for document retrieval are more common, helping put generative AI within reach for more organizations.

Despite widespread adoption of generative AI, many companies are still in the early stages. While 18% of respondents report having applications in production, there remain multiple bottlenecks for enterprises looking to implement these technologies. The top constraint respondents cited is identifying appropriate use cases (53%), and the second is a combination of legal issues, risk, and compliance (38%).

Accelerated integration of generative AI has also created a demand for technology workers with the expertise to move efforts along, with AI programming (66%), data analysis (59%), and operations for AI/ML (54%) the most-needed skills. General AI literacy (52%) is also critical, as users have learned when encountering the hallucinations generative AI tools sometimes exhibit.

In terms of risk, O’Reilly asked those whose companies are working with AI what they’re testing for. The top five responses were unexpected outcomes (49%), security vulnerabilities (48%), safety and reliability (46%), fairness, bias, and ethics (46%), and privacy (46%).

Generative AI in Action

O’Reilly’s report found that 54% of AI users believe generative AI tools will lead to greater overall productivity, with only 4% pointing to lower head counts. Where generative AI is currently being used, the survey found that the most common application is programming (77%), using tools like GitHub Copilot or ChatGPT. Data analysis (70%) and customer-facing applications (65%) round out the top three use cases for generative AI in the enterprise right now, with additional nods to the technology’s help in generating marketing (47%) and other forms of copy (56%).

Other key findings include:

• Reflecting the early stages of adoption across organizations, 34% are at the proof-of-concept stage with generative AI. Another 14% are in product development, while 10% are building models. And a remarkable 18% report already having AI applications in production.
• Among respondents, 64% have shifted from using prepackaged generative AI to developing custom applications—representing a significant leap forward that requires investment in people, infrastructure, and skills.
• While it’s not surprising that 23% of respondents are using one of the GPT models, 16% report that their companies are building on top of open source models—demonstrating a vital and active world beyond GPT. LLaMA and Llama 2 (2.4%) and Google Bard (1%) were the least used models.

“The adoption of generative AI is certainly explosive, but if we ignore the risks and hazards of hasty adoption, it is certainly possible we can slide into another AI winter,” said Mike Loukides, vice president of content strategy at O’Reilly and author of the report. “By taking a pragmatic approach versus rushing into production, investing in training and resources, and thinking creatively about how to put AI to work, enterprises have an enormous opportunity in front of them. As the report concludes, ‘AI won’t replace humans, but companies that take advantage of AI will replace companies that don’t.’”

The full survey results are now available for download here.

To learn more about O’Reilly’s AI-focused courses, certifications, and virtual events, visit www.oreilly.com.

About O’Reilly

For over 40 years, O’Reilly has provided technology and business training, knowledge, and insight to help companies succeed. Our unique network of experts and innovators share their knowledge and expertise through the company’s SaaS-based training and learning platform. O’Reilly delivers highly topical and comprehensive technology and business learning solutions to millions of users across enterprise, consumer, and university channels. For more information, visit www.oreilly.com.

Source: O’Reilly