Generative AI Adoption in the Workplace: Barriers and Future State

Artificial Intelligence (AI) is transforming the workplace at an unprecedented pace. Along with this rapid evolution comes challenges that many organizations and employees need to prepare for.

Generative AI in particular offers potential efficiency gains at work, while raising questions about its integration and ethical use. In a survey of IT leaders, 86% said they “expect generative AI to play a prominent role at their organizations in the near future.”

MIT xPRO’s new course, Generative AI Playbook: Tools, Real-World Applications, and Governance, is designed to help professionals understand the potential of AI and learn how to leverage its capabilities.

The Differences between Traditional AI and Generative AI 

Traditional AI has been a powerful tool for tasks like prediction and classification, and generative AI pushes the boundaries even further. 

By identifying patterns in its training data, generative AI can produce entirely new content: text, images, or even videos. Its strength lies in creating, not just analyzing or predicting. 

Generative AI has made AI accessible to the broader public in a way that traditional AI never did. As Luke Hobson, Assistant Director, Instructional Design, MIT xPRO, notes, “Generative AI has been the gateway for many people to finally engage with AI.” Tools like ChatGPT and DALL-E have sparked a wave of creativity, and in a study by Gallup, 13% of employees report using AI daily.

Hobson points out that chatbots like AOL Instant Messenger’s SmarterChild were early precursors, a reminder that AI tools aren’t entirely new, even if today's LLMs are far more sophisticated and capable of nuanced responses.

As Antonio Torralba, one of the generative AI course instructors, puts it, “The leap in the last few years has been surprising,” highlighting just how advanced—and accessible—AI has become. As a result, many organizations and their employees are trying to understand how to drive  adoption of generative ai in the workplace, and are facing barriers, most of which are organizational in nature vs. technical. 

Challenges to Adopting Generative AI in the Workplace 

Despite the promises of generative AI, integrating it into the workplace is no simple task. Here's a closer look at the most pressing hurdles in adopting this technology effectively.

1. Inability to use generative AI to its fullest potential 

Many people still don’t know how to maximize AI’s capabilities. In one survey, 64% of executives reported feeling “a high sense of urgency to adopt generative AI,” but over half of those respondents admitted that their organization lacks “the most critical skills.” 

One of those skills is prompt engineering. Without it, users often generate subpar results, get frustrated, and conclude the tool isn't effective, when really the prompt was too vague. Building a prompt library can help drive generative AI adoption across a team.

Hobson explains that MIT xPRO’s generative AI course teaches prompt engineering and provides opportunities to apply knowledge directly to employees' work. “In Module 3 on large language models, learners go through exercises that cover appropriate levels of detail in prompts, which is a key part of effective use,” he says.

2. Difficulty evaluating and interpreting AI outputs 

Writing good prompts is just the start, and users also need to critically evaluate the outputs they receive. Hobson warns, “These models are designed to make users happy, so they may produce things like fake citations if the information doesn’t exist.” He points to a well-known case where a lawyer submitted fake case references from ChatGPT in court.

Torralba adds, “If you don’t understand how [a tool] works, it’s easy to misinterpret its output. When you use Google, you get links written by humans. But with generative AI, the responses are machine-generated. The fact that it sounds true doesn’t make it true. You have to know how to interpret the output, and that comes from understanding how the model works.”

3. The rapid pace of change 

New tools and capabilities are emerging at an overwhelming pace, and staying on top of the latest developments is crucial.

However, as Torralba notes, "While the technology evolves quickly, that doesn’t mean all jobs are impacted right away.” Many workers have time to learn how to effectively use these tools before the next wave hits, allowing them to gradually integrate AI into their roles.

4. Unrealistic expectations from management 

Many managers approach generative AI with sky-high expectations to improve productivity overnight. 

Torralba explains, "It’s not well understood what AI can really do in many jobs. In marketing, for example, AI can assist with the creative process, but it can’t replace humans. If you rely too much on AI-generated content, all companies will end up with the same marketing campaigns. Humans need to be part of the process to extract value from these tools. AI doesn’t do the job for you; it helps you do your job better.” 

Hobson compares this to early hype around Google or Ask Jeeves: "AI is just another tool to incorporate into your work," he says, stressing that while it can improve efficiency, it’s not a magic fix. Gains take time: workers need training, employers need to support the learning curve, and results follow only after that.

MIT xPRO's course gives workers a realistic sense of AI's capabilities and limits so they can manage expectations accordingly.

5. Intensified competition in the job market 

The rapid integration of generative AI is transforming the job market. Ignoring or banning AI isn’t a viable option. “It’s here to stay,” Hobson emphasizes, underscoring the importance of learning to work with this technology rather than avoiding it.

AI proficiency is quickly becoming a sought-after skill in certain fields. As Luke Hobson points out, “Hiring managers [in fields like instructional design] are increasingly asking about candidates' knowledge of AI. They’re trying to figure it out for their own organizations.” Being skilled in AI tools can provide a major competitive edge for job applicants.

6. Ethical dilemmas

As generative AI becomes more embedded in the workforce, ethical dilemmas arise. These include increased risk of bias, challenges in distinguishing fact from fiction, and even data privacy violations.

"AI systems are trained on data, which can raise copyright or privacy concerns depending on the source of the data," warns Torralba.  Privacy issues are especially problematic when employees use unrestricted LLMs, as these systems can unintentionally reveal sensitive information. “Current technology isn’t robust enough to guarantee that won’t happen,” Torralba cautions.

Real-world incidents highlight the severity of these risks. Hobson shares the story of Samsung employees uploading financial records to ChatGPT, resulting in a data leak and a subsequent ban on generative AI. Another case involved Taylor & Francis selling data from academic journals to Microsoft for AI training, sparking backlash. These incidents underscore the ongoing need to navigate ethical concerns carefully as AI technology continues to evolve. As a result, organizations need to set company rules so teams know what they can and cannot share with AI tools. 

In summary, to effectively drive generative AI adoption in the workplace, employers need to:

• Recognize that adoption of generative AI is first and foremost an organizational and human challenge, vs. a technical one. With that, the solution lies in proper training and organizational support. 

• Focus on outcomes and business problems instead of immediately responding to pressure to adopt tools and models without a clear vision. 
• Identify top priorities for measuring success (e.g. around productivity or revenue growth) to effectively on what ROI looks like at an organizational level. 

MIT xPRO’s Generative AI Course Addresses These Challenges Head-On

MIT xPRO’s generative AI course is designed to equip learners with the essential skills to navigate the evolving and complex landscape of AI in the workplace. 

Rather than simply providing answers, the course focuses on teaching learners how to ask the right questions. As Torralba explains: "The answers will vary by domain and change over time." This approach ensures that participants can adapt to AI’s rapid advancements and apply the technology thoughtfully in their respective fields.

A key feature of the course is its hands-on, interactive approach. Learners engage directly with AI tools and platforms, gaining practical experience in real-world scenarios. The course covers key skills such as prompt engineering, helping learners craft detailed and precise prompts to maximize AI’s potential. It also emphasizes the importance of critical thinking, teaching participants how to assess AI outputs—whether it's spotting bias or fact-checking generated content.

Ethical concerns, from privacy issues to data handling, are thoroughly explored, giving learners the knowledge to responsibly navigate the risks that come with AI. By focusing on the capabilities and limitations of AI, the course ensures that participants can manage expectations and make informed decisions as they integrate AI into their work.

Ultimately, the course provides a holistic framework, blending tangible technical skills with a deeper understanding of AI’s ethical and practical implications to prepare learners for the future of AI in the workforce. 

To learn more about what the generative AI course has to offer, check out the course page.