AI in Organizations

A content deep-dive on AI, leadership transformation, and organizational change

 

“In 1879, Edison famously demonstrated the electric light bulb. Yet twenty years later, only 3 percent of households had electricity. After another two decades, that number accelerated to half the population. For electricity, these forty years were 'The Between Times'. We are now in The Between Times for AI – between the demonstration of the technology’s capability and the realization of its promise.”

Ajay Agrawal, Joshua Gans, Avi Goldfarb: Power and Prediction (2022b, pp. 3-4)


 


 ''The reality is that we are already living in the early days of the AI Age, and we need to make some very important decisions about what that actually means.[…] Many people in organizations will play a role in shaping what AI means – but to make those choices matter, serious discussions need to start in many places, and soon. We can’t wait for decisions to be made for us, and the world is advancing too fast to remain passive.''

Ethan Mollick: Co-Intelligence (2024, pp. 32, 210)


Understanding AI and The Between Times

In 1956, John McCarthy and his colleagues coin the term Artificial Intelligence: “to make machines use language, form abstractions and concepts, solve kinds of problems now reserved for humans, and improve themselves” and that “the artificial intelligence problem is taken to be that of making a machine behave in ways that would be called intelligent if a human were so behaving” (McCarthy et al., 1955, pp. 2, 13).

Today, we talk about AI with four different, more detailed approaches (Norvik & Russell, 2021): 

AI implies that machines …

  • …act humanly, for example through natural language processing, knowledge representation, reasoning, computer vision, or robotics
  • …think humanly, by representing of cognitive functions
  • …think rationally, building on logics and processes beyond human capabilities
  • …act rationally, the most commonly used definition, perceiving the environment, adapting to change, and pursuing goals to achieve the best possible outcome


Achieving such intelligence, at the level of humans or beyond, requires machines to obtain and manage vast amounts of data. The approaches and capabilities in data handling are what differentiate the types of AI.


Distinction 1: Rule-based vs Machine Learning


 



The first distinction is between systems that rely on static, pre-determined rules, and those that are capable of adaptation and improvement over time.

  • Rule-Based AI: Early systems, operating on pre-defined logics. Useful and efficient in handling well-defined tasks, but limited in complex and dynamic scenarios
  • Machine Learning: Modern systems with self-improving algorithms, improving results with new training data. Includes various types of algorithms such as deep learning neural networks

A second distinction is by way of versatility in changing domains and the respective performance


Distinction 2: Types of AI Applications


Narrow AI: Designed for specific tasks with clear instructions and given training data. Uses ML algorithms to perform tasks efficiently and improve over time. Implemented via supervised, unsupervised, and reinforcement learning, using various algorithm types from decision trees to neural networks

  • Generative AI (genAI): The latest frontier and most prominent trend in AI, focused on creating new content based on large input datasets. GenAI tools scan the internet, generate text, images, or code, opening new possibilities for content creation and problem-solving
  • Artificial General Intelligence (AGI): The ultimate goal of AI development, not yet achievable. AGI could address complex, universal problems, matching or surpassing human intelligence across a wide range of tasks and domains.






Decision-making with AI: The Role of Prediction and Judgment


At its core, AI is a prediction technology. Using input and training data, AI predicts the future and recommends outcomes or actions. For organizations, this predictive power can be applied in countless ways, such as strategic decision-making, expert analysis, or creating new content with sequences of words or numbers.

AI makes prediction more accessible and cost-effective, decreasing the value of human prediction. However, a second core element in the process of decision-making is equally important: Judgment! Human judgment remains crucial for interpreting and evaluating AI insights and making complex decisions. As the cost of prediction decreases with AI, it increases the value of human judgement, especially around an organizations values, long-term strategy, or societal morals. (Agrawal, Gans, Goldfarb: Prediction Machines)
AI can provide data, but humans need to make the final call, especially in high-stakes or ethically complex situations.

  • For simple, repetitive decisions: AI can automate tasks entirely, requiring minimal human intervention and judgement
  • For high-stakes, complex decisions: AI serves as an augmenting tool, supporting human expertise by providing fast prediction to complement the essential human judgement.



Envisioning New Organizational Systems


For some organizations, AI may upend their industry or significantly shift the product and services they are providing. For these organizations, AI affects the organizational core; the source of their competitive advantage

For these “shift towards AI” organizations, AI is a catalyst for fundamental transformation, it creates new business models and promises to upend industries. Creating AI solutions tailored to their specific requirements is essential and will become the new core of their business.





For other organizations, their competitive advantage may not be as directly affected by AI. For them, AI might be relevant for the organizational periphery, outside the source of their competitive advantage, as a tool promising efficiency and optimization, streamlining processes and enhancing effectiveness. For “work with AI” organizations, making use of AI efficiently is important. Here, buying and integrating plug-and-play solutions is often the best path forward.


Identifying where your organization lies is the first step towards an AI vision. But: The same fundamentals apply, to let you get the most out of AI:

  • Prepare for Disruption: AI has the capacity to alter competitive dynamics and disrupt industries in ways we can't always predict. Being open to change and willing to adapt is crucial – rethink assumptions about how your business operates and questioning your role in the ecosystem
  • Adopt a Systems Mindset: Rather than as a series of isolated tools, consider AI’s potential to transform systems of processes. Turn static rules into dynamic decisions with cheap prediction and then transform systems of tasks with suitable structures, goals, and human oversight



Effective Implementation: Balancing Centralization and Decentralization


Given the dynamic nature of AI, continuous adaptation is essential. Organizations must adjust their structures as AI capabilities evolve, understand the variables at play, and connect the roles of judgement and prediction to overarching economic and ethical goals.

In the long term, AI solutions rely on specific domain knowledge and must be owned by subject-matter experts. Unlike other software, ML tools evolve and their results may change over time. In the short term, central initiatives are often required to bundle expertise, provide budgets, and drive the implementation process.


Successful AI implementation thus requires a delicate balance between centralized strategy and decentralized execution, adjusting over time (Huber & Reetz, 2023):

  • Central Initiation: Strategic leaders define the long-term vision, allocate resources, and oversee initial development. Central initiatives provide resources, and governance.
  • Experimentation: Individual use cases appear throughout the organization, as departments experiment. Central forces encourage this build-up of skill and experience, but maintain transparency.
  • Standardized Structure and Control: With growing interest, Centers of Excellence consolidate expertise and implement standardized operating procedures. CoEs encourage risk-taking, provide funding, but also establish control to maintain efficiency through synergies.
  • Integrating Decentralized Responsibility and Expertise: In the long-term, subject-matter experts should own their AI applications, requiring a hand-over of control to departments. Owners of datasets and tools are responsible for up-to-date structures and human expertise in the loop, ensures that judgment is not sacrificed for efficiency through prediction.




Sources:

Agrawal, A., Gans, J., & Goldfarb, A. (2022a). Power and Prediction - The Disruptive Economics of Artificial Intelligence. Boston, MA: Harvard Business Review Press.

Agrawal, A., Gans, J., & Goldfarb, A. (2022b). Prediction Machines - The Simple Economics of Artificial Intelligence. Boston, MA: Harvard Business Review Press.

Dell'Acqua, F., McFowland, E., Mollick, E. R., Lifshitz-Assaf, H., Kellogg, K., Rajendran, S., Krayer, L., Candelon, F., & Lakhani, K. R. (2023). Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of AI on Knowledge Worker Productivity and Quality Harvard Business School Technology & Operations Mgt. Unit Working Paper No. 24-013. Retrieved 17 Feb 2025, from https://ssrn.com/abstract=4573321 

Huber, D. M., & Alexy, O. (2024). The Impact of Artificial Intelligence on Strategic Leadership. In Z. Simsek, C. Heavey, & B. Fox (Eds.), Handbook of Research on Strategic Leadership in the Fourth Industrial Revolution. Cheltenham, UK and Northampton, MA: Edward Elgar Publishing. https://doi.org/10.4337/9781802208818.00012 

Huber, D. M., & Reetz, D. K. (2024, 1 Mar 2024). Organizing for AI - Multiple Goals, Structural Dynamics, and the Introduction of a General Purpose Technology. Organization Science Winter Conference, Zurich.

Iansiti, M., & Lakhani, K. R. (2020). Competing in the age of AI: Strategy and leadership when algorithms and networks run the world. Boston, MA: Harvard Business Review Press.

Iansiti, M., & Nadella, S. (2022). Democratizing Transformation. Harvard Business Review, May-June(2022). Retrieved 17 Feb 2025, from https://hbr.org/2022/05/democratizing-transformation 

Kiron, D., & Schrage, M. (2019). Strategy for and with AI. MIT Sloan Management Review, 60(4), 29-36. Retrieved 17 Feb 2025, from https://sloanreview.mit.edu/article/strategy-for-and-with-ai/ 

McCarthy, J., Minsky, M. L., Rochester, N., & Shannon, C. E. (1955). A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence. Stanford Engineering. Retrieved 17 Feb 2025, from http://jmc.stanford.edu/articles/dartmouth/dartmouth.pdf 

Mollick, E. (2024). Co-Intelligence. London: WH Allen.

Norvik, P., & Russell, S. (2021). Artificial Intelligence: A Modern Approach (4th Global ed.). London: Pearson Education Ltd.


Mail
LinkedIn