Compound Security, Unlocked
Compound Security, Unlocked
The Illusion of Control ...
0:00
-19:46

The Illusion of Control ...

AI, War, and the Erosion of Human Judgment.

By Isaiah (Ike) Wilson III


Author Bio:

Isaiah (Ike) Wilson III (PhD) is a Professor of Practice at Arizona State University and the Founder and CEO of Wilson W.i.S.E. Consulting LLC. A retired U.S. Army Colonel and former senior civilian executive in the Department of Defense, he has served in senior strategic and operational roles at U.S. Central Command and U.S. Special Operations Command. His work focuses on compound security, strategic adaptation, and the evolving character of war in complex systems.


The Illusion of Control: AI, War, and the Erosion of Human Judgment

For much of modern military history, technological innovation has been understood as a means of enhancing control. From precision-guided munitions to network-centric warfare, each successive wave of capability promised greater clarity, faster decision-making, and more decisive outcomes.

Artificial intelligence is the latest—and perhaps most consequential—iteration of this logic.

But AI is not simply another tool in the arsenal. It is reshaping the architecture of decision-making itself. And in doing so, it is quietly eroding the very foundation upon which military command has long rested: human judgment under conditions of uncertainty.

The danger is not that machines will replace humans in war. It is that humans, believing themselves still in control, will increasingly defer to systems they do not fully understand.

From Decision Support to Decision Influence

The integration of AI into military operations did not arrive with fanfare. It emerged incrementally—through increasingly sophisticated intelligence, surveillance, and reconnaissance (ISR) systems; predictive analytics; and targeting support tools.

Initially, these systems were framed as enhancements: they would process more data, identify patterns faster, and reduce human error.

In practice, however, AI has shifted from supporting decisions to shaping them.

In Iraq and Afghanistan, early forms of algorithmic targeting and pattern-of-life analysis began influencing how operators prioritized threats.

By the time of operations against ISIS, decision cycles were already being compressed by machine-assisted analysis. In more recent conflicts—most notably in Ukraine—AI-enabled systems have accelerated this trend dramatically. Drone swarms, real-time targeting feeds, and automated analytics now shape not only what commanders see, but what they consider actionable.

The effect is subtle but profound.

AI does not simply provide answers; it frames the question set. It determines which signals are visible, which risks are foregrounded, and which options appear viable.

In this sense, it operates not at the point of decision, but upstream—at the level of perception itself.

Speed, Scale, and the Compression of Judgment

The primary advantage of AI in warfare is not intelligence in the human sense. It is speed and scale.

AI systems can process vast datasets, identify correlations, and generate outputs at a tempo no human can match. This creates a powerful incentive structure: decisions must keep pace with the system.

Over time, this leads to what might be called decision compression—a shrinking window for deliberation, reflection, and dissent.

This dynamic is already visible in contemporary battlefields. In Ukraine, the proliferation of AI-enabled targeting and drone systems has created what some analysts describe as a “transparent battlefield,” where movement is rapidly detected and acted upon.

The result is a form of persistent exposure, in which survival depends on speed rather than maneuver.

But speed comes at a cost.

When decision timelines compress, the role of human judgment changes. Commanders are no longer primarily evaluating options; they are validating—or contesting—machine-generated outputs.

The burden of proof shifts.

It is no longer sufficient to make a decision; one must justify deviating from the system.

The Problem of Trust Without Understanding

This shift introduces a fundamental tension: trust in systems that are not fully understood.

AI systems, particularly those based on machine learning, often operate as “black boxes.” They produce outputs without transparent reasoning. In operational contexts, this opacity is compounded by the pressures of time and consequence. When a system consistently produces useful results, trust develops—even if understanding does not.

This creates a dangerous asymmetry.

Operators may come to rely on systems whose limitations they cannot fully assess. Errors, when they occur, may not be immediately apparent. And when machine outputs align with human expectations, they can reinforce existing biases rather than challenge them.

The risk is not simply technical failure. It is epistemic drift—a gradual shift in how knowledge is produced, validated, and trusted within military organizations.

Accountability in a System of Systems

Perhaps the most profound implication of AI integration lies in the realm of accountability.

Traditional military command is built on a clear chain of responsibility. Decisions are made by individuals, within defined hierarchies, and accountability is assigned accordingly.

AI complicates this model.

When decisions are shaped by multiple interacting systems—data feeds, algorithms, human inputs—the locus of responsibility becomes diffuse.

Success is often attributed to teams or leadership; failure, however, tends to revert to the individual. This creates a mismatch between how decisions are made and how they are judged.

The introduction of AI thus raises a critical question:
Who is responsible when a system-influenced decision produces unintended consequences?

This is not a hypothetical concern.

As autonomous and semi-autonomous systems become more prevalent—particularly in targeting and defensive operations—the gap between action and accountability will widen.

Military Culture Under Strain

The U.S. military has long prided itself on a set of core values: judgment, responsibility, and accountability under pressure. These are not merely cultural artifacts; they are operational necessities.

AI does not eliminate these values, but it places them under strain.

The tension is most evident in the relationship between automation and authority. As systems become more capable, the temptation to delegate increases. Yet delegation without understanding risks undermining the very judgment that command requires.

Different branches and units are adapting in different ways. Some have embraced AI aggressively, integrating it into operational workflows. Others have proceeded more cautiously, emphasizing human oversight.

What unites these approaches is a shared recognition that the institution is entering uncharted territory.

The Return of Strategic Uncertainty

At the strategic level, AI is often framed in terms of competition—who will develop it faster, deploy it more effectively, and integrate it more fully into military operations.

This framing, while not incorrect, misses a deeper point.

AI does not simply enhance capability; it reshapes the environment in which capability is exercised.

In a world of AI-enabled systems, interactions become more complex, more rapid, and less predictable. Small inputs can generate disproportionate effects. Feedback loops accelerate. Miscalculations propagate more quickly.

This is, in essence, a compound security environment—one in which risks are interconnected, interactions are nonlinear, and outcomes are difficult to anticipate.

In such an environment, the traditional pursuit of control becomes increasingly elusive.

From Control to Coherence

If the promise of AI is greater control, its reality may be the opposite.

The challenge for military organizations is not to eliminate uncertainty, but to operate effectively within it. This requires a shift in perspective—from control to coherence.

Coherence, in this context, means aligning systems, institutions, and human judgment in a way that can withstand stress. It requires:

  • Transparency in how systems operate and influence decisions

  • Deliberate friction in decision processes to preserve judgment

  • Clear accountability frameworks that reflect the realities of system-mediated action

  • And a renewed emphasis on legitimacy and trust, both within institutions and in the broader strategic environment

This is not a technological problem alone. It is an organizational and cultural one.

The Real Question

The question facing military leaders today is not whether to adopt AI. That decision has already been made.

The real question is whether the institutions that employ these systems can keep pace with what they are becoming.

Can they maintain human judgment in an environment that rewards speed over reflection?
Can they assign responsibility in systems that diffuse decision-making?
Can they sustain legitimacy in the face of increasingly opaque processes?

These are not questions of capability. They are questions of governance.

Conclusion: Beyond the Machine

AI will not decide the future of warfare on its own. But it will shape the conditions under which decisions are made.

If those conditions erode judgment, diffuse accountability, and outpace governance, then the greatest risk is not that machines will fail—but that humans will succeed in using them without fully understanding the consequences.

The illusion of control, in this sense, may prove more dangerous than its absence.


If you value this work, here are three ways you can step into the story with us:

📰 Subscriber (Free)

Stay informed. Receive every new essay, briefing, and analysis straight to your inbox. Join a growing community committed to civic resilience and national security.

🎧 Supporter (Paid Pledge)

Strengthen the signal. Your support sustains both Compound Security, Unlocked and our companion podcast The Civic Brief. Supporters ensure these conversations remain accessible to the wider public while elevating the quality, depth, and reach of the work.

Pledge to My Substack Newsletter!

🛡️ Sustainer (Patron Level)

Invest in the mission. Sustainers fuel new research, convenings, and storytelling that enlarge the civic frame of security. This is more than content — it’s a civic project. Your sponsorship helps preserve an independent voice committed to equipping citizens, leaders, and institutions for the compound challenges ahead.

Venmo Me to Support The Civic Brief

Discussion about this episode

User's avatar

Ready for more?