A Synthesis of the Thoughts of Daveed Sidhu  

Our friend Daveed Sidhu is a prolific writer and provocative thought leader on the future of the electric grid and what it would mean for new business opportunities, new products, and new approaches to regulation.  He publishes his work on his LinkedIn page.  We have undertaken to summarize his latest thoughts as a way to introduce more people to them, and in order to stimulate discussion and debate.  

We also asked local expert Peter Mackin, who has hands-on experience with the grid, to comment on Daveed’s thoughts and incorporated his comments as highlighted sections.

The Core Problem

The grid is becoming more intelligent—and less effective. That contradiction is in the signals we’re ignoring. The constraint isn’t hardware — it’s data quality, coordination, and decision speed.  We’ve digitized the grid—but we haven’t fully operationalized that intelligence.  The grid has shifted from linear infrastructure to an interactive platform that must not only sense but anticipate.  That requires some major investment and a commitment to major change.

Data Quality: The Hidden Flaws in the Foundation

Despite billions invested in smart meters, sensors, and analytics, the data feeding these systems is often unreliable. Common problems include:

  • Missing or incomplete meter reads
  • Timestamp inconsistencies across systems
  • Communication latency and packet loss
  • Firmware variations across device fleets
  • Inconsistent data models between platforms
Peter Mackin:  I am not sure these issues are that big of a deal, especially when it comes to real-time operations.  Utility-grade systems do not suffer from these issues to any large extent.

These are not edge cases—they are systemic conditions across most utility environments.  At scale, across millions of endpoints, these issues become structural. Every downstream system — forecasts, optimization engines, reliability tools — inherits this uncertainty. The next phase of grid modernization won’t be defined by more sensors, but by robust data architecture, standardized models, telemetry validation, and rigorous data governance.

A Changed Operating Environment

The grid now must accommodate:

  • Rapid EV growth and rooftop solar proliferation
  • Large, fast-arriving loads from data centers and AI infrastructure
  • Climate volatility that undermines historical planning assumptions

These demands require faster, more precise operational intelligence. Without trustworthy data as a foundation, even sophisticated AI becomes an expensive, fragile overlay.

Peter Mackin:  Faster, more precise operational intelligence is not needed.  Current operational intelligence is more than adequate.  What is needed is better forecasting tools to predict where loads and resources will be so that, when these loads and resources want to connect, the grid will be ready for them.  This problem is a planning problem, not an operations problem.

From Smart to Sentient

A smart grid reacts; a sentient grid anticipates not sentient in a biological sense, but in its ability to continuously interpret, learn, and act on system-wide signals. The traditional reactive model — meters report after the fact, outages are addressed after customer calls, operators rebalance after congestion appears — is no longer adequate in a system defined by fluctuating DER output and volatile demand.

Peter Mackin:  The grid does not operate this way.  Transmission outages are detected in less than one second.  If remedial actions are needed, they are automatic and typically implemented in less than a second.  Distribution outages will be detected well before a customer has a chance to call in due to the presence of smart meters at every customer location.  Once the power goes out, each smart meter sends outage information back to the utility’s distribution operations center.  In less than a minute, the utility should have a handle on the size and geographic extent of the outage.

Congestion is mitigated in the day ahead and “real-time” (5 min. to 15 min ahead of time) markets before it can occur.  If overloads or other reliability concerns occur after an outage, system operators have up to 30 minutes to rebalance the system and restore it to a state that will be secure even after the worst next outage occurs. For the worst outages, operating procedures are in place to guide the system operators in restoring the system to a secure operating state.

A sentient grid continuously synthesizes real-time telemetry, weather intelligence, market signals, asset health data, and customer behavior to ask: “What is about to happen — and what should be done now?” This enables:

  • Predictive reliability — failures identified before they cascade
Peter Mackin: This step is already being done via tools such as RTCA (Real Time Contingency Analysis).
  • Unlocked capacity — real-time awareness reveals hidden headroom in existing assets, deferring capital projects
  • Active customer participation — DERs and flexibility orchestrated proactively
  • Orchestrated control rooms — operators supervise automated responses instead of chasing alarms
Peter Mackin:  This step has already been ordered by FERC in Order 881.

The Grid as Platform

The grid is evolving from linear infrastructure (wires, transformers, power quality controls) into an interactive platform, much like Amazon in retail or Apple in mobile. It must now coordinate rooftop solar, storage, EV charging, demand response, microgrids, and real-time markets. The critical paradox: the system in many regions isn’t short on generation capacity — it’s short on coordination capacity and visibility. That raises the question of who truly owns and controls grid data–and who should?  As a platform, the grid would be an open system with thousands or millions of players using data and controls to provide fee-based services.  

To realize this platform model, utilities must invest in:

  • Interoperability standards across OT and IT
  • Open, API-first digital ecosystems rather than closed silos
  • Cloud-native, scalable architectures
Peter Mackin:  Any application that is critical to the security and safe operation of the grid is highly unlikely to be cloud-based.
  • Event-driven data pipelines for real-time coordination

This also demands transformation along four dimensions: architectural (open ecosystems), regulatory (recognizing customers as active participants), business model (valuing flexibility alongside capital deployment), and cultural (from asset operator to ecosystem coordinator).

Decision Latency: The Next Major Constraint

The next constraint is not data availability—it is the time between signal and action.  Decision latency appears as:

  • DERs are responding slower than grid conditions require
  • Demand response signals arriving after peak events are underway
  • Balancing decisions based on stale data
  • Operators manually bridging gaps between disparate systems

Addressing this requires three shifts:

  1. Centralized → distributed intelligence: move decision-making to the edge
  2. Data collection → data synchronization: ensure systems share a consistent, current view
  3. Monitoring → autonomous coordination: enable systems to respond autonomously, with operators in supervisory roles

Congestion: The Real Bottleneck

The grid’s growing constraint isn’t generation or wires — it’s the ability to move electricity where it’s needed, when it’s needed. Evidence is already visible: renewable curtailment despite available capacity, rising locational marginal prices, and interconnection queues stretching years. Today’s congestion is driven by localized load pockets (data centers, AI infrastructure), variable DER injections, and rapid electrification outpacing traditional planning.  Are we building physical infrastructure too quickly because we underutilize what already exists? Do we underestimate how much improvement could be made by engaging more creative, entrepreneurial minds?

Congestion is more than economic inefficiency — it is a compounding reliability risk, leaving operators with fewer degrees of freedom when conditions change.

Peter Mackin:  Congestion is only an economic issue.  It is not a reliability risk.  Congestion occurs because the least cost resources are constrained behind a transmission limitation.  However, other resources are always available to meet the demand, albeit at a higher cost.  The system is planned out for 10 years (and beyond) to have adequate transmission, distribution, and generation to meet anticipated demand for all future years in the planning horizon.

Building more infrastructure alone won’t solve this fast enough; transmission expansion takes decades while demand accelerates now. The answer lies in better orchestration of existing assets through real-time visibility, automated decision-making, dynamic coordination of flexible resources, and extensive monetization of flexibility markets.  

This leads to the question of whether regulatory models built for centralized generation and closed operation of the grid can support a distributed, digital, and interactive grid. Would that mean more performance-based regulation rather than the ever-more complex rules and requirements coming from today’s regulators?  Would this be an even bigger challenge than deregulating generation?

Data-Rich but Context-Poor

The grid doesn’t suffer from a lack of visibility—it suffers from a lack of meaning. The grid sees, measures, and records — but doesn’t consistently listen. Listening means interpretation:

  • A voltage fluctuation may signal impending equipment stress
  • A transformer heating pattern may be an early failure warning
  • A sudden load shift may reveal new behavior like clustered EV charging
Peter Mackin:  Transmission level transformers are already monitored for DGA (Dissolved Gas Analysis), which can detect impending failure of the transformer.  The transmission grid already has spares available that can be used to replace a transformer that may be on the verge of failure while a replacement transformer is procured.

Another way utilities can get information on new EV charging installations is from the local permitting authorities.  Utilities already get this information for rooftop solar installations.

More data without interpretation leads to information overload — cluttered dashboards and alarm-flooded control rooms. AI and edge intelligence close this gap, not by replacing human expertise but by amplifying it: detecting patterns across noisy datasets, prioritizing anomalies, correlating operational data with external factors, and learning from historical incidents. The goal is a grid that evolves from monitoring to understanding, and from reacting to anticipating.  The consequence is much less direct human governance in favor of human-supervised autonomous control.  Is that a welcome or a frightening change?

The Path Forward

The utilities and grid operators that lead will be those that:

  • Invest as heavily in data integrity and governance as in hardware
  • Build cloud-native, event-driven, interoperable digital architectures
  • Embrace edge intelligence and distributed decision-making
  • Reframe their identity from infrastructure providers to platform orchestrators
  • Align regulatory, business, and cultural models with an open, participatory energy ecosystem

The grid is becoming a sentient platform and an interactive marketplace of electrons. The question isn’t whether this transformation will happen — it’s whether today’s utilities and grid operators are prepared to listen, anticipate, and orchestrate at the speed required for the grid to understand itself in time to act. 

Gary Simon

ABOUT THE AUTHOR

Gary Simon chairs the CleanStart Board, bringing with him a wealth of experience from over 45 years in business, government, and non-profit sectors. Gary applies his deep understanding and experience to support the growth of clean energy initiatives and startups. His work is instrumental in guiding the organization towards achieving its goals of promoting sustainable energy solutions.

Sponsors

SMUD
ChicoSTART
RiverCity Bank
Moss Adams logo