7. Beyond Ground States: The Schrödinger Equation from Ether Dynamics

7.1 The Problem

Section 5 proved that the ether's zero-point field maintains atomic ground states. This is insufficient. Without the Schrödinger equation, there are no excited states, no discrete spectra, no transition rates — no quantum mechanics. The challenge is to derive the Schrödinger equation from ether physics, not merely to show consistency with specific stationary states.

The gap is filled by a result due to Nelson [100]: a particle undergoing Brownian motion with diffusion coefficient $D = \hbar/(2m)$ in an external potential satisfies the Schrödinger equation. Nelson's derivation is proven mathematics — there is no conjecture in it. What Nelson could not do was explain why $D = \hbar/(2m)$. In his framework, this was a postulate.

The ether framework resolves this. We show that Boyer's proven result (Section 6.2) — the ZPF maintains the quantum ground state — determines $D = \hbar/(2m)$ uniquely, through Nelson's stochastic dynamics. The diffusion coefficient is not a free parameter; it is fixed by the ether's zero-point fluctuation spectrum.

The logical chain is:

$$\text{Ether ZPF spectrum (Thm 4.2)} \xrightarrow{\text{Boyer (Thm 5.1)}} \rho_0 = |\psi_0|^2 \xrightarrow{\text{Nelson dynamics}} D = \frac{\hbar}{2m} \xrightarrow{\text{Nelson (Thm 6.1)}} i\hbar\dot{\psi} = \hat{H}\psi$$

Every arrow is a derivation, not an assumption. We present each in full.

7.2 Nelson's Stochastic Mechanics

7.2.1 Kinematics

A particle of mass $m$ moves through the ether. The ZPF imparts random impulses, causing a diffusive motion described by a Markov process $\mathbf{x}(t)$ with diffusion coefficient $D$ (to be determined). Because Brownian trajectories are continuous but non-differentiable, the velocity $d\mathbf{x}/dt$ does not exist. Nelson [100] defined two mean derivatives:

$$D_+\mathbf{x}(t) = \lim_{\Delta t\to 0^+}\left\langle\frac{\mathbf{x}(t+\Delta t)-\mathbf{x}(t)}{\Delta t}\bigg|\mathbf{x}(t)\right\rangle \equiv \mathbf{b}_+ \tag{7.1}$$ $$D_-\mathbf{x}(t) = \lim_{\Delta t\to 0^+}\left\langle\frac{\mathbf{x}(t)-\mathbf{x}(t-\Delta t)}{\Delta t}\bigg|\mathbf{x}(t)\right\rangle \equiv \mathbf{b}_- \tag{7.2}$$

These are the forward and backward drifts, conditional on the current position. From them, two physical velocities are constructed:

$$\mathbf{v} = \frac{\mathbf{b}_+ + \mathbf{b}_-}{2}\qquad\text{(current velocity: transports probability)} \tag{7.3}$$ $$\mathbf{u} = \frac{\mathbf{b}_+ - \mathbf{b}_-}{2}\qquad\text{(osmotic velocity: driven by diffusion)} \tag{7.4}$$

The stochastic differential equation governing the process is:

$$d\mathbf{x} = \mathbf{b}_+\,dt + \sqrt{2D}\,d\mathbf{W}(t) \tag{7.5}$$

where $d\mathbf{W}$ is a Wiener process increment ($\langle dW_i\,dW_j\rangle = \delta_{ij}\,dt$).

7.2.2 The Continuity and Osmotic Equations

The probability density $\rho(\mathbf{x},t)$ satisfies two Fokker–Planck equations, one for each time direction:

$$\partial_t\rho = -\nabla\!\cdot\!(\mathbf{b}_+\rho) + D\nabla^2\rho \qquad\text{(forward)} \tag{7.6}$$ $$\partial_t\rho = -\nabla\!\cdot\!(\mathbf{b}_-\rho) - D\nabla^2\rho \qquad\text{(backward)} \tag{7.7}$$

Proof of (7.6). The forward Fokker–Planck equation for the Itô process (7.5) is standard [112]: the probability flux is $\mathbf{J} = \mathbf{b}_+\rho - D\nabla\rho$, so $\partial_t\rho = -\nabla\cdot\mathbf{J}$. (7.7) follows by time-reversal symmetry of the diffusion.

Adding (7.6) and (7.7):

$$\partial_t\rho = -\nabla\!\cdot\!(\mathbf{v}\rho) \tag{7.8}$$

This is the continuity equation — probability is conserved with current $\mathbf{j} = \rho\mathbf{v}$.

Subtracting (7.7) from (7.6):

$$0 = -\nabla\!\cdot\!(\mathbf{u}\rho) + D\nabla^2\rho \tag{7.9}$$

Since $\nabla^2\rho = \nabla\!\cdot\!(\nabla\rho)$, this gives:

$$\boxed{\mathbf{u} = D\,\frac{\nabla\rho}{\rho} = D\,\nabla\ln\rho} \tag{7.10}$$

The osmotic velocity is proportional to the probability gradient — particles are driven from low-density to high-density regions. This is a consequence of the diffusion process, not an assumption.

7.2.3 The Stochastic Newton's Law

For differentiable trajectories, Newton's second law is $m\ddot{\mathbf{x}} = \mathbf{F}$. For stochastic trajectories, the second derivative does not exist. Nelson defined the stochastic acceleration as the time-symmetric second derivative:

$$\mathbf{a} = \frac{1}{2}(D_+D_- + D_-D_+)\mathbf{x}(t) \tag{7.11}$$

and postulated the stochastic Newton's law:

$$m\mathbf{a} = -\nabla V \tag{7.12}$$

Computing $\mathbf{a}$ in terms of $\mathbf{v}$ and $\mathbf{u}$. The Itô calculus rules for the forward and backward derivatives acting on a function $f(\mathbf{x}(t), t)$ are [100]:

$$D_+ f = \partial_t f + \mathbf{b}_+\!\cdot\!\nabla f + D\nabla^2 f \tag{7.13}$$ $$D_- f = \partial_t f + \mathbf{b}_-\!\cdot\!\nabla f - D\nabla^2 f \tag{7.14}$$

The extra $\pm D\nabla^2 f$ terms arise from the Itô correction: for a Wiener process, $(dx_i)^2 = 2D\,dt$ to leading order, generating second-derivative contributions.

The stochastic acceleration (7.11), computed by applying $D_-$ to $\mathbf{b}_+$ and $D_+$ to $\mathbf{b}_-$, is:

$$D_-\mathbf{b}_+ = D_-(\mathbf{v}+\mathbf{u}) = \partial_t(\mathbf{v}+\mathbf{u}) + [(\mathbf{v}-\mathbf{u})\!\cdot\!\nabla](\mathbf{v}+\mathbf{u}) - D\nabla^2(\mathbf{v}+\mathbf{u}) \tag{7.15a}$$ $$D_+\mathbf{b}_- = D_+(\mathbf{v}-\mathbf{u}) = \partial_t(\mathbf{v}-\mathbf{u}) + [(\mathbf{v}+\mathbf{u})\!\cdot\!\nabla](\mathbf{v}-\mathbf{u}) + D\nabla^2(\mathbf{v}-\mathbf{u}) \tag{7.15b}$$

Taking $\mathbf{a} = \frac{1}{2}[(7.15a)+(7.15b)]$:

$$\mathbf{a} = \partial_t\mathbf{v} + \frac{1}{2}\big\{[(\mathbf{v}-\mathbf{u})\!\cdot\!\nabla](\mathbf{v}+\mathbf{u}) + [(\mathbf{v}+\mathbf{u})\!\cdot\!\nabla](\mathbf{v}-\mathbf{u})\big\} - D\nabla^2\mathbf{u} \tag{7.16}$$

Expanding the braced term: $[(\mathbf{v}-\mathbf{u})\!\cdot\!\nabla](\mathbf{v}+\mathbf{u}) = (\mathbf{v}\!\cdot\!\nabla)\mathbf{v} + (\mathbf{v}\!\cdot\!\nabla)\mathbf{u} - (\mathbf{u}\!\cdot\!\nabla)\mathbf{v} - (\mathbf{u}\!\cdot\!\nabla)\mathbf{u}$. Similarly for the second bracket. The cross terms $(\mathbf{v}\!\cdot\!\nabla)\mathbf{u}$ and $(\mathbf{u}\!\cdot\!\nabla)\mathbf{v}$ cancel pairwise between the two brackets. The $D\nabla^2\mathbf{v}$ terms also cancel ($-D\nabla^2\mathbf{v}$ from (7.15a) and $+D\nabla^2\mathbf{v}$ from (7.15b)). The surviving terms give:

$$\boxed{\mathbf{a} = \partial_t\mathbf{v} + (\mathbf{v}\!\cdot\!\nabla)\mathbf{v} - (\mathbf{u}\!\cdot\!\nabla)\mathbf{u} - D\nabla^2\mathbf{u}} \tag{7.17}$$

7.2.4 Derivation of the Schrödinger Equation

Step 1. Assume the current velocity is irrotational: $\mathbf{v} = \nabla S/m$ for a scalar field $S(\mathbf{x},t)$. (For single-particle systems with no magnetic field, this is equivalent to the single-valuedness of the wavefunction.)

Step 2. Write $\rho = R^2$ with $R > 0$. From (7.10):

$$\mathbf{u} = 2D\frac{\nabla R}{R} \tag{7.18}$$

Step 3. Evaluate $(\mathbf{u}\!\cdot\!\nabla)\mathbf{u} + D\nabla^2\mathbf{u}$. Using component notation with $u_j = 2D\partial_j R/R$:

$$\partial_i u_j = 2D\!\left(\frac{\partial_i\partial_j R}{R} - \frac{\partial_i R\,\partial_j R}{R^2}\right) \tag{7.19}$$ $$u_i\partial_i u_j = 4D^2\!\left(\frac{\partial_i R\,\partial_i\partial_j R}{R^2} - \frac{|\nabla R|^2\,\partial_j R}{R^3}\right) \tag{7.20}$$ $$\partial_i^2 u_j = 2D\!\left(\frac{\partial_j\nabla^2 R}{R} - \frac{\nabla^2 R\,\partial_j R}{R^2} - \frac{2\partial_i R\,\partial_i\partial_j R}{R^2} + \frac{2|\nabla R|^2\,\partial_j R}{R^3}\right) \tag{7.21}$$

Adding (7.20) and $D\times$(7.21):

$$u_i\partial_i u_j + D\partial_i^2 u_j = 2D^2\!\left(\frac{\partial_j\nabla^2 R}{R} - \frac{\nabla^2 R\,\partial_j R}{R^2}\right) = 2D^2\partial_j\!\left(\frac{\nabla^2 R}{R}\right) \tag{7.22}$$

(All other terms cancel in pairs.)

Step 4. Substitute into (7.17) with $m\mathbf{a} = -\nabla V$:

$$\nabla\!\left[\partial_t S + \frac{|\nabla S|^2}{2m} + V - 2mD^2\frac{\nabla^2 R}{R}\right] = 0 \tag{7.23}$$

where we used $(\mathbf{v}\!\cdot\!\nabla)\mathbf{v} = \nabla|\nabla S|^2/(2m^2)$. Since the gradient vanishes, the bracket equals a function of $t$ alone, absorbable into $S$:

$$\frac{\partial S}{\partial t} + \frac{|\nabla S|^2}{2m} + V - 2mD^2\frac{\nabla^2 R}{R} = 0 \tag{7.24}$$

Step 5. Set $\hbar = 2mD$ (derived in Section 7.3) and define $\psi = R\,e^{iS/\hbar}$.

7.3 Deriving $D = \hbar/(2m)$ from the Ether ZPF

This is the result that the ether framework uniquely provides: the derivation of the diffusion coefficient — and hence Planck's constant — from the ZPF.

7.3.1 The Argument

1. Boyer proved (Theorem 6.1) that a harmonic oscillator in the ZPF reaches a stationary state with $\rho_0(x) = |\psi_0(x)|^2$ and zero probability current ($\mathbf{v} = 0$).
2. In Nelson's framework, this stationary state has osmotic velocity $\mathbf{u} = D\nabla\ln\rho_0$ and stochastic acceleration (7.17) that must satisfy Newton's law.
3. The requirement that Newton's law holds uniquely determines $D$.

7.3.2 The Derivation

Consider the harmonic oscillator, $V = \frac{1}{2}m\omega_0^2 x^2$.

Given (from Boyer, Theorem 6.1):

$$\rho_0(x) = \sqrt{\frac{m\omega_0}{\pi\hbar}}\exp\!\left(-\frac{m\omega_0 x^2}{\hbar}\right), \qquad \mathbf{v} = 0 \tag{7.28}$$

Osmotic velocity (from 6.10):

$$u = D\frac{d\ln\rho_0}{dx} = -\frac{2Dm\omega_0}{\hbar}\,x \tag{7.29}$$

Stochastic acceleration (from 6.17 with $\mathbf{v} = 0$, $\partial_t\mathbf{v} = 0$):

$$a = -u\frac{du}{dx} - D\frac{d^2u}{dx^2} \tag{7.30}$$

Since $u$ is linear in $x$: $du/dx = -2Dm\omega_0/\hbar$ (constant) and $d^2u/dx^2 = 0$. Therefore:

$$a = -\!\left(-\frac{2Dm\omega_0}{\hbar}x\right)\!\left(-\frac{2Dm\omega_0}{\hbar}\right) = -\frac{4D^2m^2\omega_0^2}{\hbar^2}\,x \tag{7.31}$$

Newton's law requires $ma = -m\omega_0^2 x$:

$$-\frac{4D^2m^2\omega_0^2}{\hbar^2} = -\omega_0^2 \tag{7.32}$$ $$\frac{4D^2m^2}{\hbar^2} = 1 \tag{7.33}$$ $$\boxed{D = \frac{\hbar}{2m}} \tag{7.34}$$

Three critical features of this result:

(a) $\omega_0$ cancels. The oscillator frequency does not appear in $D$. The diffusion coefficient is a property of the ether, not of the system — any oscillator driven by the same ZPF has the same $D/m$ ratio.

(b) Universality. Because the ZPF is universal (it permeates all space and couples to all matter), every massive particle has $D = \hbar/(2m)$. This explains why neutral particles obey the same Schrödinger equation as charged ones: the diffusion is driven by the ether's gravitational/mechanical coupling (Section 3), not solely by electromagnetic coupling. We note, however, that the derivation above is for the harmonic oscillator. The universality claim — that $D = \hbar/(2m)$ holds for arbitrary potentials — is verified for the hydrogen atom (Section 7.3.3) and guaranteed for all systems by the Nelson bridge (Theorem 7.1), but a direct SED derivation for general potentials remains an open problem (see C2 in Section 11.2).

(c) The origin of $\hbar$. Planck's constant enters through Boyer's stationary distribution (7.28), where it was determined by the ZPF spectral density $\rho(\omega) = \hbar\omega^3/(2\pi^2c^3)$. The chain is: ZPF amplitude → stationary distribution → diffusion coefficient → Schrödinger equation. The quantum of action in the Schrödinger equation is the same $\hbar$ that sets the ZPF fluctuation amplitude.

7.3.3 Verification: Hydrogen Atom

We verify that the same $D$ produces the correct dynamics for a system with a completely different potential.

For the hydrogen ground state ($\ell=0$, $\mathbf{v}=0$): $R(r) = (\pi a_0^3)^{-1/2}e^{-r/a_0}$ where $a_0 = 4\pi\epsilon_0\hbar^2/(me^2)$.

The stationary dynamical (7.24) with $\partial_tS = -E$ and $|\nabla S|^2 = 0$ requires:

$$E = V(r) - \frac{\hbar^2}{2m}\frac{\nabla^2 R}{R} \tag{7.35}$$

Computing $\nabla^2 R/R$ in spherical coordinates:

$$\frac{\nabla^2 R}{R} = \frac{R'' + 2R'/r}{R} = \frac{1}{a_0^2} - \frac{2}{a_0 r} \tag{7.36}$$

Substituting:

$$E = -\frac{e^2}{4\pi\epsilon_0 r} - \frac{\hbar^2}{2m}\!\left(\frac{1}{a_0^2} - \frac{2}{a_0 r}\right) = -\frac{e^2}{4\pi\epsilon_0 r} + \frac{e^2}{4\pi\epsilon_0 r} - \frac{\hbar^2}{2ma_0^2} \tag{7.37}$$

using $\hbar^2/(ma_0) = e^2/(4\pi\epsilon_0)$. The Coulomb potential is exactly cancelled, leaving:

$$E = -\frac{me^4}{32\pi^2\epsilon_0^2\hbar^2} = -13.6\;\text{eV} \qquad \tag{7.38}$$

The value $D = \hbar/(2m)$, derived from the harmonic oscillator ZPF, produces the correct hydrogen ground state energy from a completely different potential — confirming universality.

7.4 Consequences

The Schrödinger (7.25) has been derived from ether dynamics. All of non-relativistic quantum mechanics follows.

7.4.1 Excited States and Discrete Spectra

The time-independent Schrödinger equation admits discrete eigenvalues $E_n$ for confining potentials. For hydrogen: $E_n = -13.6\;\text{eV}/n^2$. This resolves the principal limitation of Section 5: SED alone produces ground states but not excited states; the Nelson–SED bridge produces all energy levels.

Each eigenstate $\psi_n$ corresponds to a distinct stationary stochastic process: the particle diffuses in the ether with probability density $R_n^2$ and current velocity $\nabla S_n/m$. The discreteness of $E_n$ arises because only specific diffusion patterns are compatible with normalisability and smoothness — the ether supports resonant modes, like a vibrating membrane.

7.4.2 The Quantum Potential as Ether Diffusion Pressure

The term $Q = -(\hbar^2/2m)\nabla^2R/R$ in (7.24) is the quantum potential of de Broglie–Bohm theory [113]. In that framework, it is postulated. In the ether framework, it is derived:

$$Q = -2mD^2\frac{\nabla^2\sqrt{\rho}}{\sqrt{\rho}} \tag{7.39}$$

This is a diffusion pressure: it measures the curvature of the probability amplitude and produces an effective force $-\nabla Q$ on the particle. It is large where $\rho$ varies rapidly (near nuclei, potential barriers, nodes) and vanishes where $\rho$ is uniform. The "non-locality" of $Q$ — its dependence on the global shape of $\rho$ — reflects the spatial extent of the ether ZPF.

7.5 The Physical Content: What Is Resolved

The wavefunction. $\psi = R\,e^{iS/\hbar}$ encodes the statistical state of a particle diffusing in the ether: $R^2$ is the probability density, $\nabla S/m$ is the mean current velocity. It is neither a physical field nor mere information — it is the complete description of a stochastic process.

The gravity–quantum connection. The same ether whose mean flow is gravity (Part II) produces, through its fluctuations, quantum mechanics (Part IV):

Ether aspect	Physical effect	Mechanism
Mean flow	Gravity	Acoustic metric (Section 3)
Condensate density	Dark matter	Superfluid self-interaction (Section 4.2)
Phonon ZPF energy	Dark energy	Lorentz-invariant ZPF (Section 4.3)
EM constitutive response	Plasma dielectric	Charge-driven ether polarisation (Section 5)
EM mode fluctuations	Quantum ground states	SED (Section 6)
EM fluctuation-driven diffusion	Schrödinger equation	Nelson mechanics (Section 7)

This is not an analogy. It is a single medium with quantitative predictions across all six domains.

7.6 Open Problems

We state the limitations without euphemism.

The node problem. Excited-state wavefunctions have nodes ($\psi = 0$, $\rho = 0$, $\mathbf{u} \to \infty$). The stochastic process has singular drift at nodes; the particle cannot cross nodal surfaces. Configuration space decomposes into nodal domains; the full quantum distribution is a mixture over domains [102, 103]. This is mathematically consistent (all predictions reproduced) but physically unsatisfying: the particle's initial nodal domain is an additional hidden variable. Nelson himself identified this as a serious concern [101].

Bell's theorem. Bell [104] proved that no local hidden variable theory reproduces all quantum predictions. The ether ZPF is non-local — the field configuration $\{\alpha_\lambda(\mathbf{k})\}$ extends across all space — so it is not excluded by Bell's theorem. For continuous-variable systems, SED reproduces quantum entanglement correlations [107]. For spin-$1/2$ systems (the canonical Bell scenario), the complete calculation has not been performed. We do not claim resolution.

Spin. Intrinsic angular momentum is not derived from ether microphysics. This requires either a model of spin as rotational ether modes or extension to relativistic stochastic mechanics [111]. However, the multi-component structure required by Proposition 6.1 (Section 6.6.4) provides a concrete pathway:

This is not a conjecture but an application of Volovik's theorem [153]: in any multi-component condensate whose quasiparticle spectrum has point nodes in momentum space, the excitations near the nodes satisfy the Weyl equation $E(\mathbf{p}) = \pm|\mathbf{c}\cdot\mathbf{p}|$, where $\mathbf{c}$ is an effective velocity matrix. The $\pm$ branches are left and right chirality. The spin-$1/2$ character is topological: it arises from a Berry phase of $\pi$ accumulated around the node and cannot be removed by continuous deformations of the order parameter. Combining two Weyl nodes of opposite chirality yields a Dirac fermion — a massive spin-$1/2$ particle.

The key observation linking this to the ether programme: Corollary 6.2 established that the ether must have multi-component structure to support transverse modes at atomic frequencies. This same multi-component structure generically provides the momentum-space nodes from which spin-$1/2$ emerges. The EM cutoff problem and the spin problem are thus not independent — they are two manifestations of the same structural requirement. Specifying the ether's order parameter (vector, spinor, or tensor) would simultaneously resolve both.

The ether's order parameter determines not only spin but also the gauge structure of its low-energy excitations: which gauge bosons emerge as Goldstone modes of the broken symmetry, and what fermion mass spectrum results. We identify this as the deepest open question in the ether programme.

Relativistic quantum mechanics and QFT. The derivation is non-relativistic. The Dirac equation and second quantisation are beyond the present scope.