Independence and Orthogonality of Stochastic Processes
Summary
The document distinguishes independence from orthogonality for stochastic processes. Independence is defined through the sigma-algebras generated by the processes: events from the two sigma-algebras must factor in probability. Orthogonality, for continuous square-integrable martingales, is expressed by requiring their product to be a martingale, with related extensions possible for broader classes of processes.
The concepts coincide in an important special case: jointly normal variables that are uncorrelated are independent. This explains why independent Wiener processes have zero cross-variation, but that relation is a consequence in this setting, not the general definition of independence. Outside the jointly Gaussian setting, orthogonality or lack of correlation does not imply independence. The explanation is conceptual and points to more technical treatments for precise extensions; applying the martingale criterion requires checking the relevant process assumptions.
Key ideas
- Independence is defined by independence of the sigma-algebras generated by the processes.
- For continuous square-integrable martingales, orthogonality can be defined by requiring their product to be a martingale.
- Uncorrelated jointly normal variables are independent, which explains the special Wiener-process connection.
- Orthogonality and independence are distinct in general, so one should not infer independence from zero correlation alone.
Tags
Full text
# Definition of orthogonality and independence for a stochastic processes
# Definition of orthogonality and independence for a stochastic processes
Somehow I can't find the explicit definition of when two processes are supposed to be orthogonal or independent anywhere. I think orthogonality and independence should mean the same thing in this context.
Up to now I always assumed independence/orthogonality of two wiener processes meant $ dW_i(t) dW_j(t) = \delta_{ij} dt $ Or in a different notation $[W_i,W_j]_t=\delta_{ij}t$. Unfortunately this is just a consequence of independence not the actual definition.
Thus the questions:
- are independence and orthogonality equivalent for a stochastic process?
- what are the metric and the space used to define orthogonality of stochastic processes ?
## Answer by quasi (score 5, accepted)
https://quant.stackexchange.com/a/10680
Orthogonality and independence are different concepts. The concepts are the same for Wiener processes because in the context of normal random variables, independence is equivalent to orthogonality (i.e. uncorrelatedness)
Independence is the standard definition for probability. Let $\mathcal{F}, \mathcal{G}$ be the sigma algebras generated by two processes, $X_\cdot, Y_\cdot$. Then $X$ and $Y$ are independent if $\mathcal{F}, \mathcal{G}$ are.
For orthogonality, the condition is actually only defined for things similar to continuous square-integrable martingales. By similar, I mean that things can be extended to processes which are locally square integrable, locally martingales, have discontinuities, semimartingales. But, for $X$ and $Y$ continuous square integrable martingales, then $X$ is orthogonal to $Y$ if $XY$ is a martingale.
A good reference for this topic is Protter's book. Can look up the exact section if you're interested.
edit, in response to Probilitator's questions:
Independence for random vectors: Let $\Omega, \mathcal{H}, \mu$ be a probability space, on which $(X_i)$ and $(Y_i)$ are all defined. $X_i$ is a measurable map from $\Omega$ to $\mathbb{R}$, so it induces a subsigma algebra $\mathcal{F}_i \subset \mathcal{H}$. You can then take $\mathcal{F}$ as the sigma algebra generated by the $\mathcal{F}_i$. You can similarly get $\mathcal{G}$ from the $Y_i$.
You can also start from the point of view of a mapping into $\mathbb{R}^n$.
As sigma algebras, $\mathcal{F} \perp \mathcal{G}$ if for any $A \in \mathcal{F}, B \in \mathcal{G}$, $\mu(A \cap B) = \mu(A) \cdot \mu(B)$.
Next, for the statement about normal random variables, if $X,Y$ are jointly normal and uncorrelated, you calculate the function $f(s,t) = E \left[ \exp(sX + tY) \right]$. You can evaluate this exactly using a bare hands Riemann integral of the normal density. Then you show that $f$ can be factored into functions of $s$ and $t$, which is the equivalent characterization of independence.Shown in full with attribution under the source's licence. Licence: CC BY-SA 4.0 (Stack Exchange)
This summary was written by Stratmill's research agent from the original; it is not a copy of the source.