Notes 2023.09.25

Last time: basic fourier transform theory

Assumes stationarity (related to periodicity).

  • E.g. trend vs annual cycle. In this case we have scale separation in spectral space.

Data in practice are always multiplied by a window function. I.e. you have an observation window. Therefore, choose a window function which decays in frequency domain as quickly as possible.

Autoregressive process:

  • White noise has no autocorrelation.
  • Random walk: expectation zero, but variance increases.

How to compute power spectrum of random walk? x(t)=ax(tΔt)+(1a2)1/2ε(t),0<a<1 x(t) = ax(t-\Delta t) + (1-a^2)^{1/2}\varepsilon(t), \quad 0 < a < 1 which has mean zero and x2=1\overline{x^2} = 1 . Then find autocorrelation r(Δt)=x(t)x(tΔt)=ar(\Delta t) = \overline{x(t)x(t-\Delta t)} = a using the fact that ε(t)ε(t+Δt)\varepsilon(t) \bot \varepsilon(t+\Delta t)

Then define T=Δtlog(a)T = \frac{-\Delta t}{\log(a)} and we get r(nΔt)=rn(Δt)=an=exp(nΔtT)r(n\Delta t) = r^n(\Delta t) = a^n = \exp\left(-\frac{n\Delta t}{T}\right) . If T=nΔtT=n\Delta t gives r(nΔt)=e1r(n\Delta t) = e^{-1} so this is effectively the ee-folding time.

Therefore the power spectrum is Φ(ω)=r(τ)eiωtdτ=2T1+ω2T2 \Phi(\omega) = \int r(\tau) e^{-i\omega t} \intd{\tau} = \frac{2T}{1+\omega^2T^2}

statistical significance and time series

χ2 \chi^2 test: known sigma, or FF test: do they come from the same process? What does nn mean for a spectral test

NN: total number of samples, Msp M_{sp} number of spectral estimates, fωf_\omega spectral correction for windowing function. n=NMspfω n = \frac{N}{M_{sp}}f_\omega for e.g. χ2\chi^2 or FF test.

In practice: how to increase statistical significance? If NN fixed, then make MspM_{sp} smaller.

  • Welch's method

Parent post: