• central topics of signal processing
    • sampling: continuous-time to discrete-time
    • interpolation: discrete-time tp continuous-time
  • sampling and interpolation establish an interaction between the continuous-time world and the discrete-time world

interpolation

  • interpolation describes the process of building a continuous-time signal (x(t)) from a sequence of samples (x[n])
    • allows moving from the discrete-time world to the continuous-time world
  • interpolation raises two questions:
    • how to interpolate between samples?
      • two samples: a straight line that goes between these two samples
      • three samples: a parabola goes through these 3 samples
      • many samples: go through all samples but this is trickier compared to two or three samples
    • is there a minimum set of values to measure function to perfectly reconstruct it

sampling

  • sampling is the process of moving from a continuous-time signal to a sequence of samples
    • allows moving from the continuous-time world to the discrete-time world
  • consider equally-spaced samples of a function (x(t))
    • the question that comes up is when is there a one-to-one relationship between the continuous-time function and its samples?
    • i.e. when do the samples form a unique representation of the continuous-time function
  • to answer this, tools such as hilbert spaces, projections, filtering, sinc functions, and so on are used
    • these tools come together in the sampling theorem

history

  • the shannon sampling theorem’s history goes back well before shannon
  • numerical analysts were concerned about interpolating tables of functions
  • the first (propaganda) one to prove a version of the sampling theorem was whittaker in England in 1915
  • harry nyquist at bell labs came up with the nyqvist criterion
    • namely that a function that has a maximum frequency (F_0) could be sampled at (2F_0)
  • in the soviet union, kotelnikov proved a sampling theorem
  • the son of the first whittaker further proved results on the sampling theorem
    • then herbert raabe in berlin wrote his phd thesis about a sampling theorem
    • denis gabor worked on a version of the sampling theorem in the mid 1940s
  • then claude shannon, the inventor of information theory, wrote a paper that is to be explored later
  • in 1949 someya in japan also proved the sampling theorem
  • so sampling theorem is a fundamental result where many people independently came up with it

references