EE269 - Signal Processing for Machine Learning

Lecture Slides

Lecture 1: Introduction, signal processing and machine learning systems

Lecture 2: Discrete signals, change of basis

Lecture 3: Discrete Fourier Transform

Lecture 4: Distance based signal classification, nearest neighbor classifier, Hilbert space

Lecture 5: Linear systems, circulant matrices, convolution, eigenvector decomposition

Lecture 6: Bayes classifiers, Bayes risk, signal detection

Lecture 7: Stationary signals, autocorrelation, linear and quadratic discriminant analysis

Lecture 8: Fisher's linear discriminant, simultaneous diagonalization

Lecture 9: Multi-class discriminant, separating hyperplanes, support vector machine (SVM)

Lecture 10: Constrained optimization, convex duality, dual SVM

Lecture 11: Nonlinear features, kernels, kernel machines

Lecture 12: Least-squares regression, autoregressive models

Lecture 13: Reproducing Kernel Hilbert Spaces, regularization

Lecture 14: Adaptive filters, Least Mean Squares algorithm

Lecture 15: Neural networks

Lecture 16: Convolutional nets, deep learning

Lecture 17: Wavelets, Discrete Wavelet Transform

Lecture 18: Nonnegative Matrix Factorization, dictionary learning