**MATLAB**

Desk calculator operations

Booleans

Nonstandard numbers

Loops and conditionals

Script file

Functions

Variable scope and parameter passing

** **

**I: Linear Algebra **

Vectors

Definition of vectors

Applications of vectors

Basic operations on vectors

Dot product

Vectors in MATLAB: Basic operations

Plotting vectors in MATLAB

Vectors in other programming languages

** **

**Matrices **

Definition of matrices

Applications of matrices

Simple operations on matrices

Multiplying a matrix times a vector

Linear transformation

Systems of linear equations

Matrix multiplication

Vectors as matrices

Algebraic properties of matrix multiplication

Matrices in MATLAB

** **

**Vector Spaces **

Subspaces

Coordinates, bases, linear independence

Orthogonal and orthonormal basis

Operations on vector spaces

Null space, image space, and rank

Systems of linear equations

Inverses

Null space and Rank in MATLAB

Vector spaces

Linear independence and bases

Sum of vector spaces

Orthogonality

Functions

Linear transformations

Inverses

Systems of linear equations

The general definition of vector spaces

** **

**Algorithms **

Gaussian elimination: Examples

Gaussian elimination: Discussion

Computing a matrix inverse

Inverse and systems of equations in MATLAB

Ill-conditioned matrices

Computational complexity

** **

**Geometry **

Arrows

Coordinate systems

Simple geometric calculations

Geometric transformations

** **

**Change of Basis, DFT, and SVD **

Change of coordinate system

The formula for basis change

Confusion and how to avoid it

Nongeometric change of basis

Color graphics

Discrete Fourier transform (Optional)

Singular value decomposition

Further properties of the SVD

Applications of the SVD

MATLAB

** **

**II: Probability **

Probability

The interpretations of probability theory

Finite sample spaces

Basic combinatorial formulas

The axioms of probability theory

Conditional probability

The likelihood interpretation

Relation between likelihood and sample space probability

Bayes’ law

Independence

Random variables

Application: Naive Bayes’ classification

** **

**Numerical Random Variables**

Marginal distribution

Expected value

Decision theory

Variance and standard deviation

Random variables over infinite sets of integers

Three important discrete distributions

Continuous random variables

Two important continuous distributions

MATLAB

** **

**Markov Models**

Stationary probability distribution

PageRank and link analysis

Hidden Markov models and the k-gram model

** **

**Confidence Intervals **

The basic formula for confidence intervals

Application: Evaluating a classifier

Bayesian statistical inference (Optional)

Confidence intervals in the frequentist viewpoint: (Optional)

Hypothesis testing and statistical significance

Statistical inference and ESP

** **

**Monte Carlo Methods**

Finding area

Generating distributions

Counting

Counting solutions to DNF (Optional)

Sums, expected values, integrals

Probabilistic problems

Resampling

Pseudo-random numbers

Other probabilistic algorithms

MATLAB

** **

**Information and Entropy**

Information

Entropy

Conditional entropy and mutual information

Coding

Entropy of numeric and continuous random variables

The principle of maximum entropy

Statistical inference

** **

**Maximum Likelihood Estimation**

Sampling

Uniform distribution

Gaussian distribution: Known variance

Gaussian distribution: Unknown variance

Least squares estimates

Principal component analysis

Applications of PCA

**
**

**References**

**
**Notation

Index