Reading 05: Linear Regression and Review

Everyone:

Materials¶

Linear Regression¶

Foundations of Computational Agents
- Sections 7.3.2 (First few paragraphs) and 7.4.2 (Reading)
Additional Resources
- Probabilistic Machine Learning - Sections 7.5, 8.1.3, Chapter 11 (Reading)
- Introduction to Statistical Learning - Chapter 3 (Reading)
- Understanding Machine Learning - Chapter 9.2 (Reading)
- Harvard CS50 (Video)
- Stanford CS221 (Video)
- Cornell CS4780 (Video)
- Linear Regression (StatQuest) (Video)
- Multiple Regression (StatQuest) (Video)
- Bias and Variance (StatQuest) (Video)
- L2 Regularization (StatQuest) (Video)
- L1 Regularization (StatQuest) (Video)
- L1 vs. L2 Visualization (StatQuest) (Video)
- Linear Regression (MLU) (Blog Post)
- Linear Regression (rasbt) (Notebook)
- Linear Regression (HdM) (Blog Post)
- [(1805) Nouvelles M\xE9thodes Pour la D\xE9termination des Orbites des\ \ Com\xE8tes (Legendre)"
- [(1809) Theoria Motus Corporum Coelestium in Sectionibus Conicis Solem Ambientium (Gauss)
- [(1970) Ridge Regression - Biased Estimation for Nonorthogonal Problems (Hoerl and Kennard)
- [(1996) Regression Shrinkage and Selection via the Lasso (Tibshirani)

Review¶

Quiz¶

Once you have done the readings, answer the following Reading 02 Quiz questions:

Submission¶

To submit you work, follow the same process outlined in Reading 00:

$ git checkout master                 # Make sure we are in master branch
$ git pull --rebase                   # Make sure we are up-to-date with GitHub

$ git checkout -b reading02           # Create reading02 branch and check it out

$ cd reading02                        # Go into reading02 folder
$ $EDITOR answers.json                # Edit your answers.json file

$ ../.scripts/check.py                # Check reading02 quiz
Checking reading02 quiz ...
      Q1 0.60
      Q2 0.60
      Q3 0.90
      Q4 0.90
   Score 3.00 / 3.00
  Status Success

$ git add answers.json                # Add answers.json to staging area
$ git commit -m "Reading 02: Done"    # Commit work

$ git push -u origin reading02        # Push branch to GitHub

Pull Request¶

Once you have committed your work and pushed it to GitHub, remember to create a pull request and assign it to the appropriate teaching assistant from the Reading 02 TA List.