Skip to main content

03 · Machine-learning algorithms

Understand the model.
Explain the prediction.

Learn what each model is for, how it works and when it can mislead. Start with a familiar prediction problem, then compare approaches using sound evaluation.

Choose by the problem you want to solve

Find the right starting point.

Thirteen learning paths, including Linear Regression and evaluation. The order below is a guide, not a route lock.

Start with a numerical prediction

A house-price question is the easiest place to see how a model learns from data.

  1. 01Available to explore

    Linear Regression

    Explain a numerical prediction and how its settings are learned.

    9 lessons and activities · Equations, errors, updates, multiple inputs, implementation and limits. Recommended first algorithm.

    Open Linear Regression

Learn to judge a prediction

Do this next. Every later model is compared using the same ideas: what the model may know, how data is split and what a score means.

  1. 02Available to explore

    Evaluation Foundations

    Define what a model can legitimately know and what its score means.

    6 lessons · Prediction time, split boundaries, errors, probability quality and uncertainty.

    Open Evaluation Foundations

Bend the line, then tame it

Add curved features, then see how coefficient penalties keep a flexible model honest.

  1. 03Available to explore

    Polynomial Regression

    Explain how additional input features can represent a curve.

    4 lessons · Curved features, flexibility and validation. Helpful foundation: Linear Regression.

    Open Polynomial Regression
  2. 04Available to explore

    Ridge, Lasso & Elastic Net

    Explain how coefficient penalties change a fitted model.

    6 lessons · Regularization, scaling, sparsity and careful selection.

    Open Regularization

Predict a category or probability

Compare different ways to reason about a named outcome, without treating predictions as causal guarantees.

  1. 05Available to explore

    Logistic Regression

    Connect a score to probability and a separate decision.

    6 lessons · Log loss, thresholds, regularization, workflows and limits.

    Open Logistic Regression
  2. 06Available to explore

    K-Nearest Neighbors

    Explain a prediction using nearby labeled observations.

    4 lessons · Distances, votes, feature scales and neighbor selection.

    Open K-Nearest Neighbors
  3. 07Available to explore

    Naive Bayes

    Combine prior class information with evidence from features.

    4 lessons · Counts, smoothing, densities and probability interpretation.

    Open Naive Bayes
  4. 08Available to explore

    Support Vector Machines

    Explain a separating boundary and the margin around it.

    5 lessons · Margins, C, kernels, scaling and classification limits.

    Open Support Vector Machines

Learn with trees and ensembles

Follow a sequence of questions, then see how multiple models can combine or correct predictions.

  1. 09Available to explore

    Decision Trees

    Trace an observation through splits to a leaf prediction.

    6 lessons · Partitions, class mixtures, depth, pruning and evaluation.

    Open Decision Trees
  2. 10Available to explore

    Random Forests

    Explain why different trees can be useful together.

    5 lessons · Resampling, aggregation, out-of-bag evidence and interpretation.

    Open Random Forests
  3. 11Available to explore

    Gradient Boosting

    Explain how successive models correct remaining errors.

    6 lessons · Sequential updates, residuals, classification and stage selection.

    Open Gradient Boosting

Connect the ideas in a neural network

Build from weighted sums to small nonlinear networks; this is an introductory path rather than a general deep-learning curriculum.

  1. 12Available to explore

    Multilayer Perceptrons

    Trace a forward pass and explain the role of nonlinear units.

    5 lessons · Shapes, activations, gradients, evaluation and limitations.

    Open introductory MLP

Choose between models fairly

Bring everything together: compare candidates on matching data, metrics and information boundaries.

  1. 13Available to explore

    Model Selection & Comparison

    Choose between candidates using permitted development evidence.

    6 lessons · Fair comparisons, search, validation and responsible final evaluation.

    Open Model Selection & Comparison

Playbooks: how to build it and when to use it

One step-by-step page per model: why use it, the idea drawn, build it from scratch, use scikit-learn, tune it, choose it or not, and where it goes wrong. New to ML projects? Read how to handle a problem end to end. Not sure which model? Start with How to choose a model.

Apply a complete workflow.

Explore the existing guided housing exercise and see which larger projects are still planned.

Explore Projects →
Earlier evaluation practice and records

The original EV01 prototype remains available. Its records are separate from the full Evaluation Foundations module.

View supported learning records

Lesson refinement, manual accessibility and real learner validation are ongoing. This page does not change any model, assessment or saved progress.