Are all Machine Learning algorithms divided into Classification and Regression, not just supervised learning?

Question

I'm newbie in AI

I know that Supervised Learning algorithms are divided into Classification and Regression algorithms.

But is that true of all machine learning algorithms, not just Supervised Learning? Are there any other categories than Classification and Regression?

Answer 1

All unsupervised algorithms, e.g.

• clustering,
• dimension reduction (PCA, t-sne, autoencoder,...),
• missing value imputation,
• outlier detection,
• ...

Some of them might internally use regression or classification elements, but the algorithm itself is neither.

Answer 2

No, it's much broader than that. You should at least read about the following:

• Clustering
• Dimensionality Reduction
• Reinforcement Learning

Answer 3

Generally speaking "supervised" learning", "classification" and "regression" are actually very different levels of meaning.

Supervised learning is a high level categorization of ML problems which defines all challenges where we have at least some solved/labeled data. This is opposed to unsupervised learning (we don't know the solution) and reinforcement learning (data and labels are generated procedurally).

Classification is specific goal of ML which you can compare to targets like prediction, outlier detection, dimension reduction, etc.

Finally regression is a specific mathematical algorithm which can help us achieve tasks and might be opposed to algorithms such as a Neural Net, Naive Bayes, etc.

A specific ML model can be described in all three terms:

1. An unsupervised classification problem solved with a K-Means clustering algorithm

2. A supervised prediction problem solved with a linear regression

3. A reinforcement learning optimization problem solved with a monte carlo model.

Answer 4

First you need to know that machine learning algorithms are broadly divided into three categories-

• Supervised Learning
• Unsupervised Learning
• Reinforcement Learning

But you should know that most production level machine learning pipelines use a combination of two or all of the three kinds of algorithms.

Supervised Learning takes advantage of already known labels, like whether an email is reported spam or not, how much rainfall has occured in the last 7 days, whether a lump in body is carcinogenic or not etc.

Where in Unsupervised Learning, the data is not labeled i.e. there are no clearly defined target variables (nature of email, amount of rainfall and nature of tumor are the target variables in the previous cases).

Reinforcement Learning algorithms are complex and advanced where the model learns from its previous predictions and correctness.

So, whenever there is a clearly defined target variable, you can apply a supervised learning algorithm. Regression and Classification fall into the supervised learning domain, and cannot be classified as unsupervised learning models.

And, there are many supervised learning algorithms which are not regression or classification, for example-

• Naive Bayes Classifier
• Decision Tree
• Random Forest
• Support Vector Machine

etc.

These are just some examples of the supervised learning algorithms. And these, along with regression and classification, do not fall under unsupervised learning algorithms. Some of the most common unsupervised learning algorithms are-

• Clustering
• Neural Networks
• Anomaly Detection

etc.

Here's a diagram-

                                    Machine Learning Algorithms
                                              |
                                              |
---------------------------------------------------------------------------------
|                                    |                                          |
supervised learning         unsupervised learning           reinforcement learning
|                                            |
|--->Naive Bayes Classifier                  |--->Clustering
|--->Support Vector Machine                  |--->Neural Networks
|--->Decision Tree                           |--->Anomaly Detection
|--->Random Forest
|--->Regression
|--->Classification

These questions are better suited for the Data Science Stack Exchange site.