Artificial Intelligence

Artificial intelligence, sub-disciplines of artificial intelligence, and methodologies used in artificial intelligence and machine learning.

Blog
Artificial Intelligence
Chuong Ngo
November 21, 2024
•
Artificial Intelligence

Attention Mechanisms: Putting Things Into Focus

You can't just see. You have to know what and where to look.
Chuong Ngo
April 29, 2021
•
Artificial Intelligence

Neural Network Compositionality: A Sum of Its Parts

Machine learning means that a computer can learn from experience without being specifically programmed. But, is the computer learning the right things?
Chuong Ngo
April 15, 2021
•
Artificial Intelligence

Transformers: The Nuts and Bolts

Gears, servos, and circuits, oh my! So, many things go into a Transformer! So many things to examine! Oh...wait...that’s the wrong Transformer.
Chuong Ngo
April 8, 2021
•
Artificial Intelligence

Transformers: An Unexpected NLP Revolution

When you need to go faster, but RNNs cannot keep up. Whom do you call? Transformers, of course.
Chuong Ngo
April 1, 2021
•
Artificial Intelligence

Convolutional Neural Networks: Machine Learning's Eye

Let’s take a step back and examine a machine learning architecture that has become the go-to for image recognition and computer vision.
Chuong Ngo
March 25, 2021
•
Artificial Intelligence

NTM: Memories Under the Hood

Memory is essential to NTMs. So, understanding NTMs’ memory addressing system is a must.
Chuong Ngo
March 18, 2021
•
Artificial Intelligence

Neural Turing Machine: The Power of Memory

We have added attention and gates to our neural networks. Now, let’s revolutionize machine learning with memory.
Chuong Ngo
March 11, 2021
•
Artificial Intelligence

Gated Recurrent Unit: The Other White Meat

LSTMs fix vanishing and exploding gradients, but LSTMs are not the only architectures that do that.
Chuong Ngo
March 4, 2021
•
Artificial Intelligence

The Long Short-Term Memory Network

LSTMs are widely used in machine learning now. What are they? How do they work?
Chuong Ngo
February 25, 2021
•
Artificial Intelligence

Backpropagation: Training Neural Networks

Backpropagation is so commonplace in neural network training that it is easy to take it for granted. But what is it?
Chuong Ngo
February 4, 2021
•
Artificial Intelligence

Generalizable Variations of the Attention Mechanism

Applying the attention principle to more tasks meant that the attention mechanism had to be modified.
Chuong Ngo
December 1, 2020
•
Artificial Intelligence

The Attention Mechanism for Neural NLP Models

The attention mechanism has become widespread in neural NLP modeling, but where did it come from?