Outer Product

Introduction

In linear algebra, the outer product is a mathematical operation that takes two vectors and produces a matrix. This operation is also known as the tensor product or dyadic product. The outer product is essential in various areas of mathematics and has applications in deep learning and machine learning.

Definition

Given two vectors, $( \mathbf{u} )$ and $( \mathbf{v} )$, the outer product $( \mathbf{u} \otimes \mathbf{v} )$ results in a matrix where each element is the product of corresponding elements from the two vectors.

$$
\mathbf{u} \otimes \mathbf{v} =
\begin{bmatrix}
u_1 v_1 & u_1 v_2 & \cdots & u_1 v_n \\
u_2 v_1 & u_2 v_2 & \cdots & u_2 v_n \\
\vdots & \vdots & \ddots & \vdots \\
u_m v_1 & u_m v_2 & \cdots & u_m v_n \\
\end{bmatrix}
$$

Where:

• $( \mathbf{u} )$ is an ( m )-dimensional column vector: $( \mathbf{u} = [u_1, u_2, \ldots, u_m] )$
• $( \mathbf{v} )$ is an ( n )-dimensional row vector: $( \mathbf{v} = [v_1, v_2, \ldots, v_n] )$
• The resulting matrix is of size $( m \times n )$

Example

Let’s consider two vectors for illustration:

$( \mathbf{u} = [1, 2, 3] )$
$( \mathbf{v} = [4, 5, 6] )$

The outer product $( \mathbf{u} \otimes \mathbf{v} )$ is calculated as follows:

$$\mathbf{u} \otimes \mathbf{v} =
\begin{bmatrix}
1 \cdot 4 & 1 \cdot 5 & 1 \cdot 6 \\
2 \cdot 4 & 2 \cdot 5 & 2 \cdot 6 \\
3 \cdot 4 & 3 \cdot 5 & 3 \cdot 6 \\
\end{bmatrix}
=
\begin{bmatrix}
4 & 5 & 6 \\
8 & 10 & 12 \\
12 & 15 & 18 \\
\end{bmatrix}
$$

Numpy Code

You can compute the outer product of two vectors in Python using the NumPy library. Here’s the code in Markdown with MathJax for mathematical notation:

To compute the outer product of vectors $\mathbf{u} $ and $ \mathbf{v} $ using NumPy, you can use the following code:

import numpy as np

u = np.array([1, 2, 3])
v = np.array([4, 5, 6])

outer_product = np.outer(u, v)

print("Outer Product:")
print(outer_product)

This code will produce the following output:

Outer Product:
[[ 4 5 6]
[ 8 10 12]
[12 15 18]]

The `np.outer` function in NumPy calculates the outer product of two vectors.