![Hands-On Mathematics for Deep Learning](https://wfqqreader-1252317822.image.myqcloud.com/cover/81/36698081/b_36698081.jpg)
Inner product space
An inner product on a vector space is a function , and satisfies the following rules:
and
For all and
.
It is important to note that any inner product on the vector space creates a norm on the said vector space, which we see as follows:
![](https://epubservercos.yuewen.com/FF11E0/19470372701459106/epubprivate/OEBPS/Images/Chapter_1161.jpg?sign=1739695811-wDzOSYXNZjCY5mf2jLxlZvFtfSITsgWD-0-18e7f8954d6b612f9bebce737c88d109)
We can notice from these rules and definitions that all inner product spaces are also normed spaces, and therefore also metric spaces.
Another very important concept is orthogonality, which in a nutshell means that two vectors are perpendicular to each other (that is, they are at a right angle to each other) from Euclidean space.
Two vectors are orthogonal if their inner product is zero—that is, . As a shorthand for perpendicularity, we write
.
Additionally, if the two orthogonal vectors are of unit length—that is, , then they are called orthonormal.
In general, the inner product in is as follows:
![](https://epubservercos.yuewen.com/FF11E0/19470372701459106/epubprivate/OEBPS/Images/Chapter_277.jpg?sign=1739695811-umA6RlnAcYTnpdYMzHAqwElO6PkiZ69E-0-b1b19692f17d7d237425febec60eff31)