From f04df0ee457d2ff28d8a506537565e5a0defefe1 Mon Sep 17 00:00:00 2001 From: skindhu Date: Sun, 27 Oct 2024 11:17:31 +0800 Subject: [PATCH] add third chapter --- Book/3.实现注意力机制.md | 10 +++++++--- 1 file changed, 7 insertions(+), 3 deletions(-) diff --git a/Book/3.实现注意力机制.md b/Book/3.实现注意力机制.md index 508c3a3..570a1cc 100644 --- a/Book/3.实现注意力机制.md +++ b/Book/3.实现注意力机制.md @@ -285,9 +285,13 @@ Sum: tensor(1.) > 1. **Softmax 的原理** > > Softmax 函数的公式如下: -> $$ -> \operatorname{softmax}\left(z_{i}\right)=\frac{e^{z_{i}}}{\sum_{j} e^{z_{j}}} -> $$ +> +> $`\operatorname{softmax}\left(z_{i}\right)=\frac{e^{z_{i}}}{\sum_{j} e^{z_{j}}}`$ +> +> +> +> +> > > >