From c04f7545be2617b8e3c63f764a65aefd2d618bbc Mon Sep 17 00:00:00 2001 From: skindhu Date: Sun, 27 Oct 2024 11:21:06 +0800 Subject: [PATCH] add third chapter --- Book/3.实现注意力机制.md | 8 +++----- 1 file changed, 3 insertions(+), 5 deletions(-) diff --git a/Book/3.实现注意力机制.md b/Book/3.实现注意力机制.md index 174a81c..a4e0fc1 100644 --- a/Book/3.实现注意力机制.md +++ b/Book/3.实现注意力机制.md @@ -285,11 +285,9 @@ Sum: tensor(1.) > 1. **Softmax 的原理** > > Softmax 函数的公式如下: -> -> $\operatorname{softmax}\left(z_{i}\right)=\frac{e^{z_{i}}}{\sum_{j} e^{z_{j}}}$ -> -> -> +> $$ +> \operatorname{softmax}\left(z_{i}\right)=\frac{e^{z_{i}}}{\sum_{j} e^{z_{j}}} +> $$ > > >