From 4249f5ea7b20d5a11c05f855e74dfb5952356c2c Mon Sep 17 00:00:00 2001 From: skindhu Date: Sun, 27 Oct 2024 11:23:34 +0800 Subject: [PATCH] add third chapter --- Book/3.实现注意力机制.md | 11 +++++++++-- 1 file changed, 9 insertions(+), 2 deletions(-) diff --git a/Book/3.实现注意力机制.md b/Book/3.实现注意力机制.md index a4e0fc1..b1bf76d 100644 --- a/Book/3.实现注意力机制.md +++ b/Book/3.实现注意力机制.md @@ -284,11 +284,18 @@ Sum: tensor(1.) > > 1. **Softmax 的原理** > -> Softmax 函数的公式如下: +> Softmax 函数的公式如下: +> +> > $$ > \operatorname{softmax}\left(z_{i}\right)=\frac{e^{z_{i}}}{\sum_{j} e^{z_{j}}} > $$ -> +> +> ``` +> $$ +> E = mc^2 +> $$ +> ``` > > >