charieswei
/
Build-A-Large-Language-Model-CN
mirror of https://github.com/skindhu/Build-A-Large-Language-Model-CN.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

add third chapter

This commit is contained in:
skindhu 2024-10-27 11:23:34 +08:00
parent c04f7545be
commit 4249f5ea7b
1 changed files with 9 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
Book/3.实现注意力机制.md
View File

@ -285,10 +285,17 @@ Sum: tensor(1.)
> 1. **Softmax 的原理** > 1. **Softmax 的原理**
> >
> Softmax 函数的公式如下： > Softmax 函数的公式如下：
>
>
> $$ > $$
> \operatorname{softmax}\left(z_{i}\right)=\frac{e^{z_{i}}}{\sum_{j} e^{z_{j}}} > \operatorname{softmax}\left(z_{i}\right)=\frac{e^{z_{i}}}{\sum_{j} e^{z_{j}}}
> $$ > $$
> >
> ```
> $$
> E = mc^2
> $$
> ```
> >
> >
> >