## 轉送傳播

$$\color{input} x_j \color{black} =$$$$\sum_{i\in in(j)} w_{ij}\color{output} y_i\color{black} +b_j$$

## 轉送傳播

$$\color{output} y \color{black} = f(\color{input} x \color{black})$$

## 轉送傳播

$$\color{output} y \color{black} = f(\color{input} x \color{black})$$
$$\color{input} x_j \color{black} =$$$$\sum_{i\in in(j)} w_{ij}\color{output} y_i \color{black} + b_j$$

## 衍生錯誤

$$w_{ij} = w_{ij} - \alpha \color{dweight}\frac{dE}{dw_{ij}}$$

[注意事項] 更新規則非常簡單：如果權重隨著權重增加 ($$\color{dweight}\frac{dE}{dw_{ij}}\color{black} < 0$$) 減少，請增加權重，否則如果權重增加時錯誤增加 ($$\color{dweight}\frac{dE}{dw_{ij}} \color{black} > 0$$)，請降低權重。

## 其他衍生項目

• 節點的輸入總數 $$\color{dinput}\frac{dE}{dx}$$
• 節點 $$\color{doutput}\frac{dE}{dy}$$的輸出內容。

## 背傳播

$$\color{doutput} \frac{\partial E}{\partial y_{output}} \color{black} = \color{output} y_{output} \color{black} - \color{output} y_{target}$$

## 背傳播

$$\color{dinput} \frac{\partial E}{\partial x} \color{black} = \frac{dy}{dx}\color{doutput}\frac{\partial E}{\partial y} \color{black} = \frac{d}{dx}f(\color{input}x\color{black})\color{doutput}\frac{\partial E}{\partial y}$$

## 背傳播

$$\color{dweight} \frac{\partial E}{\partial w_{ij}} \color{black} = \frac{\partial x_j}{\partial w_{ij}} \color{dinput}\frac{\partial E}{\partial x_j} \color{black} = \color{output}y_i \color{dinput} \frac{\partial E}{\partial x_j}$$

## 背傳播

$$\color{doutput} \frac{\partial E}{\partial y_i} \color{black} = \sum_{j\in out(i)} \frac{\partial x_j}{\partial y_i} \color{dinput} \frac{\partial E}{\partial x_j} \color{black} = \sum_{j\in out(i)} w_{ij} \color{dinput} \frac{\partial E}{\partial x_j}$$