Here is an interactive tool to visualize all outputs of a 2d input $x∈ℝ²$ case. We denote with $k$ the layer index $$\ca{ x^{(0)}:=x\\ y^{(k)}:=A^{(k-1)}x^{(k-1)} + b^{(k-1)} & ∀k>0\\ x^{(k)}:=σ(y^{(k)}) & ∀k>0\\ }$$
$x^{(0)}$
$y^{(0)}$
$x^{(1)}$
$y^{(1)}$
$x^{(2)}$
$y^{(2)}$
$x^{(3)}$
1
2
3
$A^{(0)}=$
$b^{(0)}=$
$σ(x)=$
$A^{(1)}=$
$b^{(1)}=$
$σ(x)=$
$A^{(2)}=$
$b^{(2)}=$
$σ(x)=$