jax.nn.swish

jax.nn.swish(x)

SiLU activation function.

Computes the element-wise function:

\[\mathrm{silu}(x) = x \cdot \mathrm{sigmoid}(x) = \frac{x}{1 + e^{-x}}\]

Parameters

x (Any) – input array

Return type

Any