mlx_rs::nn

Function gelu_fast_approximate

Source
pub fn gelu_fast_approximate(x: impl AsRef<Array>) -> Result<Array>
Expand description

A fast approximation to Gaussian Error Linear Unit.

This is:

x * sigmoid(1.773 * x)