Struct Gelu

pub struct Gelu {
    pub approximate: GeluApprox,
}

Applies the Gaussian Error Linear Units function.

There are three variants:

• GeluApprox::None: Uses gelu. This is the default.
• GeluApprox::Precise: Uses gelu_approximate
• GeluApprox::Fast: Uses gelu_fast_approximate

Fields

approximate: GeluApprox

The approximation to use. Default to GeluApprox::None if not provided.

Implementations

impl Gelu

pub fn new() -> Self

Creates a new instance of Gelu.

Trait Implementations

impl Buildable for Gelu

type Builder = GeluBuilder

The builder type for this buildable type

impl Builder<Gelu> for GeluBuilder

type Error = Infallible

Error with building

fn build(self) -> Result<Gelu, Self::Error>

Build the type

impl Clone for Gelu

fn clone(&self) -> Gelu

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Gelu

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Module<&Array> for Gelu

type Error = Exception

Error type for the module.

type Output = Array

Output type of the module.

fn forward(&mut self, x: &Array) -> Result<Array>

Forward pass of the module.

fn training_mode(&mut self, _: bool)

Set whether the module is in training mode.

impl ModuleParameters for Gelu

fn freeze_parameters(&mut self, recursive: bool)

Freeze all parameters in the module.

fn unfreeze_parameters(&mut self, recursive: bool)

Unfreeze all parameters in the module.

fn parameters(&self) -> ModuleParamRef<'_>

Get references to the module parameters.

fn parameters_mut(&mut self) -> ModuleParamMut<'_>

Get mutable references to the module parameters.

fn trainable_parameters(&self) -> ModuleParamRef<'_>

Get references to the trainable parameters. A parameter is trainable if it is NOT frozen.

fn all_frozen(&self) -> Option<bool>

Check if all parameters in the module are frozen. Returns None if there are no parameters.

fn any_frozen(&self) -> Option<bool>

Check if any parameter in the module is frozen. Returns None if there are no parameters.

fn update(&mut self, parameters: ModuleParam)

Update the module parameters.

fn update_flattened(&mut self, flattened_parameters: FlattenedModuleParam)

Update the module parameters from a flattened representation.