Type Alias Sinpe

pub type Sinpe = SinusoidalPositionalEncoding;

Type alias for SinusoidalPositionalEncoding.

Aliased Type

pub struct Sinpe {
    pub scale: f32,
    pub cosine_first: bool,
    /* private fields */
}

Fields

scale: f32

multiplicative scale for the embeddings. Default is sqrt(2/dimensions)

cosine_first: bool

if true embed using [cos(x), sin(x)] instead of the reverse

Implementations

impl Sinpe

pub const DEFAULT_COSINE_FIRST: bool = false

Default value for cosine_first field.

pub const DEFAULT_MIN_FREQUENCY: f32 = 9.99999974E-5f32

Default value for min frequency.

pub const DEFAULT_MAX_FREQUENCY: f32 = 1f32

Default value for max frequency.

pub const DEFAULT_FULL_TURNS: bool = false

Default value for full turns.

Trait Implementations

impl Module<&Array> for Sinpe

type Error = Exception

Error type for the module.

type Output = Array

Output type of the module.

fn forward(&mut self, x: &Array) -> Result<Self::Output, Self::Error>

Forward pass of the module.

fn training_mode(&mut self, _mode: bool)

Set whether the module is in training mode.