Index

A

Aggregator (class in bio_attention.attention)

ALiBi (class in bio_attention.positional) Attention (class in bio_attention.attention)

B

BinaryEmbedding (class in bio_attention.embed)

BinEmbedding (class in bio_attention.embed)

C

CLS (class in bio_attention.embed)

ContinuousEmbedding (class in bio_attention.embed)

D

DiscreteEmbedding (class in bio_attention.embed)

DPB (class in bio_attention.positional)

F

forward() (bio_attention.attention.Aggregator method) (bio_attention.attention.Attention method) (bio_attention.attention.Transformer method) (bio_attention.attention.TransformerDecoder method) (bio_attention.attention.TransformerEncoder method) (bio_attention.embed.BinaryEmbedding method) (bio_attention.embed.BinEmbedding method) (bio_attention.embed.CLS method) (bio_attention.embed.ContinuousEmbedding method) (bio_attention.embed.DiscreteEmbedding method)

forward_indexed() (bio_attention.attention.RandomAttention method) forward_naive() (bio_attention.attention.RandomAttention method) (bio_attention.attention.WindowAttention method) forward_sliced() (bio_attention.attention.WindowAttention method)

L

LearnedContinuous (class in bio_attention.positional)

LearnedVocab (class in bio_attention.positional)

M

mod_mask() (bio_attention.positional.ALiBi method) (bio_attention.positional.DPB method) (bio_attention.positional.XL method) mod_qkv() (bio_attention.positional.Rotary method) (bio_attention.positional.XL method)

mod_x() (bio_attention.positional.LearnedContinuous method) (bio_attention.positional.LearnedVocab method) (bio_attention.positional.Sinusoidal method)

R

RandomAttention (class in bio_attention.attention)

Rotary (class in bio_attention.positional)

S

Sinusoidal (class in bio_attention.positional)

T

Transformer (class in bio_attention.attention)

TransformerDecoder (class in bio_attention.attention) TransformerEncoder (class in bio_attention.attention)

W

WindowAttention (class in bio_attention.attention)

X

XL (class in bio_attention.positional)