modules ======= .. currentmodule:: hearth.modules AbsolutePositionalEmbedding --------------------------- .. autoclass:: AbsolutePositionalEmbedding :members: :undoc-members: :no-inherited-members: ---- AttentionPool1D --------------- .. autoclass:: AttentionPool1D :members: :undoc-members: :no-inherited-members: ---- BaseModule ---------- .. autoclass:: BaseModule :members: :undoc-members: :no-inherited-members: ---- Bertish ------- .. autoclass:: Bertish :members: :undoc-members: :no-inherited-members: ---- Boom ---- .. autoclass:: Boom :members: :undoc-members: :no-inherited-members: ---- LayerNormSimple --------------- .. autoclass:: LayerNormSimple :members: :undoc-members: :no-inherited-members: ---- MaskedLayerNorm --------------- .. autoclass:: MaskedLayerNorm :members: :undoc-members: :no-inherited-members: ---- ReZero ------ .. autoclass:: ReZero :members: :undoc-members: :no-inherited-members: ---- Residual -------- .. autoclass:: Residual :members: :undoc-members: :no-inherited-members: ---- SelfAttention ------------- .. autoclass:: SelfAttention :members: :undoc-members: :no-inherited-members: ---- TimeMasked ---------- .. autoclass:: TimeMasked :members: :undoc-members: :no-inherited-members: ---- TransformerEmbedding -------------------- .. autoclass:: TransformerEmbedding :members: :undoc-members: :no-inherited-members: ---- TransformerEncoder ------------------ .. autoclass:: TransformerEncoder :members: :undoc-members: :no-inherited-members: ---- TransformerEncoderBlock ----------------------- .. autoclass:: TransformerEncoderBlock :members: :undoc-members: :no-inherited-members: ----