model_113101920_flamingo_nano.py

Model Overview

A nano-scale implementation of the flamingo architecture, built for contrastive tasks.

Architecture

  • Architecture: flamingo
  • Scale: nano
  • Attention: sparse
  • Fusion strategy: tensor fusion
  • Task head: contrastive
  • Activation: swish
  • Normalization: scalenorm
  • Initialization: trunc normal

Training

  • Optimizer: adam
  • LR scheduler: linear warmup

Files

  • model_113101920_flamingo_nano.py β€” main artifact of this repository

License

See the license field above.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support