DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averaging

Matteo Pagliardini, Amirkeivan Mohtashami, Francois Fleuret, Martin Jaggi · arXiv preprint arXiv:2402.02622 · 2024

How to cite

@article{pagliardini2024denseformer,
  title={DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averaging},
  author={Pagliardini, Matteo and Mohtashami, Amirkeivan and Fleuret, Francois and Jaggi, Martin},
  journal={arXiv preprint arXiv:2402.02622},
  year={2024}
}

References

See the full reference list in the paper.