Model Compression

concepts · 1 notes linked

Related: Microsoft · Google · Transformers · Attention Mechanism

Notes

• Efficient transformers: Survey of recent work — Taxonomy and survey of efficient transformer architectures through 2022