teacher-specific adapters

Teacher-specific adapters are components added to models to facilitate knowledge transfer from teacher models during the training of student models. They can help align the student’s learning process with the teacher’s demonstrated capabilities.