token importance scores

Token importance scores measure the relevance or contribution of individual tokens (words, symbols, etc.) in a sequence to the final model output. Analyzing these scores helps identify which elements of the input have the greatest impact on predictions.