tuned_lens.plotting.token_formatter¶
Contains a class for formatting tokens for display in plots.
Classes
- class tuned_lens.plotting.token_formatter.TokenFormatter(ellipsis='…', newline_replacement='\\\\n', newline_token='ÄŠ', whitespace_token='Ä ', whitespace_replacement='_', max_string_len=7)¶
Format tokens for display in a plots.
- format(token)¶
Format a token for display in a plot.
- Return type:
str
- pad_token_repr_to_max_len(token_repr)¶
Pad a token representation to the max string length.
- Return type:
str