So in theory you could feed it incomplete text, and then ask it for the probabilities of what the next character could be?
Or a partially completed song, asking for the next note. I’m not sure if you’re joking, but using it for space constrained next token generation within a grammar sounds like a really neat use case.
skerit · · focus · HN ↗
iforgotmypasswo · · focus · HN ↗
copperx · · focus · HN ↗