Token repetition

#7
by hyeonjlee - opened

sometimes model inference result has token repetition.
like 300,300,300,300....
how to remove it?

Sign up or log in to comment