Topic: autoregressive

Reviser, a new autoregressive method for text generation, allows for the insertion or revision of earlier content without the need for repeated sequence-level computations, offering a more efficient approach to revision-capable text generation. This development is significant as it enhances flexibility in text creation and editing processes.

arxiv.org↗

A new latent-space language model called NCP-ArchPreview has been introduced, which extends autoregressive pretraining by incorporating Next Concept Prediction (NCP) alongside standard next-token prediction. This advancement aims to enhance the model's ability to understand and generate more complex linguistic concepts.

arxiv.org↗