Hello!
Thank you for the excellent service you provide. I’ve been using Llama3.1 70B for creative writing tasks, particularly for generating long-form content that takes advantage of its large context window.
However, I’ve noticed that as the output extends, it tends to become repetitive, which limits its effectiveness for sustained creative workflows. To address this, would it be possible to support additional parameters like min-p, frequency penalty, and presence penalty?
I believe many users could benefit from having finer control over repetitiveness, and these parameters are well-known for improving text variability without compromising coherence.
1 Like
Hello,
Thank you for bringing this up. We’ll be sure to pass this along to our team for further discussion and evaluation. We’ll take a closer look at the feasibility and whether it’s something we could offer in the future.
Thanks again for your feedback, and we’ll keep you updated if there are any developments!
Regards,
Prajwal
Thank you for considering this request.
On a related note, would it also be possible for sambanova to implement support for repetition penalties in the future? This feature could significantly improve the quality of long-form texts by reducing repetitive sequences.
Your attention to this would be greatly appreciated.
1 Like