/r/NovelAi

Photograph via snooOG

Subreddit for the in-development AI storyteller NovelAI.

If you want to follow the progress, come join our Discord server!

/r/NovelAi

38,700 Subscribers

5

Trouble understanding how people run longer stories/adventures

Hi all! I'm fairly new to NovelAI but I've been reading up/learning, mainly about lorebooks but I have kind of hit a wall here.

I quickly ran into the issue of hitting the cap of contextual tokens (even by keeping most of the lorebook on key activation only) just by playing the story. The context records the story as you progress it but what do people do when they finally hit the 8k cap? I might be missing something but I feel like the only way to go forward from there is pruning the story context but even then you eventually run out of non-relevant information to cut out?

Am I missing something?

[Edit: forgot to mention I'm on the Opus tier and I'm experimenting mostly with the newest AI Erato ]

7 Comments
2024/11/02
11:14 UTC

4

Does past generations influence the next image generation?

I'm specifically talking about the images in History. Maybe it's just me, but I feel like there is a certain tendency that the AI prefers to keep iterating on what it has just done, and deleting unwanted images from history has an impact on what comes next. Can anyone confirm that? I want to know, because sometimes I just generate a ton of random stuff for brainstorming that has nothing to do with each other, and I don't know if I should be weary of that when I do.

2 Comments
2024/11/02
07:33 UTC

5

Looking for some advice

So I've just got the Opus tier.

I get that NAI isn't the same as something like ChatGPT, it's a cowriter.

But I'm running into 2 issues and I'm not sure what I need to tweak to reduce them.

One is that any time I let it run for more than a single 300 token generation, it tries to end the scene. I don't mind shorter paragraphs, most of mine tend to be, but it really wants to end things fast. Like "Their food arrives, a steaming plate of pasta for him and a mouthwatering dish of chicken parmesan for her." Ok, all good so far.

But I do another generation and it goes "They soon finish the meal and leave, happy with the date."

I know I can delete, tweak and regenerate, but it seems like it's really stuck on ending the scene.

The other issue is that it loves to summarise. It doesn't generate any dialogue, just a summary. "He learns that she is close to her family, that she loves to travel, and that she wants to start her own non-profit someday. She learns that he is a bit of a loner, that he loves to read, and that he wants to travel the world."

If I were doing that by hand, what it just put in 47 words is something I'd expect to be closer to ten thousand words of dialogue, description, actions, gestures, etc. I want the generator to inspire things I wouldn't necessarily think of, but it just seems to want to end the scene and summarise everything that happens.

What's odd is that it isn't my only story on there, and the other ones, despite the same kind of writing, don't seem to have this issue.

If anyone has any suggestions, I'd welcome them, as the advanced settings aren't making much sense to me yet.

10 Comments
2024/11/01
22:37 UTC

3

Concurrent Generation

I sometimes have two stories up in browser windows and I will occasionally accidentally trigger a 'concurrent generation' error if both windows try to talk to the AI at the same time. It's frustrating because it's accidental. I understand why you don't want concurrent generation, so I'm not arguing in favor of changing that.

I wonder if we could convince our friends at NovelAI to, instead of kicking an error, simply queue the request and serve them in the order they are received? That would avoid giving the user an error message and save you the bandwidth and processing that you'll get when they mash the generate button and resubmit the prompt again.

1 Comment
2024/11/01
15:31 UTC

3

Is there a guide for best practices to follow for Image generation for best results?

For example, stuff like Ideal image dimensions or techniques for better quality. I see a lot of quality loss when I don't generate in portrait,and succeedingly gets worse as I move to square and then landscape. Or tips for multiple characters in the same frame, formatting of brackets/prompt etc.

2 Comments
2024/11/01
02:09 UTC

11

For Halloween, how do I make patchwork skin like this?

3 Comments
2024/10/31
18:30 UTC

59

Should we create a list of art styles that Novel AI supports

10 Comments
2024/10/31
04:21 UTC

10

Asuna X Black Swordsman

4 Comments
2024/10/31
02:00 UTC

0

NovelAI is losing money on me on Erato and I feel guilty about it

I've been crunching some numbers, and I'm genuinely concerned about NovelAI's financial well-being due to my usage patterns. As we all know, they recently released their Erato model (finetuned from Llama 3 70B) with the 25 USD/month subscription requirement and the generous 8k context window.

Here's the thing though - I've been tracking my usage, and I generate around 60 million tokens per month with Erato. I just can't help myself; the model is just too good! But then I made a shocking discovery while browsing OpenRouter's pricing for Llama 3 70B RP finetuned models.

  • Input tokens: $0.35 per million tokens
  • Output tokens: $0.4 per million tokens

Now, given the 8k context window, my input costs are actually quite minimal. But those outputs... oh boy. I generate long, flowing narratives. Once I start, I can't stop.

So let's do the math:

Maybe 2 million input tokens × $0.35 per million = $0.7 in input costs

58 million output tokens × $0.4 per million = $22.4 in output costs

That's $24 in raw inference costs alone for my usage, and they're only charging $25/month! This leaves them with just $1 of margin to cover all their groundbreaking R&D efforts like the bleeding-edge work of finetuning Meta's models and the engineering required to maintain the 8k context window.

How can they possibly fund their next-generation AI research with such thin margins? We can't risk losing such an innovative company to unsustainable pricing models.

13 Comments
2024/10/30
21:34 UTC

37

Was looking at one of my old Kayra scenarios and this gave me a chuckle.

0 Comments
2024/10/30
21:01 UTC

3

Adding foreground details for imagegen

How do you guys add foreground details to pieces you create with inagegen?

I’ve had pretty good results using background:XXXXXX with varying degrees of strength but not much luck adding foreground details.

Any pointers?

1 Comment
2024/10/30
19:49 UTC

14

Why isn't there another subscription teir for 16k tokens?

Tier* Title. I mean, why not? Do they think it's overkill or something?

21 Comments
2024/10/30
05:28 UTC

31

NovelAI Testimonial Collection ('24)

Heyo, it's been like three years since we last updated our site testimonials (skullemojiskullemoji), so here's the obligatory form to leave some kind feedback :> (Stuck in a question at the end to talk about any of your gripes to offset the overwhelming kindness everyone will surely write to us here)

I've also included a field to attach a name or username, but it's not at all required.

Please be aware that submissions are entirely voluntary, and by submitting this form, you grant us the ability to use the contents of your submission in public marketing applications, like the landing page.

Link: https://forms.gle/ZtWrAzx3g2dt8CpDA

0 Comments
2024/10/29
15:11 UTC

7

Is There a Good Way to Bias Against Dialogue with Erato?

Oftentimes, after a dialogue heavy section I want to draw back from that and either have characters reflect for a bit, or else go heavier with description. The AI being what it is, it obviously prefers to keep doing things the way they've been done, and has a hard time switching that way. In the past, I would have used biases against quotation marks to encourage generation to shift away from dialogue. However, it seems that Erato has many tokens that include a starting quote, so it will use one of those instead when a standalone quotation mark is suppressed. Instruction and starting to write a non-quote line work, but I'm wondering if there's a more general way to do this without switching models.

7 Comments
2024/10/28
21:06 UTC

61

A nuclear level burn.

0 Comments
2024/10/28
06:47 UTC

2

is there way to extend the generated output in Text Adventure mode?

there's so many settings that it overwhelms me. i thought increasing Output Length would do it but nothing changed

2 Comments
2024/10/28
05:01 UTC

9

Do you Guys put "}}}" Before or after the Comma ?

Im Getting the Hang of Image Generation but unsure

13 Comments
2024/10/28
01:50 UTC

60

Created AI Image Gen Prompt Guide PDF that can be uploaded to ChatGPT for streamlined prompt creating specific to NovelAI.

A few simple steps:

  1. Prime ChatGPT with the following custom instructions:

What would you like ChatGPT to know about you to provide better responses?

I am focused on generating high-quality AI images and seek precision and control in my prompts. I prioritize efficient and clear guidance in response to achieve desired visual results. My prompts rely heavily on the structure and order of tags and settings adjustments like Steps, Guidance, and Seed. My preference is for responses that prioritize practical and technical prompt adjustments over generalized advice.

How would you like ChatGPT to respond?

When crafting responses: Never use the word “Character” or “Characters” as a token - for any group image describe the group's gender composition with either “boy” or “girl”, regardless of the character’s age, with a numerical prefix representing the total of said gender, i.e. 2boys_A_and_B, {A-boy is a wizard}, {B-Boy is a warrior} or (for multi-gender image) 1boy_and_1girl, {Boy is wizard}, {Girl is warrior}.

Structure the Prompt: Start with the main subject (e.g., "1girl" or "sunset"), followed by key details: character traits (hair, eyes), environment, lighting, and framing.

Use {} to emphasize and [] to de-emphasize tags as needed. Specify which tags to strengthen or weaken based on their importance.

Highlight essential tags (style, era, medium) and place important elements at the beginning for greater influence.

Suggest unique tags (e.g., “1980s style,” “watercolor”) and organize by importance, especially for character-centered or setting-focused prompts.

Advanced Techniques: Provide tags for perspectives and interactions (e.g., "view from above," "hugging") for complex compositions.

  1. Here is the PDF link (the link is my Google Docs PDF file).

  2. Download and then upload the PDF into ChatGPT and press enter. ChatGPT will then summarize the PDF or otherwise confirm that it has viewed the PDF.

  3. Now simply describe the image you want.

I typically phrase my prompt to ChatGPT as:

Create a prompt for a dark-fantasy illustration featuring a foreboding, eccentric, lich king sitting in an ornate gothic throne. He is residing over a dark, macabre, court of foul and insidious shadow-like entities.

The resulting prompt from ChatGPT:

"1boy, {lich king}, {skeletal face}, {pale skin}, sitting in {ornate gothic throne}, {opulent crown}, {glowing red eyes}, surrounded by {dark court of shadow-like entities}, {macabre atmosphere}, {dim and eerie lighting}, {intricate and twisted throne room}, {gothic architecture}, {decayed stone walls}, {foul and insidious creatures} in the background, {shadowy figures looming}. Foreboding {dark fantasy} style, {high detail}, {high contrast}. [bright colors]"

What's the point of this?

  1. Well for me, I struggled with understanding that prompting style and format and would often create giant oversized prompts that were overly verbose and wasting tokens.

  2. It will allow you to spend less time trying to craft a perfect prompt and instead streamline your ideas from your imagination directly into a ready to go prompt.

9 Comments
2024/10/27
11:17 UTC

6

How can I find and mix using Nsfw prompt list? (And some other questions.)

My English is bad. But using translator is much worse, so please understand about that.

1.Novel ai image prompt is coming from danbooru's image data. So even if i can't find using sexual word in prompt recommendation, it's ok in many situations to find correct tag using danbooru.

But sometimes, it doesn't work correctly. For example, i wan't male sucks female breast. breastsucking is correct tag. But it contains breast sucks herself or male both of them. Right?

I don't know how it does work, but most of results are female sucks tits herself. Then, i should try many times changing male's sexual poses, but recommending nsfw prompt is blocked, so it's so difficult.

All of tags in danbooru and prompts in image generator is not same. Even the prompt does exist, too weak to recognizing, Result is same. Therefore, some of hidden nsfw prompts should be different or virtually unusable compared by original danbooru's tag. But I can't find that!

Inputting prompt Unrecognizable makes malfunction. Especially for me, generating specific artist styles giving different characters or situations, it is a serious problem.

That's Why I asked how to unrestricting prompt recommendation. If it is impossible, is there are any newest site or listing of nsfw prompt?

I appreciate answering about that.

2.In documentation, using letter | between prompts makes these prompts are mixing. But I failed.

Some people said it's possible cause of updated generator blocks that function. I agreed but, when i use that, prompt limitation bar is separated.

Even if i can't mix prompt using |, It seems to be changed different function.

What is the truth? It just works? Or completely unusable? Or it works in different way?

3 Comments
2024/10/27
09:35 UTC

11

How do I turn off the bat animations?

Pretty sure it's causing nai to to lag out. Generations are currently taking anywhere from 10 to 20 seconds to load, and the picture Generations UI is lagging as well, despite the fact that I have trimmed my story, deleted the branches, deleted my cache and everything. Alternately, if it's not the bats, then what the hell could it be?

5 Comments
2024/10/27
04:58 UTC

34

Erato's discovered a new form of breath mint.

2 Comments
2024/10/26
21:20 UTC

Back To Top