Community forum for knowledge and support

Updated last month

Ability to generate sitemap in a more granular format

At a glance

The community members are discussing the possibility of adding more granular sitemap generation capabilities to the platform. The main points are:

- The community member who posted the original question would like to see the ability to generate sitemaps incrementally across multiple prompts, rather than the entire site at once. They also suggest adding an open LLM API key to allow for higher quality and more extensive sitemap output.

- In response, another community member notes that while there are no immediate plans for these features, they should be added to the backlog of ideas. They also mention that the platform already has page-level prompts, which could potentially be used to achieve some of the desired functionality.

The discussion then focuses on the current character limits for the sitemap prompt (3,000 characters) and the page prompts (500 characters), which the community member feels may be too restrictive, especially for professional workflows. They suggest exploring ways to increase these limits or find workarounds, such as generating separate sitemaps for different page groups.

The community members also discuss the potential impact of increasing the prompt character limits, and whether the additional output would provide a meaningful return on investment.

Finally, one community member notes that the sitemap generation capabilities are mainly being used for static site generation, as an alternative to setting

Are there any plans to add the ability to generate your sitemap in a more granular format? This would be a huge addition. things like being able to generate your sitemap incrementally across multiple prompts (e.g. one page group at a time instead of the whole site), or adding your open LLM API key to allow for a higher quality output or more extensive output with more pages?

M
M
5 comments

@Madison Sears hmm yeah this is interesting, I dont know that there are any immediate plans right now, no. But we should add this to the backlog of ideas. One thing to keep in mind is that we do have page level prompts as well.

So in theory, you could do some of what you are referring to, today.

I appreciate the reply and unfortunately it is still quite limited context.

Take for example, the 3000 character limit in the global sitemap prompt, and the 500 character limit in each page prompt. Across a 30 page site that is 18,000 total characters, or around 4k tokens we can prompt with.

o1-mini can output 64k, and most other top-tier models can output at least 16k.

The sitemap prompt only needs to be maybe 4,000-5,000 characters. 3,000 feels just a hair too small when you’re using it for a professional workflow and need specific details implemented, since those details take a lot of space.

The page prompts are the more limiting factor. 500 characters per page prompt is pretty low, I barely have enough room to describe what the page copy is supposed to say before it cuts me off.

I guess the best way to get around that right now is to generate a different sitemap for each page group? Haven’t tried it yet but I’ll see how it works.

I guess another way would be to see what kind of output you get from 100 characters, versus the full 500. Are you seeing a dramatic difference in the results? As far as I know, our team has done hours upon hours of testing. Its basically all we do internally - we breathe AI...we're even convinced @Jonathan Nathan might even be one....so from our testing, we didn't notice dramatically different results by providing more information. But you could see different results by providing less info that is more specific.

I am also guessing that those limits are imposed by us directly, not because of any integration we have. Maybe there is an opportunity to increase the character limits on both the sitemap prompt and page prompts. But again, what kind of ROI are you getting from making sure you have a 16k character prompt versus a 400?

It is mainly for static site generation capabilities.

As an example, if I have to make 20-25 (however many is too many to do by hand manually without it being a time sink) service pages for a website, I can set up the Webflow CMS, or another CMS, add framework specific props and go through the hassle of generating them.

Or, I can just go in Relume and an outline of my copy and tell it to fill it in, basically replacing a CMS for all of that stuff.

Add a reply
Sign up and join the conversation on Slack