Skip to main content

Site Configuration Files

All published Maisey sites include a default sitemap.xml, robots.txt, and llms.txt files. Custom files, including other types, can also be uploaded to the root of your website for further customization.

Written by Support
Updated today

All published Maisey sites include a default sitemap.xml, robots.txt, and llms.txt files. Custom files, including other types, can also be uploaded to the root of your website for further customization.

Friendly Reminder:

As of December 2023, Google deprecated the ability for sitemaps to be automatically submitted. To ensure prompt indexing, it's advised to manually submit your sitemap using Google Search Console (for more information, please visit Improve your performance on Google Search). Alternatively, consider using our app designed to assist with this process, Google Search Console.

Default Sitemap.xml and Robots.txt Files

To access the sitemap.xml and robots.txt files:

  1. Open your published URL and add the desired file (either sitemap.xml or robots.txt) at the end (e.g., https://www.example.com/sitemap.xml or https://www.example.com/robots.txt).

  2. Enter the modified URL into your browser.

  3. Save the file or link as needed.

Note

  • Only published sites have these files.

  • These files are note able to be edited, though a custom one can be uploaded.Sitemap.xml

Specific Information

A sitemap lists all of the URLs for your site, including eCommerce category pages and product URLs (for both native and third-party stores), as well as blog posts and dynamic page records.

The sitemap cannot be edited, though a custom one can be uploaded.

Friendly Reminder:

As of December 2023, Google deprecated the ability for sitemaps to be automatically submitted. To ensure prompt indexing, it's advised to manually submit your sitemap using Google Search Console (for more information, please visit Improve your performance on Google Search). Alternatively, consider using our app designed to assist with this process, Google Search Console

Note:

  • Only published sites have sitemaps.

  • Pages that are set to not index (located in the page's SEO settings) will not appear in the sitemap. If the entire site is set to not index in the site's settings, the sitemap will be empty.

  • If your sitemap contains non-secure URLs (HTTP instead of HTTPS), consider requiring visitors to use a secure connection (HTTPS).To enable the Force visitors to use secure connection (HTTPS) setting, in the side panel, click More, select Settings, and then click the Site SSL tab.

LLMS.txt File

A LLMS.txt file is a simple text file that provides LLMs, such as ChatGPT, with a structured overview of a website's most important content. The file includes a list of the site's URLs, along with brief descriptions, making it easy for LLMs to scan and understand.

Maisey creates and updates a LLMS.txt file for every site that is published. The file is in markdown format, and contains a list of pages that are available in the site, with descriptions and URLs. All sites will have this via www.sitedomain.com/llms.txt.

The following pages are included in the file:

  • Regular pages

  • Dynamic pages

  • Blog posts

  • Translated pages

  • Native store category pages

  • Native store product pages

Replace Default Files or Add Custom Files

To override the default files (sitemaps and robots.txt files), ensure the Source URL matches the file names (sitemap.xml and robots.txt) exactly. Supported file types include .xml, .txt, and .json. Note that the .txt files can be any .txt file and not just ads.txt or robots.txt.

Friendly Reminder:

  • Assisting with the content of custom files is beyond our support scope.

  • Keep in mind that the Maisey platform does not validate custom files, so even if a file is corrupt, it will still be served.

Note: Only site configuration file types are supported (for example, .txt and .xml).

From Site Dashboard

To upload from the Site Dashboard:

1. In the side panel, click SEO/AEO.

2. Click the Additional Settings tab.

3. Locate the Indexing & Crawling section, then click Go to URL Redirect (you will be directed to the URL Redirect screen with the File option pre-selected).

4. In the Source URL field, enter the file path you would like the file to have. For example, if you enter in ads.txt, the path for it on the live site will be www.mydomain.com/ads.txt.

Note that the .txt files can be any .txt file and not just ads.txt or robots.txt.

custom-file-source-url.png

5. Click + Upload file.

6. Ensure the Redirect type is set to 2xx OK (Redirect) and click Add.

7. Publish or republish your site to make the changes live.

From URL Redirects

To upload in URL redirects:

1. In the side panel, click More, then click Settings.

2. Click URL Redirect.

3. Click Add New Redirect.

4. In the Source URL field, enter the file path you would like the file to have. For example, if you enter in ads.txt, the path for it on the live site will be www.mydomain.com/ads.txt.

Note that the .txt files can be any .txt file and not just ads.txt or robots.txt.

custom-file-source-url.png

5. Select the File option. If you don't see the File option on the URL Redirect screen, access it initially from the SEO settings and upload a file. Once done, you can continue uploading additional files directly from the URL Redirect screen.

6. Click + Upload file.

7. Ensure the Redirect type is set to 2xx OK (Redirect) and click Add.

8. Publish or republish your site to make the changes live.

Revert Back

If you wish to revert to using Maisey's default sitemap or robots.txt files:

1. In the side panel, click More, then click Settings.

2. Click URL Redirect.

3. Locate the file you want to remove and click Delete.

4. Publish or republish your site for the changes to take effect.

Can I upload or run PHP files?

No. Server-side languages such as PHP are not supported, as the platform does not provide server-side execution or filesystem access.

You can instead host your server-side file (for example, a PHP script) on an external server and connect it to your site. Build the frontend using HTML, CSS, and JavaScript (e.g., create a form that submits to the external PHP endpoint), and process the request on that external server.

Note that Maisey Support cannot troubleshoot custom code.

Did this answer your question?