Sitemap and robots.txt
Jukto makes your sitemap and robots.txt by itself. What is listed, what is left out, where to find them and how to give them to Google.
What it is#
A sitemap is a list of your pages that you hand to Google. robots.txt is a short note that tells search engines what not to visit. Jukto builds both for you from your live website, so they are always up to date. There is nothing to turn on.
What you need#
- Nothing to set up.
- At least one published page or product, or the sitemap has nothing to list.
Where to find your keys#
There are no keys. You only need the two addresses.
- 1
Find your sitemap
Add
/sitemap.xmlto the end of your website address, for examplehttps://your-shop.jukto.store/sitemap.xml. It works on your own domain too. - 2
Find your robots.txt
Add
/robots.txtto the end of your website address. Its last line names the sitemap. - 3
Give the sitemap to Google
Connect Google Search Console. Jukto then sends the sitemap for you.
What Jukto does#
The sitemap lists:
- your home page and your shop page, if they are published
- live content pages, landing pages, the contact page and the policy pages
- published products and the collections that hold at least one of them, each with the date it last changed
It leaves out: drafts, archived pages, demo items and trashed products. A sitemap holds up to 5,000 addresses. If your online store is hidden or catalog-only, the shop and buyer pages that do not exist are not listed.
robots.txt lets search engines in, and asks them to skip your cart, checkout, account, order, search and wishlist pages, the preview and the API. It ends with the address of your sitemap. The editor preview address tells search engines to stay out completely.
Both are served fresh for about a minute at a time, so a new product shows up in the sitemap shortly after you publish it.
Test and turn on#
- 1
Open the sitemap
Open
/sitemap.xmlof your website in a browser. You should see a list of addresses, one for each published page, product and collection. - 2
Look for a new product
Publish a product, wait a minute and reload the sitemap. The product address should now be in it.
- 3
Read robots.txt
Open
/robots.txt. It should end with aSitemap:line that points to your sitemap. - 4
Nothing to turn on
Both are always on. Send the sitemap to Google by connecting Search Console.
Common errors#
| What you see | What to do |
|---|---|
| The sitemap is empty | Publish at least one product or page. The SEO score shows this as Nothing to list in the sitemap. |
| A product is missing from the sitemap | It is probably a draft, archived, a demo product or in the trash. Publish it. Wait a minute and reload. |
| robots.txt says Disallow: / for everything | You are looking at the editor preview address, or your store is not open yet. Open your real website address. |
| Google says it could not fetch the sitemap | Open the sitemap address in your browser. If it opens, wait and let Google try again; it can take some time. |
Comments (0)
Anyone can comment. Please do not post phone numbers, passwords or customer details.