Diagnosing 'Crawled – Currently Not Indexed' on Magento Stores

"Crawled – currently not indexed" is one of the more frustrating statuses in Google Search Console because it is not a crawl problem. Google found the pages. It just decided they were not worth indexing.

On Magento stores, this almost always comes down to structural issues, not content quality alone. The platform generates enough URL surface area — filtered URLs, paginated category paths, session ID fragments, URL parameter combinations — that a store with no intentional index controls can easily give Google thousands of URLs it considers low-value.

The goal is not to produce more content for Google. The goal is to produce fewer signals that undermine the pages that actually deserve to rank.

Why This Happens

Google crawls pages but decides not to index them. On Magento, the common causes are:

• Duplicate content — especially layered navigation generating parameter combinations
• Thin product descriptions — placeholder content that does not differentiate the page
• Canonical conflicts — wrong or inconsistent canonical tags across paginated or filtered paths
• Crawl budget misuse — too many low-value URLs consuming the crawl allocation that category and product pages need

Diagnosis Steps

1. Check Canonical Tags

curl -s https://yourstore.com/product.html | grep -i canonical

Some Magento configurations generate self-referencing canonicals incorrectly, particularly where URL rewrites interact with SEO extensions. The rendered canonical in the page source is what matters — not the configuration panel. Check both.

2. Inspect Layered Navigation

Layered navigation (filters) can create thousands of URLs:

/category.html
/category.html?price=100-200
/category.html?color=red
/category.html?price=100-200&color=red

Solution: Use robots.txt or noindex meta tags on filtered URLs.

3. Review Crawl Stats

In Google Search Console:

• Go to Settings → Crawl Stats
• Check if Googlebot is wasting time on parameter URLs

Fixes

Block Parameter URLs in robots.txt

User-agent: *
Disallow: /*?price=
Disallow: /*?color=
Disallow: /*?*&

Improve Product Content

Thin content kills indexing. Add:

• Detailed descriptions (300+ words)
• Unique content per product
• Structured data (Product schema)

Canonical Strategy

Ensure canonical tags point to the correct version:

<link rel="canonical" href="https://yourstore.com/product.html">

Not:

<link rel="canonical" href="https://yourstore.com/product.html?SID=abc123">

Monitoring

Track recovery in Google Search Console:

• Pages → Indexing
• Watch for status changes over 2-4 weeks

What Actually Takes Time

The indexation changes are not immediate. After applying these fixes, Google needs to recrawl the affected URLs before Search Console status updates. That recrawl cycle can take two to four weeks depending on the store's crawl frequency.

The priority order that works in practice:

1. Block parameter URLs first — this is the highest-leverage change and affects the most URLs immediately
2. Fix canonical conflicts on paginated paths — these dilute category page authority silently
3. Improve thin product content — this is slower to produce but long-term more important for ranking quality

Crawl stat monitoring in Google Search Console is useful here. After changes, Googlebot's crawl pattern should shift — more time on indexable product and category pages, less time on parameter combinations and filtered paths.

Conclusion

"Crawled – currently not indexed" on a Magento store is usually a signal that Googlebot is spending too much time on structural URL noise. Fixing it is a matter of reducing that noise — not producing more content for Google to ignore.

Most Magento stores with layered navigation and no active index controls are generating this problem silently from day one. The good news is that the structural fixes are not complex. The hard part is recognizing that the problem is not the pages Google chose not to index. It is the surrounding URLs it chose to crawl instead.