RankCore.ai

1. Challenge

A live backlink-intelligence SaaS was suffering a silent, severe SEO regression — search engine crawlers, including Googlebot and PageSpeed Insights, were being blocked at the edge without any obvious application-level error.

2. Business Requirements

• Restore full crawler accessibility without exposing the site to actual bot abuse.
• Fix the underlying authentication misconfiguration surfaced during the investigation.
• Ensure the fix was durable, not a temporary workaround.

3. Proposed Architecture

Used a layered edge-security review — DNS/proxy settings, edge security mode, and platform-level bot-challenge rules — to isolate exactly which layer was blocking legitimate automated traffic.

4. Implementation Approach

Systematically ruled out application-level causes before identifying the edge security layer as the source, then applied a targeted, scoped fix (a firewall allow-rule for known-good crawlers) rather than disabling protection broadly.

5. Security Considerations

Balanced restoring legitimate crawler access against maintaining meaningful bot protection — the fix was scoped to known-good crawler traffic rather than a blanket relaxation of edge security.

6. Results

Crawler access and SEO scoring were restored after root-causing the issue to an edge-security misconfiguration rather than an application bug.

7. Technologies Used

• Cloudflare
• Vercel
• Supabase
• DNS / Edge Security