Overview
This prompt aims to guide users in analyzing their website’s server logs for SEO optimization. Website owners and SEO professionals will benefit from actionable insights to enhance crawlability and search engine performance.
Prompt Overview
Purpose: This analysis aims to enhance the website’s crawlability and overall search engine performance through detailed log examination.
Audience: The primary audience includes webmasters and SEO professionals seeking to optimize their site’s interaction with search engine bots.
Distinctive Feature: The analysis focuses on identifying specific inefficiencies in the crawl process and providing tailored recommendations for improvement.
Outcome: By implementing the recommendations, the website can improve its visibility and efficiency in search engine results.
Quick Specs
- Media: Text
- Use case: Website log analysis
- Techniques: Crawl analysis, Log file analysis
- Models: SEO best practices
- Estimated time: 2-3 hours
- Skill level: Intermediate
Variables to Fill
- [INSERT WEBSITE URL TO ANALYZE] – Insert Website Url To Analyze
Example Variables Block
- [INSERT WEBSITE URL TO ANALYZE]: Example Insert Website Url To Analyze
The Prompt
#CONTEXT:
You are an expert SEO strategist and web analytics professional. Your task is to help the user analyze a provided website’s server logs to:
- Gain insights into how search engine bots are crawling the site
- Identify any issues or inefficiencies in the crawl process
- Provide actionable recommendations to optimize the site’s crawlability and search engine performance
#ROLE:
Expert SEO strategist and web analytics professional
#RESPONSE GUIDELINES:
The response should be organized into the following sections:
Executive Summary:
- Provide key findings from the log analysis
- Give a high-level overview of bot activity and behavior
- Highlight the most pressing issues identified
Detailed Log Analysis:
- Create a table with the following columns:
- Bot Name
- Crawl Frequency
- Pages Crawled
- Crawl Errors
- Response Codes
Key Metrics:
- Total bot visits
- Unique pages crawled
- Average pages per visit
- Most active bots
- Common crawl errors
Inefficiencies Identified:
- List and describe inefficiencies found during the analysis
Recommendations:
- Provide actionable recommendations to address the identified inefficiencies
- Optimize the site’s crawlability and search engine performance
Next Steps:
- Outline the steps the user should take to implement the recommendations
- Improve the site’s search engine performance
#ANALYSIS CRITERIA:
- The log analysis should be comprehensive and cover all relevant aspects of bot activity and behavior.
- Focus on identifying issues and inefficiencies that impact the site’s crawlability and search engine performance.
- Provide clear, actionable recommendations that directly address the identified issues.
- Avoid generic advice and tailor the recommendations to the specific website being analyzed.
#INFORMATION ABOUT ME:
- Website URL: [INSERT WEBSITE URL TO ANALYZE]
#RESPONSE FORMAT:
Use the format specified in the original prompt, including headings, tables, and bullet points.
- Do not use XML tags in the response.
Screenshot Examples
[Insert relevant screenshots after testing]
How to Use This Prompt
- [Crawl Frequency]: How often bots visit the site.
- [Pages Crawled]: Total number of pages accessed by bots.
- [Crawl Errors]: Issues encountered during bot crawling.
- [Response Codes]: HTTP status codes returned to bots.
- [Total Bot Visits]: Overall number of bot interactions.
- [Unique Pages Crawled]: Distinct pages accessed by bots.
- [Average Pages per Visit]: Average number of pages per bot visit.
- [Common Crawl Errors]: Frequent issues affecting crawl efficiency.
Tips for Best Results
- Executive Summary: Analyze bot activity to identify crawl patterns and issues.
- Detailed Log Analysis: Review bot names, crawl frequency, pages crawled, errors, and response codes.
- Inefficiencies Identified: Highlight specific areas where crawlability is hindered.
- Recommendations: Implement strategies to improve site performance and optimize crawling.
FAQ
- What are the key findings from the log analysis?
The analysis revealed high bot activity, several crawl errors, and inefficiencies affecting site performance. - How often do search engine bots visit the site?
Bots visit the site frequently, but specific frequencies vary by bot type and behavior. - What are the common crawl errors identified?
Common errors include 404 Not Found and 500 Internal Server Errors, impacting crawl efficiency. - What recommendations can improve site crawlability?
Recommendations include fixing errors, optimizing robots.txt, and enhancing site speed and structure.
Compliance and Best Practices
- Best Practice: Review AI output for accuracy and relevance before use.
- Privacy: Avoid sharing personal, financial, or confidential data in prompts.
- Platform Policy: Your use of AI tools must comply with their terms and your local laws.
Revision History
- Version 1.0 (December 2025): Initial release.