IntelCoreBot

IntelCoreBot is a legitimate web crawler operated by IntelCore that collects publicly available news articles from pre-approved sources only for source-grounded intelligence analysis.

User-Agent

Mozilla/5.0 (compatible; IntelCoreBot/1.0; +https://intelcore.dev/bot)

What We Crawl

Only pre-approved, allowlisted public news websites
We do not crawl arbitrary sites or follow external links off-domain
Sources are manually reviewed and approved before crawling begins

Crawl Behavior

Setting	Value
Respects robots.txt	Yes, always
Download delay	2–5 seconds per request (source-dependent)
Max concurrency	1–2 requests per domain
Autothrottle	Enabled — adapts to server response times
Cookies	Disabled
JavaScript rendering	None — HTML only

Block IntelCoreBot

Add this to your robots.txt:

User-agent: IntelCoreBot
Disallow: /

Data Usage

Collected articles are used for source-grounded intelligence summaries and search. Content is not used for AI model training or resold.

Contact

Email: minkoko110@gmail.com

Website: intelcore.dev