AI crawling & data licensing
Nakordoni.eu publishes live border-queue data, wait-time forecasts and travel guides that cost us money to collect every minute of every day. Search engines and AI assistants that send readers back to us are welcome for free. Bulk crawling that takes the data and returns nothing is not — it needs a paid agreement.
Who may crawl without an agreement
Search engines
Google, Bing, Yandex, DuckDuckGo, Apple, Seznam and other general search crawlers — they send us readers.
AI assistants that cite us
Crawlers of AI products that link the source in their answers — OpenAI, Google, Anthropic, Perplexity, Meta AI, Apple, Amazon, Cohere, You.com and similar — including the fetchers that load a page because a user asked about it.
Link previews & ad verification
Social and messenger preview bots, and the ad-quality crawlers of the networks that serve our ads.
Our partners and API clients
Anyone using the documented developer API with a key, within the plan they signed up for.
Free access still means: obey robots.txt, identify yourself with an honest user-agent, stay under a reasonable request rate, and keep attribution and a working link to the source page. Using another company’s crawler name is treated as abuse and blocked.
What needs a paid agreement
- Collecting our pages or data to train, fine-tune or evaluate a model.
- Systematic copying of queue numbers, forecasts, checkpoint or carrier data into your own product, dataset or feed.
- Reselling, redistributing or publishing our data, with or without our name on it.
- Any crawl heavy enough to affect our servers, or one that hides behind a false user-agent, residential proxies or rotating addresses.
Crawlers in this group receive HTTP 402 “Crawling not permitted” on every request until an agreement is in place. Nothing is stored about them beyond the counters we need to enforce this.
How pay-per-crawl works
We follow the pay-per-crawl model: instead of an outright block, a crawl is priced. You tell us which parts of the site you need and at what volume, we agree a price and a payment method, and your crawler is allowed through — either by a signed agreement and an allowance on your verified addresses, or through Cloudflare’s pay-per-crawl settlement where your operator supports it.
For structured, reliable access most companies are better served by the developer API: documented endpoints, stable formats, higher limits and support, instead of parsing HTML pages. Open the developer portal →
Request access
Write to us through the partner contact form and choose “AI crawling / data licensing”, or email partnerships@nakordoni.eu. Tell us your company, the crawler’s user-agent and addresses, what you need and how often, and what you do with it. We normally reply within two business days.