Capture AI crawlers on Netlify.

Log Drains are available on Netlify Enterprise. A Site Traffic drain covers every request Netlify's CDN serves, including cached pages.

You need your site ID and server secret from Settings → Connection (see Hosting integrations). In the dashboard, Connect analytics → Hosting integrations → Netlify shows these steps with your site ID, domain and secret filled in. Below, replace <your-site-id>, <paste-your-server-secret> and example.com with your own values.

Configure Netlify so example.com sends reliable AI crawler request telemetry to Virent.

Site ID: <your-site-id>
Use the full Virent server secret from the Connect dialog. Do not use the masked preview "vha_sk_••••" as the real value.

Use the current provider documentation: https://docs.netlify.com/manage/monitoring/log-drains/

Steps:
1. Create the Site Traffic drain: On a Netlify Enterprise site, create a Log Drain, choose General HTTP endpoint, and select Site Traffic logs.

https://virent.app/api/ingest/netlify

2. Keep required request fields: Add the Authorization header. Do not enable Exclude PII: Virent needs client_ip and user_agent for bot classification and hashes the IP before storage.

Authorization: Bearer <paste-your-server-secret>

3. Enable complete delivery: Use JSON or NDJSON delivery and leave filtering off so CDN-cached pages and every supported AI crawler reach Virent.

4. Activate and verify: Publish the drain, request https://example.com/ as an AI crawler, and verify that Virent reports the connection.

Keep the secret server-side, preserve 100% request coverage where the provider supports sampling, and verify both normal site delivery and a crawler request after activation.

Steps#

1. 01

   Create the Site Traffic drain

   On a Netlify Enterprise site, create a Log Drain, choose General HTTP endpoint, and select Site Traffic logs.

   Endpoint URL

   https://virent.app/api/ingest/netlify

2. 02

   Keep required request fields

   Add the Authorization header. Do not enable Exclude PII: Virent needs client_ip and user_agent for bot classification and hashes the IP before storage.

   Custom header

   Authorization: Bearer <paste-your-server-secret>

3. 03

   Enable complete delivery

   Use JSON or NDJSON delivery and leave filtering off so CDN-cached pages and every supported AI crawler reach Virent.

4. 04

   Activate and verify

   Publish the drain, request https://example.com/ as an AI crawler, and verify that Virent reports the connection.

Check Netlify's current documentation if its screens differ from these steps.

Verify#

Send a test crawler request to your site. The setup dialog in Virent shows "Virent is receiving AI crawler traffic" once the first request arrives.