Bot traffic tracking setup

1Get your tracking token

Create a free account, add your website, and open Dashboard → Track → Bot Traffic. Your site's tracking token is shown in the setup card.

2Install the package

npm install @didyouseo/bot-traffic

Zero dependencies, TypeScript types included, works on Node 18+ and edge runtimes.

3Add one line to your server

Next.js

// middleware.ts (or proxy.ts in newer Next.js)
import { NextResponse, type NextFetchEvent, type NextRequest } from "next/server";
import { trackBotVisit } from "@didyouseo/bot-traffic";

export function middleware(request: NextRequest, event: NextFetchEvent) {
  trackBotVisit(request, event, { token: process.env.DIDYOUSEO_TOKEN! });
  return NextResponse.next(); // or the rest of your existing middleware
}

export const config = {
  // Keep robots.txt, llms.txt, and sitemaps reachable - AI crawlers read those first
  matcher: ["/((?!_next/static|_next/image|favicon.ico).*)"],
};

Cloudflare Pages

// functions/_middleware.ts
import { trackBotVisit } from "@didyouseo/bot-traffic";

export async function onRequest(context) {
  trackBotVisit(context.request, context, { token: "YOUR_TRACKING_TOKEN" });
  return context.next();
}

Cloudflare Workers

import { trackBotResponse } from "@didyouseo/bot-traffic";

export default {
  async fetch(request, env, ctx) {
    const response = await handleRequest(request);
    // Response-aware: also records the HTTP status (404s are a content signal)
    trackBotResponse(request, response, ctx, { token: env.DIDYOUSEO_TOKEN });
    return response;
  },
};

Express / Connect

import { botTraffic } from "@didyouseo/bot-traffic/express";

app.use(botTraffic({ token: process.env.DIDYOUSEO_TOKEN }));

Hono

import { trackBotResponse } from "@didyouseo/bot-traffic";

app.use("*", async (c, next) => {
  await next();
  trackBotResponse(c.req.raw, c.res, c.executionCtx, { token: "YOUR_TRACKING_TOKEN" });
});

Any other stack

POST the same JSON from anywhere - see the API reference for the raw endpoint contract:

POST https://didyouseo.com/api/bot-traffic
Content-Type: application/json

{ "token": "...", "path": "/pricing", "userAgent": "GPTBot/1.2",
  "ip": "203.0.113.7", "status": 200 }

4Deploy and verify

Deploy, then send a test request pretending to be a bot:

curl -A "GPTBot/1.0" https://yourdomain.com/ -o /dev/null

Within a few seconds the visit appears in Track → Bot Traffic with a GPTBot badge. From then on, every real crawler visit is recorded automatically.