Does anyone know how I can identify requests from YouTube’s podcast RSS feed crawler? Like some combination of user agent string and client IP address range, maybe?
(I've been trying to go through YouTube's support channels, but I'm getting a lot of “Troubleshooting and identifying the origin of traffic to external resources like your RSS feed is typically your responsibility…” and a seeming lack of understanding of my question.)
John Siracusa
npub1lq…vhwvl
2025-03-25 23:40:36 UTC
Author Public Key
npub1lq7l458c6zqqgta485wgsw4eddwprfsmzaxu59ws2znyccdh9pas7vhwvlSeen on
wss://relay.mostr.pubPublished at
2025-03-25 23:40:36 UTCEvent JSON
{
"id": "e055b6aaec324254f7cceb55a990316e87a24881f2165969ff6874c021dcf972",
"pubkey": "f83dfad0f8d080042fb53d1c883ab96b5c11a61b174dca15d050a64c61b7287b",
"created_at": 1742946036,
"kind": 1,
"tags": [
[
"proxy",
"https://mastodon.social/users/siracusa/statuses/114225711432572062",
"activitypub"
]
],
"content": "Does anyone know how I can identify requests from YouTube’s podcast RSS feed crawler? Like some combination of user agent string and client IP address range, maybe?\n\n(I've been trying to go through YouTube's support channels, but I'm getting a lot of “Troubleshooting and identifying the origin of traffic to external resources like your RSS feed is typically your responsibility…” and a seeming lack of understanding of my question.)",
"sig": "c3a4d7bbed93f2c307195680599613e9e918989e852682734457147e41948bb0a00adc17d81300ae66349496150f445645005df143961cfa5e06512b1f897869"
}