X, effectively, Twitter.com, is now blocking Bing Search, particularly Bingbot, from crawling and accessing content material posted on Twitter.com, on the X platform. Twitter particularly added to its robots.txt file a directive to disallow Bingbot from crawling the content material on its platform.
Here’s a screenshot of its robots.txt file:
This was noticed first, I consider, by Mike Ginley who posted this on X, “Twitter blocking Bing is an fascinating transfer…” Glenn Gabe dug into the timeline, noticing this was a reasonably latest change by Bing:
As of July 1, Bing was not being blocked from crawling. By September 1, ALL bots not included particularly within the file have been being blocked. And as of Oct 17, Bing was particularly being blocked. A website question reveals some very bizarre issues for Twitter in Bing, for apparent causes. https://t.co/hWjKgxM9q7
— Glenn Gabe (@glenngabe) October 18, 2023
Actually, a website command on Bing solely reveals 180,000 Twitter URLs displaying up:
However with Google, a website command reveals 422 million URLs.
Again in July Twitter blocked Google resulting in an enormous drop in visibility for Twitter in Google Search. Just a few days later, Twitter reversed that change.
I suppose Twitter / X doesn’t need visitors from Bing Search? I imply, if they need extra environment friendly indexing, simply use IndexNow?
Discussion board dialogue at X.
