Bogus Requests From Msnbot/Bing Crawler Resulting in Error 404

Apologies to the collectors on Colnect, this post is a technical post not related to collecting and collectibles.

Recently, we've started seeing a lot of bogus requests from msnbot. These were requests to URLs that never existed on our website and were filling up our error logs. Internet searches have led to nothing which is the reason for this blog post.

Suggested solution: disable msnbot on your robots.txt file and submit a ticket to their support. While it did take them some time to respond, they finally did and the issue has been resolved. We've then removed the block on our robots.txt and for over a week now, everything seems fine.

When asked about the reasons for these problem, the support team provided NO EXPLANATION as to what might have caused the problem:

"Thank you for patiently waiting. The product group have resolved this request but no additional information was provided."

"We are sorry to inform you that we cannot provide any information regarding this. We hope you understand."

Which leads us to believe the reason is a bug in msnbot or an attack on msnbot which messed up URLs between websites.

Here are a few such bogus requests:
[27-Dec-2013 03:48:51 GMT+0] REQUEST[/content/dam/aba/global/global_nav_logo.png] REFERER[]
USER[0] AGENT[msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)] ADDR[65.55.215.33]
[27-Dec-2013 03:49:36 GMT+0]
REQUEST[/bin/dashboard/default-avatar-unknown.png] REFERER[]
USER[0] AGENT[msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)] ADDR[65.55.215.39]
[27-Dec-2013 02:50:38 GMT+0] REQUEST[/enclosure.jpg] REFERER[]
USER[0] AGENT[msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)] ADDR[199.30.20.57]
[27-Dec-2013 02:53:48 GMT+0]
REQUEST[/user_data/packages/ginichi/img/common/btn_en.jpg] REFERER[]
USER[0] AGENT[msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)] ADDR[65.55.215.71]
[27-Dec-2013 02:54:14 GMT+0]
REQUEST[/DesktopModules/CATALooKStore/MakeThumbImage.aspx?fileticket=ikazmqBNAjM%3d&PORTALID=0&W=120&H=120] REFERER[]
USER[0] AGENT[msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)] ADDR[199.30.16.47]
[27-Dec-2013 03:33:21 GMT+0]
REQUEST[/upload/save_image/category/c1177.jpg] REFERER[]
USER[0] AGENT[msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)] ADDR[65.55.215.74]
[27-Dec-2013 03:49:20 GMT+0]
REQUEST[/wvc-1365778711/wordansfiles/images/2013/4/12/186393/186393_340.jpg] REFERER[]
USER[0] AGENT[msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)] ADDR[199.30.16.30]
[27-Dec-2013 03:52:45 GMT+0]
REQUEST[/core/media/media.nl?id=343820&c=337772&h=2fd9dd88833b005b614a] REFERER[]
USER[0] AGENT[msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)] ADDR[199.30.16.14]