The Active Network
ActiveWin Anonymous | Create a User | Reviews | News | Forums | Advertise | VBA in Excel | Users Online: 0  
 

neowin.net

Amazon.com

  *  

  Microsoft Crawling Google Results For New Search Engine?
Time: 18:08 EST/23:08 GMT | News Source: E-Mail | Posted By: Todd Richardson

I was questioned today by a developer who was watching a particular IP address scan his site. The IP was 65.54.188.86 and is registered to Microsoft Corp. located at One Microsoft Way, Redmond, Washington 98052. This visitor was not sending the normal header information associated with a crawler to the web server such as an http robot name or identifying info or even a browser name.
...
So now you're saying, so what, big deal. But this really is a big deal. It's a big deal not only because the urls this visitor was making requests to don't exist any longer but because the only place these urls can be found is in Google's search results using site:www.sitename.com. A similar query on MSN Search doesn't show the urls at all, even on the beta version of their new Microsoft search engine. But then within just hours of the visitors exit from the site the new same search at Microsoft's new search engine shows all of the urls in question being fully indexed within its results.

Read Only Comments
Return to News
  Displaying Comments 1 through 10 of 10
  This is an archived static copy of ActiveWin.com.
#1 By 3653 (68.52.181.4) at Friday, November 12, 2004 05:45:51 AM
google isnt made up of a bunch of idiots. if microsoft were doing this, google would know about it QUICK and would either stop it or blast it out to the media, or both.

Typical BS from the non-MSFT crowd.

#2 By 7797 (63.76.44.6) at Friday, November 12, 2004 09:29:47 AM
"if microsoft were doing this, google would know about it QUICK and would either stop it or blast it out to the media, or both."

And how do you know they don't .. and won't?

#3 By 13030 (198.22.121.120) at Friday, November 12, 2004 11:04:27 AM
AR: Someone should have warned you about ClosedStandards and his tongue-in-cheek style: he has so much fun playing the part of a MS zealot. Just check out his other posts.

#7: if microsoft were doing this...
#7: Typical BS from the non-MSFT crowd.

It would appear that the evidence speaks for itself.

#4 By 6253 (24.1.239.191) at Friday, November 12, 2004 12:37:46 PM
The day after I moved into a house I was renting, I could not find my VCR. I had already looked through every single box, and I was absolutely, positively sure that it was not in the house. The landlord was the only other person with a key, so he MUST have stolen it! My wife kept saying how the old man seemed so honest and kind, but I lectured her about the deceiving ways of dastardly criminals. Hours later, she finally conceded that, well, maybe he might have done it. I resolved to go straight to the police in the morning.

The next morning, when looking for my razor, I found my VCR. Oops.

Good thing it happened in the days before blogs, when people can jump to conclusions in front of a worldwide audience, with nothing more than a tiny bit of circumstantial evidence.

Folks, it's pretty hard to say for certain that any particular URL exists ONLY in Google. Just because you can't find a URL on Yahoo or somewhere else, it does not mean that Google is guaranteed to be the ONLY place which points to it. If it was visible to Google for a millisecond at any time in the past, then it was visible to something else.

If you run a web server -- ANY web server -- go look at your logs (or your firewall logs, if you're doing stateful inspection of http). All you have to do is open port 80 at any IP address for a few minutes and you will get scanned, probed, and attacked by random bots of all types. They're not just hitting your home page and crawling from there; they hit common paths/filenames. Even if your site is not linked from or linked to any other site on the planet, every page of your site which is either using a common path/filename or is linked to a common path/filename will be found by somebody somewhere.

#5 By 3653 (68.52.181.4) at Friday, November 12, 2004 02:11:08 PM
ch... where's the evidence? It would take google approximately 60 seconds to determine if this were happening. Adding "Microsoft is a thief, and this proves it" to google would be a good idea, and see if it appears on msn search.

Your definition of "proof" is laughable. "some guy" did a search and noticed x, y, z.

#6 By 7797 (63.76.44.6) at Friday, November 12, 2004 02:51:48 PM
Google in't using Linux anymore? Can you elaborate please, maybe with a link or some kind to back up your statement?

"Remember, Google is not a search engine. It is a page ranking system designed to lure in people
to read the ads they've sold."

I guess the same can than also be said about the new MSN search engine?

#7 By 13030 (198.22.121.120) at Friday, November 12, 2004 04:20:14 PM
#13: Remember, Google is not a search engine. It is a page ranking system designed to lure in people to read the ads they've sold.

Well, for a page-rank system it sure does one heck of a job imitating a search engine. Google didn't have ads for several years, so what was their draw back then?

#13: Google doesn't actually use Linux anymore.

Many of their ads in DDJ and other techie journals refer to them having one of the world's largest linux clusters. The job postings on their site also mention linux repeatedly. So what do they use now?

#12: Your definition of "proof" is laughable.

Granted the evidence is speculative, making the charge interesting at best. Besides, MS nevers engages in any quesationable activity, so we don't have anything to worry about...

#8 By 13030 (67.163.112.158) at Friday, November 12, 2004 09:21:37 PM
#16: Google went live in September 1999. By early 2000 they were selling ads.

I was using Google before my second son was born while consulting at Nortel. In fact I e-mailed Google with suggestions about their product. (This is where AWBrian goes, "Suggestions?!? They don't pay me to improve their product! Bah!") The date, late 1998.

#16: If they do use Linux, tell us which distro.

Well, why don't you ask them since it bothers you more than us? After all, you suggested they don't use Linux. Meanwhile, I'll take their word for it.

#16: "The heart of our software is PageRank™... PageRank continues to provide the basis for all of our web search tools."

I guess they meant to use a word other than search.

#16: Ooops. It looks like I stepped on the toes of the Google cult members.

No, just the toes of those people who believe that companies other than MS can produce a quality product. I know, I know... I'm such a blasphemer. :-)

#9 By 12071 (203.217.66.82) at Saturday, November 13, 2004 12:07:53 AM
#13 "Google doesn't actually use Linux anymore."
Hahahahaha yes they switched all 4000 or so pc's to Windows Server 2003... in your mind.

#10 By 7797 (63.76.44.6) at Tuesday, November 16, 2004 11:28:49 AM
It amazes me how many people can't see through ClosedStandard's razorsharp sarcasm.



 

  *  
  *   *
 
replica watches