Comments on: Google MD5 Hash Search Engine http://www.dragoslungu.com/2007/06/22/google-md5-hash-search-engine/ Security Tools and Tips Wed, 20 Aug 2008 14:31:37 +0000 http://wordpress.org/?v=2.2.2 By: Onur Safak http://www.dragoslungu.com/2007/06/22/google-md5-hash-search-engine/#comment-58303 Onur Safak Mon, 14 Jul 2008 23:25:24 +0000 http://www.dragoslungu.com/2007/06/22/google-md5-hash-search-engine/#comment-58303 but how will you binefit from storing them into google It helps a lot because even if the site goes offline, google cache will still have the hash Actually, the benefit is the storage and the ability to search hundreds of gigabytes, even terabytes of result data from the index. And I don't like the idea to disturb one of the best internet service with a great team behind. but how will you binefit from storing them into google

It helps a lot because even if the site goes offline, google cache will still have the hash

Actually, the benefit is the storage and the ability to search hundreds of gigabytes, even terabytes of result data from the index.

And I don’t like the idea to disturb one of the best internet service with a great team behind.

]]> By: Dragos Lungu http://www.dragoslungu.com/2007/06/22/google-md5-hash-search-engine/#comment-5495 Dragos Lungu Wed, 17 Oct 2007 18:41:53 +0000 http://www.dragoslungu.com/2007/06/22/google-md5-hash-search-engine/#comment-5495 @photoshop It helps a lot because even if the site goes offline, google cache will still have the hash @photoshop
It helps a lot because even if the site goes offline, google cache will still have the hash

]]> By: photoshop http://www.dragoslungu.com/2007/06/22/google-md5-hash-search-engine/#comment-5466 photoshop Wed, 17 Oct 2007 04:00:19 +0000 http://www.dragoslungu.com/2007/06/22/google-md5-hash-search-engine/#comment-5466 but how will you binefit from storing them into google but how will you binefit from storing them into google

]]> By: Tim Brown http://www.dragoslungu.com/2007/06/22/google-md5-hash-search-engine/#comment-292 Tim Brown Sun, 24 Jun 2007 12:18:14 +0000 http://www.dragoslungu.com/2007/06/22/google-md5-hash-search-engine/#comment-292 No not at all, everyone sees the same content. The point here is that Google doesn't always cache the body of the web page, but will always cache the title. Hence, when we present results for any given word, we present them in both areas. The ideas is that should we ever feel like closing the PoC, Google will continue to remember :). No not at all, everyone sees the same content. The point here is that Google doesn’t always cache the body of the web page, but will always cache the title. Hence, when we present results for any given word, we present them in both areas. The ideas is that should we ever feel like closing the PoC, Google will continue to remember :).

]]> By: Ben http://www.dragoslungu.com/2007/06/22/google-md5-hash-search-engine/#comment-290 Ben Sun, 24 Jun 2007 04:01:35 +0000 http://www.dragoslungu.com/2007/06/22/google-md5-hash-search-engine/#comment-290 It's a rather interesting concept: leaving storage and indexing up to google, instead of having to handle it all yourself. So all you do is generate the hashes as google requests the page. The only problem with it is, I don't know: 1) how far Google is willing to crawl: a search for "site:www.nth-dimension.org.uk" reveals some 7K results for the domain name. 2) Poking around in the URL, it looks like they only have about 2400 words (change the startline value) 3) There's one that is more methodical: http://reverse.me.uk/, but a search for that domain reveals a measily 49 results... so somehow Google will stop early if it all looks the same? I'm not sure. 4) I've tried to make my own, just for the fun of it. My blog is searchable by google, so hopefully there'll be more than 49 results... we'll see? Here's the hash generator: http://darwin.servehttp.com/cgi-bin/hash.pl It’s a rather interesting concept: leaving storage and indexing up to google, instead of having to handle it all yourself. So all you do is generate the hashes as google requests the page. The only problem with it is, I don’t know:
1) how far Google is willing to crawl: a search for “site:www.nth-dimension.org.uk” reveals some 7K results for the domain name.
2) Poking around in the URL, it looks like they only have about 2400 words (change the startline value)
3) There’s one that is more methodical: http://reverse.me.uk/, but a search for that domain reveals a measily 49 results… so somehow Google will stop early if it all looks the same? I’m not sure.
4) I’ve tried to make my own, just for the fun of it. My blog is searchable by google, so hopefully there’ll be more than 49 results… we’ll see? Here’s the hash generator: http://darwin.servehttp.com/cgi-bin/hash.pl

]]>