Search, No Longer the Main Feature of Google Desktop

If you install the latest version of Google Desktop for Windows, you'll notice a new dialog that presents a list of features and lets you select the ones you want. Google Desktop enables by default the sidebar with gadgets, but the search feature is limited to filenames. To actually search the full content of your files, you need to enable the "enhanced search".


This is a strange choice, considering that Google Desktop was built for this "enhanced search", which is now disabled by default. Here's the description of the application when Google launched it, in October 2004:

"Google Inc. today announced a beta desktop search application that enables users to search their email, files, web history, and chats. Called Google Desktop Search, this new application makes it possible for users to find information on their computers as fast and easily as they can search the web with Google."

The desktop search application added gadgets in the subsequent versions and was renamed to Google Desktop. "Google Desktop is a new, easier way to get information – even without searching. You can think of it as a personal web assistant that learns about your habits and interests to identify and present web pages, news stories, and photos that it thinks you will be interested in," explained Marissa Mayer the shift.

Maybe performance was the main cause for disabling search, or maybe users didn't think it was very useful. You can still enable the search feature both when you install the application and in the settings, but not everyone will discover it. I recommended Google's software to someone who needed a tool for searching his documents and I was surprised to hear that the software didn't work as advertised: obviously, Google Desktop didn't index any file.

iGoogle for iPhone

Google created a version of iGoogle optimized for iPhone, that displays all the gadgets and feeds from tab in a single column. To switch to another tab, choose a name from the drop-down displayed at the bottom of the page.

The iPhone interface has a public URL: http://google.com/ig/i, but iPhone users will be automatically redirected to this URL.



The standard mobile version of iGoogle available at http://google.com/m is much more limited: it only displays feeds and a very small number of gadgets, you need to manually add items to your page and you can't change the number of items displayed from a feed. Another limitation is that it only works in the US.


{ via Blogoscoped Forum. The image doesn't show a real iPhone. }

Trends in Google Checkout

Google is all about numbers, metrics and stats, so it's natural to see features that explore trends in user's activities. There's a product for search trends, one for music trends and now a product that shows trends in Google Checkout.

"Google Checkout Trends aggregates the sales data of Google Checkout merchants and charts it in a matter of seconds," explains the product's blog. As usually, Google doesn't show actual numbers, just the revenue evolution over time. The charts are borrowed from Google Finance, so they'll look familiar.

Import Your Hotmail Messages into Gmail

I finally found an use for Microsoft's Windows Live Mail, a mail client that replaces Outlook Express as the light version of Outlook. Windows Live Mail has a unique characteristic: it's free and it allows you to access Hotmail accounts. Microsoft also provides a plug-in for Outlook with an exuberant description:

"With Microsoft Office Outlook Connector, you can use Microsoft Office Outlook 2003 or Microsoft Office Outlook 2007 to access and manage your Microsoft Windows Live Hotmail or Microsoft Office Live Mail accounts, including e-mail messages and contacts for free!"

Microsoft probably thinks it makes you a favor by providing ways to access your mail from a desktop client, so it uses a proprietary mechanism that can only be interpreted by Microsoft's software.

But I digress: Windows Live Mail is a good way to migrate the messages from your old Hotmail accounts to Gmail.

1. Enable IMAP for Gmail.

2. Download Windows Live Mail. Microsoft no longer links to the standalone version of the product and it forces you to install a package, but you can choose the software you want to install.

3. Add the Hotmail accounts from Windows Live Mail's interface.

4. Add your Gmail account and make sure you manually configure the IMAP settings.

5. To prevent some new Gmail labels from being created, right-click on your Gmail account from Windows Live Mail's sidebar, select Properties, go to the IMAP tab and uncheck "Store special folders on IMAP server".

6. Then go to the inbox of each Hotmail account, select all the messages (Ctrl+A), right-click, choose "Move to folder..." (or "Copy to folder..." if you want to keep them in Hotmail) and select the Inbox of your Gmail account (or create a new folder). You should repeat this for each folder created in Hotmail.


If you don't expect to receive other message in your Hotmail accounts, uninstall Windows Live Mail. Otherwise, check your Hotmail accounts from time to time and manually move the messages to Gmail. Microsoft doesn't allow you to create rules for IMAP and HTTP mail accounts, so you can't forward new messages to Gmail. If you try to use the forwarding option from Hotmail, you'll notice that Microsoft still tries to keep your mail hostage.

Social Yahoo Mail: from Contacts to Connections

Yahoo's CEO, Jerry Yang, made an announcement at CES about a new version of Yahoo Mail that will be more social and will integrate third-party apps.

"Jerry walked through a vision demo showcasing the possibilities of a more open Yahoo!, in this case focused on one of our key starting points, Yahoo! Mail. He showed how a smarter inbox could prioritize the most relevant connections in his life, both from Yahoo! and multiple social networks, and make all of his communications (email, IM, SMS, voice, status text, photos, etc.) simpler to manage. He then walked through how Yahoo! as an open platform—using Yahoo! Mail, Flickr, Yahoo! Local and Maps, and third party applications like Evite and eBay—could let you tap into the collective tastes, interests, and knowledge of the people you know and of the rest of the world. His example was trying to corral a bunch of very different friends, family, and execs for an awesome dinner. He was able to discover and explore what millions of people find interesting in Las Vegas (via Flickr and our TagMaps prototype) and what his dinner guests might enjoy as well."

It's interesting that the prototype allowed you to create "connections" by adding people from your inbox, your Yahoo Messenger list, but also from social networks like LinkedIn. So Yahoo tries to make the inbox more powerful by unifying all your connections and merging all their details in a single place. Based on information extracted from all these contexts, Yahoo Mail shows a list of the most important updates from your connections.

The third-party apps become tools that help you find information related to conversations and have access to your connections. The maps application can find a restaurant based on the preferences of those you want to invite for dinner.

Yahoo Mail moves from being a mail application to a social application that integrates mail in a broader context. Yahoo intends to connect you more with your contacts and to transform them into connections, links in a social graph.

{ Image licensed as Creative Commons by sdk. }

Related:
More screenshots from the Yahoo Mail prototype
Email connections
Updates from your Gmail contacts

RescueTime, Attention Monitoring Tool

What would you get by combining Google Web History with Google Analytics? An application that shows where do you spend most of your time on the web using beautiful charts.

RescueTime takes this idea, but also tracks the usage of desktop applications. "RescueTime is a web-based time management and analytics tool for information workers who want to be more productive. [It] doesn't record what apps or sites you have open, but rather what app or site you are paying attention to!"

RescueTime installs a desktop client (available for Windows and Mac) that monitors the web sites you visit and the software you use. The data is sent to a web application that processes it and displays statistics. For now, you can only see the domains, subdomains and apps sorted by the time spent and details for each item, but it would be interesting to see information about navigation paths and individual web pages.

If you don't like the application or you're concerned about your privacy, RescueTime lets you delete your data. It also makes it clear in the FAQ that the application only monitors "the names of the apps and sites you use and the times that you use them."

Use Google Web History Without Installing Google Toolbar

If you want to use Google Web History and save your browser's history on Google's servers, you generally need to go to this page and select "Enable Web History and install the toolbar". This procedure installs Google Toolbar, a plug-in available only for Internet Explorer and Firefox, and enables the PageRank feature, which displays the ranking of any site you visit while sending the URL to Google in the process.

If you use another browser or if you don't like Google Toolbar, there's an alternative way to send all the web pages you visit to Google: a script that asks Google for the PageRank of any web pages you load in your browser. To install the script you need:

* Greasemonkey, an extension for Firefox. Make sure to restart the browser before trying to add the script.
* Trixie, one of the best Greasemonkey-like plug-ins for Internet Explorer
* SIMBL and GreaseKit for Safari
* no additional software for Opera, but you need to enable the feature from Opera's interface
* Konqueror Userscript for Konqueror

The script is taken from this site, that also adapted it from other scripts. I mirrored the script to an easily-accessible location.

Once you've added the script, you only need to enable Google Web History: go to this page and select "Enable Web History and install the toolbar", but cancel the downloading process (you don't need the toolbar).

This feature only works when you're logged in to your Google Account. To disable it, remove the script from Greasemonkey or from another plug-in you've installed.

Blacklisted from Google Notebook

Many web applications have limitations that are not disclosed to users. If you happen to use an application too frequently or upload too much data, your access will be disabled. In most cases, you'll see a message that informs you about the penalty, but Google Notebook chose a different strategy: showing a 404 error message.

"Back on December 20, I wrote about my frustration with Google Notebook, which I use every day as a way to archive much of what I read online (...). For some off reason, it seemed like Google Notebook was down, and yet I could find no other description of the issue online, which made me think I must be mad," writes Ran Barton.

He received a message from Google that explained the problem. "Your account was accidentally blacklisted by a blacklisting heuristic that looked at total size of notebook information. We've revised the heuristic, so you shouldn't be accidentally blacklisted again in the future."

Google Reveals New MapReduce Stats

An updated version of Google's paper about MapReduce (available at ACM and mirrored here) provides new information about Google's scale. MapReduce is a software framework used by Google to "support parallel computations over large (...) data sets on unreliable clusters of computers". Google uses it for indexing the web and computing PageRank, for processing geographic information in Google Maps, clustering news articles, machine translation, Google Trends etc.

The input data for some of the MapReduce jobs run in September 2007 was 403,152 TB (terabytes), the average number of machines allocated for a MapReduce job was 394, while the average completion time was 6 minutes and a half. The paper mentions that Google's indexing system processes more than 20 TB of raw data. Since 2003, when MapReduce was built, the indexing system progressed from 8 MapReduce operations to a much bigger number today.

Niall Kennedy calculates that the average MapReduce job runs across a $1 million hardware infrastructure, assuming that Google still uses the same cluster configurations from 2004: two 2 GHz Intel Xeon processors with Hyper-Threading enabled, 4 GB of memory, two 160 GB IDE hard drives and a gigabit Ethernet link.

Greg Linden notices that Google's infrastructure is an important competitive advantage. "Anyone at Google can process terabytes of data. And they can get their results back in about 10 minutes, so they can iterate on it and try something else if they didn't get what they wanted the first time."

	Aug. '04	Mar. '06	Sep. '07
Number of jobs (1000s)	29	171	2,217
Avg. completion time (secs)	634	874	395
Machine years used	217	2,002	11,081
map input data (TB)	3,288	52,254	403,152
map output data (TB)	758	6,743	34,774
reduce output data (TB)	193	2,970	14,018
Avg. machines per job	157	268	394
Unique implementations
map	395	1958	4083
reduce	269	1208	2418

{ The screenshot illustrates a Google rack from 2007. I don't remember the exact source of the image, but it's likely to be a presentation. }

Obligatory Quotes

From New Yorker's "The Search Party":

"I worry about complexity. I admire Steve Jobs. He has been able to keep his products simple." (Sergey Brin)

"Microsoft is a bit of an unusual company. It doesn't seem to like any of us being successful in the technology space." (Sergey Brin)

"How many people do you think had embarrassing information about them disclosed yesterday because of some cookie? Zero. It never happens. Yet I'm sure thousands of people had their mail stolen yesterday, or identity theft." (Sergey Brin)

"There are almost three billion mobile phones worldwide, and Schmidt expects a billion more in the next four years. If the phones use Google software to sell advertising, Schmidt thinks that over time it is 'mathematically possible for Google to become a one-hundred-billion-dollar corporation.' Two vital markets are television, which is 'easily attainable,' and mobile phones, which are 'more personable' and more 'targetable' than most advertising. To achieve this goal, Google would need to claim ten per cent of all global advertising, which now amounts to just under a trillion dollars."

"What sets Google apart, Schmidt told me in another conversation, is that although people like him always assumed that 'Google would be an important company, the founders always assumed that Google would be a defining company.' He remembers a day in 2002 when he walked into Page's office and Page started to show off a book scanner he had built. 'What are you going to do with that, Larry?' Schmidt recalls asking. 'We're going to scan all the books in the world,' Page replied. Eventually, Google began to do just that."

Headers and Footers in Google Docs

The latest version of Google Docs lets you add headers and footers in your documents. Just go to the Insert tab and click on the appropriate link. Google Docs still doesn't provide support for pagination, so you can't add any information about the number of pages in your header or footer. In fact, there doesn't seem to be a way to enter dynamic content.

In November last year, Zoho Writer added a special view for pagination and more advanced headers & footers. While the page view is still read-only, Zoho gives some idea of your document's layout. In Google Docs, the only way to see an estimation for the number of pages is to select File / Word count.

If you try to print a Google Document, you'll have another surprise: Google will export your document to PDF without mentioning that or adding a link to a PDF reader. In the print settings you finally have the option to add page numbers, but make sure there's no conflict with your document's header or footer.

An Unfulfilled Wishlist

In December 2006, I posted a list of the Google features I wanted to see in 2007 and you added 273 comments with even better ideas. Very few of your wishes were fulfilled in 2007:

* Using your own domain at Blogger.
* Ability to search feeds in Google Reader.
* An orkut redesign! Who came up with that hideous colour scheme and those pathetic-looking buttons? And the silly bevel effect added to all photos looks ridiculous!
* IMAP in Gmail
* A presentation app for Google Docs
* Google Talk on your Google Personalized Homepage
* More and better "mobile" versions of Google services
* How about the ability to open (in Docs & Spreadsheets) a Doc or Spreadsheet that is sent to you as an attachment to your Gmail account?
* GPS support in Google Maps for mobile phones
* Google Desktop for Mac and Linux
* I want Google to make their own Wikipedia.

The most frequently requested features and services were:
* GDrive (Google online storage)
* synchronization with mobile devices and Outlook for Google Calendar, Gmail Contacts
* task management (To-Do lists)
* Google Operating System (Linux-based)
* project management tools
* a lot of updates for Google Talk (Mac/Linux versions, groups, phone calls)
* Google web hosting

GDrive continues to be in the works, but it should be launched this year, according to a WSJ article. Google Calendar should add a task management feature, while the synchronization with mobile devices is currently limited to Blackberries. Google Talk will either completely move online or surprise us with some major new features; Google Operating System, project management and web hosting don't seem to be in Google's plans. The conclusion is that Google still has a lot of things to add from the wishlist for 2007.

A Search Engine from Every Collection of Links

So you've found a great web page that lists a lot of interesting links about a certain topic and now you're ready to explore them, but you don't have enough time to read everything. A good option would be to create a custom search engine, but it's too time-consuming. A faster way is to create a custom search engine on-the-fly from all the links included in the page you've found. That means you'll have a search engine restricted to all the domains, subdomains and web pages linked from your page.

For example, del.icio.us search results pages are a good place to obtain a list of authoritative sites on a topic like AJAX. Once you have the del.icio.us URL, paste it at Google's on-the-fly search engine factory and enter your query.


Other good starting points could be: Wikipedia articles, other wikis, directories, scholar papers, pages with many references etc. Maybe Google should create a separate search engine for pages that have a lot of external links related to a topic (like these pages).

Multi-Touch Interface for Google Earth

Google Summer of Code Blog mentions about an application created by Pawel Solyga "that allows you to control Google Earth using two finger gestures on [a] multi-touch table". I couldn't find too many details about TouchEarth, but it's an interesting application of the mostly-unknown Google Earth COM API.



I remember that one of the demos of Android (03:54), Google's mobile platform launched in November last year, showed a touch interface for a spinning globe.

YouTube Feeds

YouTube has never offered too many feeds and they were usually difficult to find. The new YouTube API changed that, but the feeds are still inaccessible from the interface. This why I decided to compile a list of the most useful YouTube feeds you may want to add in your favorite feed reader:

1. Search feeds
http://gdata.youtube.com/feeds/api/videos?orderby=updated&vq=mapreduce
(replace mapreduce with your query)

2. Search in a category
http://gdata.youtube.com/feeds/api/videos/-/Film/?vq=michel%20gondry&orderby=updated
(Film is the category, while michel gondry is the query - you need to replace the space with %20. Other categories: Music, Comedy, News, Sports, Autos, Howto.)

3. The latest videos from a channel
http://gdata.youtube.com/feeds/api/users/radiohead/uploads?orderby=updated
(replace radiohead with your channel)

...or only the videos that match your keywords:
http://gdata.youtube.com/feeds/api/users/radiohead/uploads?orderby=updated&vq=jigsaw

4. Feeds for favorite videos
http://gdata.youtube.com/feeds/api/users/garyferro/favorites?orderby=updated
(replace garyferro with your favorite username)

5. Your subscriptions
This is not a feed that comes directly from YouTube, it's a Yahoo Pipe.
http://pipes.yahoo.com/pipes/pipe.run?YouTubeUsername=google&
_id=28303b479f11e24199be4cafced31ad9&_render=rss&itemLimit=20
(concatenate the two lines and replace google with your username)

The feed above shows the latest videos from the first 25 subscriptions. For those who have more subscriptions, I created a new version of the pipe that shows the videos from up to 500 subscriptions:

http://pipes.yahoo.com/pipes/pipe.run?YouTubeUsername=MotherTalking&
_id=58e4f59f9e5e3282aaffdcbaf05ba68d&_render=rss&itemLimit=50
(concatenate the two lines and replace MotherTalking with your username)

6. Playlists
http://gdata.youtube.com/feeds/api/playlists/50653251EDB4E764
(the code in italic can be obtained from the playlists's URL (e.g.: Eric Speaks)