Yahoo Pipes: The Mashup Factory

Yahoo Pipes is "a hosted service that lets you remix feeds and create new data mashups in a visual programming environment". In Unix, a pipe (or a pipeline) is "a set of processes chained by their standard streams, so that the output of each process feeds directly as input of the next one".

Yahoo created a service that lets you treat feeds like some standard text files.

How to create a pipe

You'll have to go to this page, sign in to Yahoo, and use a visual environment that accepts drag and drop. You'll see a small list of modules (or commands) that can be dragged to the canvas.


In this example, someone aggregated the feeds from Technorati, Google News, Yahoo News and more. The first box accepts a user query that's used for building the URL of the feeds. You'll have to use a URLBuilder for each news source and connect it to Fetch, that actually reads the content and builds one feed. To improve the output, the author sorted the feed items by publication date and removed duplicates.

As Yahoo explains, "each module has one or more terminals, represented by small circles in the interface. You can wire modules together by clicking on one module's output terminal and another module's input terminal. Now the output from the first module will serve as input to the second module."

Yahoo exports the results of a pipe in one of these formats: RSS, RDF, JSON and Atom, so it's easy to use in a web application later.

What can you do?

You can count the number of items from a feed, sort them, filter the items that match a rule, remove duplicates, extract location names and important keywords or merge two feeds.

Start by opening pre-defined pipes and understand their meaning. Then you can build your own pipe by simply cloning an existing one and adapting to your needs.

Yahoo Pipes is a very interesting example of how easy is to play with data and build useful things by simply mashing data.

Labels

Web Search Gmail Google Docs Mobile YouTube Google Maps Google Chrome User interface Tips iGoogle Social Google Reader Traffic Making Devices cpp programming Ads Image Search Google Calendar tips dan trik Google Video Google Translate web programming Picasa Web Albums Blogger Google News Google Earth Yahoo Android Google Talk Google Plus Greasemonkey Security software download info Firefox extensions Google Toolbar Software OneBox Google Apps Google Suggest SEO Traffic tips Book Search API Acquisitions InOut Visualization Web Design Method for Getting Ultimate Traffic Webmasters Google Desktop How to Blogging Music Nostalgia orkut Google Chrome OS Google Contacts Google Notebook SQL programming Google Local Make Money Windows Live GDrive Google Gears April Fools Day Google Analytics Google Co-op visual basic Knowledge java programming Google Checkout Google Instant Google Bookmarks Google Phone Google Trends Web History mp3 download Easter Egg Google Profiles Blog Search Google Buzz Google Services Site Map for Ur Site game download games trick Google Pack Spam cerita hidup Picasa Product's Marketing Universal Search FeedBurner Google Groups Month in review Twitter Traffic AJAX Search Google Dictionary Google Sites Google Update Page Creator Game Google Finance Google Goggles Google Music file download Annoyances Froogle Google Base Google Latitude Google Voice Google Wave Google Health Google Scholar PlusBox SearchMash teknologi unik video download windows Facebook Traffic Social Media Marketing Yahoo Pipes Google Play Google Promos Google TV SketchUp WEB Domain WWW World Wide Service chord Improve Adsence Earning jurnalistik sistem operasi AdWords Traffic App Designing Tips and Tricks WEB Hosting linux How to Get Hosting Linux Kernel WEB Errors Writing Content award business communication ubuntu unik