Tuesday, January 25, 2011

Assignment 3 Part 1 - Setting up the pipe


Social Media Photo Firehose - Combines vendors from Flickr, Panoramio, Picasa, Photobucket, DeviantArt. 

Mashiness Performance - BAD


Pipe returned with only 14 results, with results parsed from photobucket only. http://pipes.yahoo.com/pipes/pipe.info?_id=7e6673ecfa5885bff59e6216a17dfd84

Issues:

1) Flickr has over 16000 photos related to "UNSW," either Yahoo! Pipes will time-out due to the number of data in the feed, or Flickr will stop the requests comming from the API. It may not even be feasible to push 16000 photos into Photosynth even if the pipe can parse 16000 results into a feed. 

2) A complex of operations was set up with multiple sites, particularly linking Google spreadsheets to loop call for page numbers. As a result there are weak links in the Pipe. For example, if Google Spreadsheets fails to parse then the rest of the URL will not work. 


Solutions:

1) reduce "mashiness" of the pipe and cut the pipe into individual vendors. 

2) reduce scope of images, perhaps shrink the data sample to highest rated 3000 images of "unsw"




No comments:

Post a Comment