Monthly Archives: April 2009

Do it your way with execute and open data tables

Filed under feature

Today we’ve released a significant new feature for YQL: <execute>.

Previously our open data tables enabled any developer to bring the power of YQL and the table model available to new APIs or data sources that we hadn’t covered. Many of these are hosted on github, and you can read (and use) about them on datatables.org. These give you access to friendfeed, google reader, guardian, lastfm, nyt, twitter, weather.com, whitepages, yelp, zillow to name just a few.

YQL <execute> extends the open data table capabilities through server-side transformation and processing using javascript. This dramatically increases the reach and power of open data tables, for example:

  • join data across services
    e.g. grab New York Times article tags and incorporate associated flickr photos
  • combine multiple searches into a single result
    twitter, web, news and image…
  • augment data
    e.g. Add city/state information to APIs that just return zip code
  • create an API from a web page
    e.g. celebrity birthdays scraped from imdb
  • access APIs that require authentication
    e.g. Netflix OAuth, FlickrAuth, Google AuthSub …
  • data transformation
    e.g. convert the result from xml to Google’s kml format
  • move business logic for your application’s data to the cloud
  • leverage the work of others to make access easier by sharing tables

Read more about this on our YDN blog post, including links to several examples to wet your appetite.

Changelog for build 1432

Filed under changelog

Bug fixes, including

  • JSON and JSONP mimetypes now different/fixed.
  • fixed robots.txt evaluation bug
  • “NaN” value sorting bug fixed

Open Data Table schema changes

  • private open data table keys don’t have to be “const” and key name (not value) is displayed in “desc”
  • new “https=true” attribute on open data tables
  • new “variable” paramType for open data table input keys
  • new “execute” element: server-side javascript support

Core table changes

  • flickr.photos.search now has sort, is_commons and geo_context  parameters
  • search.web now has lang, region, site and abstractkey keys

New core tables

  • 16 new music APIs added
    • music.artist.id
    • music.artist.popular
    • music.artist.search
    • music.artist.similar
    • music.release.artist
    • music.release.id
    • music.release.popular
    • music.release.search
    • music.track.id
    • music.track.popular
    • music.track.search
    • music.video.category
    • music.video.id
    • music.video.popular
    • music.video.search
    • music.video.similar
  • term extractor
  • search.siteexplorer.pages
  • search.siteexplorer.inlinks
  • search.suggest
  • search.spelling
  • uritemplate (for creating URLs)

Misc

  • sub-selects now support “content” as projection field selector
  • console and web service now accessible over HTTPS