Recent Projects

  • Hourly Trends - Twitter bot that finds trending topics using Wikipedia logs
  • linkedin_on_rails LinkedIn on Rails - Rails OAuth sample application that creates an HTML resume using the LinkedIn API
  • spatialanalytics - O'Reilly Where 2.0 Workshop: Spatial Analysis of Tweets using Hadoop, Pig, Python & Mechanical Turk
  • locations - Rails search wrapper around Geonames cities, for use with Mechanical Turk location standardization
  • trendingtopics - Rails application (code) runs Hadoop on Amazon EC2 to find trending topics in Wikipedia log files
  • EC2Cluster - Rails job manager, dashboard, and REST web service - launches HPC MPI clusters on Amazon EC2 - also see elasticwulf
  • ItemSimilarity - Python Streaming Hadoop code for finding similar Last.FM artists or similar Netflix movies
  • Concentrate - Search Analytics app built with the team at Juice using Django & EC2