PyCon 2008 ElasticWulf Slides

Posted by Peter Skomoroch on March 16th 2008 to Netflixprize, Information Retrieval, Cluster Computing, Python, Amazon EC2, collaborative filtering, visualization, pycon

4 8 15 16 23 42

Here are the ElasticWulf slides from my talk. The video will eventually be posted to the PyCon site.

The cluster management scripts I used to run the EC2 beowulf are hosted on google code:

ElasticWulf Project

I should make the initial checkin by Monday, until then you can try out the 32 bit images from the old EC2 tutorial.

PyCon highlights for me included Guido popping his head in towards the end of my talk (unless I was so tired from last minute preparations that I was hallucinating?) and meeting the great essayist Zed Shaw. The “Birds of Feather” (BOF) sessions were my favorite part of the conference so far. Tonight, I caught the tail end of an interesting Natural Language Processing discussion. Chris McAvoy talked me into holding a Netflix Prize BOF session where we exchanged insights about using Python for collaborative filtering. Later that night, my coworker Chris Gemignani organized a Data Visualization session where he did some cool things with Python and Nodebox. We also hung out with Peter Fein from the job search engine JuJu, who pulled together an engaging Distributed Computing BOF. JuJu just released a neat RESTful python search engine project called GrassyKnoll which you should check out. I’ll post more on PyCon when I get back to DC, along with a tutorial on using IPython1 with ElasticWulf.

Oh yeah, the back of the conference shirt featured the xkcd Python comic:

python

2 Responses to “PyCon 2008 ElasticWulf Slides”

  1. patrick ball
    March 24th, 2008 | 12:03 am

    I think tomorrow is the promised “Monday after PyCon” ;) Sorry to pester, but just wanted you to know that there’s an audience for your cluster management code. Thanks!

  2. Peter Skomoroch
    March 24th, 2008 | 7:35 am

    Patrick,

    No problem, the cluster management code is checked in now at google code:

    http://code.google.com/p/elasticwulf/

    You can grab it from the subversion repository with the following command:

    svn checkout http://elasticwulf.googlecode.com/svn/trunk/ elasticwulf-read-only

    Some people have run into an issue where the configuration script asks for a password, I’ll try to track down what is causing it and check in a fix.

    In the meantime, there is a workaround in the comments of the old tutorial:

    http://www.datawrangling.com/mpi-cluster-with-python-and-amazon-ec2-part-2-of-3.html#comment-1148

    -Pete

Leave a reply