Skip to main content

Python tools for science go to SIAM: a trip report

Update (2008.08.06): I have posted the slides I have available from the minisymposium described below.

The 2008 SIAM annual meeting was held July 7-11 in San Diego, and we had a healthy presence of Python-based tools for scientific computing. Randy LeVeque from U. Washington and I co-organized a 3-part minisymposium entitled Python and Sage: Open Source Scientific Computing. You can see the list of talks for parts I, II and III online. I should add that for the talks where we had cancellations, we ended up with excellent impromptu replacements by Bill Hart from Sandia National Labs and Travis Oliphant from Enthought.

Our sessions were well attended (especially considering the very large number of parallel sessions at the conference) and generated lively discussion. There's clearly a need in the scientific and mathematical community for open source, high level tools that integrate well with existing high performance codes written in Fortran, C or C++, while providing interactivity, visualization, access to the network, etc. This is the kind of idea that many of us in the SciPy and Sage worlds have been preaching for a while, but now the response from the wider community is much more positive than before (admittedly, years ago the tools were immature enough that they were very much of the "user assembly required" variety).

I am extremely pleased to report that we were chosen for the conference highlights page (many thanks to John Hunter, of matplotlib fame, for the great screenshot)! Given that this page mostly lists the invited plenaries and other special events, I am very happy about this (SIAM had literally hundreds of talks from parallel sessions to choose from and only two of those were highlighted). I think it is both a recognition of the work done by all our speakers, and of the relevance of the topic today. Thanks again to all who contributed. We should take this level of interest as both a recognition an a challenge: as more scientists become interested in these tools for their everyday research, the pressure on high quality documentation, easy installation and deployment, good tutorials, etc, will only increase.

Everyone is working hard on this, and in particular it's worth mentioning the excellent work that is being done this summer as part of the NumPy/SciPy Documentation Marathon 2008, where a lot of new documentation has been added to NumPy. This is an effort where anyone can contribute! The infrastructure is just a wiki where you can register to edit docs, and developers will later review and merge your contributions into the core project for the next release.

So let's all keep up the momentum going, and I hope to see many more interested faces, both new and old, at the upcoming SciPy 2008 conference at Caltech in August!

Comments

Popular posts from this blog

The IPython notebook: a historical retrospective

On December 21 2011, we released IPython 0.12 after an intense 4 1/2 months of development.  Along with a number of new features and bug fixes, the main highlight of this release is our new browser-based interactive notebook : an environment that retains all the features of the familiar console-based IPython but provides a cell-based execution workflow and can contain not only code but any element a modern browser can display.  This means you can create interactive computational documents that contain explanatory text (including LaTeX equations rendered in-browser via MathJax), results of computations, figures, video and more.  These documents are stored in a version-control-friendly JSON format that is easy to export as a pure Python script, reStructuredText, LaTeX or HTML. For the IPython project this was a major milestone, as we had wanted for years to have such a system, and it has generated a fair amount of interest online. In particular, on our mailing list a us...

Blogging with the IPython notebook

Update (May 2014): Please note that these instructions are outdated. while it is still possible (and in fact easier) to blog with the Notebook, the exact process has changed now that IPython has an official conversion framework. However, Blogger isn't the ideal platform for that (though it can be made to work). If you are interested in using the Notebook as a tool for technical blogging, I recommend looking at Jake van der Plas' Pelican support or Damián Avila's support in Nikola . Update: made full github repo for blog-as-notebooks, and updated instructions on how to more easily configure everything and use the newest nbconvert for a more streamlined workflow. Since the notebook was introduced with IPython 0.12 , it has proved to be very popular, and we are seeing great adoption of the tool and the underlying file format in research and education. One persistent question we've had since the beginning (even prior to its official release) was whether it would...

An ambitious experiment in Data Science takes off: a biased, Open Source view from Berkeley

Today, during a White House OSTP event combining government, academia and industry, the Gordon and Betty Moore Foundation and the Alfred P. Sloan Foundation announced a $37.8M funding commitment to build new data science environments. This caps a year's worth of hard work for us at Berkeley, and even more for the Moore and Sloan teams, led by Vicki Chandler , Chris Mentzel and Josh Greenberg : they ran a very thorough selection process to choose three universities to participate in this effort. The Berkeley team was led by Saul Perlmutter , and we are now thrilled to join forces with teams at the University of Washington and NYU, respectively led by Ed Lazowska and Yann LeCun . We have worked very hard on this in private, so it's great to finally be able to publicly discuss what this ambitious effort is all about. Most of the UC Berkeley BIDS team, from left to right: Josh Bloom, Cathryn Carson, Jas Sekhon, Saul Perlmutter, Erik Mitchell, Kimmen Sjölander, Jim Sethia...