These are a couple related projects which have d3.js front end interactive visualizations backed up by servers which load in data and process it on demand to send to the clients. The idea is that even if the data is large and cumbersome, lightweight visualizations can be used and efficiently delivered to the client to explore the data. The server code uses Python with Autobahn and CherryPy to write the lightweight servers so I can use fast NumPy and SciPy routines for data manipulation and linear algebra.
This work is being done in collaboration with Mauro Maggioni, Miles Crosskey, and Samuel Gerber at Duke University.
The IPCA explorer is an ongoing project navigate data "sketches" generated with Geometric Multi-Resolution Analysis (GMRA) through a web-based interface. The visualization combines an icicle view, which represents the hierarchical, low-dimensional breakdown of the data at various scales, plus a new type of scatterplot representing the distribution of the data at that scale, projected into the space of the parent distribution.
Moving further with the simplified scatterplot idea, but now for following paths in an abstract, potentially nonlinear and high-dimensional space which is represented locally by low-dimensional linear spaces.
The source code for Sam Gerber's GMRA routines. The only one we use right now for this project is CreateIPCATree. You need to use the CMake build system to compile.