The speecheditor is a web app for editing and adding musical scores to audio stories. Instead of editing speech using waveforms, the speecheditor allows you to edit audio with text, like a word processor. Likewise, it allows users to easily loop musical tracks and add musical underlays à la This American Life. The speecheditor is described in detail in our paper, "Content-based Tools for Editing Audio Stories."
Audio Story Editor
D3 Deconstructor is a Chrome extension that lets you extract the data from visualizations constructed using D3.js. Install the extension and then right-click on a D3 visualization to invoke the deconstructor. The extension extracts the underlying data and generates a new window showing the data values in tabular form. You can then download the extracted data in CSV or JSON to use in your own projects.
Radiotool Python Library
Radiotool is a python library that aims to make it easy to create audio by piecing together bits of other audio files. It also supports music retargeting techniques, which take a song and remix it from its own existing beats/structure to fit the music to certain constraints. This library was built for our audio editing projects: UnderScore and Content-Based Tools for Editing Audio Stories.
3D Puppetry Software
Our 3D Puppetry software allows users to directly perform animations using physical toys in front of a Kinect depth sensor. It tracks the puppets in real time and re-renders them in a virtual scene using stored 3D models. Even novices with no prior animation experience can produce entertaining shorts after using our system for only 30 minutes.
Proton Multitouch Framework
Proton is a C++ library that allows developers to specify multitouch gestures as a regular expression of touch event symbols. Proton then automatically provides gesture recognition code and performs gesture matching on user touch events.
Flare Visualization Toolkit
Flare is a collection of ActionScript 3 classes for building a wide variety of interactive visualizations. Written by Jeff Heer, flare can be used to build basic charts, complex animations, network diagrams, treemaps, and more. Flare is written in the ActionScript 3 programming language and can be used to build visualizations that run on the web in the Adobe Flash Player.
More information can be found on the official Flare site.
Prefuse Visualization Toolkit
Prefuse is a set of software tools for creating rich interactive data visualizations. Written by Jeff Heer, this toolkit supports a rich set of features for data modeling, visualization, and interaction. It provides optimized data structures for tables, graphs, and trees, a host of layout and visual encoding techniques, and support for animation, dynamic queries, integrated search, and database connectivity.
Please visit the official Prefuse site for more information. The toolkit can be downloaded here.