Robotics, Vision, and Sensor Networks Group (RVSN)

Mosaic of Robotics images

NEW! Read our group-wide wiki! (Group members should use this link for write access.)


Active Research

Spatially-Adaptive Learning Rates for Online Incremental SLAM

Non-linear optimization has traditionally been considered out-of-reach of most SLAM applications do to its computational cost. However, a family of iterative batch algorithms has recently demonstrated remarkably fast convergence. Because they are batch algorithms, however, they are not well-suited to online applications. In this work, we extend the reach of these algorithms to incremental applications by describing a way of maintaining spatially-adaptive learning rates, and a way of accelerating convergence by preferentially optimizing the least-converged parts of the pose graph.

Distributed Sensor Network Localization and Tracking

Given a wireless sensor network consisting of low-power devices, localization is the task of discovering the 2D or 3D positions of the sensor nodes. We have devised a robust distributed localization algorithm that makes use of distance estimates between nodes to compute 2D positions. In addition, the motion of mobile nodes can be reliably tracked. Our experimental testbed consists of the Cricket Location System designed by the Networks and Mobile Systems Group at MIT.

Estimating 6-DOF Pose from Omnidirectional Video and Known Crude Structure

We are developing robust methods for estimating 6-DOF pose in world coordinates from omnidirectional video, given a crude geometric model of the environment.

Fast optimization of Pose Graphs (a SLAM approach)

SLAM can be posed as a nonlinear optimization problem on a graph of poses. We propose a technique for rapidly optimizing these graphs given a set of constraints. As published in ICRA2006.

Fine-Grained Semantic, Topological, and Geometric Modeling of Campus Spaces

Our project aims to extract, model, and provide access to the semantic, topological, and geometric data of the entire MIT campus. Using nearly 1000 floor plans representing 37,000 spaces on the MIT campus, our software models the fine-grain geometry of the campus, and builds a graph network representing space connectivity within the campus. Lastly, we provide an API that allows for straightforward access to this data via the web.

Machine Understanding of Narrated Guided Tours

We are developing a sensor pack and associated algorithms to enable a robot, or hand-held device, to construct a map-like representation from a narrated, guided tour. The idea is that a human user would "show" the device around a space, associating spoken labels (names) with specific locations and objects within the space. The device could then produce names from (later observations of) locations or objects, and (routes to) locations or objects from supplied names.

Particle Video

Our primary goal is the ability to model complex motion and occlusion. We want the algorithm to handle general video, which may include close-ups of people talking, hand-held camera motion, multiple independently moving objects, textureless regions, narrow fields of view, and complicated geometry (e.g. trees or other clutter). A particle approach provides this kind of flexibility.

Single Cluster Graph Partitioning for Robotics Applications

We have developed a graph partitioning algorithm which can identify a cluster of maximally-consistent points, rejecting those points which do not belong to a consistent set. This is in contrast to typical graph partitioning methods which assume that all points belong to one of K clusters. There are numerous robotics applications, including outlier rejection, feature detection and estimation, and data association. As published in RSS2005.

Video Matching (with Applications to Change Detection)

This page describes a method for bringing two videos (recorded at different times, along similar but not identical camera paths) into spatiotemporal alignment, then comparing and combining corresponding pixels for applications such as background subtraction, compositing, and increasing dynamic range. We have also developed a prototype change detection system based on the method.

Ground-Truth, As-Built 3D CAD Model of Stata Center

We have gathered and combined several legacy "as-planned" CAD models of the Stata Center interior (2D) and exterior (3D), and combined them into a single 3D CAD model of the building. The model is "as-built;" it incorporates thousands of field measurements of the actual locations of walls, floors, ceilings, doors, and interior and exterior windows. It contains 3D wall surfaces extruded from the 2D floorplans. Both vertical, non-vertical, planar and non-planar walls are represented. The students' reports, and the full model (in DXF format) can be found here.

Organic Indoor Location Discovery Service

We are developing an "organic" indoor location discovery service, in which each user in an extended community contributes a small amount of location-specific information (in our case, WiFi signature data) which can then be aggregated to support location discovery for other users moving through the same space. The students' progress reports, and example open-source code and data, will be archived here.

The Boston Home Connected Mobile Wheelchair

We are working with The Boston Home, a facility for people with MS, to develop an assistive wheelchair. The wheelchair will: provide communication between residents and staff; will localize within and around the facility; and will provide autonomous mobility under speech or other command mode. Our progress will be logged on our wiki.

People

NameEmailPosition
Jessi Ambrose jambrose@mit.edu  Undergrad 
Matthew 'Matt' Antone antone@csail.mit.edu  Collaborating Researcher 
Amelia Arbisser arbisser@mit.edu  Undergrad 
Alexander Bahr abahr@mit.edu  PhD Student 
Patrick Barragan barragan@mit.edu  Undergrad 
Jonathan Yoni Battat yonib@csail.mit.edu  MEng Student 
Greg Belote gbelote@csail.mit.edu  Graduate student 
Michael Benjamin mikerb@csail.mit.edu  Postdoctoral Associate 
Mitch Berger mitchb@mit.edDGC Sysadmin 
Radu Berinde radu.berinde@gmail.coUROP 
Bryt Bradley bryt@csail.mit.edSupport Staff 
Emma Brunskill emma@lcs.mit.edu  PhD Student 
Katie Byl gonzo@mit.edu  PhD Student 
Stefan Campbell scampbel@csail.mit.edPhD Student 
Javier Castro javy@mit.edu  MEng Student 
Vanessa Hsu Chen vanehsu@csail.mit.edu  MEng Student 
Jian-Hung Chen jhchen@csail.mit.edu  Postdoctoral associate 
Han-Lim Choi hanlimc@csail.mit.edu  Graduate student 
Rick Cory rcory@csail.mit.edu  PhD Student 
Joe Curcio jacurcio@csail.mit.edResearch staff 
Finale Doshi finale@csail.mit.edu  PhD Student 
Danny Eads dan_eads@mit.edu  Undergrad 
Donald Eng don_eng@csail.mit.edu  UROP 
David Feldman dfelds@mit.edUndergrad 
Joe Ferreira jf@mit.edCollaborating Researcher 
Mike Flaxman mflaxman@mit.edu  Collaborating Researcher 
Mike Fleder mfleder@mit.edu  RSS Staff 
Luke Fletcher lukesf@csail.mit.edu  Postdoctoral Associate 
John Folkesson johnfolk@csail.mit.edResearch Fellow 
Emilio Frazzoli frazzoli@alum.mit.edu  Collaborating Researcher 
Ricky Galvao rgalvao@csail.mit.edu  Graduate student 
Vidya Ganapati vidyag@mit.edUndergrad 
Eddie Gazarian eddie@csail.mit.edu  Administrative staff 
Ross Glashan rng@mit.edu  UROP 
Jared Glover jglov@csail.mit.edu  PhD Student 
Valerie Gordeski valeriegor@gmail.com  Graduate student 
Forrest Green fgreen@mit.edRSS Staff 
Ruijie 'RJ' He ruijie@mit.edUROP 
Sachithra M. Hemachandra sachih@csail.mit.edu  PhD student 
Garrett Hemann ghemann@mit.edu  Undergrad 
Kyle Holmes klh554@mit.edUndergrad 
Doug Horner dphorner@nps.edu  Visitor 
Hank HsinHan Huang hnqar15@mit.edu  UROP 
Albert Huang albert@csail.mit.edu  PhD Student 
Vu Huynh vuhuynh@mit.edu  Graduate students 
Allison 'Allie' Jacobs ajacobs@csail.mit.edu  Undergrad 
Jeong hwan Jeon jhjeon@csail.mit.edu  Graduate student 
Collin Johnson collinj@mit.edu  UROP 
Troy B. Jones troy@draper.com  Collaborating Researcher 
Akari Kameyama aka_kame@mit.edu  UROP 
Been 'Beenie' Kim beenkim@csail.mit.edu  PhD student 
Ara Knaian ara@mit.edu  RSS Staff 
Olivier Koch koch@csail.mit.edPhD Student 
Michael 'Mike' Kokko kokkom@mit.edMSci Student 
Thomas Kollar tkollar@mit.edu  PhD Student 
Clayton 'Clay' Kunz clay@csail.mit.edPhD Student 
David Lambeth dlambeth@mit.edu  Graduate student 
Mitch Leammukda mleammukda@draper.com  Collaborating Researcher 
Jonathan Ledlie ledlie@csail.mit.edu  Research Affiliate 
Jacques Leedekerken jckerken@mit.edu  PhD Student 
John Leonard jleonard@mit.edu  Faculty 
Karim Liman-Tinguiri klt@mit.edu  UROP 
Keoni Mahelona kkm2635@draper.coDGC teammember 
Kenny Mandel kmandel@mit.edu  Undergrad 
David Moore dcm@mit.edu  PhD Student 
Edwin Olson eolson@mit.edPhD Student 
Junfeng 'Jeff' Pan panjf@csail.mit.edu  Visitor 
Georgios Papadopoulos gpapado@mit.edu  PhD student 
Leonid 'Lenny' Paritsky lparit@csail.mit.edu  Research Affiliate 
Jun-geun Park jgpark@csail.mit.edu  PhD student 
Sooho Park dreamneo@mit.edu  Graduate student 
Alex Patrikalakis amcp@mit.edu  RSS Staff 
Simon Pitts spitts@mit.edVisitor 
Christian Plagemann plagem@informatik.uni-freiburg.de  Visitor 
Brooks Reed brooksr8@mit.edu  Undergrad 
Dwayne Reeves dwaynelreeves@gmail.com  Undergrad 
Bryan Reimer reimer@mit.edCollaborating Researcher 
Dane Richter drichter@draper.com  Consultant 
Khashayar Rohanimanesh khash@csail.mit.edu  Postdoctoral Associate 
Nicholas Roy nickroy@mit.edu  Faculty 
Chris Sanders csanders@draper.com  Visitor 
Marcello Scarnecchia marscar@csail.mit.edu  Visitor 
Alec Shkolnik shkolnik@csail.mit.edPhD Student 
Dimitar Simeonov mitko@mit.edu  Undergrad 
Raj R. Singh rajsingh@mit.edu  Visitor 
Harvey Tang harveyt@mit.edu  Undergrad 
Russ Tedrake russt@csail.mit.edu  Faculty 
Seth Teller teller@csail.mit.edu  Faculty 
John 'Mofe' Uku johnuku@mit.edu  MSRP Intern, summer 2008 
Javier Velez velezj@csail.mit.edu  MEng Student 
Hon Fai Vuong hon@csail.mit.edu   
Matthew Walter mwalter@mit.edu  PhD Student 
Yuan Wei weiy@mit.edu  Undergrad 
Emily Whiting ewhiting@mit.edu  PhD Student 
Edmund Williams edmund.williams@ll.mit.edAdministrative staff 
Geoffrey Peter Wright gpwright@gmail.coUROP 
Xiao Xiao x_x@mit.edu  UROP 
Yang Yang yang2@csail.mit.edu  Undergrad 
Ryan Young ryan786@mit.edu  RSS Staff 

Publications, Reports, Supplemental Materials

Online list of RVSN publications as available.

Older Research Projects

Robust Range-Only Beacon Localization

Most autonomous underwater vehicles (AUVs) rely on fixed navigational beacons whose locations are known in advance. We show how AUVs can build maps dynamically without any prior knowledge, using only range data. As published in AUV2004.



Robotics, Vision, and Sensor Networks Group
32 Vassar Street, 32-33x
Cambridge, MA 02139
Tel: 617-253-6583
Fax: 617-258-7413
Logo of the MIT Computer Science and Artificial Intelligence Laboratory