|
Labor
Division and Distributed Sensing in Swarm Systems
William Agassounon,
Alcherio Martinoli
Collaborators: Robert
McEliece (Caltech), Erik
Antonsson (Caltech), David H. Lewis (TRW), Willy Behrens (TRW), Guy
Theraulaz (CNRS, Toulouse, France), Deborah Gordon (Stanford), Jean-Louis
Deneubourg (ULB, Bruxelles, Belgium).
This research
project aims to devise distributed scalable control algorithms for division
of labor and task allocation in mobile embedded swarm systems. Our approach
is inspired by social insect societies (ants, bees, termites, etc) whose
collective behavior often emerges from a series of local agent-to-agent
and agent-to-environment interactions. We are currently developing response
threshold-based algorithms to achieve efficient and robust division
of labor, and probabilistic models that provide accurate forecast of
the resulting collective behavior. These swarm systems are therefore
analyzed at several implementation levels, from macroscopic and microscopic
probabilistic models to real robot experiments through embodied sensor-based
simulations. (full
report)
|
|
VLSI
For Feature Detection and Tracking
Christophe Basset, Bedabrata Pain (JPL), Pietro
Perona
We are
developing an integrated visual tracking system. The goal of this collaborative
work with the Jet Propulsion Laboratory is a single chip serving as
a camera (1024x1024 pixels imager array) able to find and track a small
(7x7 pixels) target whose image has previously been provided by the
user. (full
report)
|
|
Configurable
Architectures, Systems and Tools for Real-Time Low-level Vision
Arrigo Benedetti,
Pietro Perona
The long-term
goal of this project is to build an infrastructure for the design and
implementation of real-time computer vision systems. Since vision algorithms
are compute-bound we have chosen the technology of Field Programmable
Gate Array (FPGAs), that allow to exploit the instruction level parallelism
inherent to the first stages of vision tasks. The first problem that
we have considered is the real-time computation of the optical flow
measured from the sequence of images captured by a video camera. We
have designed, built and demonstrated a system able to select in real-time
2-D visual features on a commercially available reconfigurable platform.
During this process we have learned that the system level architectures
of off-the-shelf reconfigurable computers are not optimized for low
level vision tasks, therefore, we have designed a novel architecture
dedicated to real-time processing of video streams. A system based on
this architecture has been built and is currently being tested. More
recently, we have studied the problem of bit-width computation for the
optimization of the data paths found in digital video signal processors.
(full
report)
|
|
Weighted
Feature matching Algorithms for Mobile Robot Displacement Estimation
Dr. Joel W. Burdick, Dr. Stergios Roumeliotis, Kristo Kriechbaum, Sam
Pfister
Sensor
based motion planning is an integral part of mobile robotics. It incorporates
sensor information, reflecting the current state of the environment,
into a robot's planning process, as opposed to classical planning ,
where full knowledge of the world's geometry is assumed to be known
prior to the planning event. Sensor based planning is important because:
(1) the robot often has no a priori knowledge of the world; (2) the
robot may have only a coarse knowledge of the world because of limited
memory; (3) the world model is bound to contain inaccuracies which can
be overcome with sensor based planning strategies; and (4) the world
is subject to unexpected occurrences or rapidly changing situations.
(full report)
|
|
Distributed
Collective Building of Two-Dimensional Structures Using Autonomous Robots
Kjerstin Easton, Alcherio
Martinoli
Collaborators: Joel
Burdick (CNSE, Caltech), Guy Theraulaz (CNRS, Toulouse, France), Dario
Floreano (EPFL, Lausanne, Switzerland), Nicolas Reeves (UQAM, Montreal,
Canada)
Using
autonomous robots to build three-dimensional structures is a distant
goal, but the first step in approaching collective building is to construct
two-dimensional architectures. Using a team of miniature Khepera
robots with manipulation and vision capabilities, we will implement
a building technique modeled after qualitative stigmergic construction
mechanisms used by social insects. This technique will allow the robots
to communicate building instructions through modifications to the local
environment, avoiding dependence on explicit robot-to-robot communication
and lending itself to implementation with any number of robots. (full
report)
|
|
Human
Neural Activity during Learning and Memory
Jessica Edwards, Miguel Remondes, Adam Mamelak
While
learning and memory are widely studied in a variety of systems, it is
still rare to be able to examine these behaviors at the single cell
level in humans. Working with a group of epileptic patients, we are
able to record from individual neurons in alert and learning humans.
Patients suffering from medically intractable epilepsy are resistant
to drug therapies that are traditionally used for seizure control. Resection
of the epileptogenic focus provides seizure relief. To localize the
area for surgery, patients are implanted with up to twenty electrodes,
including microwire, hybrid electrodes in the hippocampus and amygdala.
The duration of the medical procedures allows us to monitor the electrical
activity of cells in the hippocampus and amygdala for up to one week.
Using a battery of neuropsychological tests, we are able to examine
rapid learning and declarative memory. Tests we are currently using
include three versions of the Recognition Memory Task: Faces, Objects
and Words, a Continuous Visual Memory Task, Verbal Paired Associates
and a variation of the Taylor picture task. We also use a virtual Water
Maze, a joystick-operated simulation of the Morris Water Maze task,
to test object-cued place memory. We hope to add several emotional memory
tasks as well as a version of the memory game "Concentration" in the
upcoming months. Currently, we are beginning to analyze data that may
demonstrate a direct relationship between hippocampal activity and memory
formation in humans. Further, we hope to examine the correlation between
local field potentials (EEG) and single-unit activity.
|
|
Human
Action Classification
Xiaolin Feng, Pietro Perona
We study
and classify the human actions in this project. We first construct a
large dataset of movelets which are defined as body configuration and
motion. Each action is represented as the temporal link through the
movelets and this temporal link is modeled by Hidden Markov Model. For
a given test sequence, the likelihood that it fits the actions we learnt
are estimated. The sequence is classified to the action with the maximum
likelihood. The algorithm is tested on both periodic (walking, jogging
etc.) and nonperiodic (reaching) human actions.
(full
report)
|
|
Classification
of Road Vehicles
Robert Fergus, Bradley Phillips, Paul Updike
We have
worked to apply the probabilistic recognition techniques developed in
our lab to the classification of road vehicles in busy traffic scenes.
We have demonstrated that the model can successfully determine the presence
or absence of cars in a given road scene using a detection algorithm
that is translation and scale invariant, and can deal with cluttered
scenes and occlusions. (full
report)
|
|
A Thermopneumatic
Microfluidic System
Charles Grosjean, Xing Yang, and Yu-Chong Tai
A self-contained
planar microfluidic system using thermopneumatic actuation has been
demonstrated. Using a novel suspended silicon island heater fabricated
by DRIE, and a precision machined acrylic fluidic substrate with a matching
silicone rubber membrane, a system of channels, valves, and a pump has
been demonstrated with self-contained actuation using air as a working
fluid. (full
report)
|
|
Attention
as a Result of Distributed Competition.
Fred H. Hamker
Recordings
in V4, IT, MT, MST, PFC and FEF reveal influences of attention on the
average rate activity of neurons. However, it is still missing a global
picture of the process of attention, i.e. the origin of spatial attention
and the interactions between feature-based and spatial attention. We
investigate the possibility of a spatial stimulus reentry from the frontal
eye field into extrastriate visual areas by means of a quantitative
comparison between simulations and experimental data. (full
report)
|
|
Mapping
Contingency Awareness in Fear Conditioning
C.J. Han
The goal
of this project is to employ two types of Pavlovian conditioning: trace
and delay, to investigate the awareness of the contingency of the conditioned
stimulus (CS) and unconditioned stimulus (US). We have successfully
established the behavioral and molecular paradigms over the past year
and are currently collecting data of the effects of the anterior cingulate
cortex lesion and the immediate early gene c-fos expression patterns
in the mouse brain. (full
report)
|
|
Ultra
Low-power Concurrent Transceiver Architectures for Ubiquitous Networks
H. Hashemi and A. Hajimiri
We are
proposing a completely new approach to design Ultra-Low Power Concurrent
Multiband Transceivers capable of operating at multiple frequency bands
simultaneously with minimal overhead to the system resources for a network
of sensors. (full report)
|
|
Distributed
Plume Tracing
Adam
Hayes, Alcherio
Martinoli
Collaborators: Rodney Goodman, Michael Freund, Nate Lewis
External Collaborators: Owen Holland
The objective
of this project is to study biologically inspired algorithms which enable
a robot or group of robots to track an odor plume to its source, with
an appropriate combination of speed, efficiency, reliability, and accuracy.
Research is conducted at three levels: non-embodied point simulations,
embodied sensor-based simulations, and real robots. The simulations
use sensors and actuators which are based on the capabilities of the
real robots, and plume information is derived from empirical data files
recorded from real plumes or realistic plume simulators. In simulation
we explore the performance of various families of simple algorithms,
as well as the potential for automated parameter tuning and on-line
learning. We assess the most promising algorithms on real robots, which
are equipped with Caltech olfactory sensors, anemometric devices, and
simple communication systems. (full
report)
|
|
Flocking
in Embedded Robotic Systems
Adam Hayes, Ian Kelly, Alcherio Martinoli
Caltech Collaborators: Richard Murray
The goal
of this project is to implement flocking behavior on real robots, and
then study the system to determine what sensory information and behaviors
are most important to robust flocking. Our algorithms are inspired by
those of Reynolds and Brogan and Hodgins, and are specifically adapted
to the sensory and motor constraints of a real robotic platform. Work
is ongoing using a sensor-based simulator, Webots, as well as our Moorebot
fleet using the overhead camera to emulate additional sensory input.
We are in the process of developing sensory hardware for the Moorebots
so that they may flock autonomously. (full
report)
|
|
Rapid
Natural Scene Categorization without Attention
Fei Fei Li, Rufin VanRullen, Christof Koch, Pietro Perona
Visual
attention plays an important role as we walk around the world and recognizes
different objects. So what happens when attention is taken away? Are
we still able to recognize scenes or objects? Our study finds that certain
high level tasks, such as natural scene categorization, can still be
performed with little or no attention. (full
report)
|
|
Distributed
Learning in Swarm Systems
Ling Li, Alcherio
Martinoli, Yaser Abu-Mostafa
Distributed
learning is the learning process of multiple autonomous agents in a
varying environment, where each agent may have only partial information
about the environment and other agents. We model the system and individual
agents, then use several techniques such as reinforcement learning to
find the optimal strategy for each agent in order to maximize the group
performance. Our experiments with the stick-pulling problem showed agents
became specialized automatically.
(full
report)
|
|
Holographic
Imaging of Biological Samples
Wenhai
Liu, Jose Mumbru, Demetri Psaltis
We are
developing an imaging system with the ability of imaging a 3-D object
plus its color spectrum information. The system makes use of the spatial
and wavelength selectivity of volume holograms, which act as multiple
focal-length lenses and color filters to separate 2-D slices with different
color from the 3-D object into various detectors. The holographic microscope
will be a powerful tool for imaging application in cell-biology, biochemistry,
materials research and any other 3-D imaging application. (full
report)
|
|
Fast
Holographic Recording Using Angle Multiplexing
Zhiwen Liu, Gregory J. Steckman and Demetri Psaltis
We demonstrate
a holographic system which can record nanosecond events. Five frames
of laser induced shock wave propagation were recorded using this apparatus
with a time resolution of 5.9ns and frame interval of 12ns.
(full
report)
|
|
The Neuroethology
of Sensory-Based Behavior
Dr. Malcolm MacIver, Prof. Joel Burdick
We have
begun research that addresses the interrelationship between animal sensing
and the mechanics of animal movement. There are two interrelated thrusts
to this work. The first is optimal sensing and movement strategies for
far-field targets, such as distant resources that must be detected and
acquired. The second thrust is optimal sensing and movement strategies
for near-field locomotion-directed signals, such as needed for sensing
flow velocity near a constriction in a streambed that requires a fish
to increase its thrust.
(full
report)
|
|
Sensing
and Control for Robotic Fish Locomotion
Richard Mason, Kristi Morgansen, Joel Burdick
We are
studying issues in fluid mechanics, nonlinear control, and sensing that
are necessary for the development of self-propelled robot fish. (full
report)
|
|
A Mems
Body Fluid Flow Sensor
Ellis Meng, Sascha Gassmann, and Yu-Chong Tai
To achieve
in vitro flow rate measurements of biological fluids in such
tasks as hematological studies and urinalysis, a MEMS flow sensor has
been developed. Flow sensing is achieved by measuring the forced convective
heat transfer from a thermal sensing element to the fluid. Currently,
fluid flow down to 10 ml/min can be detected. (full
report)
|
|
Modeling
Reverse-PHI Motion Selective Neurons In Cortex: Double Synaptic Veto Mechanism
Chunhui Mo, C. Koch
Reverse-phi
motion is the illusory reversal of perceived direction of movement when
the stimulus contrast is reversed in successive frames. Here we proposed
a double synaptic veto mechanism that could account for experimental
observed responses to reverse-phi motion in V1 cells. We carried out
detailed biophysical simulation in NEURON and verified our results with
experimental data. (full
report)
|
|
Optically
Programmable FPGA Systems
Jose Mumbru, George Panotopoulos, Arrigo Benedetti, Demetri Psaltis, Pietro
Perona Industrial Collaborators: Holoplex, Honeywell, Photobit
The aim
of this project is to investigate and demonstrate a Parallel Optical
Interface between a Holographic Memory and a Silicon Circuit. This interface
is implemented as an Optical Programmable Gate Array (OPGA), which is
an enhanced version of a conventional FPGA, utilizing a holographic
memory accessed by an array of VCSELs to program its logic. Combining
spatial and shift multiplexing to store the configuration pages in the
memory, the OPGA module is very compact and has extremely short configuration
time allowing for dynamic reconfiguration. The reconfiguration capability
of the OPGA can be applied to solve more efficiently problems in pattern
recognition and searches in databases. The silicon hardware used for
the OPGA can also be interfaced to a Holographic Disk Database and used
for fast searches in the stored data.
(full
report)
|
|
Distributed
Manipulation
Todd Murphey, Joel W. Burdick
This research
analyzes the stability of distributed manipulation control schemes.
A commonly proposed method for designing a distributed actuator array
control scheme assumes that the system's control action can be approximated
by a continuous vector force field. The continuous control vector field
idealization must then be adapted to the physical actuator array. However,
we have shown that when one takes into account the discreteness of actuator
arrays and realistic models of the actuator/object contact mechanics,
the controls designed by the continuous approximation approach can be
unstable. For this analysis we introduce and use a ``power dissipation''
method that captures the contact mechanics in a general but tractable
way. We show that the quasi-static contact equations have the form of
a multi-model hybrid system. We introduce a discontinuous feedback law
can produce stability which is robust with respect to variations in
contact state. (full
report)
|
|
A Priori
Training Data Valuation
Alexander Nicholson, Yaser
Abu-Mostafa
For machine
learning it is generally accepted that a greater amount of available
data facilitates improved generalization. In practice, however, a learning
algorithm cannot accomodate and unlimited data set and may be hindered
by noisy and irregular data. We introduce a procedure for evaluating
individual training examples. This valuation can serve as a basis for
selecting training sets of limited size and for detecting outliers or
other undesirable data. We demonstrate that learning with a data set
from which the worst data has been removed can result in improved generalization
performance. (full report)
|
|
The Bin
Model for Generalization
Alexander Nicholson, Xubo
Song, Yaser Abu-Mostafa
The problem
of overfitting the data is attacked by using the Bin Model analysis.
This provides a method of bounding generalization error without sacrificing
valuable training data. (full
report)
|
|
Gesture
Recognition
George Panotopoulos,
Dinkar Gupta, Demetri Psaltis, Pietro Perona
Though
your personal computer has a processing capacity orders of magnitude
larger than it did some ten years ago you still use the same means to
interface with it, namely a keyboard and pointing device. In the context
of this project we investigate the design of an interface based on human
gestures. The system we are envisioning is not limited to a particular
user and should be able to learn new gestures.
(full
report)
|
|
Models
of Visual Object Categorization In Humans
Robert J. Peters,
Fabrizio Gabbiani, Christof
Koch
Previous
studies of exemplar, prototype, and decision-bound models of visual
object categorization have not resolved the importance of memory capacity
and flexibility of decision surfaces in human categorization behavior.
We have compared these previous models with our new roaming exemplar
model (RXM), according to their abilities to match human observers'
categorizations of various 2-D image contours. Unlike past comparisons
among categorization models, we explicitly accounted for memory capacity
by penalizing models for their number of free parameters with the Akaike
information criterion. This revealed that a successful model of human
categorization--such as the RXM--did not require a large memory capacity
if the orientation of its decision boundary was unconstrained, suggesting
that an efficient computer implementation of object categorization could
also rely on limited memory storage. (full
report)
|
|
Flexible
Parylene-Valved Skin for Adaptive Flow Control
T. Nick Pornsin-Sirirak, Matthieu Liger, Yu-Chong Tai, Steve Ho, Chih-Ming
Ho
This research
describes the first work of using wafer-sized flexible parylene-valved
actuator skin (total thickness ~ 20 _m) for micro adaptive flow control.
The check-valved actuator skin features vent-through holes with tethered
valve caps on the membrane to regulate pressure distribution across
the skin. The skins were integrated onto micro-aerial-vehicle (MAV)
wings that were tested in the wind tunnel for aerodynamic evaluation.
The test result has shown a very significant effect on the aerodynamic
performance. Compare to the reference wings (no actuators), both the
lift and thrust of the check-valved wings are improved by more than
50%. This is the first experimental result to demonstrate that the application
of MEMS actuator skins for flow control is very promising. (full
report)
|
|
Structural
Description of Basic Objects With Features
Christoph Rasche
We explore
the representation of basic-level categories using computer vision methods.
The category representation is expressed by lines, arcs and a combination
thereof. In a bottom-up process we extract such features, in a top-down
process we try to match each category representation against the bottom-up
output. (full
report)
|
|
Attention
Modulation of Visually Responsive Neurons in the Human Medical Temporal
Lobe.
Leila Reddy, Patrick Wilken, Christof Koch
Previous
work from our laboratory (Kreiman et al.,2000) has shown that neurons
in the medical temporal lobe structures are visually responsive to categories
of images. We intend to test whether attention modulates cell firing
in these neurons.
(full
report)
|
|
Face-gender
Discrimination Modulated by Attentional Load
Leila Reddy, Patrick Wilken, Christof Koch
This experiment
demonstrates that performance in gender discrimination tasks is compromised
when attention is engaged by another attentionally demanding task. However,
performance is still highly above chance implying that in the near absence
of attention, observers can still distinguish the gender of a face to
some extent. (full report)
|
|
Shadow
Carving
Silvio Savarese, Holly Rushmeier, Fausto Bernardini, Pietro Perona
The shape
of an object may be estimated by observing the shadows on its surface.
Assuming that a conservative estimate of the object shape is available,
our method analyzes images of the object illuminated with known point
light sources and taken from known camera locations. The surface estimate
is adjusted using the shadow regions to produce a refinement that is
still a conservative estimate. A proof of correctness is provided. The
method has been tested and validated with experimental results.
(full
report)
|
|
Detection
of Human Motion in a Cluttered Scene
Yang Song, Luis Goncalves, and Pietro Perona
Humans
are the most important component of a machine's environment. We develop
an algorithm which can generate models of human motion automatically
from unlabeled real image sequences. Experiments show that the resulting
models can successfully detect and label humans from image sequences
with clutter and occlusion. (full
report)
|
|
Attentional
Modulation of Visual Motion Perception Using Novel Wavelet Stimuli Ð Combination
Study of Psychophysics and fMRI Imaging
N. Tsuchiya, G. Rees, J. Braun & C. Koch
We have
previously characterized the effects of withdrawing attention on detection
and discrimination of static visual stimuli (Lee et al. Nat Neuro 1998).
Here we report attentional modulation of motion perception in psychophysics
experiment. A novel motion stimulus comprising spatio-temporally contrast-modulated
Gabor wavelets was used to distinguish attentional effects on mechanisms
sensitive to component motion from those sensitive to pattern motion
(Schrater et al Nat Neuro 2000). In the second experiment, we confirmed
our component stimulus only activates only early visual cortex by functioal
magnetic resonance imaging (fMRI) measurement, supporting our argument
in psychophysics and consistent with our previous result (Rees et al.
Nat Neuro 2000). (full
report)
|
|
Part
1/ Rapid Visual Categorization In The Absence of Awareness
Part 2/ Processing Capacity For Natural Scenes and Objects in the Human
Visual System
Rufin VanRullen
Humans
can categorize natural scenes on the basis of the presence of a target
object (i.e. animal) so rapidly (150 ms) that such processing has been
proposed to rely on the feed-forward propagation of information collected
during the first milliseconds of visual stimulation. According to this
view, early motor responses should be mostly unaffected by masking the
visual stimulus after a few tens of milliseconds. We asked our subjects
to respond to masked (SOA 26.6 ms) and unmasked natural scenes when
they contained an animal. (full
report)
|
|
Primitives
for Human Motion: A Dynamical Approach
D. Del Vecchio, R.M. Murray, P. Perona
Using
tools from d dynamical systems theory and systems identification theory
we develop the study of primitives for human motion which we refer to
as movemes. We introduce basic definitions of dynamical independence
of LTI systems and segmentability of signals and we develop classification
and segmentation algorithms for two dimensional motions. We test our
ideas on data sampled from four human subjects who were engaged in a
simple reallife activity including two movemes. Our experiments show
that we are able to distinguish between the two movemes and recognize
them even when they take place in an activity containing more than one
moveme.
(full
Report)
|
|
Towards
an Integrated Model of Saliency-based Attention and Object Recognition
Dirk Walther, Maximilian Riesenhuber, Tomaso Poggio, Laurent Itti, Christof
Koch
We are
working on an integrated model for the dorsal (where) and the ventral
(what) pathway in the primate's visual processing system and the interaction
between these two pathways. The model will be applied to visual search
tasks for detecting objects in cluttered natural scenes. Components
of top-down attention will be integrated into the system to achieve
this goal. (full report)
|
|
Underwater
Shear Stress Sensor
Yong Xu, Fukang Jiang, Qiao Lin, Jason Clendenen, Steve Tung and Yu-Chong
Tai
A micromachined,
vacuum-cavity insulated, thermal shear stress sensor is developed for
underwater applications. The two major challenges for underwater application,
namely the waterproof coating and pressure sensitivity, are specially
studied for our device. (full report)
|
|
Swarm
Intelligence and Traffic Safety
Yizhen Zhang,
Alcherio Martinoli
Collaborators: Erik
Antonsson (Caltech), Ross Olney (Delphi-Delco Automotive Systems)
A smart
car that assists the driver must give warnings in dangerous situations,
override the driver to avoid collisions, and help to reach the intended
destination as quickly as possible. Unfortunately, satisfying these
requirements and at the same time leaving the decisional autonomy at
the individual level becomes an extremely hard problem to solve with
traditional methods. Biologically-inspired techniques such as Swarm
Intelligence and Incremental Evolution provide new promising ways to
tackle the design and distributed control problems of a traffic system.
In this project, solutions are developed using embodied simulations
and validated with real robot experiments. (full
report)
|
[top]
|
|
|