Structured Light Field Design for Correspondence Free RotationEstimation,
Ian Schillebeeckx Robert Pless ,ICCP 2015.
This paper derived simple approaches to creating and using chromo-coded light fields as an approach to simplify geometric inference for camera calibration and rotation. It demonstrated the feasibility of smart-phone based augmented reality apps based on this approach.
Structured Indoor Modeling
Satoshi Ikehata, Hang Yan, Yasutaka Furukawa, ICCV 2015
This paper presents a novel 3D modeling framework that reconstructs an indoor scene as a structured model from panorama RGBD images. A scene geometry is represented as a graph, where nodes correspond to structural elements such as rooms, walls, and objects. The approach devises a structure grammar that defines how a scene graph can be manipulated. Video
The Geometry of Colorful, Lenticular Fiducial Markers
Ian Schillebeeckx, Joshua Little, Brendan Kelly, Robert Pless, 3DV 2015
This papers derives pose estimation constraints from fiducial markers made from chromo-coding lenticular markers. These markers (small, along the tweezers in the middle of the image), give pose estimation results that are as accurate as the standard pose estimation constraints that use the entire checkerboard image.
Binocular Goggle Augmented Imaging and Navigation System provides real-time fluorescence image guidance for tumor resection and sentinel lymph node mapping
Suman B Mondal, Shengkui Gao, Nan Zhu, Gail P Sudlow, Kexian Liang, Avik Som, Walter J Akers, Ryan C Fields, Julie Margenthaler, Rongguang Liang, Viktor Gruev, Samuel Achilefu. Nature Scientific Reports, 2015
This paper presents a 3D reconstruction and visualization system to automatically produce clean and well-regularized texture-mapped 3D models for large indoor scenes, from ground-level photographs and 3D laser points.
The key component is a new algorithm called “Inverse CSG” for reconstructing a scene in a Constructive Solid Geometry (CSG) representation consisting of volumetric primitives, which imposes powerful regularization constraints to exploit structural regularities
Foreman, Matthew Hale, and Jack Engsberg. “Virtual Reality for Shaping Compensation During Upper Extremity Rehabilitation.” Archives of Physical Medicine and Rehabilitation 96.10 (2015): e112.
furukawa/newimages/museum.jpg” />Reconstructing the World’s Museums
Jianxiong Xiao and Yasutaka Furukawa, IJCV 2014 .
This paper presents a 3D reconstruction and visualization system to automatically produce clean and well-regularized texture-mapped 3D models for large indoor scenes, from ground-level photographs and 3D laser points. The key component is a new algorithm called “Inverse CSG” for reconstructing a scene in a Constructive Solid Geometry (CSG) representation consisting of volumetric primitives, which imposes powerful regularization constraints to exploit structural regularities
This paper presents a system to reconstruct piecewise planar and compact floorplans from images, which are then converted to high quality texture-mapped models for freeviewpoint visualization.
Developing Home-Based Virtual Reality Therapy Interventions
Janice Lin, Caitlin L. Kelleher, and Jack R. Engsberg. Games for Health Journal.
Stroke is one of the leading causes of serious long-term disability. However, home exercise programs given at rehabilitation often lack in motivational aspects. The purposes of this pilot study were (1) create individualized virtual reality (VR) games and (2) determine the effectiveness of VR games for improving movement in upper extremities in a 6-week home therapy intervention for persons with stroke.
SIGGRAPH Sketch, 2013
We build smart phone apps to enable collaborative projects that allow multiple users to re-photograph multiple sites over time. These sites may be architectural, social, urban scenes or ecological. Current projects utilizing our mobile tools range from nation-scale rephotography of scenic overlooks, to monitoring of urban street trees in NYC by local conservancy group volunteers. Rephotography directly connects pictures at one time to pictures at another time and provides a mechanism to collaboratively record the story of how our world changes.
abramsa/images/pl3d/ptz2.jpg” />Web-Accessible Geographic Integration and Calibrationof Webcams
Austin Abrams and Robert Pless, ACM Transactions on Multimedia Computing, Communications and Applications, 2012
A global network of webcams offers unique viewpoints from tens of thousands of locations. Understanding the geographic context of this imagery is vital in using these cameras for quantitative environmental monitoring or surveillance applications. We derive robust geo-calibration constraints that allow users to geo-register static or pan-tilt-zoom cameras by specifying a few corresponding points, and describe our web interface suitable for novices. We discuss design decisions that support our scalable, publicly-accessible web service that allows webcam textures to be displayed live on 3D geographic models. Finally, we demonstrate several multimedia applications for geocalibrated cameras, including projection of live video data onto Google Earth.
New Scientist blurb about this work.
A Virtual Reality Study on Santa Maria Crater on Mars,
Jue Wang and Keith Bennett
IEEE Virtual Reality, 2013
A Virtual Astronaut (VA) is created as an interactive virtual 3D environment for the planetary science community to support the Mars Exploration Rover (MER) mission. A prototype study was conducted based on orbital and Opportunity rover data covering Santa Maria Crater in Meridiani Planum. The prototype VA provides dynamic visual representations of the imaging, compositional, and mineralogical data for the rover operations. It lets one navigate through the scene and interact with the environment, such as viewing in-situ observations, feature measurement, and an animation of rover drives
Movement Function Follows Spatial Form: Coordinate System Implications for Online Visual Feedback Control of the Hand
Justin Brooks, PhD Thesis, 2012
Closed loop visual feedback control of the hand is essential for accurate reaching movements. We were interested to find out whether there was behavioral evidence for the independent control of hand direction and extent as a movement unfolded. We asked subjects to make a reaching movement in a virtual reality environment in which we singularly removed the visual presentation of direction and extent information of the moving hand.
Real Time Baseball Augmented Reality
Adam Kraft, MS project (advised by Robert Pless), 2011
Sports augmented reality is one area that is projected to grow over the next couple of years. We build an application intended for use at a live baseball game. Our application optimizes a best-fit homography to locate the structure of the playing field. From there, we are able to visualize information and statistics directly onto the user’s mobile device. This is accomplished in real time, requiring minimal input from the user.