Paper: Rendering Synthetic Objects into Legacy Photographs

Inserting 3D objects into existing photographs

 

This fascinating video presents a new method to insert 3D objects into existing photographs. It is based on the research of Kevin Karsch, Varsha Hedau, David Forsyth and Derek Hoiem  (all University of Illinois at Urbana-Champaign). Their main contribution is the algorithm, which generates the light model for the scene. The algorithm needs only one photograph and a few manual markings by a novice user together with a ground truth data set to create a near real life insertion. The ground truth data set was generated with 200 images from 20 indoor scenes under varying lighting conditions.

The video is well done and I am surprised whats possible, but I like to see how much user input is really necessary and how well the algorithm and the ground truth perform with other images. What do you think?

More details can be found at Kevin Karsch’s website.

Building Rome in a Day with Photosynth

Remeber Photosynth(video), the Microsoft Research software that turned hundreds of Flickr images of one building into a 3D view? They have, together with researchers from the University of Washington, Cornell, improved the software to a point where they can model the city Rome out of 150,000 photos from Flickr in less than 21h.

More videos and details are available from the project website, http://grail.cs.washington.edu/rome/.

The paper, “Building Rome in a Day” by Sameer Agarwal, Noah Snavely, Ian Simon, Steven M. Seitz, and Richard Szeliski, was presented at the International Conference on Computer Vision (ICCV 2009) on September 30th.

via Improved Photosynth can model a city in hours | Computer Vision Central.

Seam carving tutorial for Matlab

I just found a Matlab tutorial at savvash.blogspot.com for content aware image scaling, aka seam carving. It is basically the same algorithms they use in PhotoShop CS4 for their ‘Content Aware Scaling’.

If you’ve never heard of seam carving make sure to watch the video

And here is an outlook into the future, a video demo what CS5 is able to do. Sweet magic.

[update]

for more on Matlab look at my post: Programming in Matlab!