PhotoSketch

In case you missed it, PhotoSketch is the application which is leaving everyone excited.
PhotoSketch, developed by Tao Chen* , Ming-Ming Chen* , Ping Tan+, Ariel Shamir° and Shi-Min Hu’, is a system

which composes a realistic picture from a simple freehand sketch annotated with text labels. The composed picture is generated by seamlessly stitching several photographs in agreement with the sketch and text labels.

I must say, I am very impressed. Both selection of the images and combining them is done on a level I haven’t seen before. The application wont render Photoshop useless, as they don’t consider lighting and perspective, but  I personally see the application as a showcase of what their algorithms are capable of, Nevertheless we only have a video and no demo but, they presented their results at Siggraph so it is not totally fake. In any case, watch the video to form your own opinion.

Example PhotoSketch

Example Results from PhotoSketch

On their website you can find their paper and more material.

Here the complete abstract:

We present a system that composes a realistic picture from a simple freehand sketch annotated with text labels. The composed picture is generated by seamlessly stitching several photographs in agreement with the sketch and text labels; these are found by searching the Internet. Although online image search generates many inappropriate results, our system is able to automatically select suitable photographs to generate a high quality composition, using a filtering scheme to exclude undesirable images. We also provide a novel image blending algorithm to allow seamless image composition. Each blending result is given a numeric score, allowing us to find an optimal combination of discovered images. Experimental results show the method is very successful; we also evaluate our system using the results from two user studies.

Workflow PhotoSketch

Pipeline of Photosketch

* Tsinghua University

+ National University of Singapore

° The Interdisciplinary Center

‘ Tsinghua University

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s