
Rendering Synthetic Objects into Legacy Photographs
5 months ago
Supplementary material video for our 2011 SIGGRAPH Asia paper (see the project page here: kevinkarsch.com/publications/sa11.html). 3D objects are rendered using LuxRender (luxrender.net).
Authors: Kevin Karsch, Varsha Hedau, David Forsyth, Derek Hoiem
Abstract: We propose a method to realistically insert synthetic objects into existing photographs without requiring access to the scene or any additional scene measurements. With a single image and a small amount of annotation, our method creates a physical model of the scene that is suitable for realistically rendering synthetic objects with diffuse, specular, and even glowing materials while accounting for lighting interactions between the objects and the scene. We demonstrate in a user study that synthetic images produced by our method are confusable with real scenes, even for people who believe they are good at telling the difference. Further, our study shows that our method is competitive with other insertion methods while requiring less scene information. We also collected new illumination and reflectance datasets; renderings produced by our system compare well to ground truth. Our system has applications in the movie and gaming industry, as well as home decorating and user content creation, among others.
Authors: Kevin Karsch, Varsha Hedau, David Forsyth, Derek Hoiem
Abstract: We propose a method to realistically insert synthetic objects into existing photographs without requiring access to the scene or any additional scene measurements. With a single image and a small amount of annotation, our method creates a physical model of the scene that is suitable for realistically rendering synthetic objects with diffuse, specular, and even glowing materials while accounting for lighting interactions between the objects and the scene. We demonstrate in a user study that synthetic images produced by our method are confusable with real scenes, even for people who believe they are good at telling the difference. Further, our study shows that our method is competitive with other insertion methods while requiring less scene information. We also collected new illumination and reflectance datasets; renderings produced by our system compare well to ground truth. Our system has applications in the movie and gaming industry, as well as home decorating and user content creation, among others.
Showing 100 of 143 comments.
Want to see the rest?
This conversation is missing your voice. Take five seconds to join Vimeo or log in.
MP4
00:04:57
36 Related collections
- Categories / Animation & Motion Graphics
- Categories / Music
- EXPM - CHANNEL
- Blender 3D
- Inspirational
- DSLR Cinema
| Date | Plays | Likes | Comments |
|---|---|---|---|
| Totals | 927K | 3,512 | 144 |
| Feb 23rd | 133 | 1 | 0 |
| Feb 22nd | 326 | 1 | 0 |
| Feb 21st | 444 | 0 | 0 |
| Feb 20th | 289 | 2 | 0 |
| Feb 19th | 299 | 2 | 0 |
| Feb 18th | 280 | 3 | 0 |
| Feb 17th | 390 | 1 | 0 |
-
Vimeo: About / Blog / Developers / Jobs /
Community Guidelines /
Help Center / Video School / Music Store / Site Map
/ Vimeo
or
-
Legal: TM + ©2012 Vimeo, LLC. All rights reserved. / Terms of Service / Privacy Statement / Copyright

Prev week
Working with regular old 3d renders will feel like going from Photoshop CS5 to MS Paint.
I'll now have to cry myself to sleep till we'll be able to toy around with an actual app using this cool tech ='(
as an interior designer i cant wait to get something like this to my workflow.
real great work!
Today.
Now I know that I can't trust any photo anymore.
When will this become a commercial product?
Any idea of the price for this wonderfull software ? Will it work on a mac too or just on PC ??
Thank you sooooo much for such an innovative technology !
I'll just say, I spotted the real photo instantly :P
I repeat, until one actually works with a program, you don't know what is actually possible, seeing the final result is not proof.
Take your cynical unwanted abuse to your grave, you sad, negative, bitter old man.
That isn't being a dick head, it's being realistic. I've used lots of software that looked good in the Demo, but the reality turned out that it wasn't that easy to you.
You should try not being an obnoxious, ignorant asshole.
I think if they offered a free trial package (perhaps time-limited) I'd love to try it and then write a review.
With one of the add-ons that keep objects in place automatically, these would have been far easier. As it was, I had to try to move them frame by frame. Because the camera was inexpensive and not steady at all, this was harder than it should have been, but all we had was an inexpensive Casio hand-help.
I still think the system shown here, if it is even half automated would save many hours of tedious work. I'd have to be far more serious to justify it and a much better camera, too. :D
this would help every project i'm working on.
With 3D motion tracking, this would be the number 1 tool for 3D.
For the love of everything, release that Demo.