Fixing video with Photographs

This system, by students at the University of Washington, uses still photographs or one single frame of a video scene to automatically improve video. The improvements are amazing. Video might contain artifacts like overexposure and low-resolution imagery and this system takes cues from still images of the scene to bring almost the entire video up to photographic quality. Can’t wait for this to hit our local point and shoot - in maybe five years.

10 Comments/Pingbacks so far

 
no image
lM ll lL lL S (Who am I?)

no way. i don’t believe it. that’s wicked crazy. especially the last one with the masking of the no parking sign. that doesn’t happen.

 
no image
Chuck (Who am I?)

Frickin magic. That what I’m talkin about.

Ideally the high res photography camera and the video camera should be the same unit. Maybe taking a high res photo every second or two as a key frame while contiuously recording the video. Maybe even dynamically changing the rate of the High res camera dependent on the difference frame to frame.

Very cool. I wish I’d done it.

I think I also see that there technology is somewhat dependednt on side to side movement. I have made 3D movies out of 2D video using a similar technique.

 
no image
Matt Huggins (Who am I?)

Wow, that’s insane! The parking sign one is pretty hard to believe, I’d have to see the software do it with my own eyes.

 
no image
wow (Who am I?)
 
no image
nicos (Who am I?)

I want it, I want it, I want it, NOW !

 
no image
Esfandiar (Who am I?)

Once you are able to do the SFM (structure from montion) for the video and the picture and build the 3D, removing the poles and certain objects can actually be the easier part of the process (as long as you don’t have permanent occlusions).

As a complete system, this can have a major commercial impact on Hollywood and special effect for the movies. I particularly loved their (dynamic) texture mapping :-) Cut and paste 3D objects into each frame and… wow :-)

Cheers, E

 
no image
Daniel (Who am I?)

That was without doubt the most amazing thing I have ever seen done with a video. Wow.

I wish this could get to the market sooner preferably now.

Daniel

 
no image
panTribe (Who am I?)

This is revolutionary. CPU processing times are taking all the math out of filming.

 
Earl O'Mar

Absolutely revolutionary. However when I see this, I can’t help but to think about the abuse and purposeful deceptions that can be disseminated to the public. I recognize that the same capability exists with still photos, but video is always more convincing. Imagine this software being used on video from Iraq that would otherwise show the carnage of war?

Believe me, as a photographer I am eagerly awaiting a production release of this technology so I can improve the quality of my work. I simply anticipate the inevitable realities of it’s capabilities.

 
no image
Al (Who am I?)

The days of admissible video evidence are nearing their end.

Trackbacks/Pings

Leave a Comment

« Back to text comment

Comment template by SezWho

CrunchGear Sponsors