Black Cat Filtering Woes

This forum is for questions and discussion of all the aspects of handling and cleaning up your footage with Avisynth.
Locked
macchinainterna
Joined: Mon Jul 10, 2006 2:27 am
Status: Done. So done.
Org Profile

Black Cat Filtering Woes

Post by macchinainterna » Thu Jun 26, 2008 6:04 am

Okay, This is really the first time I've really explored avisynth filtering for my sources beyond mere deinterlacing and resizing, and well let's face it; I plain suck at it . . . :x

I'm having trouble filtering the R1 Black Cat DVDs. I have my footage filtered to where I'm satisfied with the color depth and overall saturation. My biggest problem is pixilation No matter what I try I can't seem to smooth out these scenes, and I'm about all out of patience.

Can anyone help me out?

Here are a couple of examples of these scenes . . .

http://i219.photobucket.com/albums/cc78 ... Clip10.png

http://i219.photobucket.com/albums/cc78 ... clip20.png

This is my current script:
  • MPEG2Source("C:\Documents and Settings\o\My Documents\AMV Stuff\Black Cat\1-4.d2v")
    ConvertToYV12()
    Telecide(order=1)
    Decimate(Cycle=5, mode=3, Threshold=1.0)
    Deen("w3d",3,4,6)
    Tweak(cont=1.1,sat=1.5,bright=0,hue=.2)
    FluxSmoothT()
    TemporalCleaner()
    VagueDenoiser(threshold=1.5,method=1,nsteps=6,chromaT=2.0)
    WarpSharp(Depth=128, Blur=3, Bump=128, Cubic=0.6)
    Crop(8,4,-8,-4)
    LanczosResize(848,480)
    ConvertToRGB32()

Mosc
Joined: Mon Oct 30, 2006 8:13 am
Org Profile

Re: Black Cat Filtering Woes

Post by Mosc » Thu Jun 26, 2008 5:23 pm

gradfun2db(69). In all seriousness though, provide screenshots/a sample of the unfiltered version. Your current filtering makes it pretty much impossible for anything to remove the noise without destroying the picture completely.

User avatar
Kariudo
Twilight prince
Joined: Fri Jul 15, 2005 11:08 pm
Status: 1924 bots banned and counting!
Location: Los taquitos unidos
Contact:
Org Profile

Post by Kariudo » Thu Jun 26, 2008 7:34 pm

a few things that may help...
you don't need the converttoyv12 line (dvd footage should already be in yv12)

I'm not a fan of warpsharp, every time I try to use it eyes, hair, skin, etc... shifts random directions and by random amounts.

It may be worth your time to disable temporalcleaner() and see if your picture improves any.

Sometimes, frames right around scene changes are just bad...are the problems in the two pics here an example of what happens throughout the source?
Image
Image

macchinainterna
Joined: Mon Jul 10, 2006 2:27 am
Status: Done. So done.
Org Profile

Re: Black Cat Filtering Woes

Post by macchinainterna » Fri Jun 27, 2008 12:30 am

Mosc wrote:gradfun2db(69). In all seriousness though, provide screenshots/a sample of the unfiltered version. Your current filtering makes it pretty much impossible for anything to remove the noise without destroying the picture completely.
Here are the unfiltered caps

http://i219.photobucket.com/albums/cc78 ... efore0.png

http://i219.photobucket.com/albums/cc78 ... efore0.png
Kariudo wrote:a few things that may help...
you don't need the converttoyv12 line (dvd footage should already be in yv12)

I'm not a fan of warpsharp, every time I try to use it eyes, hair, skin, etc... shifts random directions and by random amounts.

It may be worth your time to disable temporalcleaner() and see if your picture improves any.

Sometimes, frames right around scene changes are just bad...are the problems in the two pics here an example of what happens throughout the source?
I gave disabling these filters a shot and the overall quality didn't really improve. The examples I gave I've only noticed happening on the first disc and the opening and closing animations so far. The rest of the discs seem to be fine and they all have the same filtering . . .

Mosc
Joined: Mon Oct 30, 2006 8:13 am
Org Profile

Post by Mosc » Fri Jun 27, 2008 4:57 am

Wow, that's pretty bad.

dfttest() at the default settings appears to remove more artifacts than your code above, although I certainly would only it use it at the defaults on material this crappy; adjusting sigma will alter the strength of the smoothing. Making the filter temporal by setting tbsize to an integer higher than 1 may or may not help here, as may any other temporal denoiser. LimitedSharpenFaster() somewhat brings back sharpness, but it also highlights the remaining artifacts.

macchinainterna
Joined: Mon Jul 10, 2006 2:27 am
Status: Done. So done.
Org Profile

Post by macchinainterna » Fri Jun 27, 2008 12:36 pm

Mosc wrote:Wow, that's pretty bad.

dfttest() at the default settings appears to remove more artifacts than your code above, although I certainly would only it use it at the defaults on material this crappy; adjusting sigma will alter the strength of the smoothing. Making the filter temporal by setting tbsize to an integer higher than 1 may or may not help here, as may any other temporal denoiser. LimitedSharpenFaster() somewhat brings back sharpness, but it also highlights the remaining artifacts.
Thanks for the help. 'Cept I don't have dfttest, nor do I have winzip on here so that I can download it. Crap . . .

macchinainterna
Joined: Mon Jul 10, 2006 2:27 am
Status: Done. So done.
Org Profile

Post by macchinainterna » Tue Jul 01, 2008 5:30 am

macchinainterna wrote:
Thanks for the help. 'Cept I don't have dfttest, nor do I have winzip on here so that I can download it. Crap . . .
. . . Somebody please smack me the next time I say something stupid like that again. :x

macchinainterna
Joined: Mon Jul 10, 2006 2:27 am
Status: Done. So done.
Org Profile

Post by macchinainterna » Tue Jul 01, 2008 11:24 am

Okay, long story short; I got dfttest and installed it, but now when I add it to the script I get an error message saying "dfttest: unable to load libfftw3f-3.dll."

Is there something I did wrong?

User avatar
EvaFan
Joined: Sun Mar 21, 2004 10:25 pm
Status: (*゚▽゚)o旦~ ー乾杯ー♪
Location: Somerset, KY
Org Profile

Post by EvaFan » Tue Jul 01, 2008 5:03 pm

could be that the file its trying to load "libfftw3f-3.dll" is not on your computer, or its named something else that your version of dfttest doesn't know.

I've encountered alot of scripts that use other dll's that have them named wrong and you have to edit it yourself, same way with functions.
"The people cannot be [...] always, well informed. The part which is wrong will be discontented, in proportion to [...] the facts they misconceive. If they remain quiet under such misconceptions, it is lethargy, the forerunner of death to public liberty. What country can preserve its liberties, if it's rulers are not warned [...] that this people preserve the spirit of resistance? The tree of liberty must be refreshed from time to time, with the blood of patriots and tyrants."-Thomas Jefferson

CorruptNova
Joined: Wed Jun 04, 2008 4:24 pm
Org Profile

Post by CorruptNova » Sat Aug 02, 2008 6:08 pm

you need the FFT dlls for windows

http://www.fftw.org/install/windows.html

ftp://ftp.fftw.org/pub/fftw/fftw3win32mingw.zip

Copy all the dlls into your into your system32 folder and make sure your system32 folder is listed under PATH

To figure this out, go to My Computer and right click it and hit properties go to the advanced tab and go to environment variables in the first white box there should be a section called PATH under User variables for "username". If not make a new one and name it PATH and put the path to your system32 folder below the variable name. If it is there but the path to your system32 folder isn't listed add a semicolon to the end of whatever is in PATH and add your system32 folder (there are no spaces when adding the semicolon.

Locked

Return to “AviSynth Help”