+ Reply to Thread
Page 5 of 6 FirstFirst ... 3 4 5 6 LastLast
Results 101 to 125 of 146

Thread: Batch Intermediate Creation Utilities

  1. #101
    Forum Mogul Khaver's Avatar
    Join Date
    Jan 2009
    Location
    Oregon
    Posts
    697

    Default

    Eric,

    In the ffdshow video decoder configuration dialog, go to the Codecs section and set H.264/AVC to ffmpeg-mt. Set MPEG1, MPEG2 to libmpeg2. Set all other codecs to disabled. Check the box for Deinterlacing and set the method to TomsMoComp or Yet Another DeInt... (yadif).

    This is the basic setup for ffdshow to work with my FFMpeg-BIC utility.

    Let me know if you have any more problems.

  2. #102

    Default

    Quote Originally Posted by Khaver View Post
    Eric,

    In the ffdshow video decoder configuration dialog, go to the Codecs section and set H.264/AVC to ffmpeg-mt. Set MPEG1, MPEG2 to libmpeg2. Set all other codecs to disabled. Check the box for Deinterlacing and set the method to TomsMoComp or Yet Another DeInt... (yadif).

    This is the basic setup for ffdshow to work with my FFMpeg-BIC utility.

    Thanks! H.264/AVC was set to libavcodec as was mpeg1 and 2.. Do you have a preference when using TomsMoComp or yadif?

    Also, do I need to change any settings in the encoder menu?

    I've made the changes you described and attempted an encode to MPEG2 and DNxHD (with proxy). The MPEG2 file doesn't display video in Media Player and in Quicktime it resizes to 1920x1080 but is all black.

    The DNxHD file still produces the problem with a bad public movie atom error message. I do have the codec installed (and uninstalled/reinstalled it several times now).

    I'm going to reboot into linux and see if mplayer works with them.

    Eric

  3. #103

    Default Update:

    Okay,
    Mplayer correctly plays both MPEG2 and DNxHD files generated by your utlil app. They appear to be deinteralced but it's not as accurate as the mencoder ones I did earlier. There are a few frames that appear to be reconstructed poorly.

    I'm going to attempt them on the MAC now.

    Thanks
    Eric

  4. #104

    Default Update:

    Okay, so the intermediate util is the problem. I was able to render DNxHD files from After Effects and play them in Windows/Mac correctly. There must be some other setting I'm missing that is creating these broken files.

    Any ideas?

  5. #105

    Red face

    i started reading this discussion and my brain exploded before the end.

    so basically, this lovely hfs10/100 can't just plug into a computer and then turn on a program and woosh all the video into it and start editing happily?

    it sounds maddening!!!!!

    is there an easy way to transfer footage lossless and with little pain?


    i was planning to buy a hfs100, but maybe i should wait until you can plug A into B and work with C.

    isn't that the way it's suppose to work?
    Last edited by davidkenneth; 2009 August 31st at 10:15.

  6. #106
    Forum Mogul Khaver's Avatar
    Join Date
    Jan 2009
    Location
    Oregon
    Posts
    697

    Default

    These cams record the video to sdhc cards using the AVCHD codec. You should be able to plug in the cam to the computer with a USB cable. The computer will see the cam as a USB mass storage device and using windows explorer, you simply drag the files to your computer hard drive. Once you have them on your computer, you can edit them directly if you have a beefy enough computer, or you can transcode them to an intermediate file format. My utitlities are for creating high quality intermediates, plus they have the ability to create lower quality, fast editing, proxy files for offline editing.

    If you have Video for Windows codecs such as MJPEG, HUFFYUV, Lagarith, and/or FFdshow, install Avisynth and use my AVS-BIC, or VDub-BIC utilities for creating intermediates and proxy files. They're the easiest ones to use.

    My utilities are for processing footage after you have it transfered to your computer. There are other programs for transfering from cam to computer. (Widows Explorer for SDHC card or Hard Drive cams. HDVSplit, NeoScene, NeoHD, capturing with Premiere or Vegas, etc. for miniDV tape based cams like the HVxx)

    Reply here or use the email address in the documentation of my utilities for questions and comments. Preferably here so others might benefit.
    Last edited by Khaver; 2009 August 31st at 11:00.

  7. #107

    Default

    I am completely new to all this pulldown removal, and trying really hard to understand all of this. I did everything Eugenia said in tutorial, and everything that is mentioned here, but...

    when I import one .m2t in your program, and click START, pretty soon, although original file is 700 MB, soon it became around 3 GB... I was run out of free space on that partition.

    Is that normal? How big the output file should be? And if it is, what's the point with that? Is there a way to create aproximately the same size of original file but with pulldown removal?

    I clicked abort, and then tried to open the file in BSplayer, KMPlayer and VLCPlayer, but I couldn't. I also tried to import in Sony Vegas Pro 9, but I get error message. Is this because I abort the file, or there is some other player for seeing it?

    Thank you very much for creating this program, all i need to do now, is to understand how it works.

  8. #108
    Forum Mogul Khaver's Avatar
    Join Date
    Jan 2009
    Location
    Oregon
    Posts
    697

    Default

    The way the HVx0 cams compress the video, you can't just remove frames and recompress back to the same type of file without losing some of the video quality. The purpose of creating lossless or near lossless intermediates is so you can do multiple processing effects on your footage without losing any more quality.

    In order to do pulldown removal from HDV video it must first be decoded into uncompressed, deinterlaced frames, then these frames are fed into an inverse telecine filter where the duplicates are removed. This filter outputs uncompressed 24p frames and you then feed these to an encoder. The encoder can simply create a video file containing uncompressed, lossless frames (huge files), semi-compressed lossless frames (less huge files), or compressed, lossy frames (small files). Because the original HDV files are compressed to a lossy format in the camera, it's best to create lossless intermediates in order to not lose any more quality while editing. If your editor can't handle the intermediates while editing, you can use lower quality proxy files to edit you project then swap these out for your intermediates when you're ready to render.

    So to answer your question, yes the intermediate files will be large and aborting the encoding will cause errors in the file.

  9. #109

    Default

    Wow, don't you just love being a film creator I mean, so much work to be done, transfer this, use this, open in there, put in back here... God I love this job!

    I understood you everything, thank you.

    Do you know exactly how big the output file will be? For instance:

    1MB (original .m2t file ) ----> through FFmpeg-BIC = how much MB of DNxHD .mov settings with mpeg2 libmpeg2 decoder.

    Can it be calculated? At least approximately?

  10. #110
    Forum Mogul Khaver's Avatar
    Join Date
    Jan 2009
    Location
    Oregon
    Posts
    697

    Default

    I ran a test. A 100MB 24p in 60i m2t file created a 665MB 24p DNxHD mov file.

  11. #111
    Forum Mogul Khaver's Avatar
    Join Date
    Jan 2009
    Location
    Oregon
    Posts
    697

    Default

    The package at this link, http://www.westernwoodstructures.com...reator-v16.zip, now contains all my BIC utilities plus a proxy swapping utility.

    FFmpeg-BIC: Batch intermediate creator that uses ffmpeg for conversion.
    VDub-BIC: Batch intermediate creator that uses virtualdub for conversion.
    AVS-BIC: Batch intermediate creator that uses a modified version of the utility avs2avi for conversion.
    ProxSwap: Utility for swapping intermediates and proxies for offline editing.

    PDF instructions are included for each utility.

  12. #112

    Default

    Quote Originally Posted by Khaver View Post
    The package at this link, http://www.westernwoodstructures.com...reator-v16.zip, now contains all my BIC utilities plus a proxy swapping utility.

    FFmpeg-BIC: Batch intermediate creator that uses ffmpeg for conversion.
    VDub-BIC: Batch intermediate creator that uses virtualdub for conversion.
    AVS-BIC: Batch intermediate creator that uses a modified version of the utility avs2avi for conversion.
    ProxSwap: Utility for swapping intermediates and proxies for offline editing.

    PDF instructions are included for each utility.

    Thank you for this. I actually signed up to this forum just to say that. I was directed here from someone at dvxuser.com. I have an HMC150 and was pulling my hair trying to find a way to convert avchd to DNxHD without going nuts.. or paying through the nose. lol.

    Is there any way you can make the ffmpeg version maximize hyperthreading? I don't know a heck of a lot about ffmeg but I do know there is a flag that can be enabled to make it use 8 threads. That would be great. I have an I7 and converting one stream only uses around 20% of the processor.

    I think the flag was [User video options: "-threads 8"]
    Thank you,

    Denny

  13. #113
    Forum Mogul Khaver's Avatar
    Join Date
    Jan 2009
    Location
    Oregon
    Posts
    697

    Default

    You can try this version: FFmpeg-BIC-v16-MT.zip

    It adds a "Threads" option. -1 removes the -threads command from the command line of ffmpeg. 0 thru 8 do whatever ffmpeg expects them to do. I couldn't get it to work consistantly with my dual core machine. Sometimes more CPU used sometimes not.

    Let me know if this works and I'll add it to the full package.

  14. #114

    Default

    Quote Originally Posted by Khaver View Post
    You can try this version: FFmpeg-BIC-v16-MT.zip

    It adds a "Threads" option. -1 removes the -threads command from the command line of ffmpeg. 0 thru 8 do whatever ffmpeg expects them to do. I couldn't get it to work consistantly with my dual core machine. Sometimes more CPU used sometimes not.

    Let me know if this works and I'll add it to the full package.

    I tried sending you an email but I think the software glitched. I will resend to your direct email address.

  15. #115

    Default

    Heya!

    Was wondering if this would work with the UTVideo codec as well? It's a new codec made by a japanese programmer that's similar to huffyuv/lagarith, but was made from the ground up to decode faster with multi-core cpus (especially i7!!! ). I use this codec all the time for intermediates, and was just wondering if it'll work with BIC.

    I'll try it out later, it's just I'm at work now and was bored so I thought I might ask anyway. :P

    The codec is discussed on the doom9 forums. http://forum.doom9.org/showthread.php?t=143624

    The latest version is 7.0.0. The first post hasn't been updated, but there's a link to the latest version on the last page of the thread.

    Cheers!

  16. #116
    Forum Mogul Khaver's Avatar
    Join Date
    Jan 2009
    Location
    Oregon
    Posts
    697

    Default

    FFmpeg-BIC won't work with that codec but my AVS-BIC and VDub-BIC utilities (enclosed in the same zip file) will work with it. That codec is a Video for Windows codec but ffmpeg uses a codec library compiled into the executable.

  17. #117
    Forum Mogul racer-x's Avatar
    Join Date
    Feb 2008
    Location
    3rd rock from the Sun
    Posts
    901

    Default

    DraygonZero wrote:
    Was wondering if this would work with the UTVideo codec as well? It's a new codec made by a japanese programmer that's similar to huffyuv/lagarith, but was made from the ground up to decode faster with multi-core cpus (especially i7!!! ). I use this codec all the time for intermediates, and was just wondering if it'll work with BIC.

    I'll try it out later, it's just I'm at work now and was bored so I thought I might ask anyway. :P

    The codec is discussed on the doom9 forums. http://forum.doom9.org/showthread.php?t=143624

    The latest version is 7.0.0. The first post hasn't been updated, but there's a link to the latest version on the last page of the thread.
    Thanks for posting that link. I downloaded and installed vesion 7. It works very well, much faster than lagaryth and uses all my 4 cores. It can play back full resolution 1080 in realtime on my media player. Even Vegas 8 likes it (no easy feat!) and if you use RGB, Vegas 8 can smart render it back after editing.

    So far, looks like a winner. It will replace Lagaryth for me unless I can make it break.
    .........but don't take my word for it, test it out for yourself!

  18. #118

    Default

    I transcoded some footage last night from PH avchd to DNxHD. It did use all 8 threds though the cpu only maxed out at 53%, usually around 44% (i7 system).

    At first I thought hyperthreading wasn't working but then I noticed it was fairly evenly spread through out the threads. This could be due to a bottle neck somewhere else like HD.

    The footage I transcoded was 21-24 mbps PH mode 720 60P footage from an AG-HMC150.

    I have some editing to do but I will have some interview footage to transcode on thursday/friday, so I will try and time the transcode etc. When I have some spare time I will transcode the same file with hyperthreading off and again with it on and see how that effects speed etc.
    Last edited by Denwa; 2009 October 28th at 16:58.

  19. #119
    Senior Member
    Join Date
    Jul 2008
    Location
    Montreal, QC
    Posts
    232

    Default

    Quote Originally Posted by Denwa View Post
    When I have some spare time I will transcode the same file with hyperthreading off and again with it on and see how that effects speed etc.
    This review can save you some time: http://www.tomshardware.com/reviews/...5,2410-11.html

    Hyperthreading does indeed make a difference...as long as the app supports it.

    Michael

  20. #120
    Forum Mogul Khaver's Avatar
    Join Date
    Jan 2009
    Location
    Oregon
    Posts
    697

    Default

    Actually, what we're talking about is multithreading.

  21. #121
    Senior Member
    Join Date
    Jul 2008
    Location
    Montreal, QC
    Posts
    232

    Default

    Quote Originally Posted by Khaver View Post
    Actually, what we're talking about is multithreading.
    That is right. Hyperthreading is Intel's trademarked name for what is generically referred to as Simultaneous Multi-threading (SMT)

    Michael

  22. #122

    Default

    Cool, AVS-BIC it is then! Thanks!

  23. #123

    Default

    Thanks for making this. I just got an HF200 and was amazed at just how big a headached it seems to get 1080p 24fps footage from it into Avid unless you want to pay. I was using the trial of TMPGEnc 4.0 but wasn't looking forward to paying for it.

    After reading all the posts I am a tad confused and need some help. Warning, I am a super newb

    My System:
    AMD Quad Core 3.2 GHz
    Windows 7 Ultimate (64 bit)
    Avid 3.5 Academic
    Canon VIXIA HF200

    My Goal:
    Shoot video at 21 Mbps in PF24 mode
    Remove pulldown and transcode to use in Avid
    Lossless quality (or as close as humanly possible)
    I would like to ideally be able to Fast Import into Avid

    My Questions:
    1. Which of these utils will be the best for me to use? FFmpeg-Bic? avs-bic?
    2. Anyone run into any issues with 64 bit or Windows 7 that I should know about before starting installing and trying things out?
    3. What type of project and project settings in Avid would be ideal?

    Thanks for any help you can give.
    Last edited by Jim01; 2009 November 2nd at 16:59.

  24. #124
    Forum Mogul Khaver's Avatar
    Join Date
    Jan 2009
    Location
    Oregon
    Posts
    697

    Default

    For Avid import, I would use FFmpeg-BIC and select DNxHD quicktime as the output format. I believe these will fast import into Avid.

  25. #125

    Post

    Ok I am having a couple issues.

    I installed everything instructed per the links in the readme (except the Avid CODECs, as I already have Avid MC 3.5 installed so figured I already had those).

    Some of the tools have installs, but some of them are just files with no install program that I could find. I did the right click->install for huffyuv. Others I extracted the files where I thought logically they would go.

    For ffdshow I selected the 64 bit version since there was one availible.

    My final configuration:

    FFmpeg = C:\Program Files (x86)\ffmpeg
    ffdshow = C:\Program Files\ffdshow
    Avisynth = C:\Program Files (x86)\AviSynth 2.5
    huffyuv = C:\Program Files (x86)\huffyuv
    TIVTC.dll = C:\Program Files (x86)\TIVTC (AND A COPY IN) C:\Program Files (x86)\AviSynth 2.5\plugins

    My first problem is that when I click on the "ffdshow video decoder configuration" button I get this error:


    Should I have not installed the 64 bit version and just stuck with the 32?

    Beyond that I go ahead and run the program with this setup:


    The program completes just fine, but when I play the video I see lines like the de-interlacing wasn't done properly (NOTE: look at the window edges on the door):


    Any ideas?
    Jim
    Last edited by Jim01; 2009 November 2nd at 22:41.

+ Reply to Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts