使用capture.get(CV_CAP_PROP_FPS)时，OpenCV报告TBR而不是FPS

Question

我有几个视频需要使用OpenCV和Qt 4.7.4在Mac OS 10.6.8（Snow Leopard）上处理。如果我创建一个cv :: VideoCapture对象，然后查询与该视频相关的帧速率，那么我得到的是TBR而不是FPS。

例如，如果使用ffprobe Video1.mp4，我得到的是：

>> ffprobe Video1.mp4      
ffprobe version 0.7.8, Copyright (c) 2007-2011 the FFmpeg developers
built on Nov 24 2011 14:31:00 with gcc 4.2.1 (Apple Inc. build 5666) (dot 3)
configuration: --prefix=/opt/local --enable-gpl --enable-postproc --enable-swscale --   
enable-avfilter --enable-libmp3lame --enable-libvorbis --enable-libtheora --enable-
libdirac --enable-libschroedinger --enable-libopenjpeg --enable-libxvid --enable-libx264 
--enable-libvpx --enable-libspeex --mandir=/opt/local/share/man --enable-shared --
enable-pthreads --cc=/usr/bin/gcc-4.2 --arch=x86_64 --enable-yasm
libavutil    50. 43. 0 / 50. 43. 0
libavcodec   52.123. 0 / 52.123. 0
libavformat  52.111. 0 / 52.111. 0
libavdevice  52.  5. 0 / 52.  5. 0
libavfilter   1. 80. 0 /  1. 80. 0
libswscale    0. 14. 1 /  0. 14. 1
libpostproc  51.  2. 0 / 51.  2. 0

Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'Video1.mp4':
Metadata:
major_brand     : isom
minor_version   : 0
compatible_brands: mp41avc1qt  
creation_time   : 2012-01-09 23:09:43
encoder         : vlc 1.1.3 stream output
encoder-eng     : vlc 1.1.3 stream output
Duration: 00:10:10.22, start: 0.000000, bitrate: 800 kb/s
Stream #0.0(eng): Video: h264 (Baseline), yuvj420p, 704x480 [PAR 10:11 DAR 4:3], 798 
kb/s, 27.71 fps, 1001 tbr, 1001 tbn, 2002 tbc
Metadata:
  creation_time   : 2012-01-09 23:09:43

正确报告FPS = 27.71和TBR = 1001。但是，如果我使用以下OpenCV代码查询FPS：

QString filename = QFileDialog::getOpenFileName(this,
                                        "Open Video",
                                        "Video Files (*.mp4, *.mpg)");

capture.release();
capture.open(filename.toAscii().data());

if (!capture.isOpened()){
    qDebug() <<"Error when opening the video!";
    return;
}


qDebug() << "Frame Rate:" << capture.get(CV_CAP_PROP_FPS);
qDebug() << "Num of Frames:" << capture.get(CV_CAP_PROP_FRAME_COUNT);
qDebug() << "OpenCV Version" << CV_VERSION;

我得到的输出是：

Frame Rate: 1001 
Num of Frames: 610832 
OpenCV Version 2.3.1 

这个问题是当我尝试打开不同的视频时，它会报告TBR而不是FPS。我查看了OpenCV的bug跟踪器，并且我也发现这个stackoverflow问题与我的问题类似但不完全相同，所以我不知道下一步该怎么做。任何提示或想法都非常欢迎，因为我尝试了很多方法，却似乎一无所获。

- Malife

Answer 1

我想他们选择报告 TBR 是因为那是FFmpeg 最好的猜测实际帧率是多少。在许多容器中，fps 字段（更具体地说是AVStream.avg_frame_rate）不可用，因此不能太过依赖它。

这里是来自 ffmpeg 源代码的 tbr、tbc 和 tbn 字段的注释：

TBR（FFmpeg 的最佳猜测）：

struct AVStream {
...
/**
 * Real base framerate of the stream.
 * This is the lowest framerate with which all timestamps can be
 * represented accurately (it is the least common multiple of all
 * framerates in the stream). Note, this value is just a guess!
 * For example, if the time base is 1/90000 and all frames have either
 * approximately 3600 or 1800 timer ticks, then r_frame_rate will be 50/1.
 */
AVRational r_frame_rate;

TBC (the codec timebase):

struct AVCodecContext {
...
/**
 * This is the fundamental unit of time (in seconds) in terms
 * of which frame timestamps are represented. For fixed-fps content,
 * time base should be 1/framerate and timestamp increments should be 1.
 * decoding: set by libavformat
 * encoding: set by libavformat in av_write_header
 */
AVRational time_base;

TBN (the stream (container) timebase):

TBN（流（容器）时间基准）：

struct AVStream {
...
/**
 * This is the fundamental unit of time (in seconds) in terms
 * of which frame timestamps are represented. For fixed-fps content,
 * timebase should be 1/framerate and timestamp increments should be
 * identically 1.
 * - encoding: MUST be set by user.
 * - decoding: Set by libavcodec.
 */
 AVRational time_base;

希望这能解释为什么报告的是TBR而不是FPS。看起来ffmpeg难以确定视频流的时间基准，并且容器（例如AVI、MP4、DivX、XviD等）提供帧速率，因此ffmpeg即使无法通过分析确定帧速率也会显示它。是否有可能重新正确地重新编码视频？

- mevatron

---

重新编码视频虽然可行，但会很麻烦，因为这些视频数量相当多且有些较长。它们是由网络摄像机生成的。但您的答案清楚地解释了为什么我得到TBR而不是FPS。谢谢！ - Malife