h.264裸碼流的格式，參考“H.264-AVC-ISO_IEC_14496-10.pdf, page 211.”，這個文檔的下載地址：https://github.com/winlinvip/simple-rtmp-server/tree/develop/trunk/doc/H.264-AVC-ISO_IEC_14496-10.pdf

一個錄制的h.264裸碼流文件：http://winlinvip.github.io/srs.release/3rdparty/720p.h264.raw，或者：http://ossrs.net/srs.release/3rdparty/720p.h264.raw，里面的格式是annexb格式：

[plain]?view plaincopy

//?SPS??

000000016742802995A014016E40??

//?PPS??

0000000168CE3880??

//?IFrame??

0000000165B8041014C038008B0D0D3A071.....??

//?PFrame??

0000000141E02041F8CDDC562BBDEFAD2F.....??

一般可以從IP攝像頭的sdk中拿到這種數據，一般sdk會使用如下接口：

[cpp]?view plaincopy

int?device_read(char**?pdata,?int*?psize,?int*?pdts,?int*?ppts);??

也有的攝像頭沒有B幀，所以dts和pts是一致的，所以后面的時間戳合并成一個：

[cpp]?view plaincopy

int?device_read(char**?pdata,?int*?psize,?int*?timestamp);??

或者，使用回調函數，當攝像頭編碼出h.264數據時回調這個函數，格式和上面的也差不多。

本文描述了如何將拿到的h.264數據，通過RTMP協議發布到RTMP服務器，然后使用RTMP或者HLS播放。

srs-librtmp

顯然發送h.264的數據得使用RTMP庫，rtmpdump提供的librtmp要求是flv/RTMP格式的數據，而srs-librtmp提供了接口直接發送h.264數據。

srs-librtmp是SRS服務器提供的客戶端庫，SRS項目參考：https://github.com/winlinvip/simple-rtmp-server

srs-librtmp的wiki參考：https://github.com/winlinvip/simple-rtmp-server/wiki/v2_CN_SrsLibrtmp#publish-h264-raw-data

對應的srs的bug參考：https://github.com/winlinvip/simple-rtmp-server/issues/66#issuecomment-62240521

使用git clone下來，可以選擇github源，或者國內的其他鏡像源，參考：https://github.com/winlinvip/simple-rtmp-server#mirrors

例如：

[plain]?view plaincopy

git?clone?https://github.com/winlinvip/simple-rtmp-server.git??

SRS目前有兩個分支，只有SRS2（即master分支）提供了h.264裸碼流發送的功能，git clone之后要切換到這個分支：

[plain]?view plaincopy

cd?simple-rtmp-server/trunk??

git?checkout?master??

如果你可以使用.h和.a庫，就可以直接編譯srs，可以看到生成了.h和.a文件：

[plain]?view plaincopy

./configure?--disable-all?--with-librtmp?&&?make?&&???

ls?-lh?objs/include/srs_librtmp.h?objs/lib/srs_librtmp.a???

如果是需要將srs-librtmp導出成一個.h和.cpp文件，執行下面的命令，可以看到生成了.h和.cpp文件：

[plain]?view plaincopy

./configure?--export-librtmp-single=objs/srs-librtmp?&&???

ls?-lh?objs/srs-librtmp/srs_librtmp.h?objs/srs-librtmp/srs_librtmp.cpp???

下面就可以編寫程序，讀取h.264裸碼流，然后調用srs-librtmp發送出去了。

srs_h264_raw_publish

SRS提供了例子讀取錄制的h.264文件并發布到RTMP服務器：https://github.com/winlinvip/simple-rtmp-server/tree/develop/trunk/research/librtmp/srs_h264_raw_publish.c

錄制的h.264裸碼流文件：http://winlinvip.github.io/srs.release/3rdparty/720p.h264.raw，或者：http://ossrs.net/srs.release/3rdparty/720p.h264.raw，里面的格式是annexb格式：

[plain]?view plaincopy

//?SPS??

000000016742802995A014016E40??

//?PPS??

0000000168CE3880??

//?IFrame??

0000000165B8041014C038008B0D0D3A071.....??

//?PFrame??

0000000141E02041F8CDDC562BBDEFAD2F.....??

下載這個h.264裸碼流文件和實例文件：

[plain]?view plaincopy

wget?https://raw.githubusercontent.com/winlinvip/simple-rtmp-server/master/trunk/research/librtmp/srs_h264_raw_publish.c?-O?objs/srs-librtmp/srs_h264_raw_publish.c?--no-check-certificate?&&??

wget?http://ossrs.net/srs.release/3rdparty/720p.h264.raw?-O?objs/srs-librtmp/720p.h264.raw??

查看srs-librtmp目錄，應該是下面的結構：

[plain]?view plaincopy

[winlin@dev6?trunk]$?ls?-lh??objs/srs-librtmp??

total?5.8M??

-rw-rw-r--?1?winlin?winlin?5.1M?Nov??8?12:39?720p.h264.raw??

-rw-rw-r--?1?winlin?winlin??633?Nov?16?10:32?example.c??

-rw-rw-r--?1?winlin?winlin??87K?Nov?16?10:36?srs_h264_raw_publish.c??

-rw-rw-r--?1?winlin?winlin?557K?Nov?16?10:32?srs_librtmp.cpp??

-rw-rw-r--?1?winlin?winlin??20K?Nov?16?10:32?srs_librtmp.h??

srs_h264_raw_publish.c讀取h.264裸碼流后，基本上讀取到的就是一個一個的h.264 annexb格式的包，參考read_h264_frame()：

[plain]?view plaincopy

//?SPS??

000000016742802995A014016E40??

//?PPS??

0000000168CE3880??

//?IFrame??

0000000165B8041014C038008B0D0D3A071.....??

//?PFrame??

0000000141E02041F8CDDC562BBDEFAD2F.....??

連接RTMP和發送的主要函數是：

[cpp]?view plaincopy

srs_rtmp_t?rtmp?=?srs_rtmp_create(rtmp_url);??

srs_simple_handshake(rtmp);??

srs_connect_app("rtmp://127.0.0.1/live/livestream");??

srs_publish_stream(rtmp);??

while?(!EOF)?{??

????read_h264_frame(&data,?&size,?&dts,?&pts);??

????srs_h264_write_raw_frames(rtmp,?data,?size,?dts,?pts);??

}??

這幾個函數就可以把h.264裸碼流發出去了。

編譯和運行

若使用srs-librtmp導出的單個.h和.cpp文件，編譯和運行命令是：

[plain]?view plaincopy

cd?objs/srs-librtmp?&&??

gcc?-g?-O0?srs_h264_raw_publish.c?srs_librtmp.cpp?-o?publisher?-lstdc++?&&??

./publisher?./720p.h264.raw?rtmp://ossrs.net/live/h264.raw??

播放的RTMP地址為：rtmp://ossrs.net/live/h264.raw，打開下面的鏈接即可觀看流：

http://www.ossrs.net/srs.release/trunk/research/players/srs_player.html?server=ossrs.net&vhost=ossrs.net&stream=h264.raw&autostart=true

接口

srs-librtmp定義的h.264裸碼流發送接口使用參考：https://github.com/winlinvip/simple-rtmp-server/issues/66#issuecomment-62240521

其中有幾個錯誤可以忽略：

• srs_h264_is_dvbsp_error：這個是因為IP攝像頭在每個I幀前都插入了SPS和PPS，所以在服務器斷開重連時，重新調用srslibrtmp的連接和publish函數，不用考慮接下來的幀是否是sps和pps。但是RTMP要求第一個video包是sps/pps，所以srs-librtmp的srs_h264_write_raw_frame()會忽略sps和pps之前的video包，然后返回一個錯誤碼，用戶只要忽略這個錯誤碼即可。
• srs_h264_is_duplicated_sps_error：這個因為IP攝像頭在每個I幀前都插入sps和pps，這些重復的sps和pps會導致hls頻繁的插入discontinue信息，所以srs-librtmp只有在sps和pps都變化時才發送新的sequence header包，而不是每次都發送。所以sps重復時會返回一個錯誤碼，用戶忽略這個錯誤即可。
• srs_h264_is_duplicated_pps_error：這個和上面的錯誤一樣，是pps重復，用戶忽略即可。

目前的接口聲明如下，最新的接口聲明以代碼為準：

[cpp]?view plaincopy

/**?

*?write?h.264?raw?frame?over?RTMP?to?rtmp?server.?

*?@param?frames?the?input?h264?raw?data,?encoded?h.264?I/P/B?frames?data.?

*???????frames?can?be?one?or?more?than?one?frame,?

*???????each?frame?prefixed?h.264?annexb?header,?by?N[00]?00?00?01,?where?N>=0,??

*???????for?instance,?frame?=?header(00?00?00?01)?+?payload(67?42?80?29?95?A0?14?01?6E?40)?

*???????about?annexb,?@see?H.264-AVC-ISO_IEC_14496-10.pdf,?page?211.?

*?@paam?frames_size?the?size?of?h264?raw?data.??

*???????assert?frames_size?>?0,?at?least?has?1?bytes?header.?

*?@param?dts?the?dts?of?h.264?raw?data.?

*?@param?pts?the?pts?of?h.264?raw?data.?

*??

*?@remark,?user?should?free?the?frames.?

*?@remark,?the?tbn?of?dts/pts?is?1/1000?for?RTMP,?that?is,?in?ms.?

*?@remark,?cts?=?pts?-?dts?

*?@remark,?use?srs_h264_startswith_annexb?to?check?whether?frame?is?annexb?format.?

*?@example?/trunk/research/librtmp/srs_h264_raw_publish.c?

*?@see?https://github.com/winlinvip/simple-rtmp-server/issues/66?

*??

*?@return?0,?success;?otherswise,?failed.?

*???????for?dvbsp?error,?@see?srs_h264_is_dvbsp_error().?

*???????for?duplictated?sps?error,?@see?srs_h264_is_duplicated_sps_error().?

*???????for?duplictated?pps?error,?@see?srs_h264_is_duplicated_pps_error().?

*/??

/**?

For?the?example?file:??

????http://winlinvip.github.io/srs.release/3rdparty/720p.h264.raw?

The?data?sequence?is:?

????//?SPS?

????000000016742802995A014016E40?

????//?PPS?

????0000000168CE3880?

????//?IFrame?

????0000000165B8041014C038008B0D0D3A071.....?

????//?PFrame?

????0000000141E02041F8CDDC562BBDEFAD2F.....?

User?can?send?the?SPS+PPS,?then?each?frame:?

????//?SPS+PPS?

????srs_h264_write_raw_frames('000000016742802995A014016E400000000168CE3880',?size,?dts,?pts)?

????//?IFrame?

????srs_h264_write_raw_frames('0000000165B8041014C038008B0D0D3A071......',?size,?dts,?pts)?

????//?PFrame?

????srs_h264_write_raw_frames('0000000141E02041F8CDDC562BBDEFAD2F......',?size,?dts,?pts)?

User?also?can?send?one?by?one:?

????//?SPS?

????srs_h264_write_raw_frames('000000016742802995A014016E4',?size,?dts,?pts)?

????//?PPS?

????srs_h264_write_raw_frames('00000000168CE3880',?size,?dts,?pts)?

????//?IFrame?

????srs_h264_write_raw_frames('0000000165B8041014C038008B0D0D3A071......',?size,?dts,?pts)?

????//?PFrame?

????srs_h264_write_raw_frames('0000000141E02041F8CDDC562BBDEFAD2F......',?size,?dts,?pts)??

*/??

extern?int?srs_h264_write_raw_frames(srs_rtmp_t?rtmp,???

????char*?frames,?int?frames_size,?u_int32_t?dts,?u_int32_t?pts??

);??

/**?

*?whether?error_code?is?dvbsp(drop?video?before?sps/pps/sequence-header)?error.?

*?

*?@see?https://github.com/winlinvip/simple-rtmp-server/issues/203?

*?@example?/trunk/research/librtmp/srs_h264_raw_publish.c?

*?@remark?why?drop?video??

*???????some?encoder,?for?example,?ipcamera,?will?send?sps/pps?before?each?IFrame,?

*???????so,?when?error?and?reconnect?the?rtmp,?the?first?video?is?not?sps/pps(sequence?header),?

*???????this?will?cause?SRS?server?to?disable?HLS.?

*/??

extern?srs_h264_bool?srs_h264_is_dvbsp_error(int?error_code);??

/**?

*?whether?error_code?is?duplicated?sps?error.?

*??

*?@see?https://github.com/winlinvip/simple-rtmp-server/issues/204?

*?@example?/trunk/research/librtmp/srs_h264_raw_publish.c?

*/??

extern?srs_h264_bool?srs_h264_is_duplicated_sps_error(int?error_code);??

/**?

*?whether?error_code?is?duplicated?pps?error.?

*??

*?@see?https://github.com/winlinvip/simple-rtmp-server/issues/204?

*?@example?/trunk/research/librtmp/srs_h264_raw_publish.c?

*/??

extern?srs_h264_bool?srs_h264_is_duplicated_pps_error(int?error_code);??

srs-librtmp會將h.264包打包成RTMP包，不用用戶每次都要處理。

總結

以上是生活随笔為你收集整理的将h.264裸码流推送到RTMP服务器的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。