Den 27.09.2024 22:27, skrev Terje J. Hanssen:
Den 27.09.2024 19:45, skrev Andrew Randrianasulu:
пт, 27 сент. 2024 г., 18:55 Terje J. Hanssen <[email protected]>:
Den 27.09.2024 12:44, skrev Andrew Randrianasulu:
пт, 27 сент. 2024 г., 12:40 Terje J. Hanssen <[email protected]>:
Den 26.09.2024 01:18, skrev Andrew Randrianasulu:
On Thu, Sep 26, 2024 at 2:06 AM Terje J. Hanssen <[email protected]> wrote:
Den 25.09.2024 23:22, skrev Andrew Randrianasulu:
чт, 26 сент. 2024 г., 00:16 Terje J. Hanssen <[email protected]>:
Den 25.09.2024 21:33, skrev Andrew Randrianasulu:
ср, 25 сент. 2024 г., 18:25 Terje J. Hanssen <[email protected]>:
Den 25.09.2024 00:27, skrev Andrew Randrianasulu: > try this git patch, do not forgot to make > install again, or put profiles in > bin/ffmpeg/video folder manually.
# cd /home/cinelerra/cinelerra-5.1 # mv /home/terje/0001-Qsv-encoders-for-testing.patch .
# git am 0001-Qsv-encoders-for-testing.patch Applying: Qsv encoders for testing
make install > make_install.log 2&1
make install > make_install.log 2>&1 ?
Sorry. I should cleanup all ">" with Find & Replace in my note, and oversaw here should be two of them in this command ;(
Now make install went through without faults as I could see, but attach it by email again.
But unhappily, no success with testing Cingg Qsv Rendering. All attempts so far breaks with the output below:
FFMPEG::open_encoder err: Internal bug, should not have happened int FFMPEG::open_encoder(const char*, const char*):
---------- localhost:/home/cinelerra/cinelerra-5.1 # bin/cin Cinelerra Infinity - built: Sep 23 2024 10:31:07 ---------- 1) Loaded hdv09_04.m2t Render: Output to file: /Videoklipp/QSV/hdv09_04_h264_qsv.mp4 File format: FFMPEG-mp4 Compression: h264_qsv.mp4 Pixels: qsv
libva info: VA-API version 1.22.0 libva info: Trying to open /usr/lib64/dri/iHD_drv_video.so libva info: Found init function __vaDriverInit_1_21 libva info: va_openDriver() returns 0 libva info: VA-API version 1.22.0 libva info: Trying to open /usr/lib64/dri/iHD_drv_video.so libva info: Found init function __vaDriverInit_1_21 libva info: va_openDriver() returns 0
FFMPEG::open_encoder err: Internal bug, should not have happened int FFMPEG::open_encoder(const char*, const char*): open failed h264_qsv:/Videoklipp/QSV/hdv09_04_h264_qsv.mp4 Render::render_single: Session finished. -------------- 2a) Loaded hdv09_04.m2t Render: Output to file: /Videoklipp/QSV/hdv09_04_h265_qsv.mp4 File format: FFMPEG-mp4
Compression: h265_qsv.mp4 Pixels: qsv
[hevc_qsv encoder @ 0x7f44e0d0bd80] [Eval @ 0x7f44e57eb6f0] Undefined constant or missing '(' in 'high' [hevc_qsv encoder @ 0x7f44e0d0bd80] Unable to parse option value "high" [hevc_qsv encoder @ 0x7f44e0d0bd80] Error setting option profile to value high. FFMPEG::open_encoder err: Invalid argument int FFMPEG::open_encoder(const char*, const char*): open failed hevc_qsv:/Videoklipp/QSV/hdv09_04_h265_qsv.mp4 Render::render_single: Session finished.
# profile=high Pixels: qsv (yuv420 isn't available)
Didn't render: FFMPEG::open_encoder err: Internal bug, should not have happened int FFMPEG::open_encoder(const char*, const char*): open failed hevc_qsv:/Videoklipp/QSV/hdv09_04_h265_qsv.mp4 Render::render_single: Session finished.
---------------- 2b) Compression: h265_qsv.mp4 Pixels: p010le
[hevc_qsv encoder @ 0x7f93dcdb3c00] [Eval @ 0x7f93cbff06f0] Undefined constant or missing '(' in 'high' [hevc_qsv encoder @ 0x7f93dcdb3c00] Unable to parse option value "high" [hevc_qsv encoder @ 0x7f93dcdb3c00] Error setting option profile to value high. FFMPEG::open_encoder err: Invalid argument int FFMPEG::open_encoder(const char*, const char*): open failed hevc_qsv:/Videoklipp/QSV/hdv09_04_h265_qsv.mp4 Render::render_single: Session finished.
Some progress:
# profile=high Pixels: yuvy422 (yuv420 isn't available) Settings>Appearance: BT.709/MPEG2
Rendered: Render::render_single: Session finished. ** rendered 5972 frames in 33.999 secs, 175.652 fps audio0 pad 64 0 (64)
VLC playback OK
ffprobe -hide_banner hdv09_04_h265_qsv.mp4 Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'hdv09_04_h265_qsv.mp4': Metadata: major_brand : isom minor_version : 512 compatible_brands: isomiso2mp41 encoder : Lavf61.1.100 Duration: 00:03:58.88, start: 0.000000, bitrate: 3359 kb/s Stream #0:0[0x1](und): Video: hevc (Rext) (hev1 / 0x31766568), yuv422p(tv, bt709/unknown/unknown, top coded first (swapped)), 1440x1080 [SAR 4:3 DAR 16:9], 3223 kb/s, 25 fps, 25 tbr, 12800 tbn (default) Metadata: handler_name : VideoHandler vendor_id : [0][0][0][0] Stream #0:1[0x2](und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 129 kb/s (default) Metadata: handler_name : SoundHandler vendor_id : [0][0][0][0]
ah, so it need tv range .. try also with Pixels nv12 (worked for me on mediacodec)
Not really., Also the default at first startup, appearance BT.601-PAL/MJPEG, worked, and then ffprobe output Stream #0:0[0x1](und): Video: hevc (Rext) (hev1 / 0x31766568), yuv422p(pc, bt470bg/unknown/unknown, top coded first (swapped)), 1440x1080 [SAR 4:3 DAR 16:9], 3248 kb/s, 25 fps, 25 tbr, 12800 tbn (default)
I just changed it to BT.701/MPEG which is for HD video, and I also remembed you also suggested this in a previous thread.
Both yuv422 and nv12 work.
But why isn't also the usual yuv420p available for h264 and h265?
not sure, may be qsv library does not support this?
at least I can't see it in source
https://git.ffmpeg.org/gitweb/ffmpeg.git/blob/HEAD:/libavcodec/qsvenc_hevc.c...
Possibly also rename h265 to hevc as ffmpeg use?
ok, I'll rename it and add nv12 as default pix format.
can you also see if h264 works with nv12?
No, h264 doesn't work with nv12, neither with # profile=high
I've extracted three ffmpeg QSV code lines below with qsv and yuv420p used from https://trac.ffmpeg.org/wiki/Hardware/QuickSync#FullExamples
ffmpeg -hwaccel qsv -c:v h264_qsv -i input.mp4 -vf hwdownload,format=nv12 -pix_fmt yuv420p output.yuv ffmpeg -hwaccel qsv -c:v h264_qsv -i input.mp4 -vf hwdownload,format=nv12 -pix_fmt yuv420p -f sdl - ffmpeg -init_hw_device qsv=hw -filter_hw_device hw -f rawvideo -pix_fmt yuv420p -s:v 1920x1080 -i input.yuv -vf hwupload=extra_hw_frames=64,format=qsv -c:v h264_qsv -b:v 5M output.mp4
On the other hand the following VAAPI section and code lines from 'The encoders only accept input as VAAPI surfaces. If the input is in normal memory, it will need to be uploaded before giving the frames to the encoder - in the ffmpeg utility, the |hwupload| filter can be used for this. It will upload to a surface with the same layout as the software frame, so it may be necessary to add a |format| filter immediately before to get the input into the right format (hardware generally wants the |nv12| layout, but most software functions use the |yuv420p| layout). The |hwupload| filter also requires a device to upload to, which needs to be defined before the filter graph is created.'
ffmpeg -vaapi_device /dev/dri/renderD128 -i input.mp4 -vf 'format=nv12,hwupload' -c:v h264_vaapi output.mp4
and from my own ffmpeg test
ffmpeg -hide_banner -hwaccel_output_format qsv -i hdv09_04.m2t hdv09_04_h264_qsv.mp4
note that this line uses *software* x264 encoder, not qsv.
Yeah, I was confused by the "-hwaccel_output_format qsv" See below for another attempt
Does av1_qsv/vp9_qsv works? Can you also try with progressive (not interlaced) video?
Sorry, none of av1_qsv nor vp9_qsv pixel formats work (interlaced hdv input) I was looking for a progressive video to download?
But I tested "h284_qsv/nv12/profile high" rendering wiht SD-DV file (interlaced) and it worked
FFStream::encode_frame: encode failed. file: /Videoklipp/QSV/dv01_07_h264_qsv.mp4 err: Resource temporarily unavailable FFStream::flush failed :file:/Videoklipp/QSV/dv01_07_h264_qsv.mp4 err: Operation not permitted Render::render_single: Session finished. ** rendered 2832 frames in 5.592 secs, 506.438 fps audio0 pad 32 0 (32)
---------------------
What about this modified ffmpeg code line?
ffmpeg -hide_banner -hwaccel_output_format qsv -i hdv09_04.m2t -pix_fmt p010le -c:v hevc_qsv -profile:v main10 hdv09_04_hevc_qsv.mp4 [mpeg2video @ 0x559aa0f2b740] Invalid frame dimensions 0x0. Last message repeated 3 times [mpegts @ 0x559aa0f26080] PES packet size mismatch [mpegts @ 0x559aa0f26080] Packet corrupt (stream = 1, dts = 258142320). [mpegts @ 0x559aa0f26080] Could not find codec parameters for stream 2 (Unknown: none ([160][0][0][0] / 0x00A0)): unknown codec Consider increasing the value for the 'analyzeduration' (0) and 'probesize' (5000000) options [mpegts @ 0x559aa0f26080] Could not find codec parameters for stream 3 (Unknown: none ([161][0][0][0] / 0x00A1)): unknown codec Consider increasing the value for the 'analyzeduration' (0) and 'probesize' (5000000) options Input #0, mpegts, from 'hdv09_04.m2t': Duration: 00:03:59.06, start: 2629.496000, bitrate: 26110 kb/s Program 100 Stream #0:0[0x810]: Video: mpeg2video (Main) ([2][0][0][0] / 0x0002), yuv420p(tv, bt709, top first), 1440x1080 [SAR 4:3 DAR 16:9], 25000 kb/s, 25 fps, 25 tbr, 90k tbn Side data: cpb: bitrate max/min/avg: 25000000/0/0 buffer size: 7340032 vbv_delay: N/A Stream #0:1[0x814]: Audio: mp2 (mp3float) ([3][0][0][0] / 0x0003), 48000 Hz, stereo, fltp, 384 kb/s Stream #0:2[0x815]: Unknown: none ([160][0][0][0] / 0x00A0) Stream #0:3[0x811]: Unknown: none ([161][0][0][0] / 0x00A1) Stream mapping: Stream #0:0 -> #0:0 (mpeg2video (native) -> hevc (hevc_qsv)) Stream #0:1 -> #0:1 (mp2 (native) -> aac (native)) Press [q] to stop, [?] for help libva info: VA-API version 1.22.0 libva info: Trying to open /usr/lib64/dri/iHD_drv_video.so libva info: Found init function __vaDriverInit_1_21 libva info: va_openDriver() returns 0 libva info: VA-API version 1.22.0 libva info: Trying to open /usr/lib64/dri/iHD_drv_video.so libva info: Found init function __vaDriverInit_1_21 libva info: va_openDriver() returns 0 [hevc_qsv @ 0x559aa0f2d840] Using the constant quantization parameter (CQP) by default. Please use the global_quality option and other options for a quality-based mode or the b option and other options for a bitrate-based mode if the default is not the desired choice. Output #0, mp4, to 'hdv09_04_hevc_qsv.mp4': Metadata: encoder : Lavf61.1.100 Stream #0:0: Video: hevc (hev1 / 0x31766568), p010le(tv, bt709, top coded first (swapped)), 1440x1080 [SAR 4:3 DAR 16:9], q=2-31, 25 fps, 12800 tbn Metadata: encoder : Lavc61.3.100 hevc_qsv Side data: cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A Stream #0:1: Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 128 kb/s Metadata: encoder : Lavc61.3.100 aac [mpegts @ 0x559aa0f26080] PES packet size mismatch0:03:49.92 bitrate=26241.8kbits/s dup=12 drop=0 speed= 23x [mpegts @ 0x559aa0f26080] Packet corrupt (stream = 1, dts = 258142320). [mpeg2video @ 0x559aa0f56fc0] ac-tex damaged at 10 61 [mpeg2video @ 0x559aa0f56fc0] Warning MVs not available [mpeg2video @ 0x559aa0f56fc0] concealing 630 DC, 630 AC, 630 MV errors in P frame [vist#0:0/mpeg2video @ 0x559aa0f2e100] [dec:mpeg2video @ 0x559aa103c340] corrupt decoded frame [out#0/mp4 @ 0x559aa0f5d600] video:756129KiB audio:3774KiB subtitle:0KiB other streams:0KiB global headers:0KiB muxing overhead: 0.024395% frame= 5977 fps=575 q=-0.0 Lsize= 760088KiB time=00:03:58.77 bitrate=26077.3kbits/s dup=14 drop=0 speed= 23x [aac @ 0x559aa0f5c000] Qavg: 488.617
ffprobe -hide_banner hdv09_04_hevc_qsv.mp4 Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'hdv09_04_hevc_qsv.mp4': Metadata: major_brand : isom minor_version : 512 compatible_brands: isomiso2mp41 encoder : Lavf61.1.100 Duration: 00:03:59.08, start: 0.000000, bitrate: 26044 kb/s Stream #0:0[0x1](und): Video: hevc (Main 10) (hev1 / 0x31766568), yuv420p10le(tv, bt709, top coded first (swapped)), 1440x1080 [SAR 4:3 DAR 16:9], 25908 kb/s, 25 fps, 25 tbr, 12800 tbn (default) Metadata: handler_name : VideoHandler vendor_id : [0][0][0][0] encoder : Lavc61.3.100 hevc_qsv Stream #0:1[0x2](und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 129 kb/s (default) Metadata: handler_name : SoundHandler vendor_id : [0][0][0][0]
----------------------------------------------------------------------
Else I've used ffmpeg to query the supported Qsv formats as follows:
ffmpeg -hide_banner -h encoder=hevc_qsv | egrep 'Supported|profile|main' Supported hardware devices: qsv qsv qsv Supported pixel formats: nv12 p010le p012le yuyv422 y210le qsv bgra x2rgb10le vuyx xv30le -profile <int> E..V....... (from 0 to INT_MAX) (default unknown) main 1 E..V....... main10 2 E..V....... mainsp 3 E..V....... main 0 E..V.......
ffmpeg -hide_banner -h encoder=h264_qsv | egrep 'Supported|profile|main' Supported hardware devices: qsv qsv qsv Supported pixel formats: nv12 qsv -profile <int> E..V....... (from 0 to INT_MAX) (default unknown) main 77 E..V.......
ffmpeg -hide_banner -h encoder=av1_qsv | egrep 'Supported|profile|main' Supported hardware devices: qsv qsv qsv Supported pixel formats: nv12 p010le qsv -profile <int> E..V....... (from 0 to INT_MAX) (default unknown) main 1 E..V.......
ffmpeg -hide_banner -h encoder=vp9_qsv | egrep 'Supported|profile|main' Supported hardware devices: qsv qsv qsv Supported pixel formats: nv12 p010le vuyx qsv xv30le -profile <int> E..V....... (from 0 to INT_MAX) (default unknown) profile0 1 E..V....... profile1 2 E..V....... profile2 3 E..V....... profile3 4 E..V.......
ffmpeg -hide_banner -h encoder=vp9_qsv | egrep 'Supported|main' Supported hardware devices: qsv qsv qsv Supported pixel formats: nv12 p010le vuyx qsv xv30le
--------------
And also to compare actual pixel formats
ffmpeg -hide_banner -pix_fmts | egrep 'yuv420p|p010le|yuv422p' ------- Pixel formats: I.... = Supported Input format for conversion .O... = Supported Output format for conversion ..H.. = Hardware accelerated format ...P. = Paletted format ....B = Bitstream format FLAGS NAME NB_COMPONENTS BITS_PER_PIXEL BIT_DEPTHS ----- IO... yuv420p 3 12 8-8-8
and forgot IO... nv12 3 12 8-8-8
IO... yuv422p 3 16 8-8-8 IO... yuv420p16le 3 24 16-16-16 IO... yuv420p16be 3 24 16-16-16 IO... yuv422p16le 3 32 16-16-16 IO... yuv422p16be 3 32 16-16-16 IO... yuv420p9be 3 13 9-9-9 IO... yuv420p9le 3 13 9-9-9 IO... yuv420p10be 3 15 10-10-10 IO... yuv420p10le 3 15 10-10-10 IO... yuv422p10be 3 20 10-10-10 IO... yuv422p10le 3 20 10-10-10 IO... yuv422p9be 3 18 9-9-9 IO... yuv422p9le 3 18 9-9-9 IO... yuv420p12be 3 18 12-12-12 IO... yuv420p12le 3 18 12-12-12 IO... yuv420p14be 3 21 14-14-14 IO... yuv420p14le 3 21 14-14-14 IO... yuv422p12be 3 24 12-12-12 IO... yuv422p12le 3 24 12-12-12 IO... yuv422p14be 3 28 14-14-14 IO... yuv422p14le 3 28 14-14-14 IO... p010le 3 15 10-10-10
-----------------------------
And as extracted from cuda - Understanding pixel format and profile when encoding 10-bit video in ffmpeg with nvenc - Super User https://superuser.com/questions/1614571/understanding-pixel-format-and-profi...
Hardware HEVC encoder uses pixel formats p010le and p016le for 10-bit output where first one produces yuv 4:2:0 and the second one yuv 4:4:4.*Params explanation:*
* |-pix_fmt p010le| converts 8bit input into 10bit; note that conversion is done by CPU so it makes the encoding slower but produces better quality video and in CRF also lower bitrate (smaller file). For CUDA decoder must be used with |-vf "hwdownload,format=nv12"| (or |-vf "hwdownload,format=p010le"| for 10 bit input video) to copy decoded frames from CUDA into CPU for conversion (NVDEC decoder sends frames into CPU automatically.) Specifying |-profile main10| is required to allow 10bit encoding but does not accually affect how the encoder encodes the video - encoder itself does not change the bit depth of the input!
According to this reddit post <https://www.reddit.com/r/ffmpeg/comments/c1im2i/encode_4k_hdr_pixel_format/> by @Anton1699:
*p010le is equivalent to yuv420p10le* (it's 10-bit video with 4:2:0 subsampling = 15-bit per pixel).
I have yet to find a more authoritative source in documentation.
|p010le| is supported by nvenc. The output log also indicates that this works. As a result, I put this up as a tentative answer. Sample command:
|ffmpeg -i input.mkv -pix_fmt p010le -c:v hevc_nvenc -profile:v main10 -cq 21 out.mkv|