[Cin] Prepping HW upgrade options for AV1 de-/encoding
Andrew Randrianasulu
randrianasulu at gmail.com
Thu Dec 14 00:02:20 CET 2023
чт, 14 дек. 2023 г., 01:53 Terje J. Hanssen <terjejhanssen at gmail.com>:
>
>
> Den 11.12.2023 00:02, skrev Terje J. Hanssen:
>
>
>
> Den 10.12.2023 19:04, skrev Andrew Randrianasulu:
>
>
>
> вс, 10 дек. 2023 г., 20:37 Andrew Randrianasulu <randrianasulu at gmail.com>:
>
>>
>>
>> вс, 10 дек. 2023 г., 20:32 Terje J. Hanssen via Cin <
>> cin at lists.cinelerra-gg.org>:
>>
>>>
>>> Den 03.12.2023 22:29, skrev Terje J. Hanssen:
>>>
>>> Already touched this topic barely in another thread
>>> https://lists.cinelerra-gg.org/pipermail/cin/2023-December/007346.html
>>>
>>> But so many SW and HW pieces are mentioned around, it is almost a
>>> full-time reading and study:
>>> VAAPI, MESA, VULKAN, Intel Quick Sync Video etc......
>>>
>>> I realize my aging hardware which is fast enough for other tasks, needs
>>> some "AV1 upgrade", if possible.
>>>
>>> But first I wonder, what is expected possible to do (obtain) with AV1
>>> de-/encoding on my existing 64bit hardware:
>>>
>>> 1) laptop 2018: Dell XPS 13-9370: quad core i7-8550U CPU (8. gen
>>> Kabylake) and Intel UHD Graphics
>>>
>>> 2) WS infinity: MSI Z170A mobo: quad core i7-6700K CPU (6. gen
>>> Skylake), NVIDIA GeForce GT-730 graphics
>>>
>>>
>>>
>>> I continue the "AV1 de-/encoding on my existing 64bit hardware" question
>>> above as a branch here (instead of a new related thread).
>>>
>>> This part is also related to another 2021 thread, [Cin] tried to update
>>> av1.webm profile
>>> https://www.mail-archive.com/cin@lists.cinelerra-gg.org/msg02804.html
>>> which refere to FFmpeg's AV1 Video Encoding Guide
>>> https://trac.ffmpeg.org/wiki/Encode/AV1
>>>
>>>
> I took my first AV1 rendering test with CinGGs default av1.webm preset by
> loading a standard SD DV file clip.
>
> du -sh dv*
> 389M dv01_07.dv
> 30M dv01_07.webm
>
>
> ffprobe -hide_banner dv01_07.dv
> [dv @ 0x5595e79b4580] Estimating duration from bitrate, this may be
> inaccurate
> Input #0, dv, from 'dv01_07.dv':
> Metadata:
> timecode : 01:09:35:09
> Duration: 00:01:53.28, start: 0.000000, bitrate: 28800 kb/s
> Stream #0:0: Video: dvvideo, yuv420p, 720x576 [SAR 16:15 DAR 4:3], 25000
> kb/s, 25 fps, 25 tbr, 25 tbn, 25 tbc
> Stream #0:1: Audio: pcm_s16le, 48000 Hz, stereo, s16, 1536 kb/s
>
>
> ffprobe -hide_banner dv01_07.webm
> [libdav1d @ 0x560ccddb3380] libdav1d 1.0.0
> Input #0, matroska,webm, from 'dv01_07.webm':
> Metadata:
> ENCODER : Lavf60.16.100
> Duration: 00:01:53.28, start: 0.000000, bitrate: 2220 kb/s
> Stream #0:0: Video: av1 (Main), yuv420p(tv, bt470bg/unknown/unknown),
> 720x576 [SAR 1:1 DAR 5:4], 25 fps, 25 tbr, 1k tbn, 1k tbc
> Metadata:
> DURATION : 00:01:53.243000000
> Stream #0:1: Audio: vorbis, 48000 Hz, stereo, fltp
> Metadata:
> DURATION : 00:01:53.281000000
>
> Rendering took 0:03:33 or 1.87 x the Duration
> This webm file was displayed ok in VLC and FFplay on Leap 15.5
>
>
> SVT-AV1 re-encoding
> ---------------------------------
> I will add the re-encoded sample SD DV file using ffmpeg SVT-AV1, as I was
> positive surprised how much faster (preset 10 about 25 sec) it was than
> rendering AV1 with CinGG (libaom?) . I've tested three presets: 8, 10 and
> 12. "Useable visible quality" for all.
>
Good!
If you come to rebuilding cingg on your machine you can always try to
add "--enable-libsvtav1"
for embedded ffmpeg, along with libs (`pkg-config --libs svtav1` probably?)
and create new profile, even if by default we do not use this encoder.
> ffmpeg -i dv01_07.dv -c:v libsvtav1 -preset 8 -crf 35 -c:a libvorbis
> dv01_07_svt-av1_pr8.webm
> frame= 2832 fps= 66 q=35.0 Lsize= 28836kB time=00:01:53.26
> bitrate=2085.6kbits/s speed=2.65x
>
> ffmpeg -i dv01_07.dv -c:v libsvtav1 -preset 10 -crf 35 -c:a libvorbis
> dv01_07_svt-av1_pr10.webm
> frame= 2832 fps=112 q=35.0 Lsize= 34419kB time=00:01:53.26
> bitrate=2489.4kbits/s speed=4.47x
>
> ffmpeg -i dv01_07.dv -c:v libsvtav1 -preset 12 -crf 35 -c:a libvorbis
> dv01_07_svt-av1_pr12.webm
> frame= 2832 fps=262 q=35.0 Lsize= 35913kB time=00:01:53.26
> bitrate=2597.5kbits/s speed=10.5x
>
> du -sh *
> 30M dv01_07_av1_cingg.webm
> 389M dv01_07.dv
> 34M dv01_07_svt-av1_pr10.webm
> 36M dv01_07_svt-av1_pr12.webm
> 29M dv01_07_svt-av1_pr8.webm
>
> I add full output for preset 10 only:
>
> ffprobe -hide_banner dv01_07_svt-sv1_pr10.webm
> [libdav1d @ 0x55ba878325c0] libdav1d 1.3.0
> Input #0, matroska,webm, from 'dv01_07_svt-sv1_pr10.webm':
> Metadata:
> TIMECODE : 01:09:35:09
> ENCODER : Lavf60.3.100
> Duration: 00:01:53.28, start: 0.000000, bitrate: 2488 kb/s
> Stream #0:0: Video: av1 (Main), yuv420p(tv), 720x576, SAR 16:15 DAR 4:3,
> 25 fps, 25 tbr, 1k tbn
> Metadata:
> ENCODER : Lavc60.3.100 libsvtav1
> DURATION : 00:01:53.283000000
> Stream #0:1: Audio: vorbis, 48000 Hz, stereo, fltp
> Metadata:
> ENCODER : Lavc60.3.100 libvorbis
> DURATION : 00:01:53.283000000
> [libdav1d @ 0x55ba8788e6c0] libdav1d 1.3.0
>
> ----------
>
> ffmpeg -i dv01_07.dv -c:v libsvtav1 -preset 10 -crf 35 -c:a libvorbis
> dv01_07_svt-sv1_pr10.webm
> ffmpeg version 6.0.1 Copyright (c) 2000-2023 the FFmpeg developers
> built with gcc 13 (SUSE Linux)
> configuration: --prefix=/usr --libdir=/usr/lib64 --shlibdir=/usr/lib64
> --incdir=/usr/include/ffmpeg --extra-cflags='-O2 -Wall -U_FORTIFY_SOURCE
> -D_FORTIFY_SOURCE=3 -fstack-protector-strong -funwind-tables
> -fasynchronous-unwind-tables -fstack-clash-protection -Werror=return-type
> -flto=auto -ffat-lto-objects -g' --optflags='-O2 -Wall -U_FORTIFY_SOURCE
> -D_FORTIFY_SOURCE=3 -fstack-protector-strong -funwind-tables
> -fasynchronous-unwind-tables -fstack-clash-protection -Werror=return-type
> -flto=auto -ffat-lto-objects -g' --disable-htmlpages --enable-pic
> --disable-stripping --enable-shared --disable-static --enable-gpl
> --enable-version3 --disable-openssl --enable-gnutls --enable-ladspa
> --enable-libshaderc --enable-vulkan --enable-libplacebo --enable-libaom
> --enable-libass --enable-libbluray --enable-libbs2b --enable-libcdio
> --enable-libcodec2 --enable-libdav1d --enable-libdc1394 --enable-libdrm
> --enable-libfontconfig --enable-libfreetype --enable-libfribidi
> --enable-libgsm --enable-libjack --enable-libjxl --enable-librist
> --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg
> --enable-libopenmpt --enable-libopenh264-dlopen --enable-libopus
> --enable-libpulse --enable-librav1e --enable-librubberband
> --enable-libsvtav1 --enable-libsoxr --enable-libspeex --enable-libssh
> --enable-libsrt --enable-libtheora --enable-libtwolame --enable-libvidstab
> --enable-libvmaf --enable-libvorbis --enable-libvpx --enable-libwebp
> --enable-libxml2 --enable-libzimg --enable-libzmq --enable-libzvbi
> --enable-lto --enable-lv2 --enable-libmfx --enable-vaapi --enable-vdpau
> --enable-version3 --enable-libfdk-aac-dlopen --enable-nonfree
> --enable-libopencore-amrnb --enable-libopencore-amrwb
> --enable-libvo-amrwbenc --enable-libx264 --enable-libx265 --enable-libxvid
> libavutil 58. 2.100 / 58. 2.100
> libavcodec 60. 3.100 / 60. 3.100
> libavformat 60. 3.100 / 60. 3.100
> libavdevice 60. 1.100 / 60. 1.100
> libavfilter 9. 3.100 / 9. 3.100
> libswscale 7. 1.100 / 7. 1.100
> libswresample 4. 10.100 / 4. 10.100
> libpostproc 57. 1.100 / 57. 1.100
> [dv @ 0x55c1b0b87380] Estimating duration from bitrate, this may be
> inaccurate
> Input #0, dv, from 'dv01_07.dv':
> Metadata:
> timecode : 01:09:35:09
> Duration: 00:01:53.28, start: 0.000000, bitrate: 28800 kb/s
> Stream #0:0: Video: dvvideo, yuv420p, 720x576 [SAR 16:15 DAR 4:3], 25000
> kb/s, 25 fps, 25 tbr, 25 tbn
> Stream #0:1: Audio: pcm_s16le, 48000 Hz, stereo, s16, 1536 kb/s
> File 'dv01_07_svt-sv1_pr10.webm' already exists. Overwrite? [y/N] y
> Stream mapping:
> Stream #0:0 -> #0:0 (dvvideo (native) -> av1 (libsvtav1))
> Stream #0:1 -> #0:1 (pcm_s16le (native) -> vorbis (libvorbis))
> Press [q] to stop, [?] for help
> Svt[info]: -------------------------------------------
> Svt[info]: SVT [version]: SVT-AV1 Encoder Lib v1.7.0
> Svt[info]: SVT [build] : GCC 13.2.1 20230912 [revision
> b96e66fd4ef3e36983969fb8cdd1956f551a074b] 64 bit
> Svt[info]: LIB Build date: Nov 3 2023 00:00:00
> Svt[info]: -------------------------------------------
> Svt[info]: Number of logical cores available: 8
> Svt[info]: Number of PPCS 107
> Svt[info]: [asm level on system : up to avx2]
> Svt[info]: [asm level selected : up to avx2]
> Svt[info]: -------------------------------------------
> Svt[info]: SVT [config]: main profile tier (auto) level (auto)
> Svt[info]: SVT [config]: width / height / fps numerator / fps denominator
> : 720 / 576 / 25 / 1
> Svt[info]: SVT [config]: bit-depth / color format : 8
> / YUV420
> Svt[info]: SVT [config]: preset / tune / pred struct :
> 10 / PSNR / random access
> Svt[info]: SVT [config]: gop size / mini-gop size / key-frame type
> : 161 / 32 / key frame
> Svt[info]: SVT [config]: BRC mode / rate factor : CRF
> / 35
> Svt[info]: -------------------------------------------
> Output #0, webm, to 'dv01_07_svt-sv1_pr10.webm':
> Metadata:
> timecode : 01:09:35:09
> encoder : Lavf60.3.100
> Stream #0:0: Video: av1, yuv420p(bottom coded first (swapped)), 720x576
> [SAR 16:15 DAR 4:3], q=2-31, 25 fps, 1k tbn
> Metadata:
> encoder : Lavc60.3.100 libsvtav1
> Stream #0:1: Audio: vorbis, 48000 Hz, stereo, fltp
> Metadata:
> encoder : Lavc60.3.100 libvorbis
> frame= 2832 fps=112 q=35.0 Lsize= 34419kB time=00:01:53.26
> bitrate=2489.4kbits/s speed=4.47x
> video:32865kB audio:1495kB subtitle:0kB other streams:0kB global
> headers:4kB muxing overhead: 0.171717%
>
>
>
>
> To start with the workstation 2) above, I want suggestions how to test the
>>> possible AV1 encoding options (libaom, SVT-AV1, MESA, VAAPI, VDPAU) using
>>> my system enabled ffmpeg 6.0.1 commands,, and also suggestions to required
>>> change in system/graphics settings.
>>>
>>> System output as background info:
>>>
>>> fmpeg -encoders -hide_banner | grep av1
>>> V....D libaom-av1 libaom AV1 (codec av1)
>>> V....D librav1e librav1e AV1 (codec av1)
>>>
>>>
>> From phoronix articles librav1e and SVT-AV1 should be faster, but
>> sometimes at quality cost.
>>
>> Sorry, not tried them personally due to svt demanding 64-bit system and
>> rav1e demanding rust.
>>
>> So for this task you are on your own .. sorry!
>>
>
> https://ottverse.com/analysis-of-svt-av1-presets-and-crf-values/
>
>
> may be crf 26 (ish) and preset 6 ?
>
> On 36 core machine with avx512 it surely was fast, but on 4c .. I guess
> 1.25 fps or so will be best you can get? (for fullhd source)
>
>
>
>>
>>
>>
>>> V..... libsvtav1 SVT-AV1(Scalable Video Technology for AV1)
>>> encoder (codec av1)
>>> V....D av1_nvenc NVIDIA NVENC av1 encoder (codec av1)
>>> V....D av1_amf AMD AMF AV1 encoder (codec av1)
>>> A....D wmav1 Windows Media Audio 1
>>>
>>> libaom3 v. 3,7.1
>>>
>>> libSvtAv1Enc1 v. 1.7.0
>>>
>>> libva-vdpau-driver v. 0.7.4
>>>
>>> vainfo
>>> Trying display: wayland
>>> error: XDG_RUNTIME_DIR is invalid or not set in the environment.
>>> Trying display: x11
>>> libva info: VA-API version 1.20.0
>>> libva info: Trying to open /usr/lib64/dri/nouveau_drv_video.so
>>> libva info: Found init function __vaDriverInit_1_20
>>> libva info: va_openDriver() returns 0
>>> vainfo: VA-API version: 1.20 (libva 2.20.0)
>>> vainfo: Driver version: Mesa Gallium driver 23.2.1 for NV106
>>> vainfo: Supported profile and entrypoints
>>> VAProfileNone : VAEntrypointVideoProc
>>>
>>> ---------------
>>>
>>> inxi -zdGCS
>>> System:
>>> Kernel: 6.6.1-1-default arch: x86_64 bits: 64 Desktop: GNOME v: 45.1
>>> Distro: openSUSE Tumbleweed-Slowroll 20231119
>>> CPU:
>>> Info: quad core model: Intel Core i7-6700K bits: 64 type: MT MCP cache:
>>> L2: 1024 KiB
>>> Speed (MHz): avg: 800 min/max: 800/4200 cores: 1: 800 2: 800 3: 800 4:
>>> 800
>>> 5: 800 6: 800 7: 800 8: 800
>>> Graphics:
>>> Device-1: NVIDIA GK208B [GeForce GT 730] driver: nouveau v: kernel
>>> Device-2: Microdia Camera driver: snd-usb-audio,uvcvideo type: USB
>>> Device-3: MACROSILICON USB3.0 UHD
>>> driver: hid-generic,snd-usb-audio,usbhid,uvcvideo type: USB
>>> Display: server: X.org v: 1.21.1.9 with: Xwayland v: 23.2.2 driver: X:
>>> loaded: nouveau unloaded: fbdev,modesetting,vesa dri: nouveau gpu:
>>> nouveau
>>> resolution: 2560x1440~60Hz
>>> API: OpenGL v: 4.3 vendor: mesa v: 23.2.1 renderer: NV106
>>> API: EGL Message: EGL data requires eglinfo. Check --recommends.
>>> Drives:
>>> Local Storage: total: 8.8 TiB used: 5.02 TiB (57.1%)
>>> ID-1: /dev/nvme0n1 vendor: Samsung model: MZVPV512HDGL-00000
>>> size: 476.94 GiB
>>> ID-2: /dev/sda vendor: Intel model: SSDSA2CW160G3 size: 149.05 GiB
>>> ID-3: /dev/sdb vendor: Seagate model: ST3500418AS size: 465.76 GiB
>>> ID-4: /dev/sdc vendor: Seagate model: ST3500418AS size: 465.76 GiB
>>> ID-5: /dev/sdd vendor: Seagate model: Expansion HDD size: 7.28 TiB
>>> type: USB
>>> Optical-1: /dev/sr0 vendor: HL-DT-ST model: BD-RE BH10LS30
>>> dev-links: cdrom
>>> Features: speed: 40 multisession: yes audio: yes dvd: yes
>>> rw: cd-r,cd-rw,dvd-r,dvd-ram
>>>
>>> ------------------
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> --
>>> Cin mailing list
>>> Cin at lists.cinelerra-gg.org
>>> https://lists.cinelerra-gg.org/mailman/listinfo/cin
>>>
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.cinelerra-gg.org/pipermail/cin/attachments/20231214/c16e4c03/attachment-0001.htm>
More information about the Cin
mailing list