Bug #4925: tvheadend crashes - Tvheadend

Bug #4925

Bug #4851: TVH freezes: mpegts: too much queued table input data (over 2MB), discarding new

tvheadend crashes

Added by Vahram Mazlumyan over 6 years ago. Updated over 6 years ago.

Status:

Rejected

Priority:

Normal

Assignee:

Category:

Crashes

Target version:

Start date:

2018-02-08

Due date:

% Done:

Estimated time:

Found in version:

4.3-1038

Affected Versions:

Description

tvheadend freezing . version 4.3-1038
This issue is happening every 30 minutes , I have downgraded version to 4.3-982 . Still working fine

Log
Feb 07 12:40:01 stream tvheadend2590: mpegts: too much queued input data (over 50MB), discarding new
Feb 07 12:40:11 stream tvheadend2590: mpegts: too much queued input data (over 50MB), discarding new
Feb 07 12:40:21 stream tvheadend2590: mpegts: too much queued input data (over 50MB), discarding new
Feb 07 12:40:31 stream tvheadend2590: mpegts: too much queued input data (over 50MB), discarding new
Feb 07 12:40:41 stream tvheadend2590: mpegts: too much queued input data (over 50MB), discarding new
Feb 07 12:40:51 stream tvheadend2590: mpegts: too much queued input data (over 50MB), discarding new

Files

Untitled.png (41.2 KB) Untitled.png		Vahram Mazlumyan, 2018-02-15 20:37
before.JPG (2.89 MB) before.JPG		Vahram Mazlumyan, 2018-02-22 19:41
after.JPG (3.91 MB) after.JPG		Vahram Mazlumyan, 2018-02-22 19:41
MVI_2673.MOV (28.7 MB) MVI_2673.MOV		Vahram Mazlumyan, 2018-02-22 20:39
Untitled1.png (98.1 KB) Untitled1.png		Vahram Mazlumyan, 2018-03-08 09:28
Untitled.png (93.1 KB) Untitled.png		Vahram Mazlumyan, 2018-03-08 09:28
Untitled.png (37 KB) Untitled.png		Vahram Mazlumyan, 2018-03-09 14:13

History

Updated by Jaroslav Kysela over 6 years ago

'top -H' when this occurs ?

Updated by Vahram Mazlumyan over 6 years ago

I have upgraded , waiting ....

Updated by Vahram Mazlumyan over 6 years ago

Hello
Crached

Feb 15 11:43:00 stream tvheadend²⁵⁰⁸: CRASH: Signal: 11 in PRG: /usr/bin/tvheadend (4.3-1038~g65038bfdf~artful) [30d3280851c74a516bbeea66d9ebf0c3df89aeea] CWD: /
Feb 15 11:43:00 stream tvheadend²⁵⁰⁸: CRASH: Fault address 0x7ff3489c5240 (Access error)
Feb 15 11:43:00 stream tvheadend²⁵⁰⁸: CRASH: Loaded libraries: /usr/lib/x86_64-linux-gnu/libhdhomerun.so.4 /usr/lib/x86_64-linux-gnu/libdvbcsa.so.1 /lib/x86_64-linux
gnu/libssl.so.1.0.0 /lib/x86_64-linux-gnu/libcrypto.so.1.0.0 /lib/x86_64-linux-gnu/libz.so.1 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0 /usr/lib/x86_64-linux-gnu/libur
iparser.so.1 /usr/lib/x86_64-linux-gnu/libavahi-common.so.3 /usr/lib/x86_64-linux-gnu/libavahi-client.so.3 /usr/lib/x86_64-linux-gnu/libavfilter.so.6 /usr/lib/x86_64-l
inux-gnu/libavformat.so.57 /usr/lib/x86_64-linux-gnu/libavcodec.so.57 /usr/lib/x86_64-linux-gnu/libavutil.so.55 /usr/lib/x86_64-linux-gnu/libva.so.1 /lib/x86_64-linux
gnu/libdbus-1.so.3 /lib/x86_64-linux-gnu/libsystemd.so.0 /lib/x86_64-linux-gnu/libdl.so.2 /lib/x86_64-linux-gnu/libpthread.so.0 /lib/x86_64-linux-gnu/libm.so.6 /lib/x8
6_64-linux-gnu/librt.so.1 /lib/x86_64-linux-gnu/libc.so.6 /usr/lib/x86_64-linux-gnu/libavresample.so.3 /usr/lib/x86_64-linux-gnu/libswscale.so.4 /usr/lib/x86_64-linux-
gnu/libpostproc.so.54 /usr/lib/x86_64-linux-gnu/libswresample
Feb 15 11:43:00 stream tvheadend²⁵⁰⁸: CRASH: Register dump [23]: 00007ff3489c523000007ff366bada770000563707d4484000007ff366bfcfa000007ff30820eb3900007ff30820eb390000
7ff3242c6e5000007ff324d43b6000007ff3489c528000007ff30820eb8900000000000000bc0000563707d44840000000000000002c00007ff3489c5230000000000000400000007ff3423f340800007ff366b
adab30000000000010202002b0000000000330000000000000006000000000000000efffffffe7ffbba1300007ff3489c5240
Feb 15 11:43:00 stream tvheadend²⁵⁰⁸: CRASH: STACKTRACE
Feb 15 11:43:00 stream tvheadend²⁵⁰⁸: CRASH: 0x56370576359d 0x5637055c3000
Feb 15 11:43:00 stream tvheadend²⁵⁰⁸: CRASH: 0x7ff3673a1150 0x7ff36738e000
Feb 15 11:43:00 stream tvheadend²⁵⁰⁸: CRASH: 0x7ff366badab3 0x7ff366a50000
Feb 15 11:43:00 stream tvheadend²⁵⁰⁸: CRASH: 0x563705722d54 0x5637055c3000
Feb 15 11:43:00 stream tvheadend²⁵⁰⁸: CRASH: 0x5637057dee9f 0x5637055c3000
Feb 15 11:43:00 stream tvheadend²⁵⁰⁸: CRASH: 0x5637057e00f0 0x5637055c3000
Feb 15 11:43:00 stream tvheadend²⁵⁰⁸: CRASH: 0x5637057dcbef 0x5637055c3000
Feb 15 11:43:00 stream tvheadend²⁵⁰⁸: CRASH: 0x563705723bb8 0x5637055c3000
Feb 15 11:43:00 stream tvheadend²⁵⁰⁸: CRASH: 0x7ff3673957fc 0x7ff36738e000
Feb 15 11:43:00 stream tvheadend²⁵⁰⁸: CRASH: clone+0x3f (/lib/x86_64-linux-gnu/libc.so.6)
Feb 15 11:43:00 stream kernel: [518099.774978] tvh:mi-main²⁵⁴⁵: segfault at 7ff3489c5240 ip 00007ff366badab3 sp 00007ff3423f3408 error 6 in libc-2.26.so[7ff366a50000
+1d6000]
Feb 15 11:43:22 stream systemd¹: tvheadend.service: Main process exited, code=killed, status=11/SEGV
Feb 15 11:43:22 stream systemd¹: tvheadend.service: Unit entered failed state.
Feb 15 11:43:22 stream systemd¹: tvheadend.service: Failed with result 'signal'.
Feb 15 11:43:23 stream systemd¹: Created slice User Slice of tv.
Feb 15 11:43:23 stream systemd¹: Starting User Manager for UID 1000...
Feb 15 11:43:23 stream systemd¹: Started Session 161 of user tv.
Feb 15 11:43:23 stream systemd²⁰⁵⁴⁹: Starting D-Bus User Message Bus Socket.
Feb 15 11:43:23 stream systemd²⁰⁵⁴⁹: Reached target Timers.
Feb 15 11:43:23 stream systemd²⁰⁵⁴⁹: Reached target Paths.
Feb 15 11:43:23 stream systemd²⁰⁵⁴⁹: Listening on D-Bus User Message Bus Socket.
Feb 15 11:43:23 stream systemd²⁰⁵⁴⁹: Reached target Sockets.
Feb 15 11:43:23 stream systemd²⁰⁵⁴⁹: Reached target Basic System.
Feb 15 11:43:23 stream systemd²⁰⁵⁴⁹: Reached target Default.

Updated by Jaroslav Kysela over 6 years ago

https://tvheadend.org/projects/tvheadend/wiki/Debugging#Incorrect-not-useable-crash-reports

Updated by Vahram Mazlumyan over 6 years ago

File Untitled.png Untitled.png added

Hello

top -H screen in attachment
Feb 15 23:33:12 stream tvheadend¹³⁷¹: mpegts: too much queued input data (over 50MB), discarding new
Feb 15 23:33:22 stream tvheadend¹³⁷¹: mpegts: too much queued input data (over 50MB), discarding new
Feb 15 23:33:32 stream tvheadend¹³⁷¹: mpegts: too much queued input data (over 50MB), discarding new
Feb 15 23:33:42 stream tvheadend¹³⁷¹: mpegts: too much queued input data (over 50MB), discarding new
Feb 15 23:33:52 stream tvheadend¹³⁷¹: mpegts: too much queued input data (over 50MB), discarding new
Feb 15 23:34:02 stream tvheadend¹³⁷¹: mpegts: too much queued input data (over 50MB), discarding new
Feb 15 23:34:12 stream tvheadend¹³⁷¹: mpegts: too much queued input data (over 50MB), discarding new
Feb 15 23:34:22 stream tvheadend¹³⁷¹: mpegts: too much queued input data (over 50MB), discarding new
Feb 15 23:34:32 stream tvheadend¹³⁷¹: mpegts: too much queued input data (over 50MB), discarding new
Feb 15 23:34:42 stream tvheadend¹³⁷¹: mpegts: too much queued input data (over 50MB), discarding new

Updated by Vahram Mazlumyan over 6 years ago

Again same issue

в—Џ tvheadend.service - Tvheadend - a TV streaming server and DVR
Loaded: loaded (/lib/systemd/system/tvheadend.service; enabled; vendor preset: enabled)
Active: active (running) since Thu 2018-02-15 23:38:05 +04; 18h ago
Process: 1033 ExecStart=/usr/bin/tvheadend -f -p /var/run/tvheadend.pid $OPTIONS (code=exited, status=0/SUCCESS)
Main PID: 1303 (tvheadend)
Tasks: 30 (limit: 4915)
Memory: 150.9M
CPU: 6h 21min 31.379s
CGroup: /system.slice/tvheadend.service
в””в”Ђ1303 /usr/bin/tvheadend -f -p /var/run/tvheadend.pid -u hts -g video

Feb 16 18:02:31 stream tvheadend¹³⁰³: mpegts: too much queued input data (over 50MB), discarding new
Feb 16 18:02:41 stream tvheadend¹³⁰³: mpegts: too much queued input data (over 50MB), discarding new
Feb 16 18:02:51 stream tvheadend¹³⁰³: mpegts: too much queued input data (over 50MB), discarding new
Feb 16 18:03:01 stream tvheadend¹³⁰³: mpegts: too much queued input data (over 50MB), discarding new
Feb 16 18:03:11 stream tvheadend¹³⁰³: mpegts: too much queued input data (over 50MB), discarding new
Feb 16 18:03:21 stream tvheadend¹³⁰³: mpegts: too much queued input data (over 50MB), discarding new
Feb 16 18:03:31 stream tvheadend¹³⁰³: mpegts: too much queued input data (over 50MB), discarding new
Feb 16 18:03:41 stream tvheadend¹³⁰³: mpegts: too much queued input data (over 50MB), discarding new
Feb 16 18:03:51 stream tvheadend¹³⁰³: mpegts: too much queued input data (over 50MB), discarding new
Feb 16 18:04:01 stream tvheadend¹³⁰³: mpegts: too much queued input data (over 50MB), discarding new
root@stream:/home/tv# top -H
top - 18:04:14 up 18:26, 2 users, load average: 0.47, 0.49, 0.45
Threads: 182 total, 1 running, 181 sleeping, 0 stopped, 0 zombie
%Cpu(s): 1.2 us, 2.5 sy, 0.0 ni, 89.5 id, 0.0 wa, 0.0 hi, 6.8 si, 0.0 st
KiB Mem : 8166648 total, 7244668 free, 225732 used, 696248 buff/cache
KiB Swap: 2097148 total, 2097148 free, 0 used. 7604928 avail Mem

PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND                                                                                             
 1339 hts       20   0 2277652 107044  14440 S 31.1  1.3 335:03.57 tvh:httpc                                                                                           
   22 root      20   0       0      0      0 S  2.0  0.0  22:28.97 ksoftirqd/2                                                                                         
 4468 root      20   0   46468   4160   3436 R  0.7  0.1   0:00.04 top                                                                                                 
  375 root      20   0   95884  18652  18008 S  0.3  0.2   0:45.03 systemd-journal                                                                                     
    1 root      20   0  219992   8220   6276 S  0.0  0.1   0:02.92 systemd                                                                                             
    2 root      20   0       0      0      0 S  0.0  0.0   0:00.00 kthreadd                                                                                            
    4 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 kworker/0:0H                                                                                        
    6 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 mm_percpu_wq                                                                                        
    7 root      20   0       0      0      0 S  0.0  0.0   0:00.14 ksoftirqd/0                                                                                         
    8 root      20   0       0      0      0 S  0.0  0.0   0:01.12 rcu_sched                                                                                           
    9 root      20   0       0      0      0 S  0.0  0.0   0:00.00 rcu_bh                                                                                              
   10 root      rt   0       0      0      0 S  0.0  0.0   0:00.00 migration/0                                                                                         
   11 root      rt   0       0      0      0 S  0.0  0.0   0:00.09 watchdog/0                                                                                          
   12 root      20   0       0      0      0 S  0.0  0.0   0:00.00 cpuhp/0                                                                                             
   13 root      20   0       0      0      0 S  0.0  0.0   0:00.00 cpuhp/1                                                                                             
   14 root      rt   0       0      0      0 S  0.0  0.0   0:00.10 watchdog/1                                                                                          
   15 root      rt   0       0      0      0 S  0.0  0.0   0:00.00 migration/1                                                                                         
   16 root      20   0       0      0      0 S  0.0  0.0   0:00.03 ksoftirqd/1                                                                                         
   18 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 kworker/1:0H                                                                                        
   19 root      20   0       0      0      0 S  0.0  0.0   0:00.00 cpuhp/2                                                                                             
   20 root      rt   0       0      0      0 S  0.0  0.0   0:00.12 watchdog/2                                                                                          
   21 root      rt   0       0      0      0 S  0.0  0.0   0:00.00 migration/2                                                                                         
   24 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 kworker/2:0H                                                                                        
   25 root      20   0       0      0      0 S  0.0  0.0   0:00.00 cpuhp/3                                                                                             
   26 root      rt   0       0      0      0 S  0.0  0.0   0:00.07 watchdog/3                                                                                          
   27 root      rt   0       0      0      0 S  0.0  0.0   0:00.00 migration/3                                                                                         
   28 root      20   0       0      0      0 S  0.0  0.0   0:13.15 ksoftirqd/3                                                                                         
   30 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 kworker/3:0H                                                                                        
   31 root      20   0       0      0      0 S  0.0  0.0   0:00.00 kdevtmpfs                                                                                           
   32 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 netns                                                                                               
   33 root      20   0       0      0      0 S  0.0  0.0   0:10.93 kworker/0:1                                                                                         
   34 root      20   0       0      0      0 S  0.0  0.0   2:16.57 kworker/2:1                                                                                         
   35 root      20   0       0      0      0 S  0.0  0.0   0:00.02 khungtaskd                                                                                          
   36 root      20   0       0      0      0 S  0.0  0.0   0:00.00 oom_reaper                                                                                          
   37 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 writeback                                                                                           
   38 root      20   0       0      0      0 S  0.0  0.0   0:00.00 kcompactd0                                                                                          
   39 root      25   5       0      0      0 S  0.0  0.0   0:00.00 ksmd                                                                                                
   40 root      39  19       0      0      0 S  0.0  0.0   0:00.00 khugepaged                                                                                          
   41 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 crypto

Updated by Jaroslav Kysela over 6 years ago

httpc thread is httpc client - what is your tvh doing? IPTV source?

Updated by Vahram Mazlumyan over 6 years ago

Yes

I have 3 TVH
1 - installed 2 TBS cards 50 scrambled channels
2 - installed 1 TBS card with 7 scrambled channels

3-rd TVH all time running in MUX schedulers streams from 1st and 2nd for descrambling channels , and my clients are subscribing to 3-rd TVH

Updated by Jaroslav Kysela over 6 years ago

Upgrade to latest, there's configuration for IPTV input threads now which can split load across more CPUs when you use too many IPTV streams. But I don't know, if it resolves this.

#10

Updated by Vahram Mazlumyan over 6 years ago

Hello,

Thanks for information, which version ? v4.3.1095 ?

#11

Updated by Vahram Mazlumyan over 6 years ago

I have upgraded 4.3.1100 version
Craches after 1 hour and automaticaly restarted service

в—Џ tvheadend.service - Tvheadend - a TV streaming server and DVR
Loaded: loaded (/lib/systemd/system/tvheadend.service; enabled; vendor preset: enabled)
Active: activating (auto-restart) (Result: signal) since Thu 2018-02-22 13:02:01 +04; 28s ago
Process: 1076 ExecStart=/usr/bin/tvheadend -f -p /var/run/tvheadend.pid $OPTIONS (code=exited, status=0/SUCCESS)
Main PID: 1332 (code=killed, signal=SEGV)
CPU: 10min 24.639s

Feb 22 13:02:01 stream systemd¹: tvheadend.service: Failed with result 'signal'.

#12

Updated by Jaroslav Kysela over 6 years ago

https://tvheadend.org/projects/tvheadend/wiki/Debugging#Correct-crash-reports

#13

Updated by Vahram Mazlumyan over 6 years ago

File after.JPG after.JPG added
File before.JPG before.JPG added

Ok, i will setup debug.
But i got new problem with this version

After 3-5 minutes watching channels stream coming with interraption "before.jpeg" ,I am turning on another channel and turning back and get a good picture for a few minutes "after.JPEG"
This happening all time on all channels even on HD channels.

On version 4.3-1051 i did not face this problem .

#14

Updated by Vahram Mazlumyan over 6 years ago

File MVI_2673.MOV MVI_2673.MOV added

Video is Football 3 HD channel

#15

Updated by Vahram Mazlumyan over 6 years ago

The same issue with 4.3-1130 version , i downgraded back to 1100 version

в—Џ tvheadend.service - Tvheadend - a TV streaming server and DVR
Loaded: loaded (/lib/systemd/system/tvheadend.service; enabled; vendor preset: enabled)
Active: active (running) since Sat 2018-03-03 15:10:51 +04; 6h ago
Process: 1916 ExecStart=/usr/bin/tvheadend -f -p /var/run/tvheadend.pid $OPTIONS (code=exited, status=0/SUCCESS)
Main PID: 1938 (tvheadend)
Tasks: 27 (limit: 4915)
Memory: 78.7M
CPU: 1h 7min 30.728s
CGroup: /system.slice/tvheadend.service
в””в”Ђ1938 /usr/bin/tvheadend -f -p /var/run/tvheadend.pid -u hts -g video

Mar 03 21:57:29 stream tvheadend¹⁹³⁸: mpegts: too much queued input data (over 50MB), discarding new
Mar 03 21:57:39 stream tvheadend¹⁹³⁸: mpegts: too much queued input data (over 50MB), discarding new
Mar 03 21:57:49 stream tvheadend¹⁹³⁸: mpegts: too much queued input data (over 50MB), discarding new
Mar 03 21:57:59 stream tvheadend¹⁹³⁸: mpegts: too much queued input data (over 50MB), discarding new
Mar 03 21:58:09 stream tvheadend¹⁹³⁸: mpegts: too much queued input data (over 50MB), discarding new
Mar 03 21:58:19 stream tvheadend¹⁹³⁸: mpegts: too much queued input data (over 50MB), discarding new
Mar 03 21:58:29 stream tvheadend¹⁹³⁸: mpegts: too much queued input data (over 50MB), discarding new
Mar 03 21:58:39 stream tvheadend¹⁹³⁸: mpegts: too much queued input data (over 50MB), discarding new
Mar 03 21:58:49 stream tvheadend¹⁹³⁸: mpegts: too much queued input data (over 50MB), discarding new
Mar 03 21:58:59 stream tvheadend¹⁹³⁸: mpegts: too much queued input data (over 50MB), discarding new

#16

Updated by Vahram Mazlumyan over 6 years ago

Th same issue with 1100 verison

в—Џ tvheadend.service - Tvheadend - a TV streaming server and DVR
Loaded: loaded (/lib/systemd/system/tvheadend.service; enabled; vendor preset: enabled)
Active: active (running) since Thu 2018-03-08 08:10:37 +04; 1h 16min ago
Process: 13807 ExecStart=/usr/bin/tvheadend -f -p /var/run/tvheadend.pid $OPTIONS (code=exited, status=0/SUCCESS)
Main PID: 13818 (tvheadend)
Tasks: 28 (limit: 4915)
Memory: 81.3M
CPU: 14min 25.925s
CGroup: /system.slice/tvheadend.service
в””в”Ђ13818 /usr/bin/tvheadend -f -p /var/run/tvheadend.pid -u hts -g video

Mar 08 09:26:03 stream tvheadend¹³⁸¹⁸: mpegts: too much queued input data (over 50MB), discarding new
Mar 08 09:26:13 stream tvheadend¹³⁸¹⁸: mpegts: too much queued input data (over 50MB), discarding new
Mar 08 09:26:23 stream tvheadend¹³⁸¹⁸: mpegts: too much queued input data (over 50MB), discarding new
Mar 08 09:26:33 stream tvheadend¹³⁸¹⁸: mpegts: too much queued input data (over 50MB), discarding new
Mar 08 09:26:43 stream tvheadend¹³⁸¹⁸: mpegts: too much queued input data (over 50MB), discarding new
Mar 08 09:26:53 stream tvheadend¹³⁸¹⁸: mpegts: too much queued input data (over 50MB), discarding new
Mar 08 09:27:03 stream tvheadend¹³⁸¹⁸: mpegts: too much queued input data (over 50MB), discarding new
Mar 08 09:27:13 stream tvheadend¹³⁸¹⁸: mpegts: too much queued input data (over 50MB), discarding new
Mar 08 09:27:23 stream tvheadend¹³⁸¹⁸: mpegts: too much queued input data (over 50MB), discarding new
Mar 08 09:27:33 stream tvheadend¹³⁸¹⁸: mpegts: too much queued input data (over 50MB), discarding new

top - 09:28:31 up 1 day, 23:15, 1 user, load average: 0.11, 0.16, 0.17
Threads: 177 total, 1 running, 176 sleeping, 0 stopped, 0 zombie
%Cpu(s): 1.0/1.6 3[||| ]
KiB Mem : 8166648 total, 7296284 free, 207344 used, 663020 buff/cache
KiB Swap: 2097148 total, 2097148 free, 0 used. 7657792 avail Mem

PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND                                                                                             
   22 root      20   0       0      0      0 S  0.8  0.0  20:39.96 ksoftirqd/2                                                                                         
13831 hts       20   0 2560604  92264  14196 S 18.1  1.1  12:52.46 tvh:httpc                                                                                           
   28 root      20   0       0      0      0 S  0.0  0.0   1:26.24 ksoftirqd/3                                                                                         
13854 hts       20   0 2560604  92264  14196 S  0.0  1.1   0:58.33 tvh:mi-main                                                                                         
13853 hts       20   0 2560604  92264  14196 S  0.0  1.1   0:34.65 tvh:mi-table

#17

Updated by Jaroslav Kysela over 6 years ago

Could you show the state? Inputs/subscriptions/bandwidth ?

#18

Updated by Vahram Mazlumyan over 6 years ago

File Untitled1.png Untitled1.png added
File Untitled.png Untitled.png added

Attached

#19

Updated by Jaroslav Kysela over 6 years ago

Split your IPTV load across more threads. 'IPTV #1' in the input means that only one thread is used. You can configure number of IPTV threads in the 'Base config'.

#20

Updated by Vahram Mazlumyan over 6 years ago

Hello

How many thread i must setup for 60 channels ?

Thanks.

#21

Updated by Jaroslav Kysela over 6 years ago

Each thread has it's own input queue protection. Try something between 6-10.

#22

Updated by Vahram Mazlumyan over 6 years ago

Ok, i will monitor and let you know about result

#23

Updated by Vahram Mazlumyan over 6 years ago

Result

Threads: 203 total, 1 running, 202 sleeping, 0 stopped, 0 zombie
%Cpu(s): 2.2 us, 1.5 sy, 0.0 ni, 94.0 id, 0.0 wa, 0.0 hi, 2.3 si, 0.0 st
KiB Mem : 8166648 total, 6781008 free, 638424 used, 747216 buff/cache
KiB Swap: 2097148 total, 2097148 free, 0 used. 7213048 avail Mem

PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND                                                                                             
27114 hts       20   0 2803784 519424  17976 S 12.3  6.4  37:48.88 tvh:httpc                                                                                           
27149 hts       20   0 2803784 519424  17976 S  6.0  6.4   1:43.67 tvh:mi-main                                                                                         
27625 root      20   0   46476   4060   3344 R  1.0  0.0   0:00.05 top

в—Џ tvheadend.service - Tvheadend - a TV streaming server and DVR
Loaded: loaded (/lib/systemd/system/tvheadend.service; enabled; vendor preset: enabled)
Active: active (running) since Fri 2018-03-09 09:26:17 +04; 4h 19min ago
Process: 27087 ExecStart=/usr/bin/tvheadend -f -p /var/run/tvheadend.pid $OPTIONS (code=exited, status=0/SUCCESS)
Main PID: 27101 (tvheadend)
Tasks: 51 (limit: 4915)
Memory: 486.8M
CPU: 45min 40.236s
CGroup: /system.slice/tvheadend.service
в””в”Ђ27101 /usr/bin/tvheadend -f -p /var/run/tvheadend.pid -u hts -g video

Mar 09 13:45:12 stream tvheadend²⁷¹⁰¹: mpegts: too much queued table input data (over 2MB), discarding new
Mar 09 13:45:13 stream tvheadend²⁷¹⁰¹: mpegts: too much queued input data (over 50MB), discarding new
Mar 09 13:45:18 stream tvheadend²⁷¹⁰¹: mpegts: too much queued table input data (over 2MB), discarding new
Mar 09 13:45:20 stream tvheadend²⁷¹⁰¹: mpegts: too much queued table input data (over 2MB), discarding new
Mar 09 13:45:20 stream tvheadend²⁷¹⁰¹: mpegts: too much queued table input data (over 2MB), discarding new
Mar 09 13:45:21 stream tvheadend²⁷¹⁰¹: mpegts: too much queued table input data (over 2MB), discarding new
Mar 09 13:45:22 stream tvheadend²⁷¹⁰¹: mpegts: too much queued table input data (over 2MB), discarding new
Mar 09 13:45:22 stream tvheadend²⁷¹⁰¹: mpegts: too much queued table input data (over 2MB), discarding new
Mar 09 13:45:22 stream tvheadend²⁷¹⁰¹: mpegts: too much queued table input data (over 2MB), discarding new
Mar 09 13:45:23 stream tvheadend²⁷¹⁰¹: mpegts: too much queued input data (over 50MB), discarding new

#24

Updated by Vahram Mazlumyan over 6 years ago

And system autorestarting every time.
Ned debug ? How can i enable it?

Loaded: loaded (/lib/systemd/system/tvheadend.service; enabled; vendor preset: enabled)
   Active: active (running) since Fri 2018-03-09 14:19:00 +04; 1min 22s ago
  Process: 27945 ExecStart=/usr/bin/tvheadend -f -p /var/run/tvheadend.pid $OPTIONS (code=exited, status=0/SUCCESS)
 Main PID: 27955 (tvheadend)
    Tasks: 68 (limit: 4915)
   Memory: 26.7M
      CPU: 6.286s

#25

Updated by Jaroslav Kysela over 6 years ago

https://tvheadend.org/projects/tvheadend/wiki/Debugging

#26

Updated by Vahram Mazlumyan over 6 years ago

Ok
What do for issue "too much queued table input data (over 2MB), discarding new" ?
increase thread count ?

#27

Updated by Vahram Mazlumyan over 6 years ago

Cant find debug pack for Tvheadend 4.3-1152~g2baa71998~artful
Please send me download link

#28

Updated by Vahram Mazlumyan over 6 years ago

Ok i have installed tvheadend-dbg_4.3-1152~g2baa71998~artful_amd64.deb
Where are log files located ?

#29

Updated by Vahram Mazlumyan over 6 years ago

File Untitled.png Untitled.png added

Log file is missing on /var/log path. Something wrong ?

#30

Updated by Vahram Mazlumyan over 6 years ago

Ok working, what i must filtred ?

htsp,tbl-base,subscription,mpegts,linuxdvb ?

#31

Updated by Vahram Mazlumyan over 6 years ago

log file is too big , in 2 hours 4gb , please tell me what filters i must set in Trace subsystems ?

#32

Updated by Jaroslav Kysela over 6 years ago

Show the CRASH lines for the start.

#33

Updated by Vahram Mazlumyan over 6 years ago

file is too big , problem time 21:48

https://ufile.io/4e6mh

#34

Updated by Jaroslav Kysela over 6 years ago

There's big drop in the total bandwidth at 21:48. Unfortunately, it's too complex problem and I cannot read anything useable from logs. No further suggestions.

#35

Updated by Vahram Mazlumyan over 6 years ago

Hello

The problem occurs every day, even every few hours in this version .I can test more, but I need to know which filters on debug i must enable .
Important that i must use IPTV source 60 - 80 channels.

#36

Updated by Paul M over 6 years ago

this appears to be a duplicate of 4875
https://tvheadend.org/issues/4875

despite 4875 having been closed, I got the problem with version 4.2.6 as well as 4.3-1221~g25dfdb6~xenial

for me, this makes TVH unusable. I'm having to do "pkill -9 tvheadend ; systemctl restart tvheadend" up to twice an hour.

#37

Updated by Jaroslav Kysela over 6 years ago

#4875 is closed because the problem described in that bug was fixed. This is another issue which has not been resolved yet. Unfortunately, it's no easy to reproduce this in my environment and it seems that logs does not help much for this CPU usage related issue.

I added some time profiling to tvh's code:

Update to recent (v4.3-1233-g4fe0af0e8 +) and add --tprofile argument to your start script (/etc/sysconfig/tvheadend or so). Also, enable '--trace tprof,qprof' traces : https://tvheadend.org/projects/tvheadend/wiki/Traces .

#38

Updated by Paul M over 6 years ago

I recently did an OS upgrade which pulled in a new kernel, so I had to rebuild drivers etc; things went a bit wrong so I undid that and went to an older kernel, in fact, I switched to 4.4.0-116-lowlatency

When I original set up my TV server in late February, I used the ljalves repository of drivers; this time I went for the drivers here: https://github.com/tbsdtv/media_build.git

It took a fair amount of time to retrieve and build and install, but since then I've not had a single lockup in the two days or so its been running.

#39

Updated by Jaroslav Kysela over 6 years ago

Status changed from New to Rejected
Parent task set to #4851

Marking as dup of #4851.

Also available in: Atom PDF

Project

General

Profile

Tvheadend

Issues

Custom queries

Bug #4925

tvheadend crashes

History

Updated by Jaroslav Kysela over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Jaroslav Kysela over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Jaroslav Kysela over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Jaroslav Kysela over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Jaroslav Kysela over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Jaroslav Kysela over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Jaroslav Kysela over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Jaroslav Kysela over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Jaroslav Kysela over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Jaroslav Kysela over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Jaroslav Kysela over 6 years ago

Updated by Vahram Mazlumyan over 6 years ago

Updated by Paul M over 6 years ago

Updated by Jaroslav Kysela over 6 years ago

Updated by Paul M over 6 years ago

Updated by Jaroslav Kysela over 6 years ago