Bug #4644
opentv: opentv scraper doesn't unsubscribe after ending scraping
0%
Description
As anticipated in #4633, when OTA triggering is launched while DVB EIT scraper correctly tune channel, downloads epg , and then it unsubscribes and continue to others channels, it seems that opentv grabber tune channel, downloads EPG, but never release the subscription even if it seems to complete the downloading. Only when "EPG scan time-out in seconds" , value present in channels/epg>epg grabber, is reached, the scarper is forced to unsubscribe.
According to tvh log 2 events occur that are:
opentv: opentv-skyit: channels complete
opentv: opentv-skyit: titles complete
If i undestand correctly opentv "finishes his job" after the second one and should release the tuner.
Example log:
ott 02 14:24:20 tvheadend[384]: mpegts: 10930H in DVB-S Network - tuning on Montage Technology M88RS60 ott 02 14:24:20 tvheadend[384]: subscription: 000D: "epggrab" subscribing to mux "10930H", weight: 4, ott 02 14:24:20 tvheadend[384]: mpegts: 11054H in DVB-S Network - tuning on Montage Technology M88RS60 ott 02 14:24:20 tvheadend[384]: subscription: 000E: "epggrab" subscribing to mux "11054H", weight: 4, ott 02 14:24:50 tvheadend[384]: subscription: 000E: "epggrab" unsubscribing ott 02 14:24:51 tvheadend[384]: mpegts: 11526H in DVB-S Network - tuning on Montage Technology M88RS60 ott 02 14:24:52 tvheadend[384]: subscription: 0010: "epggrab" subscribing to mux "11526H", weight: 4, ott 02 14:24:54 tvheadend[384]: subscription: 000D: "epggrab" unsubscribing ott 02 14:24:55 tvheadend[384]: mpegts: 11880V in DVB-S Network - tuning on Montage Technology M88RS60 ott 02 14:24:55 tvheadend[384]: subscription: 0012: "epggrab" subscribing to mux "11880V", weight: 4, ott 02 14:25:02 tvheadend[384]: subscription: 0010: "epggrab" unsubscribing ott 02 14:25:06 tvheadend[384]: opentv: opentv-skyit: channels complete ott 02 14:27:06 tvheadend[384]: opentv: opentv-skyit: titles complete ott 02 14:30:05 tvheadend[384]: epggrab: OpenTV: Sky Italia - data completion timeout for 11880V in DV ott 02 14:30:05 tvheadend[384]: epggrab: EIT: DVB Grabber - data completion timeout for 11880V in DVB- ott 02 14:30:05 tvheadend[384]: subscription: 0012: "epggrab" unsubscribing
Thank you very much for your excellent job
Anthony
History
Updated by Antonio Tex about 7 years ago
Updated by Additional information: the only frequency in which opentv grabber is Enabled (in mux config) is 11880V.
Updated by Jaroslav Kysela about 7 years ago
Updated by There should be also 'summaries complete' line in the log before the opentv grabber completes the full job.
channels -> titles -> summaries
Updated by Antonio Tex about 7 years ago
You are right @perexg i've set timeout to max value and summaries appear but it still doesn't release the tuner updated log and as you can see i've launched it at 9:09 and it is still running:
2017-10-03 09:09:16.609 mpegts: 10930H in DVB-S Network - tuning on Montage Technology M88RS6000 : DVB-S #0 2017-10-03 09:09:16.785 subscription: 0007: "epggrab" subscribing to mux "10930H", weight: 4, adapter: "Montage Technology M88RS6000 : DVB-S #0", network: "DVB-S Network", service: "Raw PID Subscription" 2017-10-03 09:09:16.785 mpegts: 11054H in DVB-S Network - tuning on Montage Technology M88RS6000 : DVB-S #0 2017-10-03 09:09:17.340 subscription: 0008: "epggrab" subscribing to mux "11054H", weight: 4, adapter: "Montage Technology M88RS6000 : DVB-S #0", network: "DVB-S Network", service: "Raw PID Subscription" 2017-10-03 09:09:47.671 subscription: 0008: "epggrab" unsubscribing 2017-10-03 09:09:48.637 mpegts: 11526H in DVB-S Network - tuning on Montage Technology M88RS6000 : DVB-S #0 2017-10-03 09:09:48.814 subscription: 000A: "epggrab" subscribing to mux "11526H", weight: 4, adapter: "Montage Technology M88RS6000 : DVB-S #0", network: "DVB-S Network", service: "Raw PID Subscription" 2017-10-03 09:09:55.571 subscription: 0007: "epggrab" unsubscribing 2017-10-03 09:09:56.530 mpegts: 11880V in DVB-S Network - tuning on Montage Technology M88RS6000 : DVB-S #0 2017-10-03 09:09:57.086 subscription: 000C: "epggrab" subscribing to mux "11880V", weight: 4, adapter: "Montage Technology M88RS6000 : DVB-S #0", network: "DVB-S Network", service: "Raw PID Subscription" 2017-10-03 09:09:58.358 subscription: 000A: "epggrab" unsubscribing 2017-10-03 09:10:07.951 opentv: opentv-skyit: channels complete 2017-10-03 09:12:08.109 opentv: opentv-skyit: titles complete 2017-10-03 09:22:08.192 opentv: opentv-skyit: summaries complete 2017-10-03 09:22:16.849 htsp: ::ffff:192.168.1.9 [ | Kodi Media Center ]: Disconnected
Updated by Jaroslav Kysela about 7 years ago
I think that the EIT grabber has not been finished yet. '--trace epggrab' might show more...
Updated by Antonio Tex about 7 years ago
Thank for your interest, here are 2 logs: trace only epggrab and one with trace opentv https://drive.google.com/file/d/0BzKigOTG5qLER1F0ZUZFNHBoOGc/view?usp=sharing
Updated by Jaroslav Kysela about 7 years ago
Yes, EIT grabber does not complete the job:
017-10-03 10:52:35.647 [ INFO]:opentv: opentv-skyit: summaries complete 2017-10-03 10:52:35.647 [ TRACE]:epggrab: opentv-skynz complete 1 first 1 2017-10-03 10:52:35.647 [ TRACE]:epggrab: opentv-skyuk complete 1 first 1 2017-10-03 10:52:35.648 [ TRACE]:epggrab: opentv-ausat complete 1 first 1 2017-10-03 10:52:35.648 [ TRACE]:epggrab: opentv-skyit complete 1 first 0 2017-10-03 10:52:35.648 [ TRACE]:epggrab: psip complete 1 first 1 2017-10-03 10:52:35.648 [ TRACE]:epggrab: Bulsatcom_39E complete 1 first 1 2017-10-03 10:52:35.648 [ TRACE]:epggrab: viasat_baltic complete 1 first 1 2017-10-03 10:52:35.648 [ TRACE]:epggrab: uk_freeview complete 1 first 1 2017-10-03 10:52:35.648 [ TRACE]:epggrab: uk_freesat complete 1 first 1 2017-10-03 10:52:35.648 [ TRACE]:epggrab: eit complete 0 first 0 2017-10-03 10:55:34.677 [ DEBUG]:epggrab: grab done for 11880V in DVB-S Network (timeout) 2017-10-03 10:55:34.677 [WARNING]:epggrab: EIT: DVB Grabber - data completion timeout for 11880V in DVB-S Network
"first 0" means that the grabber is active (perhaps I should use different variable name)...
Updated by Antonio Tex about 7 years ago
Thanks it seems so, but isn't maybe the "openTV" module that doesn't notify "i've finish" (of course is a supposition of mine sorry if i say rubbish ): looking at opentv trace starting from last line it seems to be in idle after "summary complete" . Thanks again @perexg (also thanks to explain 
)
2017-10-03 11:10:35.626 [ TRACE]:opentv: opentv-skyit: section 0 last 0 ver 13 (ver 13 st 2 incomp 0 comp 424) 2017-10-03 11:10:35.626 [ TRACE]:opentv: opentv-skyit: skip, already complete (2) 2017-10-03 11:10:35.626 [ TRACE]:opentv: opentv-skyit: pid 68 complete remain 0 2017-10-03 11:10:35.869 [ TRACE]:opentv: opentv-skyit: pid 44 tableid A8 extraid 0000001b59dc0d80 len 1571 2017-10-03 11:10:35.869 [ TRACE]:opentv: opentv-skyit: section 0 last 0 ver 13 (ver 13 st 2 incomp 0 comp 424) 2017-10-03 11:10:35.869 [ TRACE]:opentv: opentv-skyit: skip, already complete (2) 2017-10-03 11:10:35.869 [ TRACE]:opentv: opentv-skyit: pid 68 complete remain 0 2017-10-03 11:10:35.869 [ INFO]:opentv: opentv-skyit: summaries complete #####IDLE ? 2017-10-03 11:13:34.656 [WARNING]:epggrab: EIT: DVB Grabber - data completion timeout for 11880V in DVB-S Network 2017-10-03 11:13:34.656 [ INFO]:subscription: 0006: "epggrab" unsubscribing
Updated by Jaroslav Kysela about 7 years ago
Look to info I provided - all opentv grabbers 'complete 1', eit grabber 'complete 0'. So, TVH is waiting for EIT grabber.
Updated by Antonio Tex about 7 years ago
First thank you again also for your patience . Yes my bad, apologize don't know why i was still thinking about opentv.
There must be something wrong with 11880V and in general with EIT-opentv enabled on same channel: i've performed this test:
1 Disable EIT grabber and leave only opentv result: (Tuner is correctly release OK)
2017-10-03 17:19:05.420 mpegts: 11880V in DVB-S Network - tuning on Montage Technology M88RS6000 : DVB-S #0 2017-10-03 17:19:05.972 subscription: 0001: "epggrab" subscribing to mux "11880V", weight: 4, adapter: "Montage Technology M88RS6000 : DVB-S #0", network: "DVB-S Network", service: "Raw PID Subscription" 2017-10-03 17:19:06.298 linuxdvb: Unable to provide UNC value. 2017-10-03 17:19:16.625 opentv: opentv-skyit: channels complete 2017-10-03 17:21:16.821 opentv: opentv-skyit: titles complete 2017-10-03 17:31:16.904 opentv: opentv-skyit: summaries complete 2017-10-03 17:31:16.904 subscription: 0001: "epggrab" unsubscribing
2 Disable OpenTV grabber and leave EIT result:(EIT seems not to complete downloading in 11880V takes forever)
3 Enable both grabber but because 11880V locks EIT (don't know why) i want that only opentv is performed and so under mux>epg scan i've set "OpenTV Sky Italia" ...result: again reaches timeout and never release the tuner... but why if i've set to perform only "OpenTV Sky Italia"?
2017-10-03 17:36:10.841 mpegts: 11526H in DVB-S Network - tuning on Montage Technology M88RS6000 : DVB-S #0 2017-10-03 17:36:11.018 subscription: 0004: "epggrab" subscribing to mux "11526H", weight: 4, adapter: "Montage Technology M88RS6000 : DVB-S #0", network: "DVB-S Network", service: "Raw PID Subscription" 2017-10-03 17:36:16.287 subscription: 0001: "epggrab" unsubscribing 2017-10-03 17:36:17.245 mpegts: 11880V in DVB-S Network - tuning on Montage Technology M88RS6000 : DVB-S #0 2017-10-03 17:36:17.837 subscription: 0006: "epggrab" subscribing to mux "11880V", weight: 4, adapter: "Montage Technology M88RS6000 : DVB-S #0", network: "DVB-S Network", service: "Raw PID Subscription" 2017-10-03 17:36:20.629 subscription: 0004: "epggrab" unsubscribing 2017-10-03 17:36:28.360 opentv: opentv-skyit: channels complete 2017-10-03 17:38:28.516 opentv: opentv-skyit: titles complete 2017-10-03 17:48:28.477 opentv: opentv-skyit: summaries complete 2017-10-03 17:51:27.746 epggrab: EIT: DVB Grabber - data completion timeout for 11880V in DVB-S Network 2017-10-03 17:51:27.746 subscription: 0006: "epggrab" unsubscribing
4 Enable only EIT like test 2 and set 11880V like 3 to "OpenTV Sky Italia" result: EIT grabber correctly ignore that channel (while it does not in 3)
ott 03 17:52:28 tvheadend[1654]: subscription: 0001: "epggrab" subscribing to mux "10930H", weight: 4, adapter: "Montage Technology M88RS6000 : DVB-S #0", network: "DVB-S Network ott 03 17:52:28 tvheadend[1654]: mpegts: 11054H in DVB-S Network - tuning on Montage Technology M88RS6000 : DVB-S #0 ott 03 17:52:28 tvheadend[1654]: subscription: 0002: "epggrab" subscribing to mux "11054H", weight: 4, adapter: "Montage Technology M88RS6000 : DVB-S #0", network: "DVB-S Network ott 03 17:52:28 tvheadend[1654]: linuxdvb: Unable to provide UNC value. ott 03 17:52:28 tvheadend[1654]: linuxdvb: Unable to provide UNC value. ott 03 17:52:58 tvheadend[1654]: subscription: 0002: "epggrab" unsubscribing ott 03 17:52:59 tvheadend[1654]: mpegts: 11526H in DVB-S Network - tuning on Montage Technology M88RS6000 : DVB-S #0 ott 03 17:53:00 tvheadend[1654]: subscription: 0004: "epggrab" subscribing to mux "11526H", weight: 4, adapter: "Montage Technology M88RS6000 : DVB-S #0", network: "DVB-S Network ott 03 17:53:04 tvheadend[1654]: subscription: 0001: "epggrab" unsubscribing ott 03 17:53:09 tvheadend[1654]: subscription: 0004: "epggrab" unsubscribing
does opentv pull EIT even if "OpenTV Sky Italia" only is forced?
Updated by Antonio Tex about 7 years ago
To show you better what i mean this is a short video... https://drive.google.com/open?id=0BzKigOTG5qLEZ2hXYWxnc2lYU1k
1: EIT, opentv,xmltv modules are active
2: All muxes have EPG turned off except for 11880V with "OpenTV Sky Italia" forced
3: Triggered OTA
4: Minute 12:38 opentv finishes scarping but somehow there is EIT working....
5: Minute:15:38 ...indeed it is closed by ota timeout (and keep the tuner on until that moment)
Thank you again @perexg