Bug #5572
Neither UK-Freesat Bouquets NOR 7 day epg appear to be working
100%
Description
Neither UK-Freesat Bouquets NOR 7 day epg appear to have been working
for all pi builds for around 8 to 12 weeks.
Unless there is some new trick to trigger them that I do not know?
Freesat home server epg pid not seen.
Both test show same problem on :
pi3bv1.1
Linux h1 4.4.0-1103-raspi2 #111-Ubuntu (xenial)
with tvheadend/xenial,now 4.2.8-17~gd64d8c8~xenial armhf
pi3b+
Linux h0 4.15.0-1031-raspi2 #33-Ubuntu (bionic)
with tvheadend/bionic,now 4.3-1781~g811fd889e~bionic arm64
Testing setup using forced play with scheduled-mux on 11425H
(similar results with other 2 Freesat home transponders...)
Method using various epg enabled on epg-grabber-modules tab
4.3-1781 (Main test config for problem)
Freesat: Status-Pids 0,1,16,17
Freesat (EIT): Status->Pids 0,1,16,17
EIT EPG Grabber: Status->Pids 0,1,16,17 and sometimes ,18
All 3 enabled: Status->Pids 0,1,16,17 and sometimes ,18
Bandwith (kb/s) now always only 200~300 since problem started.
(Note: Previously bandwidth was 10x plus this before problem
- so fast epg not beimg accessed now)
(latest -1781 thankfully does not clog bouquet list with unwanted sky!)
4.2.8-17
Same problem
No Status-Pids column + No Log Pid listed
However bandwidth column behaves in a similar manner
So, I do not see any Freesat "non-standard" home server pid requested??
History
Updated by Jaroslav Kysela over 5 years ago
Check the MUX (EPG Scan, EPG module id) and EPG grabber module settings (both must have Freesat EPG grabber enabled).
Updated by Deep Thought over 5 years ago
In case of doubt: the correct mux is 11425H. If you scan this transponder, an encrypted
channel trp1 will appear. Tuning to that one is a reliable way to start uk freesat epggrab
(if it works).
In the epg grabber modules, there are two modules: "UK Freesat" and "UK freesat EIT".
I have enabled them both, not knowing what is the difference.
If I remember correctly, it is also important that scraper configuration is set to default (not
"uk"). Also epg grabber timeout should be set to a sufficiently low value (120 works reasonably well) otherwise it may take ages before the Uk freesat grabber is even started.
This is from memory: I may be wrong about a few details (with these values it should
work, but perhaps it also works with others)
It took a lot of trials for me to make it work. It is all quite confusing.
Updated by g siviero over 5 years ago
I cannot receive 11425H (I'm out of the beam footprint for this transponder), but it seems that I can get 7 day EPG data for many of the channels that I receive from the frequency 11778V. I don't know if this transponder contains data also for the channels you are looking for.
Updated by Mark Clarkstone over 5 years ago
g siviero wrote:
I cannot receive 11425H (I'm out of the beam footprint for this transponder), but it seems that I can get 7 day EPG data for many of the channels that I receive from the frequency 11778V. I don't know if this transponder contains data also for the channels you are looking for.
That is the Sky home transponder, it contains the OpenTV data, it can be used for Freesat channels.
Updated by cy clic over 5 years ago
Firstly I should add that I use multiple satip tuners for receiving UK-Freesat.
Thank you both for your help.
I also have only got it to work over the years by trying all sorts of combinations.
One could say tried "randomly" because I also have little or
no information as to the "correct" process.
However historically I have eventually (sometimes after days) been successful.
I understand the 3 home transponders to currently be 11425H, 11426V & 11426.5V
and that they transmit the same channels/bouquets/epgs
cursory inspection seems to confirm this. They all have the same 6 services which all play.
I do not see a "trp1" service.
I do not not know the current bouquet/epg pid number but am expecting ~3xxx ?
Config->Muxes->EPGScan offers:
Disable/Enable (auto)/Force (auto)/Manual selection/Auto-Detected
Config->Muxes->EPGmoduleid:
UK:Freesat/UK:Freeview/EIT:EPGGrabber/...+All the other bouquets
Config->Channel/EPG->EPG Grabber Modules offers:
Over the air:EIT EPG Grabber/Over the air:UK:Freesat/Over the air:UK:Freesat(EIT)/... +et al
I have spent days and day try any plausible combination and many implausible combinations and failed.
The one thing I note that may relevant is that there is never a Freesat epg pid ~3xxx requested.
It is understanding that this is a must for the bulk (fast) epg download.
My suggestion that the bouquet/7day-epg is no longer working is
based on no pid requested and that all reasonable combinations of settings have failed.
Putting on my "User Head" ( a la Worsel Gummidge :-) )
I would suggest that simply enabling a "UK-Freesat module" in the tabs, alone
should be all that is required for everything to be appropriately configured and all of Freesat to burst into life.
That UK Freesat module would strictly only need a single option i.e. postcode of desired viewing seat.
Of course, there is no need to remove all the other stuff for those who wish to tinker.
But tinkering should not be needed for normal usage.
I have read somewhere that Jaroslav has said he does not have signal
from the UK beam transponders that UK-Freesat typically uses especially for the home transponders
Perhaps someone might be able to offer ad-hoc access to satip tuners
when required for all this to be looked at?
I would willing offer my own but regrettable I am not endowed with fibre and
my ADSL up-link is worse that derisory.
Updated by Jaroslav Kysela over 5 years ago
I debugged freesat last week (I had remote SAT>IP server access) and the only weak point is that you need to tune to 11425H for a while to read bouquets correctly. Then everything was ok, just enable both Freesat EPG grab modules and map the one from the detected bouquet or freesat services to trigger the EPG grab.
The MUX EPG grabber settings should change from auto to auto-detected and EPG grabber module to UK Freeview (without EIT which is the dependent grabber used automatically). That's all. I have not tried other transponders and I agree that the things should be improved (TVH should wait more to get the bouquets and other transponders should be checked, too).
An UK SAT>IP server for the debugging would be helpful, but I don't know when I'll have a time for more debugging (the real work really buries me now).
Updated by Oli Jeal over 5 years ago
I'm unable to get any OTA bouquets after a fresh install. Could this be down to commit a3c5e75? I'm not familiar with the code but are Priv and Map always assigned or could Map sometimes be null? If the later then should it be an AND instead of an OR?
https://github.com/tvheadend/tvheadend/commit/a3c5e751b05018a2cb3764627c3a77b4a5d9e7ce#diff-204c1e5944a0e11491aefdf0e6366bb5
Updated by Flole Systems over 5 years ago
If you don't have that check and it's null you'll experience a crash. You could try to revert to before that commit was made to make sure it's not causing the issues.
Updated by Oli Jeal over 5 years ago
I've reverted https://github.com/tvheadend/tvheadend/commit/726e6e65441a9802b6678b05e5f78d82c8cad5f5 and rebuilt and all my bouquets were found straight away so I think the problem must be there.
Updated by Oli Jeal over 5 years ago
Can this change be updated? I'm hesitant to ask for it to be reverted as it was meant to be fixing another problem. The code in question is
761 if (TAILQ_SAFE_ENTRY(fs, region_link))
762 continue;
Updated by Jaroslav Kysela over 5 years ago
- Status changed from New to Fixed
- % Done changed from 0 to 100
Applied in changeset commit:tvheadend|6bfeca6c03dbd73fa73b1b0dde383ddab29ba91c.
Updated by Rob D over 5 years ago
Can anyone confirm this patch works? I can see the BskyB bouquets but no Freesat bouquets or EPG still (Built from master with the commit referenced above included)
Updated by cy clic over 5 years ago
Rob D wrote:
Can anyone confirm this patch works? I can see the BskyB bouquets but no Freesat bouquets or EPG still (Built from master with the commit referenced above included)
Current Cosmic & pi64 with 4.3-1789 arm64 on pi3b+ do find Freesat bouquets & 7day EPG, little or no delay.
Thanks
There has been no update yet to stable - Xenix armhf still at 4.2.8-22 and hence no Freesat Bouquets.
Updated by cy clic over 5 years ago
Jaroslav Kysela wrote:
Pushed to 4.2, too.
Thanks
Confirm that that Freesat bouquets now OK on current ubuntu-xenix armhf with stable 4.2.8-23~g74cdf3f on pi2bc1.1 (sd)
Now also confirm that Freesat bouquets OK on raspianstretch armhf 4.3-1789 on pi3b+ (boot+run USB).
Re your previous comment: sometimes a delay before bouquets appear.
This could be because Network->Forcescan rarely completes all muxes on the first attempt after clean install.
With new install i.e. no muxes/services pre-scanned on both stable & unstable Forcescan "stops" (hangs?) with around 35 to 40 muxes remaining.
Multiple manual Forcescan and or or leaving over night usually succeeds and all muxes scanned i.e. none left remaining queued.
At which time there will show about 1100-1200+ services and Freesat bouquets appear.
This is a long standing "feature" and I have mused that it may be connected to a bug or ungraceful handling of SatIp not always being successful in tuning first time.
So for example, upgrading to 4.3-1789 and 4.2.8-23 which were existing installed muxes/services pre-scanned and channels manually mapped then bouquets appear without this delay.
Updated by Ziggy Goodman almost 4 years ago
Hi, I am run a Pi3B with ARCH ARM Update Lee with TVHeadend 4.2.8 as was having problem with the headend hanging on epg. I am using DVB-S Astra 28.2 and mostly looking for freesat. The XML and OTG appeared to be populating the data I was expecting.
I saw this forum, so cloned the tvheadend master and compiled. So now reports as running 4.3-1915
It does not show a Freesat EPG OTA Grabber in the GUI.
I enabled debug and then edited the Mux to Force EPG for 11425H (which I believe has freesat on it). I have added a OpenTV: Sky UK EPG module for this channel. But I do appear to get any EPG data populated. I thought the debug would show me more reports from the module processing it. Do I need to compile differently to include Freesat or change config?
2020-11-27 14:34:14.887 [ NOTICE]:START: HTS Tvheadend version 4.3-1915~gfebcf9818-dirty started, running as PID:29832
UID:1000 GID:986, CWD:/home/alarm/src/tvheadend CNF:/home/alarm/.hts/tvheadend
2020-11-27 14:34:18.275 [ INFO]:htsp: Got connection from 192.168.1.124
2020-11-27 14:34:18.275 [ INFO]:htsp: 192.168.1.124: Welcomed client software: Kodi Media Center (HTSPv34)
2020-11-27 14:34:18.277 [ INFO]:htsp: 192.168.1.124 [ Kodi Media Center ]: Identified as user 'admin'
2020-11-27 14:34:18.278 [ INFO]:htsp: 192.168.1.124 [ admin | Kodi Media Center ]: Privileges updated
2020-11-27 14:34:44.833 [ DEBUG]:epggrab: no OTA modules active for 11425H in DVB-S Network, check again next time
2020-11-27 14:37:43.134 [ INFO]:mpegts: 11425H in DVB-S Network - tuning on Montage Technology M88DS3103 #0 : DVB-S #
0
2020-11-27 14:37:43.422 [ INFO]:subscription: 0001: "epggrab" subscribing to mux "11425H", weight: 4, adapter: "Monta
ge Technology M88DS3103 #0 : DVB-S #0", network: "DVB-S Network", service: "Raw PID Subscription"
2020-11-27 14:37:44.892 [ NOTICE]:mpegts: mux 11259V in DVB-S Network old params DVB-S 28.2E freq 11259000 V sym 275000
00 fec 2/3 mod QPSK roff 35 is_id -1 pls_mode GOLD pls_code 0 (00000004)
2020-11-27 14:37:44.892 [ NOTICE]:mpegts: mux 11259V in DVB-S Network new params DVB-S 28.2E freq 11265000 V sym 275000
00 fec 2/3 mod QPSK roff 35 is_id -1 pls_mode GOLD pls_code 0 (00000004)
2020-11-27 14:39:53.335 [ DEBUG]:epggrab: grab done for 11425H in DVB-S Network (timeout)
2020-11-27 14:39:53.335 [WARNING]:epggrab: PSIP: ATSC Grabber - data completion timeout for 11425H in DVB-S Network
2020-11-27 14:39:53.335 [ INFO]:subscription: 0001: "epggrab" unsubscribing
2020-11-27 14:46:49.274 [ INFO]:mpegts: 11425H in DVB-S Network - tuning on Montage Technology M88DS3103 #0 : DVB-S #
0
2020-11-27 14:46:49.546 [ INFO]:subscription: 0002: "epggrab" subscribing to mux "11425H", weight: 4, adapter: "Monta
ge Technology M88DS3103 #0 : DVB-S #0", network: "DVB-S Network", service: "Raw PID Subscription"
2020-11-27 14:46:51.217 [ NOTICE]:mpegts: mux 11259V in DVB-S Network old params DVB-S 28.2E freq 11259000 V sym 275000
00 fec 2/3 mod QPSK roff 35 is_id -1 pls_mode GOLD pls_code 0 (00000004)
2020-11-27 14:46:51.218 [ NOTICE]:mpegts: mux 11259V in DVB-S Network new params DVB-S 28.2E freq 11265000 V sym 275000
00 fec 2/3 mod QPSK roff 35 is_id -1 pls_mode GOLD pls_code 0 (00000004)
2020-11-27 14:48:37.384 [ DEBUG]:epggrab: no OTA modules active for 11836H in DVB-S Network, check again next time
2020-11-27 14:48:37.384 [ DEBUG]:epggrab: no OTA modules active for 11914H in DVB-S Network, check again next time