Bug #1176
EPG updates does not seem to add new recording objects related to autorecord.
100%
Description
Hi,
I'm not sure how best to describe the issue but I'm currently using '3.1.605.g1d15f' with a configuration (DVB-S2 & DVB-T) which came from the last of the 2.X series. It took a long time to setup for FreeView and FreeSAT so I didn't want to lose it.
My EPG grabber is set to:
1/. XMLTV (Radio times)- Update channel name, icon, number every 5 hours.
2/. OTA interface set as UK Freesat, UK Freeview, EIT DVB grabber
I have 2 DVB devices:
1/. DVB-S2 - Conexant CX24116/CX24118 - FreeSAT setup - (Set to NOT autodetect new muxes to prevent too many rubbish channels being added)
2/. DVB-T - Nova T500 - Dual - FreeView setup - (Set autodetect new muxes)
The problem is that I have a set of 'Auto record' objects which do not get recorded. Whilst the EPG gets updated correctly, something does not work out that it should update the list of items to recorded with the new EPG information against the 'Auto record' objects. I might be lucky to get 1 item occasionally updated, but it would miss 20 or 30 items.
The only way I can get it to work correctly is to stop the tvheadend daemon, delete the epgdb.v2 file and restart. After 20 to 30 minutes it will then add all the missing items to be record. It will stop updating after what seems like a first past, but then I can live with no new updates for 3 or 4 days before doing again.
I understand that the EIT will only get 1 week of data whereas RT XMLTV will get 2 weeks of data, but I can search through the EPG and see programs which should be recorded, but aren't in the DVR recorder schedule (and never appear in there).
Thanks,
Chris
History
Updated by Frans Nilsson about 12 years ago
Hi! I got what I think is the same problem. I get strange signs in my log-file, an example:
Aug 29 06:19:31 pooh tvheadend1328: dvr: "�#001#007��~" on "Disney Channel" recorder starting
Aug 29 06:19:31 pooh tvheadend1328: subscription: "DVR: Händige Manny" subscribing on "Disney Channel", weight: 300, adapter: "Micronas DRXD DVB-T #1", network: "Teracom_Mux_3", mux: "Teracom_Mux_3: 698,000 kHz", provider: "Disney", service: "Disney Channel", quality: 100
Aug 29 06:19:31 pooh tvheadend1328: dvr: /media/rechdd/inspelningar/Händige Manny/Händige Manny.2012-08-29.06-20.ts from adapter: "Micronas DRXD DVB-T #1", network: "Teracom_Mux_3", mux: "Teracom_Mux_3: 698,000 kHz", provider: "Disney", service: "Disney Channel"
So I suspected the fix for "my" bug #620. I tested to remove the setlocale line from main.c and my autorecording works fine again.
My locale is: sv_SE.UTF-8
Is this the same error?
Updated by C E about 12 years ago
Not sure to be honest. I have updated to the latest GIT version about 2hours ago (I do regularly update to see if the issue is fixed).
Yet again I still have 'doctor who' in the Auto record list, but the EPG still has 2 episodes not being recorded. The same goes for a variety of other auto record objects.
Updated by Adam Sutton about 12 years ago
I need to look at this, I've not had time. The setlocale was, ironcially, added specifically at the request of a Swedish user to ensure that regexp matching was non-case sensitive as it is for standard ASII based langs.
I have to admit its not had extensive testing, so if it causes a problem we can certainly remove/move it.
Updated by Frans Nilsson about 12 years ago
If you feel brave you could try to change line 276 in src/main.c from:
setlocale(LC_ALL, "");
to:
//setlocale(LC_ALL, "");
and then install and see if your autorecordings works.
ps.Im not a tvheadend developer, just an user
Updated by C E about 12 years ago
I'm afraid after making the change in main.c and recompiling/installing there wasn't a notifiable difference. One thing which has come to the fore is that a series record for Star Trek only seems to be recorded for the 7 days (EIT) whereas there is 2 weeks of data in the system from the XMLTV RT system. It doesn't look like the furthest 1 week of data is checked/setup for recording.
I'm not sure if this is related, because some programs (perhaps most) do slip through the system entirely.
Updated by Adam Sutton about 12 years ago
Right, lets try and sort things out:
1. Fran, sorry didn't realise it was you submitting there. If you're setlocale patch (with my mod), has broken things can you report that on the original issue. I don't think this is related.
2. The DVR output issue has already been solved, it was a minor printing mistake when I introduced the new multi-lingual EPG code. So try using git master.
I'll take a look at your config and see exactly what you've got in your autorec rules. It's possible that its a variation in the way the XMLTV and Freesat data is varying.
Updated by Adam Sutton about 12 years ago
Chris,
I need your database file, I have a suspicion about what might be going wrong here.
Adam
Updated by Adam Sutton about 12 years ago
Can you give me some examples of the broadcasts you think should be recorded but aren't? Or are they always working on startup and just not as the data is updated (while running)?
Adam
Updated by Richard Lloyd about 12 years ago
Just a note that I'm seeing this too with a git copy I took on 25th Aug 2012 (1d15fb9) and I don't believe I saw it on my
previous git copy on 21st Aug 2012 (4493e89). I'm actually getting absolutely nothing new added by the Automatic Recorder which is
how I set 90% of my recordings, so it's likely I'll have to revert to the 21st Aug version shortly.
Doctor Who (new season!) is about to start here in the UK and I've had it in my Automatic Recorder config for a couple of days (which included
some tvheadend restarts and running the EPG grabber several times during that period) and a few hours before the airing it
hadn't been added so I've had to add it and several other AR-set shows manually, which is not something I like doing, particularly
for a multi-episode show like this.
Updated by Adam Sutton about 12 years ago
Indeed no one wants that, but if you need stability/reliability stick to an official releases, in this case 3.0. If you use unstable code expect some instability
There are definitely some significant issues with my new epg code, I'm working to resolve the problems its just finding the time.
Adam
Updated by Richard Lloyd about 12 years ago
Just rolled back to 21st Aug 2012 (4493e89) from the git master and it looks like the bug may be in that too :-( Also went forward to today (1st Sep 2012 - 3db460f) and it didn't seem to set any auto-recordings either. BTW, how do you find what build you've got installed? Once you've logged in to the tvheadend Web interface, the page that the About tab displays has just "Build:" and no version string displayed :-(
As you said, perhaps I'm going a bit too bleeding edge here (had to for a while because the gap between 2.12 [very crashy] and 3.0 [very stable] was so large) because of my heavy reliance on the excellent Automatic Recorder feature. Probably time to look at installing 3.0 until the AR stuff is fixed - if I could narrow down which release triggered the bug, then maybe that could be useful info to you I guess.
Updated by Adam Sutton about 12 years ago
I would strongly recommend sticking with 3.0 for stability. My aim, though I still need to discuss with the others developers, is to try and release the next stable release 3.2 at the end of the month. But it all depends on whether I (and the others) can find enough time to fix the various issues.
We may decide to back port a few fixes into 3.0 to bring that a bit more up to date, without changing functionality. But we'll see.
Adam
Updated by Adam Sutton about 12 years ago
- Category set to EPG
- Status changed from New to Accepted
- Assignee set to Adam Sutton
Hopefully this will be solved when I update the EPG code based on recent discussions in #hts.
Updated by Adam Sutton about 12 years ago
- Status changed from Accepted to Fixed
- % Done changed from 0 to 100
Applied in changeset commit:c54734125a45ee5329220fcd3c64534423fbf5ac.
Updated by C E about 12 years ago
Hi,
Allow long will it take for the system to work out new 'Programs' have been added to the EPG?
The reason I ask it that I can see new episodes of Star Trek have been added to the EPG, but the Autorecord object I've added to capture them hasn't 'caught' them yet.
I've recreated the 'Autorecord' object to see if that helps and whilst it has caught a couple, it still leaves a fair few at the moment of the EPG (furthest into the distances - 1.5 weeks away) which aren't added to the record list.
Do I need to wait a few hours for it to work?
Thanks,
Chris
Updated by Adam Sutton about 12 years ago
No it should be instantaneous. This is presumably an title based autorec?
I'll try and set something up on my system and see what happens.
Adam
Updated by Adam Sutton about 12 years ago
Chris,
Can you send me the details/config for the autorec rule so I can check this out. I've added a rules to search for stuff and then restarted TVH with a fresh database. That appears to have worked.
I'll add a rule for something I know will pop up daily, News or something and see if that picks up new stuff overnight.
Adam
Updated by C E about 12 years ago
I think this must be me now, because no matter what autorec I add nothing seems to get found at all. I've just tried adding 2 new autorec objects for different TV shows and neither of them has decided to record anything!
Apart from clearing everything out and starting again is there anything I can quickly delete to refresh things back to the beginning? It took too long for me to think about redoing the 'Satellite' configs again. There must be some config setup somewhere which is prevening objects from being recorded.
Updated by Adam Sutton about 12 years ago
Yeah something is definitely not right, I added that rule to recording anything with "News" in the title for BBC 1 and it picked up all the newly added entries just fine.
But since you recreated the rule, I can't see why it wouldn't work. However I've still got a few more tests I'd like to run to see if I can replicate the problem. As I didn't get your screenshots till last night and only had my phone to look at them.
Adam
Updated by Adam Sutton about 12 years ago
I've just setup my own Star Trek rule using the Autorec button on EPG tab (once a filter has been setup).
This seemed to work fine, it doesn't record all episodes as some will be noted as duplicates if you're using Freesat/OpenTV for data. I'm wondering if that might be part of the confusion?
One odd point though is that in your case it seems to be recording (in some cases) a later episode, it should really record the earliest available but that might be due to some mods I made recently to remove some of the intelligence until I do a proper DVR update.
Adam
Updated by C E about 12 years ago
Update:
After many combinations and tests I've come to the following conclusions:
1/. Autorec doesn't work well if you have OTA EIT and XMLTV selected. It just causes confusion on the system. I think this was my main problem. I've dumped XMLTV and things roughly work.
2/. If the EIT isn't fully populated and you do an autorec you could get later episodes being recorded before the main episode. This cannot be changed later.
3/. It is possible for HD channels to selected before normal SD channels. (Depends on channel order) I cannot get it to record both or just the SD version.
4/. Sometime is still just doesn't work, and I don't know why. But I've only been able to get this once now or twice instead of all the time.
I'm going to stick with things how they are. Not perfect, but at least most things do seem to be selected for recording.
Best wishes,
Chris
On 14/09/2012 13:13, Chris Eagles wrote:
Update:
I've dropped the entire .hts directory and started with a clean sheet. I started by adding in the adapters (there is a bug in the extjs code where you cannot now switch between adapters without refreshing the whole page!)
Anyway the short story is:
Added in Freeview (Nova T-500)
Got the Freeview channels
Added in an auto record for Start Trek and everything worked. All entries added as expected
Changed EPG to include RadioTimes XMLTV
Added in FreeSAT (Astra 28 - DVB-S2) muxes
Got all the FreeSAT plus Sky channels
Checked the EPG and saw that new episodes for Star Trek had been added by XMLTV. They were not being autorecorded. Only the original OTA EIT episodes were autorecorded.
Added a new auto record for Batman ITV 4 (Freeview) - Nothing was added for record. All failed.
Changed XMLTV from 12 hours to 6 hours and it set of another XMLTV collectionTen minutes later I checked again and saw TVHEADEND had crashed
Sep 14 13:10:05 tvheadend1 tvheadend7133: /usr/bin/tv_grab_uk_rt: grab took 665 seconds
Sep 14 13:10:05 tvheadend1 tvheadend7133: CRASH: Signal: 11 in PRG: /usr/local/bin/tvheadend (3.1.670.g9ed26) [3d7fe85a95267b1c69e26943fff2cf1d9e0447e9] CWD: /
Sep 14 13:10:05 tvheadend1 tvheadend7133: CRASH: Fault address (nil) (Address not mapped)
Sep 14 13:10:05 tvheadend1 tvheadend7133: CRASH: Loaded libraries: /lib/x86_64-linux-gnu/libcrypto.so.1.0.0 /lib/x86_64-linux-gnu/libz.so.1 /usr/lib/x86_64-linux-gnu/libavahi-common.so.3 /usr/lib/x86_64-linux-gnu/libavahi-client.so.3 /lib/x86_64-linux-gnu/librt.so.1 /lib/x86_64-linux-gnu/libdl.so.2 /lib/x86_64-linux-gnu/libpthread.so.0 /lib/x86_64-linux-gnu/libc.so.6 /lib/x86_64-linux-gnu/libdbus-1.so.3 /lib64/ld-linux-x86-64.so.2 /lib/x86_64-linux-gnu/libnss_compat.so.2 /lib/x86_64-linux-gnu/libnsl.so.1 /lib/x86_64-linux-gnu/libnss_nis.so.2 /lib/x86_64-linux-gnu/libnss_files.so.2
Sep 14 13:10:05 tvheadend1 tvheadend7133: CRASH: Register dump [23]: 00007f3ba4082210 0000000000000000 0000000000000001 0000000000000000 00007f3bcd136d04 0000000000000000 00007f3b8b9bce50 00007f3b89f72fd0 00007f3bb4016af8 0000000000000000 00007f3bb4016af8 00007f3ba4b59030 0000000000000000 0000000000000000 00007f3ba45d2350 00007f3bcd136c30 000000000040ac01 0000000000010246 0000000000000033 0000000000000006 000000000000000e fffffffe7ffbfa17 0000000000000000
Sep 14 13:10:05 tvheadend1 tvheadend7133: CRASH: STACKTRACE
Sep 14 13:10:05 tvheadend1 tvheadend7133: CRASH: /home/chris/tvheadend/src/trap.c:139 0x424beb
Sep 14 13:10:05 tvheadend1 tvheadend7133: CRASH: ??:0 0x7f3bd1253cb0
Sep 14 13:10:05 tvheadend1 tvheadend7133: CRASH: /home/chris/tvheadend/src/epg.c:627 0x40ac01
Sep 14 13:10:05 tvheadend1 tvheadend7133: CRASH: /home/chris/tvheadend/src/epg.c:976 0x40a1c8
Sep 14 13:10:05 tvheadend1 tvheadend7133: CRASH: /home/chris/tvheadend/src/epg.c:1377 0x40b3aa
Sep 14 13:10:05 tvheadend1 tvheadend7133: CRASH: /home/chris/tvheadend/src/epggrab/module/xmltv.c:378 0x42de79
Sep 14 13:10:05 tvheadend1 tvheadend7133: CRASH: /home/chris/tvheadend/src/epggrab/module.c:116 0x42aa71
Sep 14 13:10:05 tvheadend1 tvheadend7133: CRASH: /home/chris/tvheadend/src/epggrab.c:74 0x40fdbf
Sep 14 13:10:05 tvheadend1 tvheadend7133: CRASH: ??:0 0x7f3bd124be9a
Sep 14 13:10:05 tvheadend1 tvheadend7133: CRASH: clone+0x6d (/lib/x86_64-linux-gnu/libc.so.6)
Sep 14 13:10:05 tvheadend1 kernel: [87635.030685] tvheadend7152: segfault at 0 ip 000000000040ac01 sp 00007f3bcd136c30 error 6 in tvheadend[400000+81000]
Sep 14 13:10:05 tvheadend1 kernel: [87635.192690] cx8802_start_dma() Failed. Unsupported value in .mpeg (0x00000001)
Sep 14 13:10:07 tvheadend1 kernel: [87637.196481] cx8802_start_dma() Failed. Unsupported value in .mpeg (0x00000001)I did notice a crash on the old .hts config last night. This only started in the last couple of GIT updates.
Have now given up for a few hours.