Tvheadend

Hi! I got what I think is the same problem. I get strange signs in my log-file, an example:

Aug 29 06:19:31 pooh tvheadend¹³²⁸: dvr: "�#001#007��~" on "Disney Channel" recorder starting
Aug 29 06:19:31 pooh tvheadend¹³²⁸: subscription: "DVR: Händige Manny" subscribing on "Disney Channel", weight: 300, adapter: "Micronas DRXD DVB-T #1", network: "Teracom_Mux_3", mux: "Teracom_Mux_3: 698,000 kHz", provider: "Disney", service: "Disney Channel", quality: 100
Aug 29 06:19:31 pooh tvheadend¹³²⁸: dvr: /media/rechdd/inspelningar/Händige Manny/Händige Manny.2012-08-29.06-20.ts from adapter: "Micronas DRXD DVB-T #1", network: "Teracom_Mux_3", mux: "Teracom_Mux_3: 698,000 kHz", provider: "Disney", service: "Disney Channel"

So I suspected the fix for "my" bug #620. I tested to remove the setlocale line from main.c and my autorecording works fine again.

My locale is: sv_SE.UTF-8

Is this the same error?

Not sure to be honest. I have updated to the latest GIT version about 2hours ago (I do regularly update to see if the issue is fixed).

Yet again I still have 'doctor who' in the Auto record list, but the EPG still has 2 episodes not being recorded. The same goes for a variety of other auto record objects.

I need to look at this, I've not had time. The setlocale was, ironcially, added specifically at the request of a Swedish user to ensure that regexp matching was non-case sensitive as it is for standard ASII based langs.

I have to admit its not had extensive testing, so if it causes a problem we can certainly remove/move it.

If you feel brave you could try to change line 276 in src/main.c from:
setlocale(LC_ALL, "");

to:
//setlocale(LC_ALL, "");

and then install and see if your autorecordings works.

ps.Im not a tvheadend developer, just an user :)

I'm afraid after making the change in main.c and recompiling/installing there wasn't a notifiable difference. One thing which has come to the fore is that a series record for Star Trek only seems to be recorded for the 7 days (EIT) whereas there is 2 weeks of data in the system from the XMLTV RT system. It doesn't look like the furthest 1 week of data is checked/setup for recording.

I'm not sure if this is related, because some programs (perhaps most) do slip through the system entirely.

Right, lets try and sort things out:

1. Fran, sorry didn't realise it was you submitting there. If you're setlocale patch (with my mod), has broken things can you report that on the original issue. I don't think this is related.

2. The DVR output issue has already been solved, it was a minor printing mistake when I introduced the new multi-lingual EPG code. So try using git master.

I'll take a look at your config and see exactly what you've got in your autorec rules. It's possible that its a variation in the way the XMLTV and Freesat data is varying.

Chris,

I need your database file, I have a suspicion about what might be going wrong here.

Adam

Can you give me some examples of the broadcasts you think should be recorded but aren't? Or are they always working on startup and just not as the data is updated (while running)?

Adam

Just a note that I'm seeing this too with a git copy I took on 25th Aug 2012 (1d15fb9) and I don't believe I saw it on my
previous git copy on 21st Aug 2012 (4493e89). I'm actually getting absolutely nothing new added by the Automatic Recorder which is
how I set 90% of my recordings, so it's likely I'll have to revert to the 21st Aug version shortly.

Doctor Who (new season!) is about to start here in the UK and I've had it in my Automatic Recorder config for a couple of days (which included
some tvheadend restarts and running the EPG grabber several times during that period) and a few hours before the airing it
hadn't been added so I've had to add it and several other AR-set shows manually, which is not something I like doing, particularly
for a multi-episode show like this.

Indeed no one wants that, but if you need stability/reliability stick to an official releases, in this case 3.0. If you use unstable code expect some instability ;)

There are definitely some significant issues with my new epg code, I'm working to resolve the problems its just finding the time.

Adam

Just rolled back to 21st Aug 2012 (4493e89) from the git master and it looks like the bug may be in that too :-( Also went forward to today (1st Sep 2012 - 3db460f) and it didn't seem to set any auto-recordings either. BTW, how do you find what build you've got installed? Once you've logged in to the tvheadend Web interface, the page that the About tab displays has just "Build:" and no version string displayed :-(

As you said, perhaps I'm going a bit too bleeding edge here (had to for a while because the gap between 2.12 [very crashy] and 3.0 [very stable] was so large) because of my heavy reliance on the excellent Automatic Recorder feature. Probably time to look at installing 3.0 until the AR stuff is fixed - if I could narrow down which release triggered the bug, then maybe that could be useful info to you I guess.

I would strongly recommend sticking with 3.0 for stability. My aim, though I still need to discuss with the others developers, is to try and release the next stable release 3.2 at the end of the month. But it all depends on whether I (and the others) can find enough time to fix the various issues.

We may decide to back port a few fixes into 3.0 to bring that a bit more up to date, without changing functionality. But we'll see.

Adam

Hi,

Allow long will it take for the system to work out new 'Programs' have been added to the EPG?

The reason I ask it that I can see new episodes of Star Trek have been added to the EPG, but the Autorecord object I've added to capture them hasn't 'caught' them yet.

I've recreated the 'Autorecord' object to see if that helps and whilst it has caught a couple, it still leaves a fair few at the moment of the EPG (furthest into the distances - 1.5 weeks away) which aren't added to the record list.

Do I need to wait a few hours for it to work?

Thanks,

Chris

No it should be instantaneous. This is presumably an title based autorec?

I'll try and set something up on my system and see what happens.

Adam

Chris,

Can you send me the details/config for the autorec rule so I can check this out. I've added a rules to search for stuff and then restarted TVH with a fresh database. That appears to have worked.

I'll add a rule for something I know will pop up daily, News or something and see if that picks up new stuff overnight.

Adam

I think this must be me now, because no matter what autorec I add nothing seems to get found at all. I've just tried adding 2 new autorec objects for different TV shows and neither of them has decided to record anything!

Apart from clearing everything out and starting again is there anything I can quickly delete to refresh things back to the beginning? It took too long for me to think about redoing the 'Satellite' configs again. There must be some config setup somewhere which is prevening objects from being recorded.

Yeah something is definitely not right, I added that rule to recording anything with "News" in the title for BBC 1 and it picked up all the newly added entries just fine.

But since you recreated the rule, I can't see why it wouldn't work. However I've still got a few more tests I'd like to run to see if I can replicate the problem. As I didn't get your screenshots till last night and only had my phone to look at them.

Adam

I've just setup my own Star Trek rule using the Autorec button on EPG tab (once a filter has been setup).

This seemed to work fine, it doesn't record all episodes as some will be noted as duplicates if you're using Freesat/OpenTV for data. I'm wondering if that might be part of the confusion?

One odd point though is that in your case it seems to be recording (in some cases) a later episode, it should really record the earliest available but that might be due to some mods I made recently to remove some of the intelligence until I do a proper DVR update.

Adam

Update:

After many combinations and tests I've come to the following conclusions:

1/. Autorec doesn't work well if you have OTA EIT and XMLTV selected. It just causes confusion on the system. I think this was my main problem. I've dumped XMLTV and things roughly work.
    2/. If the EIT isn't fully populated and you do an autorec you could get later episodes being recorded before the main episode. This cannot be changed later.
    3/. It is possible for HD channels to selected before normal SD channels. (Depends on channel order) I cannot get it to record both or just the SD version.
    4/. Sometime is still just doesn't work, and I don't know why. But I've only been able to get this once now or twice instead of all the time.

I'm going to stick with things how they are. Not perfect, but at least most things do seem to be selected for recording.

Best wishes,

Chris
On 14/09/2012 13:13, Chris Eagles wrote:

Update:

I've dropped the entire .hts directory and started with a clean sheet. I started by adding in the adapters (there is a bug in the extjs code where you cannot now switch between adapters without refreshing the whole page!)

Anyway the short story is:

Added in Freeview (Nova T-500)
Got the Freeview channels
Added in an auto record for Start Trek and everything worked. All entries added as expected
Changed EPG to include RadioTimes XMLTV
Added in FreeSAT (Astra 28 - DVB-S2) muxes
Got all the FreeSAT plus Sky channels
Checked the EPG and saw that new episodes for Star Trek had been added by XMLTV. They were not being autorecorded. Only the original OTA EIT episodes were autorecorded.
Added a new auto record for Batman ITV 4 (Freeview) - Nothing was added for record. All failed.
Changed XMLTV from 12 hours to 6 hours and it set of another XMLTV collection

Ten minutes later I checked again and saw TVHEADEND had crashed

Sep 14 13:10:05 tvheadend1 tvheadend⁷¹³³: /usr/bin/tv_grab_uk_rt: grab took 665 seconds
Sep 14 13:10:05 tvheadend1 tvheadend⁷¹³³: CRASH: Signal: 11 in PRG: /usr/local/bin/tvheadend (3.1.670.g9ed26) [3d7fe85a95267b1c69e26943fff2cf1d9e0447e9] CWD: /
Sep 14 13:10:05 tvheadend1 tvheadend⁷¹³³: CRASH: Fault address (nil) (Address not mapped)
Sep 14 13:10:05 tvheadend1 tvheadend⁷¹³³: CRASH: Loaded libraries: /lib/x86_64-linux-gnu/libcrypto.so.1.0.0 /lib/x86_64-linux-gnu/libz.so.1 /usr/lib/x86_64-linux-gnu/libavahi-common.so.3 /usr/lib/x86_64-linux-gnu/libavahi-client.so.3 /lib/x86_64-linux-gnu/librt.so.1 /lib/x86_64-linux-gnu/libdl.so.2 /lib/x86_64-linux-gnu/libpthread.so.0 /lib/x86_64-linux-gnu/libc.so.6 /lib/x86_64-linux-gnu/libdbus-1.so.3 /lib64/ld-linux-x86-64.so.2 /lib/x86_64-linux-gnu/libnss_compat.so.2 /lib/x86_64-linux-gnu/libnsl.so.1 /lib/x86_64-linux-gnu/libnss_nis.so.2 /lib/x86_64-linux-gnu/libnss_files.so.2
Sep 14 13:10:05 tvheadend1 tvheadend⁷¹³³: CRASH: Register dump [23]: 00007f3ba4082210 0000000000000000 0000000000000001 0000000000000000 00007f3bcd136d04 0000000000000000 00007f3b8b9bce50 00007f3b89f72fd0 00007f3bb4016af8 0000000000000000 00007f3bb4016af8 00007f3ba4b59030 0000000000000000 0000000000000000 00007f3ba45d2350 00007f3bcd136c30 000000000040ac01 0000000000010246 0000000000000033 0000000000000006 000000000000000e fffffffe7ffbfa17 0000000000000000
Sep 14 13:10:05 tvheadend1 tvheadend⁷¹³³: CRASH: STACKTRACE
Sep 14 13:10:05 tvheadend1 tvheadend⁷¹³³: CRASH: /home/chris/tvheadend/src/trap.c:139 0x424beb
Sep 14 13:10:05 tvheadend1 tvheadend⁷¹³³: CRASH: ??:0 0x7f3bd1253cb0
Sep 14 13:10:05 tvheadend1 tvheadend⁷¹³³: CRASH: /home/chris/tvheadend/src/epg.c:627 0x40ac01
Sep 14 13:10:05 tvheadend1 tvheadend⁷¹³³: CRASH: /home/chris/tvheadend/src/epg.c:976 0x40a1c8
Sep 14 13:10:05 tvheadend1 tvheadend⁷¹³³: CRASH: /home/chris/tvheadend/src/epg.c:1377 0x40b3aa
Sep 14 13:10:05 tvheadend1 tvheadend⁷¹³³: CRASH: /home/chris/tvheadend/src/epggrab/module/xmltv.c:378 0x42de79
Sep 14 13:10:05 tvheadend1 tvheadend⁷¹³³: CRASH: /home/chris/tvheadend/src/epggrab/module.c:116 0x42aa71
Sep 14 13:10:05 tvheadend1 tvheadend⁷¹³³: CRASH: /home/chris/tvheadend/src/epggrab.c:74 0x40fdbf
Sep 14 13:10:05 tvheadend1 tvheadend⁷¹³³: CRASH: ??:0 0x7f3bd124be9a
Sep 14 13:10:05 tvheadend1 tvheadend⁷¹³³: CRASH: clone+0x6d (/lib/x86_64-linux-gnu/libc.so.6)
Sep 14 13:10:05 tvheadend1 kernel: [87635.030685] tvheadend⁷¹⁵²: segfault at 0 ip 000000000040ac01 sp 00007f3bcd136c30 error 6 in tvheadend[400000+81000]
Sep 14 13:10:05 tvheadend1 kernel: [87635.192690] cx8802_start_dma() Failed. Unsupported value in .mpeg (0x00000001)
Sep 14 13:10:07 tvheadend1 kernel: [87637.196481] cx8802_start_dma() Failed. Unsupported value in .mpeg (0x00000001)

I did notice a crash on the old .hts config last night. This only started in the last couple of GIT updates.

Have now given up for a few hours.