Tvheadend

hi Renato,

i think it does, i will try tonight after work and let you know.

Stephane Chauveau wrote:

For Nicolas,

The easiest way to log the errors is to redirect the error output stream (number 2) to a file.

For example, you can run the script as follow

/usr/local/bin/category-filter.pl 2> /tmp/category-filter.log

or if you want to APPEND to the log file, use a double >> instead

/usr/local/bin/category-filter.pl 2>> /tmp/category-filter.log

The alternative is to modify the perl script itself.

Add the following line at the beginning of the script to open the log file in append mode:

open(LOG, ">>", "/tmp/category-filter.log") or die "Can't open LOG file: $!";

Then clone the 'print STDERR' line and replace 'STDERR' by 'LOG':

print STDERR "Warning: Unmanaged category: '$a'\n" ;
print LOG "Warning: Unmanaged category: '$a'\n" ;

If you do not want to repeat the same error hundreds or thousands of times, you can memorize the wrong categories as follow to emit a single error for each.

At the beginning of the script, create an empty map:

my %BAD ;

Then modify the prints to STDERR and LOG as follow

if ( ! exists $BAD{$a} ) {
print STDERR "Warning: Unmanaged category: '$a'\n" ;
print LOG "Warning: Unmanaged category: '$a'\n" ;

1. Record in BAD map so next error won't produce a message
   $BAD{$a} = 1 ;
   }

Hi Stephane,
I´m trying to implement your script with the BAD map now because I´m started to get more Unmanaged categories from some time ago since I´ve included more grabbers to fill my .xml file.

The problem is that I´m doing something wrong since I´m recieving this output:

Missing right curly or square bracket at /share/CACHEDEV1_DATA/homes/nico/wg++/categorias/cambia_categorias.pl line 330, at end of line
syntax error at /share/CACHEDEV1_DATA/homes/nico/wg++/categorias/cambia_categorias.pl line 330, at EOF
Execution of /share/CACHEDEV1_DATA/homes/nico/wg++/categorias/cambia_categorias.pl aborted due to compilation errors.

I´ve tried some things but without success. Check the script attached in this post to review it and comment me what is wrong.

Thank you very much

thierry castelot wrote:

i assume that perl is already installed into your pi3 and have the same path as ubuntu.

move the two tv_grab into usr/bin and category into usr/local/bin, make them executable and restart tvh, you should be able to pick tv_grab_fr_alacarte_2.

many thanks : it works!

At least partialy since categories are not all colored inside Kodi.
But at least the grabber is display in Tvheadend interface.

EDIT : IT IS 100% WORKING! and it is maybe 20 time faster than the original script.
that was my fault...
First I was using your zguidetv account :D
Second, I had trash EPG datas preventing the correct mapping of new EPG datas.

@ james Bond

your welcome

@ Renato

works perfect into Synology ds112j and it's much much faster than my previous script.

you just need to update categories.pl to minimize the number of unmanaged categories.

thierry castelot wrote:

@ james Bond

your welcome

@ Renato

works perfect into Synology ds112j and it's much much faster than my previous script.

you just need to update categories.pl to minimize the number of unmanaged categories.

I think your modded script should be posted in its own thread since it is working unlike 98% of the code posted on this thread

@Thierry,
Many thanks, I will try it

i made some corrections on this one.

Thank you very much for script. But how to make it case insensetive,
so that "Fin" = "fin" ?

I have found function ucfirst() to make first letter upper case, maybe
this can help here, but I can't understand how to implement it.

Thanks

The lc() function convert a string to lowercase so replace the while loop at the end of the script with

foreach my $key (keys %REPLACE) {
    $REPLACE{lc($key)} = $REPLACE{$key}  ;
}

while (<>) {
    my $line = $_ ;
    $line =~ s/($PRE)(.*)($POST)/"$1".myfilter(lc("$2"))."$3"/ge ;
    print $line;
} 

The purpose of the foreach loop is to clone each entry in %REPLACE with a lowercase key.

In the while loop, lc() is applied to the argument passed to the my filter function.

Thanks Stephane, but the problem is that all entries I have in script are upper case,
for example "Fin" => 0 , and my provider in xmltv has "Fin" and also "fin".
So as I understand I need upper case the first letter of xmltv entries of category.

My previous post using lc is not tested.

Be aware that if you already have lowercase entries in %REPLACE then they may be replaced by a corresponding non-lowercase value.

If this is a problem then you may want to use something like that to prevent existing entries to be overwritten

foreach my $key (keys %REPLACE) {
  if (!exists $REPLACE{lc($key)} ) {
    $REPLACE{lc($key)} = $REPLACE{$key}  ;
  }
}

Ho! Your keyboard is bro

The while loop is calling myfilter(lc("$2")). For example, if your provider uses "fin", "Fin" or "FIN" then myfilter will always be called with "fin".

So that means that %REPLACE only need to contain the lowercase key.

The foreach loop takes care of that.

The original non-lowercase values such as "Fin" are still present in %REPLACE but they will never be used.

Can't make it work. My provider use two in the same xmltv - "Fin" and "fin" as for example. So there is category "Movie" and "movie" in the same xmltv file. "Movie" works and "movie" not. I am very beginner with perl

Strange. That should work!
Can you send me the script you are currently using and a sample XML input file?

Strange. I have just tested the original script with samples. All works. Understand nothing )

P.S. Seems that I am very tired because I have put Movie and movie in replace pl script

So it must be

my %REPLACE=(

    "Movie"                           => $MOVIE ,
 ) ;

And in this case it will be one missing categorie - movie.
This sample works with your script. Thanks. Seems somewhere my error.

Update:
Your script works well. Thanks again. But I have investigated a problem that
it works only for english letters if there are chinese, russian, greek and so on letters
it doesn't work and must be modified with these strings:

use utf8 ;
use Encode ;

foreach my $key (keys %REPLACE) {
    $REPLACE{lc($key)} = $REPLACE{$key}  ;
}

while (<>) {
    my $line = $_ ;
    $line = decode_utf8($line);
    $line =~ s/($PRE)(.*)($POST)/"$1".myfilter(lc("$2"))."$3"/ge ;
    $line = encode_utf8($line);
    print $line;
}

I like to have the "Unmanaged categories" unique and how often they appear and ordered:

Add/replace the following code:

my %Categories;
my $PRE = '<category lang=\"nl\">';
my $POST = '</category>';

sub myfilter {
my ($a) = @_;
if (exists $REPLACE{$a}) {
return $REPLACE{$a} ;
} else {
if (exists $Categories{$a}) {
$Categories{$a} = $Categories{$a} + 1;
} else {
$Categories{$a} = 1;
}
return $a ;
}
}

while (<>) {
my $line = $_ ;
$line =~ s/($PRE)(.*)($POST)/"$1".myfilter("$2")."$3"/ge ;
print $line;
}

foreach my $category (sort { $Categories{$a} <=> $Categories{$b} } keys %Categories) {
print STDERR "WARNING: Unmanaged category: '$category' is $Categories{$category}\n";
}

The last source of XMLTV is not available anymore.
http://xmltv.dtdns.net/alacarte/

Have anyone found a different source ?
In the end, has KAZER been able to source HeadTvEnd on Synology DSM6+ ?
Right now, I am stuck with no program input, which is a shame as all the rest has proved to work perfectly !

Thanks for your sharing

hello Alexandre,

i will take a look this week end, i've found some news xml but i need rewrite the category.pl to match with.

Thierry,
Thanks for your answer !
Actually, I am a bit disappointed about the loss of programs.
Even a straight XML input (without categories) would please me enough :-)
Would be nice if we could get in touch.
Is my email available in my profile ?

I much thank you for your contribution.

Regards

Alexandre,

just replace your tv_grab_fr_alacarte by this one, it should works. i will update category.pl later

Hello Thierry,
Many thanks for your solution.
Is there a way to have episode # in the episode column of tvheadend, not in the title ?
In this way I could manage the naming of file as I prefer.

Anyway in the wait time, it is a nice solution.

Kind regards

Many thanks Thierry
I am off for a few days, and will try and report as soon as I am back

Once again thanks for your help !

Works again !
But, for some reason, the Categories don't work (they never have)
In the log, I can see many many lines with "UNMANAGED CATEGORY" as if it know none.
Is there something I have missed ?

hello Renato,

according to racacax (author of this xmltv) it should be fixed soon:

" ◘ Modification de l'affichage des épisodes des séries. Les modifications seront prises en compte progressivement avant que ce soit entièrement fonctionnel dès la semaine prochaine. Cela concerne la majorité des chaines."

<programme start="20170909190000 +0200" stop="20170909194500 +0200" channel="6ter">
<title>Rénovation impossible</title>
<sub-title lang="fr">Ambiance country</sub-title>
<episode-num system="onscreen">S05E09</episode-num>

Alex, it's sadly normal, i'm waiting for a new update from racacax to clean up the xmltv ( too many categories because he put the length into categories).