Project

General

Profile

Bug #2831

EMMs are not sent to oscam through cwc (recent viaccess)

Added by Artur Averyanikhin over 9 years ago. Updated over 9 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
Descrambling
Target version:
-
Start date:
2015-05-06
Due date:
% Done:

100%

Estimated time:
(Total: 0.00 h)
Found in version:
latest 4.1
Affected Versions:

Description

CAID 0500; PROVID 040600. NTV+ Russian provider. Oscam ver. r10659, Tvh ver: 3.4.28~geb79aee~trusty. Communication - newcamd.
No emm updates come on a smart card.


Files

oscam.conf (1.03 KB) oscam.conf Artur Averyanikhin, 2015-05-09 14:40
oscam.dvbapi (33 Bytes) oscam.dvbapi Artur Averyanikhin, 2015-05-09 14:41
oscam.log (318 KB) oscam.log Artur Averyanikhin, 2015-05-09 14:41
oscam.server (644 Bytes) oscam.server Artur Averyanikhin, 2015-05-09 14:41
oscam.user (90 Bytes) oscam.user Artur Averyanikhin, 2015-05-09 14:41
newcamd.log (2.58 MB) newcamd.log B C, 2015-05-11 09:22
tvheadend (510 KB) tvheadend Artur Averyanikhin, 2015-05-11 14:37
viaemm.log (77.3 KB) viaemm.log B C, 2015-05-11 17:11
tvheadend (9.54 MB) tvheadend Artur Averyanikhin, 2015-05-13 10:02
Screen Shot 2015-05-13 at 10.42.42 PM.png (63.5 KB) Screen Shot 2015-05-13 at 10.42.42 PM.png Artur Averyanikhin, 2015-05-13 21:43
tvheadend.log (319 KB) tvheadend.log B C, 2015-05-13 22:02
dreambox.log (1.79 MB) dreambox.log B C, 2015-05-13 22:03
tvhhexdump.log (6.48 MB) tvhhexdump.log B C, 2015-05-15 11:06
tvhlinuxdvb.log (15.8 MB) tvhlinuxdvb.log B C, 2015-05-15 14:45
tvhemmmpegts.log (10.3 MB) tvhemmmpegts.log B C, 2015-05-15 15:36
tvhcwc.log (15.1 MB) tvhcwc.log B C, 2015-05-15 17:29
tvheadend (8.76 MB) tvheadend Artur Averyanikhin, 2015-05-15 23:02
Screen Shot 2015-05-16 at 12.04.57 AM.png (129 KB) Screen Shot 2015-05-16 at 12.04.57 AM.png Artur Averyanikhin, 2015-05-15 23:05
oscam.log (9.23 MB) oscam.log Artur Averyanikhin, 2015-05-15 23:49

Subtasks

Bug #2825: EMMs fails on specific CA/Provider IDRejected

Actions

History

#2

Updated by Jaroslav Kysela over 9 years ago

  • Subject changed from no dmm update to oscam to 3.4: no dmm update to oscam
#3

Updated by Jaroslav Kysela over 9 years ago

If you can reproduce this with 3.9, add a tvh trace log for these subsystems: --trace descrambler,cwc .

#4

Updated by Artur Averyanikhin over 9 years ago

I have tune burst diseqc switch and a circular lnb. So on tvh 3.4 i was able to set diseqc value and lnb freq - circular 10750. I can't find such settings on tvh 3.9. So with this version the i'm troubled to start my system. Is tvh 3.9 able to work with diseqc?

#5

Updated by Jaroslav Kysela over 9 years ago

.ld_type    = "Ku 10750",
.lnb_low    = 10750000,
.lnb_high   = 0,
.lnb_switch = 0,
.ld_type    = "Ku 10750 (Hi-Band)",
.lnb_low    = 10750000,
.lnb_high   = 10750000,
.lnb_switch = 10750000,

Just select one which fits your requirements. You should enable the advanced satellite configuration.

#6

Updated by B C over 9 years ago

as I had no time by now to connect my dreambox to get some logs to compare emm problems on via provider 040820 via capmt, I have now included logs for newcamd and 040820. OSCAM does not accept any emm as valid, so I suspect some filtering problem. As I know I can update my via card with my DB via newcamd and dvbapi I hardly belive it's OSCAMs fault. This thread my be helpfull as well: http://www.streamboard.tv/wbb2/thread.php?postid=542802#post542802

#7

Updated by Artur Averyanikhin over 9 years ago

I enabled advanced sat configuration. But can't find any reliable configuration in UI. Which file should i insert those configs?

#8

Updated by B C over 9 years ago

enable advanced, add at least one position in the advanced tree node below, go to Position 1 and there you can change your LNB type

#9

Updated by Jaroslav Kysela over 9 years ago

B C wrote:

enable advanced, add at least one position in the advanced tree node below, go to Position 1 and there you can change your LNB type

EMMs are filtered in cwc_emm_viaccess() - cwc.c, so you may give a look and compare this fcn with oscam's reader-viaccess.c - fcn viaccess_reassemble_emm() .

#10

Updated by B C over 9 years ago

viaccess reassemble is only done on cwc side, not in capmt, isn't it (as it is not working on capmt too I don't suspect this to be the primary reason)?

What I can see (on capmt side) is that OSCAM opens 9 EMM filters on PID 1029, but tvheadend only adds 3 of them if I do Interpret the log correctly?

2015-05-11 13:12:13.943 [  TRACE]:descrambler: CAT data (len 115)
2015-05-11 13:12:13.943 [  TRACE]:descrambler: 09 04 17 02 F0 00 09 04 18 30 F0 03 09 04 18 37 .........0.....7
2015-05-11 13:12:13.943 [  TRACE]:descrambler: F0 04 09 04 18 60 F0 07 09 04 18 33 F0 02 09 04 .....`.....3....
2015-05-11 13:12:13.943 [  TRACE]:descrambler: 18 67 F0 06 09 04 18 43 F0 05 09 04 09 C4 F0 08 .g.....C........
2015-05-11 13:12:13.943 [  TRACE]:descrambler: 09 04 09 8C F0 08 09 0C 05 00 F0 29 13 01 20 14 ...........).. .
2015-05-11 13:12:13.943 [  TRACE]:descrambler: 03 04 08 20 09 0C 05 00 F0 30 13 01 20 14 03 05 ... .....0.. ...
2015-05-11 13:12:13.943 [  TRACE]:descrambler: 08 10 09 0F 05 00 F0 31 10 01 00 13 01 20 14 03 .......1..... ..
2015-05-11 13:12:13.943 [  TRACE]:descrambler: 06 02 10 09 04 18 FE E9 99 09 04 18 6A F0 13 4B ............j..K
2015-05-11 13:12:13.943 [  TRACE]:descrambler: E0 F7 BF                                        ...             
2015-05-11 13:12:13.943 [  TRACE]:descrambler: attach emm caid 0500 (1280) pid 1029 (4137)
2015-05-11 13:12:13.943 [  TRACE]:descrambler: mux 0x48957d0 open pid 1029 (4137) (flags 0x0000) for 0x7f3b8400e890
2015-05-11 13:12:13.943 [  TRACE]:descrambler: attach emm caid 0500 (1280) pid 1029 (4137)
2015-05-11 13:12:13.943 [  TRACE]:descrambler: mux 0x48957d0 open pid 1029 (4137) (flags 0x0000) for 0x7f3b84001150

2015-05-11 13:12:43.312 [  TRACE]:capmt: OSCAM Spaz (local): Received message from socket 62
2015-05-11 13:12:43.312 [  TRACE]:capmt: 40 3C 6F 2B 02 00 03 10 29 8A 00 00 80 00 00 00 @<o+....).......
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 FE 00 00 80 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 04                                              .               
2015-05-11 13:12:43.312 [  TRACE]:capmt: OSCAM Spaz (local): setting filter: adapter=2, demux=0, filter=3, pid=4137
2015-05-11 13:12:43.312 [  TRACE]:capmt: 8A 00 00 80 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: FE 00 00 80 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:descrambler: mux 0x48957d0 open pid 1029 (4137) (flags 0x0000) for 0x4fcec10
2015-05-11 13:12:43.312 [  TRACE]:capmt: OSCAM Spaz (local): Received message from socket 62
2015-05-11 13:12:43.312 [  TRACE]:capmt: 40 3C 6F 2B 02 00 04 10 29 8C 00 00 00 08 10 00 @<o+....).......
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 FE 00 00 00 FF F0 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 04 40 3C 6F 2B 02 00 05 10 29 8E C4 1A 5E 00 00 .@<o+....)...^..
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 FF FF FF FF 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 04                                           ..              
2015-05-11 13:12:43.312 [  TRACE]:capmt: OSCAM Spaz (local): setting filter: adapter=2, demux=0, filter=4, pid=4137
2015-05-11 13:12:43.312 [  TRACE]:capmt: 8C 00 00 00 08 10 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: FE 00 00 00 FF F0 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: OSCAM Spaz (local): setting filter: adapter=2, demux=0, filter=5, pid=4137
2015-05-11 13:12:43.312 [  TRACE]:capmt: 8E C4 1A 5E 00 00 00 00 00 00 00 00 00 00 00 00 ...^............
2015-05-11 13:12:43.312 [  TRACE]:capmt: FF FF FF FF 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: OSCAM Spaz (local): Received message from socket 62
2015-05-11 13:12:43.312 [  TRACE]:capmt: 40 3C 6F 2B 02 00 06 10 29 8C 00 00 00 08 20 00 @<o+....)..... .
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 FE 00 00 00 FF F0 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 04 40 3C 6F 2B 02 00 07 10 29 8C 00 00 00 08 30 .@<o+....).....0
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 FE 00 00 00 FF F0 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 04 40 3C 6F 2B 02 00 08 10 29 8A 00 00 00 08 ..@<o+....).....
2015-05-11 13:12:43.312 [  TRACE]:capmt: 10 00 00 00 00 00 00 00 00 00 00 FE 00 00 00 FF ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: F0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 04                                        ...             
2015-05-11 13:12:43.312 [  TRACE]:capmt: OSCAM Spaz (local): setting filter: adapter=2, demux=0, filter=6, pid=4137
2015-05-11 13:12:43.312 [  TRACE]:capmt: 8C 00 00 00 08 20 00 00 00 00 00 00 00 00 00 00 ..... ..........
2015-05-11 13:12:43.312 [  TRACE]:capmt: FE 00 00 00 FF F0 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: OSCAM Spaz (local): setting filter: adapter=2, demux=0, filter=7, pid=4137
2015-05-11 13:12:43.312 [  TRACE]:capmt: 8C 00 00 00 08 30 00 00 00 00 00 00 00 00 00 00 .....0..........
2015-05-11 13:12:43.312 [  TRACE]:capmt: FE 00 00 00 FF F0 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: OSCAM Spaz (local): setting filter: adapter=2, demux=0, filter=8, pid=4137
2015-05-11 13:12:43.312 [  TRACE]:capmt: 8A 00 00 00 08 10 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: FE 00 00 00 FF F0 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: OSCAM Spaz (local): Received message from socket 62
2015-05-11 13:12:43.312 [  TRACE]:capmt: 40 3C 6F 2B 02 00 09 10 29 8A 00 00 00 08 20 00 @<o+....)..... .
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 FE 00 00 00 FF F0 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 04 40 3C 6F 2B 02 00 0A 10 29 8A 00 00 00 08 30 .@<o+....).....0
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 FE 00 00 00 FF F0 ................
2015-05-11 13:12:43.313 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.313 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.313 [  TRACE]:capmt: 00 04 40 3C 6F 2B 02 00 0B 10 29 88 C4 1A 5E E3 ..@<o+....)...^.
2015-05-11 13:12:43.313 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 FF FF FF FF FF ................
2015-05-11 13:12:43.313 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.313 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.313 [  TRACE]:capmt: 00 00 04                                        ...             
2015-05-11 13:12:43.313 [  TRACE]:capmt: OSCAM Spaz (local): setting filter: adapter=2, demux=0, filter=9, pid=4137
2015-05-11 13:12:43.313 [  TRACE]:capmt: 8A 00 00 00 08 20 00 00 00 00 00 00 00 00 00 00 ..... ..........
2015-05-11 13:12:43.313 [  TRACE]:capmt: FE 00 00 00 FF F0 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.313 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.313 [  TRACE]:capmt: OSCAM Spaz (local): setting filter: adapter=2, demux=0, filter=10, pid=4137
2015-05-11 13:12:43.313 [  TRACE]:capmt: 8A 00 00 00 08 30 00 00 00 00 00 00 00 00 00 00 .....0..........
2015-05-11 13:12:43.313 [  TRACE]:capmt: FE 00 00 00 FF F0 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.313 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.313 [  TRACE]:capmt: OSCAM Spaz (local): setting filter: adapter=2, demux=0, filter=11, pid=4137
2015-05-11 13:12:43.313 [  TRACE]:capmt: 88 C4 1A 5E E3 00 00 00 00 00 00 00 00 00 00 00 ...^............
2015-05-11 13:12:43.313 [  TRACE]:capmt: FF FF FF FF FF 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.313 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ............

#11

Updated by Jaroslav Kysela over 9 years ago

B C wrote:

viaccess reassemble is only done on cwc side, not in capmt, isn't it (as it is not working on capmt too I don't suspect this to be the primary reason)?

What I can see (on capmt side) is that OSCAM opens 9 EMM filters on PID 1029, but tvheadend only adds 3 of them if I do Interpret the log correctly?

[...]

No, because PID matches, the filters are shared for this PID (in other words - each PID is opened only once - there is a reference counter in capmt.c - pid_refs).

#12

Updated by Artur Averyanikhin over 9 years ago

Finished with the settings, scanned muxes and started stream of recommended by provider channel to get an emm's. But now it seems like tvh don't send any emm at all. So oscam don't see any emm message.

#13

Updated by Artur Averyanikhin over 9 years ago

Is it okay to use newcamd protocol to update emm's? I heard, that it cannot handle with big emm's. I tried to configure tvh and oscam to use capmt file through dvbapi, but it was useless. So With newcamd oscam successfully descramble all channels, but it can't update my card.

#14

Updated by Artur Averyanikhin over 9 years ago

a bit addition - i use sky star and ubuntu, not a linux receiver.

#15

Updated by B C over 9 years ago

so there is no additional "section filter" or whatever on the pid? The flags are always 0000? EMM streams are always on a single pid, so why is OSCAM opening 9 times the same pid? I tried to ask this on streamboard but unfortunately they are not very helpful ATM.

2015-05-11 13:12:43.312 [  TRACE]:capmt: OSCAM Spaz (local): Received message from socket 62
2015-05-11 13:12:43.312 [  TRACE]:capmt: 40 3C 6F 2B 02 00 06 10 29 8C 00 00 00 08 20 00 @<o+....)..... .
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 FE 00 00 00 FF F0 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 04 40 3C 6F 2B 02 00 07 10 29 8C 00 00 00 08 30 .@<o+....).....0
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 FE 00 00 00 FF F0 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 04 40 3C 6F 2B 02 00 08 10 29 8A 00 00 00 08 ..@<o+....).....
2015-05-11 13:12:43.312 [  TRACE]:capmt: 10 00 00 00 00 00 00 00 00 00 00 FE 00 00 00 FF ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: F0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 13:12:43.312 [  TRACE]:capmt: 00 00 04                                        ...  

is this really 3 times exactly the same request? what stuff but pid Information is included here?

#16

Updated by B C over 9 years ago

Artur Averyanikhin wrote:

a bit addition - i use sky star and ubuntu, not a linux receiver.

capmt should work as long as you are on oscam >= r10656

I also can not see any EMMs on my via card via newcamd ATM, on the other side my nagra cards are updated fine through newcamd and capmt.

#17

Updated by B C over 9 years ago

last time I'm spamming without knowing anything....

40 3C 6F 2B 02 00 06 10 29 8C 00 00 00 08 20 00 00 00 00 00 00 00 00 00 00 FE 00 00 00 FF F0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 04
40 3C 6F 2B 02 00 07 10 29 8C 00 00 00 08 30 00 00 00 00 00 00 00 00 00 00 FE 00 00 00 FF F0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 04
40 3C 6F 2B 02 00 08 10 29 8A 00 00 00 08 10 00 00 00 00 00 00 00 00 00 00 FE 00 00 00 FF F0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 04

#18

Updated by Jaroslav Kysela over 9 years ago

B C wrote:

so there is no additional "section filter" or whatever on the pid? The flags are always 0000? EMM streams are always on a single pid, so why is OSCAM opening 9 times the same pid? I tried to ask this on streamboard but unfortunately they are not very helpful ATM.
[...]

is this really 3 times exactly the same request? what stuff but pid Information is included here?

The different filters can be installed for same PID to filter out the unwanted messages. The filter contains AND mask and VALUE mask - so this expression must match - (RCVMSG & MASK) == EXPECTED_DATA . MASK and EXPECTED_DATA are values from oscam. But you should see that tvh sends some EMM messages to oscam using these filters (if the filters are not buggy).

#19

Updated by B C over 9 years ago

yes I see EMMs going through, just expect something is missing in between so that only some of the data is reaching the cards. I'll take a look at the masking

#20

Updated by Jaroslav Kysela over 9 years ago

Jaroslav Kysela wrote:

B C wrote:

so there is no additional "section filter" or whatever on the pid? The flags are always 0000? EMM streams are always on a single pid, so why is OSCAM opening 9 times the same pid? I tried to ask this on streamboard but unfortunately they are not very helpful ATM.
[...]

is this really 3 times exactly the same request? what stuff but pid Information is included here?

The different filters can be installed for same PID to filter out the unwanted messages. The filter contains AND mask and VALUE mask - so this expression must match - (RCVMSG & MASK) == EXPECTED_DATA . MASK and EXPECTED_DATA are values from oscam. But you should see that tvh sends some EMM messages to oscam using these filters (if the filters are not buggy).

Do you see "filter data sent" in log with this patch ?

diff --git a/src/descrambler/capmt.c b/src/descrambler/capmt.c
index 3124ca6..3878c7a 100644
--- a/src/descrambler/capmt.c
+++ b/src/descrambler/capmt.c
@@ -840,8 +840,10 @@ capmt_filter_data(capmt_t *capmt, uint8_t adapter, uint8_t demux_index,
   buf[4] = demux_index;
   buf[5] = filter_index;
   memcpy(buf + 6, data, len);
-  if (len - 3 == ((((uint16_t)buf[7] << 8) | buf[8]) & 0xfff))
+  if (len - 3 == ((((uint16_t)buf[7] << 8) | buf[8]) & 0xfff)) {
+    tvhtrace("capmt", "filter data sent, len %d, flags 0x%x\n", len, flags);
     capmt_queue_msg(capmt, adapter, 0, buf, len + 6, flags);
+  }
 }

 static void
#21

Updated by B C over 9 years ago

a lot of EMM message, but only a few filter data sent....
2015-05-11 15:19:57.788 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.788 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.788 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.788 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.788 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.788 [ TRACE]:descrambler: EMM message (len 15, pid 4137)
2015-05-11 15:19:57.788 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.788 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.788 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.788 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.788 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.788 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.788 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.788 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.788 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.788 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.788 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.788 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.878 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.878 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.878 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.878 [ TRACE]:descrambler: EMM message (len 15, pid 4137)
2015-05-11 15:19:57.878 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.878 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.878 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.878 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.878 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.878 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.878 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.878 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.878 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.878 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:57.878 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:58.053 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:58.053 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:19:58.053 [ TRACE]:descrambler: EMM message (len 183, pid 4137)
2015-05-11 15:19:58.506 [ TRACE]:descrambler: EMM message (len 15, pid 4137)
2015-05-11 15:19:58.566 [ TRACE]:descrambler: EMM message (len 183, pid 4137)
2015-05-11 15:19:58.595 [ TRACE]:capmt: filter data sent, len 42, flags 0x1

2015-05-11 15:19:58.595 [ TRACE]:descrambler: EMM message (len 42, pid 8160)
2015-05-11 15:19:58.595 [ TRACE]:capmt: filter data sent, len 42, flags 0x1

2015-05-11 15:19:58.595 [ TRACE]:descrambler: EMM message (len 42, pid 8161)
2015-05-11 15:19:58.595 [ TRACE]:capmt: filter data sent, len 48, flags 0x1

#22

Updated by B C over 9 years ago

well these are actually the ecm messages....

#23

Updated by B C over 9 years ago

some go through, could there be a problem with the "or" of the filter mask when adding the same pid?

2015-05-11 15:30:41.404 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:30:41.404 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:30:41.404 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:30:41.404 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:30:41.404 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:30:41.404 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:30:41.404 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:30:41.404 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:30:41.404 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:30:41.404 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:30:41.404 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:30:41.404 [ TRACE]:capmt: filter data sent, len 47, flags 0x0

2015-05-11 15:30:41.404 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:30:41.404 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:30:41.404 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:30:41.404 [ TRACE]:descrambler: EMM message (len 15, pid 4137)
2015-05-11 15:30:41.404 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:30:41.404 [ TRACE]:descrambler: EMM message (len 47, pid 4137)
2015-05-11 15:30:41.404 [ TRACE]:capmt: OSCAM Spaz (local): Sending message to socket 28 (sid 0)
2015-05-11 15:30:41.404 [ TRACE]:capmt: FF FF 00 00 00 05 8E 70 2C C4 1A 5E 00 00 04 00 .......p,..^....
2015-05-11 15:30:41.404 [ TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 15:30:41.404 [ TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 22 58 81 ............."X.
2015-05-11 15:30:41.404 [ TRACE]:capmt: F1 46 F9 4F C8 .F.O.

#24

Updated by Artur Averyanikhin over 9 years ago

My descrambler log looks similar. Does that mean, EMM are filtered?

#25

Updated by Artur Averyanikhin over 9 years ago

after an hour working no one emm send to oscam.

#26

Updated by Jaroslav Kysela over 9 years ago

  • Subject changed from 3.4: no dmm update to oscam to no emm update to oscam
#27

Updated by Jaroslav Kysela over 9 years ago

B C - could you upgrade to latest master and apply this patch?

diff --git a/src/descrambler/descrambler.c b/src/descrambler/descrambler.c
index bcf560b..9defbbf 100644
--- a/src/descrambler/descrambler.c
+++ b/src/descrambler/descrambler.c
@@ -600,6 +600,7 @@ descrambler_table_callback
                    des->number, len, mt->mt_pid);
       } else {
         tvhtrace("descrambler", "EMM message (len %d, pid %d)", len, mt->mt_pid);
+        tvhlog_hexdump("descrambler", ptr, len);
       }
     }
   }

And post the whole descrambler,capmt log until the first EMM dump.

#28

Updated by B C over 9 years ago

here we go

#29

Updated by Jaroslav Kysela over 9 years ago

Example:

2015-05-11 17:06:56.111 [  TRACE]:capmt: OSCAM Spaz (local): setting filter: adapter=2, demux=0, filter=5, pid=4137
2015-05-11 17:06:56.111 [  TRACE]:capmt: 8C 00 00 00 08 30 00 00 00 00 00 00 00 00 00 00 .....0..........
2015-05-11 17:06:56.111 [  TRACE]:capmt: FE 00 00 00 FF F0 00 00 00 00 00 00 00 00 00 00 ................
2015-05-11 17:06:56.111 [  TRACE]:capmt: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................

2015-05-11 17:06:56.260 [  TRACE]:descrambler: EMM message (len 15, pid 4137)
2015-05-11 17:06:56.260 [  TRACE]:descrambler: 8D 70 0C 90 03 04 08 21 A9 05 46 7E 46 AE 04    .p.....!..F~F.. 
EMM: 8D 70 0C 90 03 04 08 21 A9 05 46 7E 46 AE 04
EXP: 8C xx xx 00 00 00 08 30 00 00 00 00 00 00 00 00 00 00
MSK: FE xx xx 00 00 00 FF F0 00 00 00 00 00 00 00 00 00 00
RSL: OK OK OK OK OK OK OK ER OK OK OK OK OK OK OK ....

EXP - expected
MSK - mask
RSL - result
xx - extra bytes which are not in the filter data (they're ignored in the filter process)

Error explanation - (0x21 & 0xf0) = 0x20 ; 0x20 != 0x30

So, you can go through all EMMs (use all filters) in this way... It just does not match.

#30

Updated by B C over 9 years ago

well actually with the latest changes oscam is getting at least some emm updates.....
one question, is emm reassembly on capmt performed in tvheadend or not?

#31

Updated by Artur Averyanikhin over 9 years ago

Jaroslav, have you seen my descrambler,capmt logs? Should i apply a patch to?

#32

Updated by Jaroslav Kysela over 9 years ago

B C wrote:

well actually with the latest changes oscam is getting at least some emm updates.....
one question, is emm reassembly on capmt performed in tvheadend or not?

No, with capmt only the raw EMM data are sent to the oscam. The reassembling is run in cwc (newcamd).

#33

Updated by Jaroslav Kysela over 9 years ago

Artur Averyanikhin wrote:

Jaroslav, have you seen my descrambler,capmt logs? Should i apply a patch to?

No, the discussion was for capmt. For cwc (newcamd), the cwc_emm_viaccess() function must be probably updated according to oscam function viaccess_reassemble_emm().

EDIT: Just a little note - I won't work on it.

#34

Updated by Jaroslav Kysela over 9 years ago

  • Subject changed from no emm update to oscam to EMMs are not sent to oscam through cwc (recent viaccess)
#35

Updated by Artur Averyanikhin over 9 years ago

okay, will smbdy update cwc_emm_viaccess() function from your team?

#36

Updated by Artur Averyanikhin over 9 years ago

I build latest release of tvh with patch above, made a communication with oscam on dvbapi and there still no emm messages for ident 040600.

#37

Updated by Artur Averyanikhin over 9 years ago

2015-05-11 22:42:09.326 [  TRACE]:descrambler: stream key changed to even for service "Первый канал" 
2015-05-11 22:42:11.322 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:42:11.322 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:42:11.970 [  TRACE]:descrambler: Obtained keys 0000000000000000:837936324E8CD4AE from capmt-/tmp/camd.socket-0 for service "Первый канал" 
2015-05-11 22:42:19.380 [  TRACE]:descrambler: stream key changed to odd for service "Первый канал" 
2015-05-11 22:42:21.386 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:42:21.386 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:42:22.033 [  TRACE]:descrambler: Obtained keys 71D6FE4539B2200B:0000000000000000 from capmt-/tmp/camd.socket-0 for service "Первый канал" 
2015-05-11 22:42:29.404 [  TRACE]:descrambler: stream key changed to even for service "Первый канал" 
2015-05-11 22:42:31.396 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:42:31.396 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:42:32.044 [  TRACE]:descrambler: Obtained keys 0000000000000000:F0A56AFF73A9CDE9 from capmt-/tmp/camd.socket-0 for service "Первый канал" 
2015-05-11 22:42:39.434 [  TRACE]:descrambler: stream key changed to odd for service "Первый канал" 
2015-05-11 22:42:41.467 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:42:41.467 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:42:42.117 [  TRACE]:descrambler: Obtained keys 0B9242DF8A0CAB41:0000000000000000 from capmt-/tmp/camd.socket-0 for service "Первый канал" 
2015-05-11 22:42:49.519 [  TRACE]:descrambler: stream key changed to even for service "Первый канал" 
2015-05-11 22:42:51.523 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:42:51.523 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:42:52.172 [  TRACE]:descrambler: Obtained keys 0000000000000000:E9372D4DB26493A9 from capmt-/tmp/camd.socket-0 for service "Первый канал" 
2015-05-11 22:42:59.546 [  TRACE]:descrambler: stream key changed to odd for service "Первый канал" 
2015-05-11 22:43:01.610 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:43:01.610 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:43:02.259 [  TRACE]:descrambler: Obtained keys A870879FEC55B4F5:0000000000000000 from capmt-/tmp/camd.socket-0 for service "Первый канал" 
2015-05-11 22:43:09.597 [  TRACE]:descrambler: stream key changed to even for service "Первый канал" 
2015-05-11 22:43:11.633 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:43:11.633 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:43:12.280 [  TRACE]:descrambler: Obtained keys 0000000000000000:B58BD717116F4ACA from capmt-/tmp/camd.socket-0 for service "Первый канал" 
2015-05-11 22:43:19.698 [  TRACE]:descrambler: stream key changed to odd for service "Первый канал" 
2015-05-11 22:43:21.643 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:43:21.643 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:43:22.293 [  TRACE]:descrambler: Obtained keys 371B88DA4F349417:0000000000000000 from capmt-/tmp/camd.socket-0 for service "Первый канал" 
2015-05-11 22:43:29.687 [  TRACE]:descrambler: stream key changed to even for service "Первый канал" 
2015-05-11 22:43:31.675 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:43:31.675 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:43:32.322 [  TRACE]:descrambler: Obtained keys 0000000000000000:F8648CE80C8071FD from capmt-/tmp/camd.socket-0 for service "Первый канал" 
2015-05-11 22:43:39.682 [  TRACE]:descrambler: stream key changed to odd for service "Первый канал" 
2015-05-11 22:43:41.739 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:43:41.739 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:43:42.387 [  TRACE]:descrambler: Obtained keys 7F259E42B2DC018F:0000000000000000 from capmt-/tmp/camd.socket-0 for service "Первый канал" 
2015-05-11 22:43:49.778 [  TRACE]:descrambler: stream key changed to even for service "Первый канал" 
2015-05-11 22:43:51.774 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:43:51.774 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:43:52.424 [  TRACE]:descrambler: Obtained keys 0000000000000000:FC7FB732B912BB86 from capmt-/tmp/camd.socket-0 for service "Первый канал" 
2015-05-11 22:43:59.808 [  TRACE]:descrambler: stream key changed to odd for service "Первый канал" 
2015-05-11 22:44:01.822 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:44:01.822 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:44:02.469 [  TRACE]:descrambler: Obtained keys B35988944867AF5E:0000000000000000 from capmt-/tmp/camd.socket-0 for service "Первый канал" 
2015-05-11 22:44:09.927 [  TRACE]:descrambler: stream key changed to even for service "Первый канал" 
2015-05-11 22:44:11.904 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:44:11.904 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:44:12.550 [  TRACE]:descrambler: Obtained keys 0000000000000000:5463D78E6B5FD49E from capmt-/tmp/camd.socket-0 for service "Первый канал" 
2015-05-11 22:44:19.898 [  TRACE]:descrambler: stream key changed to odd for service "Первый канал" 
2015-05-11 22:44:21.949 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:44:21.950 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:44:22.599 [  TRACE]:descrambler: Obtained keys 17F1596100B4D589:0000000000000000 from capmt-/tmp/camd.socket-0 for service "Первый канал" 
2015-05-11 22:44:30.002 [  TRACE]:descrambler: stream key changed to even for service "Первый канал" 
2015-05-11 22:44:32.001 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:44:32.001 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:44:32.650 [  TRACE]:descrambler: Obtained keys 0000000000000000:8BDF117BE8C314BF from capmt-/tmp/camd.socket-0 for service "Первый канал" 
2015-05-11 22:44:40.098 [  TRACE]:descrambler: stream key changed to odd for service "Первый канал" 
2015-05-11 22:44:42.095 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:44:42.095 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:44:42.743 [  TRACE]:descrambler: Obtained keys B146847BB8853B78:0000000000000000 from capmt-/tmp/camd.socket-0 for service "Первый канал" 
2015-05-11 22:44:50.130 [  TRACE]:descrambler: stream key changed to even for service "Первый канал" 
2015-05-11 22:44:52.132 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:44:52.132 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:44:52.780 [  TRACE]:descrambler: Obtained keys 0000000000000000:EF723C9DE24BCBF8 from capmt-/tmp/camd.socket-0 for service "Первый канал" 
2015-05-11 22:45:00.141 [  TRACE]:descrambler: stream key changed to odd for service "Первый канал" 
2015-05-11 22:45:02.163 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:45:02.163 [  TRACE]:descrambler: ECM message (section 144, len 96, pid 4006) for service "Первый канал" 
2015-05-11 22:45:02.809 [  TRACE]:descrambler: Obtained keys AFB94CB4FE7B9E17:0000000000000000 from capmt-/tmp/camd.socket-0 for service "Первый канал" 

#38

Updated by Artur Averyanikhin over 9 years ago

Who will work on this ticket later?

#39

Updated by Jaroslav Kysela over 9 years ago

For capmt (dvbapi in oscam), oscam requests data - so it's oscam's fault if EMMs are not passed/evaluated.

For cwc (newcamd) - apply the patch bellow and provide descrambler,cwc traces.

diff --git a/src/descrambler/cwc.c b/src/descrambler/cwc.c
index 7361b67..d81ab7d 100644
--- a/src/descrambler/cwc.c
+++ b/src/descrambler/cwc.c
@@ -1503,6 +1503,9 @@ cwc_emm_viaccess(cwc_t *cwc, struct cs_card_data *pcard, const uint8_t *data, in
   /* Get SCT len */
   int len = 3 + ((data[1] & 0x0f) << 8) + data[2];

+  tvhtrace("cwc", "viaccess EMM dump");
+  tvhlog_hexdump("cwc", data, mlen);
+
   switch (data[0])
     {
     case 0x8c:
@@ -1514,6 +1517,7 @@ cwc_emm_viaccess(cwc_t *cwc, struct cs_card_data *pcard, const uint8_t *data, in

       /* Match provider id */
       id = via_provider_id(data);
+      tvhtrace("cwc", "provider id: 0x%x", id);
       if (!id) break;

       for(i = 0; i < pcard->cwc_num_providers; i++)
@@ -1522,8 +1526,10 @@ cwc_emm_viaccess(cwc_t *cwc, struct cs_card_data *pcard, const uint8_t *data, in
           break;
         }
       if (!match) break;
+      tvhtrace("cwc", "match ok");

       if (data[0] != cwc->cwc_viaccess_emm.shared_toggle) {
+        tvhtrace("cwc", "toggle ok");
         cwc->cwc_viaccess_emm.shared_len = 0;
         free(cwc->cwc_viaccess_emm.shared_emm);
         cwc->cwc_viaccess_emm.shared_emm = (uint8_t*)malloc(len);
@@ -1551,6 +1557,8 @@ cwc_emm_viaccess(cwc_t *cwc, struct cs_card_data *pcard, const uint8_t *data, in
         }
         if (!match) break;

+        tvhtrace("cwc", "match ok 2");
+
         uint8_t * tmp = alloca(len + cwc->cwc_viaccess_emm.shared_len);
         const uint8_t * ass = nano_start(data);
         len -= (ass - data);
@@ -1574,6 +1582,7 @@ cwc_emm_viaccess(cwc_t *cwc, struct cs_card_data *pcard, const uint8_t *data, in
         if(ass2) {
           uint32_t crc;

+          tvhtrace("cwc", "ass2 ok 2");
           memcpy(ass2, data, 7);
           if (sort_nanos(ass2 + 7, tmp, len))
             return;
#41

Updated by Artur Averyanikhin over 9 years ago

done

#42

Updated by B C over 9 years ago

I hopefully will be able to do some logging this weekend and compare local dvbapi dreambox updates with tvheadends, this should help us a lot. I did my card update on my dreambox without problems, so we should be able to find out whats missing.
BTW, Artur, did you disable emmreassembly on the oscam user CWC client connects to? I get partitial EMMs from tvheadend through newcamd, but they seem to be incomplete --> non makes it through to the card as they all get dropped during validation. For another provider I get full EMMs and the card is updated fine.

#43

Updated by Artur Averyanikhin over 9 years ago

B C, yeah, i tried to disable emmreassembly on oscam side since Jaroslav posted that dvbapi send raw emm to oscam, and cwc send reassembled. That was helpless.

#44

Updated by Artur Averyanikhin over 9 years ago

Now i'm getting partial emms from tvh through dvbapi.

#45

Updated by Artur Averyanikhin over 9 years ago

 SmartReader [viaccess] EMM: SHARED (part)
2015/05/13 12:04:23  1D0D590 c      (emm) emm:
2015/05/13 12:04:23  1D0D590 c      (emm)   8D 70 30 90 03 04 06 01 91 08 B5 51 EE 7D ED BB 
2015/05/13 12:04:23  1D0D590 c      (emm)   76 32 92 08 6C B5 AB 52 47 C7 02 0A 81 15 5D 05 
2015/05/13 12:04:23  1D0D590 c      (emm)   9E 3A 37 13 34 4B BF E2 A8 77 FE B0 B7 27 D3 7A 
2015/05/13 12:04:23  1D0D590 c      (emm)   47 AB CC 
2015/05/13 12:04:23  1D0D590 c   (reader) SmartReader [viaccess] EMM: reader provid FFF500 no match with emm provid 040600 -> SKIP!
2015/05/13 12:04:23  1D0D590 c   (reader) SmartReader [viaccess] EMM: reader provid 040600 matching with emm provid 040600 -> SEND!
2015/05/13 12:04:23  1D0D590 c   (reader) SmartReader [viaccess] EMM: Entered viaccess_get_emm_type ep->emm[0]=8d
2015/05/13 12:04:23  1D0D590 c   (reader) SmartReader [viaccess] EMM: SHARED (part)
2015/05/13 12:04:23  1D0D590 c      (emm) emm:
2015/05/13 12:04:23  1D0D590 c      (emm)   8D 70 30 90 03 04 06 01 91 08 B5 51 EE 7D ED BB 
2015/05/13 12:04:23  1D0D590 c      (emm)   76 32 92 08 6C B5 AB 52 47 C7 02 0A 81 15 5D 05 
2015/05/13 12:04:23  1D0D590 c      (emm)   9E 3A 37 13 34 4B BF E2 A8 77 FE B0 B7 27 D3 7A 
2015/05/13 12:04:23  1D0D590 c      (emm)   47 AB CC 
2015/05/13 12:04:23  1D0D590 c   (reader) SmartReader [viaccess] EMM: reader provid FFF500 no match with emm provid 040600 -> SKIP!
2015/05/13 12:04:23  1D0D590 c   (reader) SmartReader [viaccess] EMM: reader provid 040600 matching with emm provid 040600 -> SEND!
2015/05/13 12:04:23  1D0D590 c   (reader) SmartReader [viaccess] EMM: Entered viaccess_get_emm_type ep->emm[0]=8d
2015/05/13 12:04:23  1D0D590 c   (reader) SmartReader [viaccess] EMM: SHARED (part)
2015/05/13 12:04:23  1D00580 r   (reader) SmartReader [viaccess] cardreader_do_checkhealth: reader->card_status = 2, ret = 1
2015/05/13 12:04:24  1D0D590 c      (emm)   28 
2015/05/13 12:04:24  1D0D590 c   (reader) SmartReader [viaccess] EMM: reader provid FFF500 no match with emm provid 040600 -> SKIP!
2015/05/13 12:04:24  1D0D590 c   (reader) SmartReader [viaccess] EMM: reader provid 040600 matching with emm provid 040600 -> SEND!
2015/05/13 12:04:24  1D0D590 c   (reader) SmartReader [viaccess] EMM: Entered viaccess_get_emm_type ep->emm[0]=8c
2015/05/13 12:04:24  1D0D590 c   (reader) SmartReader [viaccess] EMM: SHARED (part)
2015/05/13 12:04:24  1D0D590 c      (emm) emm:
2015/05/13 12:04:24  1D0D590 c      (emm)   8C 70 2E 90 03 04 06 01 91 08 74 3D 4E 32 59 4A 
2015/05/13 12:04:24  1D0D590 c      (emm)   0C 70 92 08 1D 38 E8 23 39 FB E9 02 81 13 63 85 
2015/05/13 12:04:24  1D0D590 c      (emm)   5E 24 F8 58 45 DB 4B BB AC DB 3D C2 1A 5F 55 DF 
2015/05/13 12:04:24  1D0D590 c      (emm)   28 
2015/05/13 12:04:24  1D0D590 c   (reader) SmartReader [viaccess] EMM: reader provid FFF500 no match with emm provid 040600 -> SKIP!
2015/05/13 12:04:24  1D0D590 c   (reader) SmartReader [viaccess] EMM: reader provid 040600 matching with emm provid 040600 -> SEND!
2015/05/13 12:04:24  1D0D590 c   (reader) SmartReader [viaccess] EMM: Entered viaccess_get_emm_type ep->emm[0]=8c
2015/05/13 12:04:24  1D0D590 c   (reader) SmartReader [viaccess] EMM: SHARED (part)
2015/05/13 12:04:24  1D0D590 c      (emm) emm:
2015/05/13 12:04:24  1D0D590 c      (emm)   8C 70 2E 90 03 04 06 01 91 08 74 3D 4E 32 59 4A 
2015/05/13 12:04:24  1D0D590 c      (emm)   0C 70 92 08 1D 38 E8 23 39 FB E9 02 81 13 63 85 
2015/05/13 12:04:24  1D0D590 c      (emm)   5E 24 F8 58 45 DB 4B BB AC DB 3D C2 1A 5F 55 DF 
2015/05/13 12:04:24  1D0D590 c      (emm)   28 
2015/05/13 12:04:24  1D0D590 c   (reader) SmartReader [viaccess] EMM: reader provid FFF500 no match with emm provid 040600 -> SKIP!
2015/05/13 12:04:24  1D0D590 c   (reader) SmartReader [viaccess] EMM: reader provid 040600 matching with emm provid 040600 -> SEND!
2015/05/13 12:04:24  1D0D590 c   (reader) SmartReader [viaccess] EMM: Entered viaccess_get_emm_type ep->emm[0]=8c
2015/05/13 12:04:24  1D0D590 c   (reader) SmartReader [viaccess] EMM: SHARED (part)
2015/05/13 12:04:24  1D0D590 c      (emm) emm:
#46

Updated by B C over 9 years ago

for dvbapi you must have reassembling on, just to make sure....

#47

Updated by Artur Averyanikhin over 9 years ago

just mentioned, that latest tvh from master brunch fails on multi streams. I use such script to get a multiple transcoding and send traffic through internet:

#!/bin/bash

_PLAYLIST=r2r-stream.m3u8
_SRC=http://USER:[email protected]:9981/playlist/channels
_TRCD="#transcode{vcodec=h264,vb=800,width=640,height=480,acodec=mp3,ab=128,channels=2,samplerate=44100}:http{mux=ffmpeg{mux=flv},dst=" 
_CAST="#transcode{vcodec=theo,vb=800,scale=Auto,acodec=vorb,ab=128,channels=2,samplerate=44100}:std{access=shout,mux=ogg,dst=source:[email protected]:8000/streaming}" 
#_TRCD="#transcode{vcodec=h264,vb=800,scale=Auto,width=640,height=480,acodec=mp3,ab=128,channels=2,samplerate=44100}:rtp{sdp=rtsp://:1234}" 

function param_stop {
    for i in `ps -lax | grep vlc | awk '{print $3}'`
    do
        kill -9 ${i} 2>/dev/null
    done
    exit 0
}

if [ "$1" == "stop" ]
then
    param_stop
fi

j=10000
echo "#EXTM3U" > ${_PLAYLIST}
wget ${_SRC}
cat channels | sed "s/ /_/g" | sed "s/,/ /g" > channels.mod || exit 1
for i in `cat channels.mod | grep EXTINF | awk '{print $2}'`
do
    _OPT=`cat channels.mod | grep -w -A 1 $i | tail -n 1`
#    echo ${_OPT}
    if wget -q -t1 --spider ${_OPT}
        then
                vlc -I dummy ${_OPT} --sout ${_TRCD}:${j}} --sout-keep 2>/dev/null &
        _state=`echo $?`
        if [ "${_state}" == "0" ]
            then echo "#EXTINF:-1,${i}" >> ${_PLAYLIST}
                echo "http://10.8.0.1:${j}" >> ${_PLAYLIST}
                j=$((${j}+1))
        fi
    else
        echo $i not responding
    fi
#    sleep 1
done
rm -f channels*

So on stable versions it works, providing playlist, on current dev version, I get streams, but they are not working.

#48

Updated by Artur Averyanikhin over 9 years ago

it's just of topic. I'm not shure it's a bug

#50

Updated by B C over 9 years ago

this one does not build......

src/descrambler/cwc.c:1553:11: error: unknown type name ‘u8’
u8 buf6;
^
src/descrambler/cwc.c:1556:32: error: macro "tvhlog_hexdump" requires 3 arguments, but only 2 given
tvhlog_hexdump(buf, 6);

#51

Updated by B C over 9 years ago

1554: uint8_t buf6;
1556: tvhlog_hexdump("cwc",buf, 6);

#52

Updated by Artur Averyanikhin over 9 years ago

Strange thing. XBMC client gets full band stream. VLC transcoding over http, runs on the same transponder runs times less. s result there no possibility to get mpeg stream over http. Any ideas?

#53

Updated by Artur Averyanikhin over 9 years ago

Jaroslav Kysela wrote:

Another patch to dump more using cwc: https://github.com/perexg/tvheadend/commit/f649d21a166554c5e4afdddbb10d6d35baed94f9

patch  cwc.c patch 
(Patch is indented 1 space.)
patching file cwc.c
Hunk #1 FAILED at 1514.
Hunk #2 FAILED at 1522.
Hunk #3 FAILED at 1542.
Hunk #4 FAILED at 1551.
Hunk #5 FAILED at 1574.
5 out of 5 hunks FAILED -- saving rejects to file cwc.c.rej

am i doing write? can't patch file. Latest tvh from master.

#54

Updated by Artur Averyanikhin over 9 years ago

*write -> right =)

#55

Updated by B C over 9 years ago

checkout perexg via branch

#56

Updated by B C over 9 years ago

oscam logs added from dreambox and tvh. db succeeds, tvh no update

#57

Updated by Jaroslav Kysela over 9 years ago

Missing full emm dump for 8C .. B C - could you repeat same steps as for tvheadend.log in comment#56 (same EMM PID 1029 - same mux, same service), but provide the tvheadend log (not oscam log) using the patch from comment#27 to dump the whole EMM message ?

My comments, dreambox ok:

2015/05/13 21:33:53   563070 c   (dvbapi) Demuxer 0 Filter 3 started successfully (caid 0500 provid 040820 pid 1029)
2015/05/13 21:33:53   563070 c   (dvbapi) Demuxer 0 Filter 3 added to active emmfilters (CAID 0500 PROVID 040820 EMMPID 1029)
2015/05/13 21:33:53   563070 c   (dvbapi) Demuxer 0 started emm filter type SHARED, pid: 0x1029
2015/05/13 21:33:53   563070 c   (dvbapi)   8E C4 1A 5E 00 00 00 00 00 00 00 00 00 00 00 00 
2015/05/13 21:33:53   563070 c   (dvbapi)   FF FF FF FF 00 00 00 00 00 00 00 00 00 00 00 00 
2015/05/13 21:33:53   563070 c   (dvbapi) Demuxer 0 reader srg-int emmfilter 3/10 type match -> ENABLE!
2015/05/13 21:33:53   563070 c   (dvbapi) Open device /dev/dvb/adapter0/demux0 (fd 17)
2015/05/13 21:33:53   563070 c   (dvbapi) Demuxer 0 Filter 4 started successfully (caid 0500 provid 040820 pid 1029)
2015/05/13 21:33:53   563070 c   (dvbapi) Demuxer 0 Filter 4 added to active emmfilters (CAID 0500 PROVID 040820 EMMPID 1029)
2015/05/13 21:33:53   563070 c   (dvbapi) Demuxer 0 started emm filter type SHARED, pid: 0x1029
2015/05/13 21:33:53   563070 c   (dvbapi)   8C 00 00 00 08 20 00 00 00 00 00 00 00 00 00 00 
2015/05/13 21:33:53   563070 c   (dvbapi)   FE 00 00 00 FF F0 00 00 00 00 00 00 00 00 00 00 

2015/05/13 21:33:53   563070 c   (dvbapi) Demuxer 0 Filter 4 fetched emm data
2015/05/13 21:33:53   563070 c      (emm) emm:
2015/05/13 21:33:53   563070 c      (emm)   8C 70 0C 90 03 04 08 21 A9 05 46 86 46 B5 04 
2015/05/13 21:33:53   563070 c   (reader) srg-int [viaccess] EMM: reader provid FFF430 no match with emm provid 040820 -> SKIP!
2015/05/13 21:33:53   563070 c   (reader) srg-int [viaccess] EMM: reader provid 040810 no match with emm provid 040820 -> SKIP!
2015/05/13 21:33:53   563070 c   (reader) srg-int [viaccess] EMM: reader provid 040820 matching with emm provid 040820 -> SEND!
2015/05/13 21:33:53   563070 c   (reader) srg-int [viaccess] EMM: Entered viaccess_get_emm_type ep->emm[0]=8c
2015/05/13 21:33:53   563070 c   (reader) srg-int [viaccess] EMM: SHARED (part)
2015/05/13 21:33:53   563070 c   (reader) srg-int [viaccess] EMM: viaccess_reassemble_emm: received fresh emm-gh for provid 040820
2015/05/13 21:33:53   563070 c   (reader)   8C 70 0C 90 03 04 08 21 A9 05 46 86 46 B5 04 

... no filter3 EMMs ...

tvheadend fail:

2015/05/13 21:50:51   562D20 c   (dvbapi) Demuxer 0 Filter 3 started successfully (caid 0500 provid 040820 pid 1029)
2015/05/13 21:50:51   562D20 c   (dvbapi) Demuxer 0 Filter 3 added to active emmfilters (CAID 0500 PROVID 040820 EMMPID 1029)
2015/05/13 21:50:51   562D20 c   (dvbapi) Demuxer 0 started emm filter type SHARED, pid: 0x1029
2015/05/13 21:50:51   562D20 c   (dvbapi)   8E C4 1A 5E 00 00 00 00 00 00 00 00 00 00 00 00 
2015/05/13 21:50:51   562D20 c   (dvbapi)   FF FF FF FF 00 00 00 00 00 00 00 00 00 00 00 00 
2015/05/13 21:50:51   562D20 c   (dvbapi) Demuxer 0 reader srg-int emmfilter 3/10 type match -> ENABLE!
2015/05/13 21:50:51   562D20 c   (dvbapi) Sending packet to dvbapi client (fd=13):
2015/05/13 21:50:51   562D20 c   (dvbapi)   40 3C 6F 2B 02 00 03 10 29 8C 00 00 00 08 20 00 
2015/05/13 21:50:51   562D20 c   (dvbapi)   00 00 00 00 00 00 00 00 00 FE 00 00 00 FF F0 00 
2015/05/13 21:50:51   562D20 c   (dvbapi)   00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 
2015/05/13 21:50:51   562D20 c   (dvbapi)   00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 
2015/05/13 21:50:51   562D20 c   (dvbapi)   04 
2015/05/13 21:50:51   562D20 c   (dvbapi) Demuxer 0 Filter 4 started successfully (caid 0500 provid 040820 pid 1029)
2015/05/13 21:50:51   562D20 c   (dvbapi) Demuxer 0 Filter 4 added to active emmfilters (CAID 0500 PROVID 040820 EMMPID 1029)
2015/05/13 21:50:51   562D20 c   (dvbapi) Demuxer 0 started emm filter type SHARED, pid: 0x1029
2015/05/13 21:50:51   562D20 c   (dvbapi)   8C 00 00 00 08 20 00 00 00 00 00 00 00 00 00 00 
2015/05/13 21:50:51   562D20 c   (dvbapi)   FE 00 00 00 FF F0 00 00 00 00 00 00 00 00 00 00 

2015/05/13 21:51:22   562D20 c   (dvbapi) Demuxer 0 Filter 3 fetched emm data
2015/05/13 21:51:22   562D20 c      (emm) emm:
2015/05/13 21:51:22   562D20 c      (emm)   8E 70 2C C4 1A 5E 00 00 00 00 00 00 00 00 00 00 
2015/05/13 21:51:22   562D20 c      (emm)   60 00 00 00 00 00 00 00 00 00 00 00 00 01 FF FF 
2015/05/13 21:51:22   562D20 c      (emm)   FF 5F FF FF FE 7F FF 02 B1 FC 60 FA 8A 36 86 
2015/05/13 21:51:22   562D20 c   (reader) srg-int [viaccess] EMM: reader provid FFF430 no match with emm provid 040820 -> SKIP!
2015/05/13 21:51:22   562D20 c   (reader) srg-int [viaccess] EMM: reader provid 040810 no match with emm provid 040820 -> SKIP!
2015/05/13 21:51:22   562D20 c   (reader) srg-int [viaccess] EMM: reader provid 040820 matching with emm provid 040820 -> SEND!
2015/05/13 21:51:22   562D20 c   (reader) srg-int [viaccess] EMM: Entered viaccess_get_emm_type ep->emm[0]=8e
2015/05/13 21:51:22   562D20 c   (reader) srg-int [viaccess] EMM: SHARED

no filter4 activity
#58

Updated by B C over 9 years ago

sure, attached log is based on latest master

Thanks for trying to sort this out

#59

Updated by Jaroslav Kysela over 9 years ago

B C wrote:

sure, attached log is based on latest master

Thanks for trying to sort this out

It seems like a different mux - the logs in comment#56 are for pid 1029 not for pid 4099.

#60

Updated by B C over 9 years ago

actually there are a few CAIDs on this TS, it is the same mux, see log line below

2015-05-15 11:02:06.405 [ TRACE]:descrambler: mux 0x3d76c20 open pid 1029 (4137) (flags 0x0000) for 0x430a600

#61

Updated by Jaroslav Kysela over 9 years ago

The problem is that there are no EMMs received for pid 0x1029.

Could you add also this and add linuxdvb to trace subsystems:

diff --git a/src/input/mpegts/linuxdvb/linuxdvb_frontend.c b/src/input/mpegts/linuxdvb/linuxdvb_frontend.c
index 1b20206..4abbb67 100644
--- a/src/input/mpegts/linuxdvb/linuxdvb_frontend.c
+++ b/src/input/mpegts/linuxdvb/linuxdvb_frontend.c
@@ -855,6 +855,7 @@ linuxdvb_frontend_close_pid0
           pids_size--, pids++);
   if (pids_size == 0)
     return;
+  tvhtrace("linuxdvb", "%s - close PID %04X (%d) fd %d\n", name, pid, pid, pids->fd);
   close(pids->fd);
   pids->fd = -1;
   pids->pid = -1;
#62

Updated by B C over 9 years ago

this no filter traffic at all stuff might have been introduced recently.....

#63

Updated by Jaroslav Kysela over 9 years ago

Add 'emm' and 'mpegts' to the trace subsystems, too.... It seems that the issue is not in the descrambler.

#64

Updated by Jaroslav Kysela over 9 years ago

Also add this debug lines to code:

diff --git a/src/input/mpegts/linuxdvb/linuxdvb_frontend.c b/src/input/mpegts/linuxdvb/linuxdvb_frontend.c
index 4abbb67..87f34ab 100644
--- a/src/input/mpegts/linuxdvb/linuxdvb_frontend.c
+++ b/src/input/mpegts/linuxdvb/linuxdvb_frontend.c
@@ -382,6 +382,7 @@ linuxdvb_frontend_update_pids
   }
   pthread_mutex_unlock(&lfe->lfe_dvr_lock);

+  tvhinfo("linuxdvb", "update pids notify");
   tvh_write(lfe->lfe_dvr_pipe.wr, "c", 1);
 }

@@ -879,10 +880,17 @@ linuxdvb_update_pids ( linuxdvb_frontend_t *lfe, const char *name,
   mpegts_apids_t wpid, padd, pdel;
   int i, max = MAX(16, lfe->lfe_pids_max);

+  tvhinfo("linuxdvb", "update pids called");
+
   pthread_mutex_lock(&lfe->lfe_dvr_lock);

   if (!lfe->lfe_pids.all) {
     mpegts_pid_weighted(&wpid, &lfe->lfe_pids, max);
+    {
+      char buf[512];
+      mpegts_pid_dump(&wpid, buf, sizeof(buf), 0, 0);
+      tvhinfo("linuxdvb", "wpids %s", buf);
+    }
     mpegts_pid_compare(&wpid, tuned, &padd, &pdel);
     mpegts_pid_done(&wpid);
     for (i = 0; i < pdel.count; i++)
#65

Updated by B C over 9 years ago

here we go

#66

Updated by Jaroslav Kysela over 9 years ago

Thanks. It should be fixed in v4.1-2-gcef2062

#67

Updated by B C over 9 years ago

YES, seems to be fixed now, I see updates on my card through capmt, new keys should be sent on may 21, than it will be certai.
Thanky you as always for your great support and deep bug digging.

#68

Updated by B C over 9 years ago

I'm not sure if this is fixed for newcamd as well, have to take a look at my config later, currently I do not get any updates through cwc client.

#69

Updated by Jaroslav Kysela over 9 years ago

I updated my via branch for cwc - https://github.com/perexg/tvheadend/tree/via - with the debugging code if cwc does not work. Please, use this code and show me the EMMs sent..

#70

Updated by B C over 9 years ago

log attached, in oscam arrive just 3 incomplete/wrong emms, the rest is filtered on tvh's cw emm cache side???

this is all from oscams log of this try:

2015/05/15 17:23:28   D740A0 c      (emm) emm:
2015/05/15 17:23:28   D740A0 c      (emm)   8E 70 3C C4 1A 5E 00 90 03 04 08 21 9E 20 00 00 
2015/05/15 17:23:28   D740A0 c      (emm)   00 00 00 00 00 00 00 60 00 00 00 00 00 00 00 00 
2015/05/15 17:23:28   D740A0 c      (emm)   00 00 00 00 01 FF FF FF 5F FF FF FE 7F FF A9 05 
2015/05/15 17:23:28   D740A0 c      (emm)   46 8D 46 BC 04 F0 08 02 B1 FC 60 FA 8A 36 86 
2015/05/15 17:23:28   D740A0 c   (reader) srg [viaccess] EMM: reader 0500 match since emmpid has no provid -> SEND!
2015/05/15 17:23:28   D740A0 c   (reader) srg [viaccess] EMM: Entered viaccess_get_emm_type ep->emm[0]=8e
2015/05/15 17:23:28   D740A0 c   (reader) srg [viaccess] EMM: SHARED
2015/05/15 17:23:31   D740A0 c      (emm) emm:
2015/05/15 17:23:31   D740A0 c      (emm)   8E 70 3C C4 1A 5E 00 90 03 04 08 21 9E 20 FF FB 
2015/05/15 17:23:31   D740A0 c      (emm)   FF FB FF FF FF FF 7F 9F FF FF FF 7F FF FF FF FF 
2015/05/15 17:23:31   D740A0 c      (emm)   BF FF DF 7F BE 00 00 00 00 00 00 00 00 00 A9 05 
2015/05/15 17:23:31   D740A0 c      (emm)   46 90 46 BF 04 F0 08 F7 E0 DA EC B8 90 31 47 
2015/05/15 17:23:31   D740A0 c   (reader) srg [viaccess] EMM: reader 0500 match since emmpid has no provid -> SEND!
2015/05/15 17:23:31   D740A0 c   (reader) srg [viaccess] EMM: Entered viaccess_get_emm_type ep->emm[0]=8e
2015/05/15 17:23:31   D740A0 c   (reader) srg [viaccess] EMM: SHARED
2015/05/15 17:23:32   D740A0 c      (ecm) tvheadend (0500&040820/28E2/0000/1260/2A:491556B4D86DD71C37BCDED1BAA96DD0): found (202 ms) by srg
2015/05/15 17:23:38   D740A0 c      (emm) emm:
2015/05/15 17:23:38   D740A0 c      (emm)   8E 70 3C C4 1A 5E 00 90 03 04 08 21 9E 20 00 04 
2015/05/15 17:23:38   D740A0 c      (emm)   00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 
2015/05/15 17:23:38   D740A0 c      (emm)   00 00 00 00 00 00 00 00 00 00 00 00 00 00 A9 05 
2015/05/15 17:23:38   D740A0 c      (emm)   46 94 46 C4 04 F0 08 22 58 81 F1 46 F9 4F C8 
2015/05/15 17:23:38   D740A0 c   (reader) srg [viaccess] EMM: reader 0500 match since emmpid has no provid -> SEND!
2015/05/15 17:23:38   D740A0 c   (reader) srg [viaccess] EMM: Entered viaccess_get_emm_type ep->emm[0]=8e
2015/05/15 17:23:38   D740A0 c   (reader) srg [viaccess] EMM: SHARED

#71

Updated by Jaroslav Kysela over 9 years ago

This looks like an old log for capmt... EDIT: Nope, wrong file...

#72

Updated by Jaroslav Kysela over 9 years ago

I don't see anything wrong in the logic. Why you think that the messages are incomplete ? Note that they are reassemmbled. Also, I don't know the expected EMM traffic.

#73

Updated by B C over 9 years ago

they are not passed to the reader (this is missing from oscams log). Actually the expected EMM traffic is in dreambox.log, they should be the same

#74

Updated by B C over 9 years ago

8C and 8D EMMs are missing

2015/05/13 21:34:02   563070 c      (emm) emm:
2015/05/13 21:34:02   563070 c      (emm)   8E 70 2C C4 1A 5E 00 00 00 00 00 00 00 00 00 00 
2015/05/13 21:34:02   563070 c      (emm)   60 00 00 00 00 00 00 00 00 00 00 00 00 01 FF FF 
2015/05/13 21:34:02   563070 c      (emm)   FF 5F FF FF FE 7F FF 02 B1 FC 60 FA 8A 36 86 
2015/05/13 21:34:02   563070 c   (reader) srg-int [viaccess] EMM: reader provid FFF430 no match with emm provid 040820 -> SKIP!
2015/05/13 21:34:02   563070 c   (reader) srg-int [viaccess] EMM: reader provid 040810 no match with emm provid 040820 -> SKIP!
2015/05/13 21:34:02   563070 c   (reader) srg-int [viaccess] EMM: reader provid 040820 matching with emm provid 040820 -> SEND!
2015/05/13 21:34:02   563070 c   (reader) srg-int [viaccess] EMM: Entered viaccess_get_emm_type ep->emm[0]=8e
2015/05/13 21:34:02   563070 c   (reader) srg-int [viaccess] EMM: SHARED
2015/05/13 21:34:02   563070 c   (reader) srg-int [viaccess] EMM: viaccess_reassemble_emm: start extracting nanos
2015/05/13 21:34:02   563070 c   (reader) srg-int [viaccess] EMM: viaccess_reassemble_emm: fixed emm-s
2015/05/13 21:34:02   563070 c   (reader)   8E 70 2C C4 1A 5E 00 00 00 00 00 00 00 00 00 00 
2015/05/13 21:34:02   563070 c   (reader)   60 00 00 00 00 00 00 00 00 00 00 00 00 01 FF FF 
2015/05/13 21:34:02   563070 c   (reader)   FF 5F FF FF FE 7F FF 02 B1 FC 60 FA 8A 36 86 
2015/05/13 21:34:02   563070 c   (reader) srg-int [viaccess] EMM: viaccess_reassemble_emm: emm-gh provid 040820
2015/05/13 21:34:02   563070 c   (reader)   8C 70 0C 90 03 04 08 21 A9 05 46 8B 46 BA 04 
2015/05/13 21:34:02   563070 c   (reader) srg-int [viaccess] EMM: viaccess_reassemble_emm: assembled emm
2015/05/13 21:34:02   563070 c   (reader)   8E 70 3C C4 1A 5E 00 90 03 04 08 21 9E 20 00 00 
2015/05/13 21:34:02   563070 c   (reader)   00 00 00 00 00 00 00 60 00 00 00 00 00 00 00 00 
2015/05/13 21:34:02   563070 c   (reader)   00 00 00 00 01 FF FF FF 5F FF FF FE 7F FF A9 05 
2015/05/13 21:34:02   563070 c   (reader)   46 8B 46 BA 04 F0 08 02 B1 FC 60 FA 8A 36 86 
2015/05/13 21:34:02   563070 c   (reader) srg-int [viaccess] EMM: emmtype shared. Reader serial ################.
2015/05/13 21:34:02   563070 c   (reader) srg-int [viaccess] EMM: emm UA/SA: ################.
2015/05/13 21:34:02   563070 c   (reader) srg-int [viaccess] EMM: emm is being sent to reader
2015/05/13 21:34:02   563070 c   (dvbapi) Demuxer 0 Filter 4 fetched emm data
2015/05/13 21:34:02   563070 c      (emm) emm:
2015/05/13 21:34:02   563070 c      (emm)   8D 70 0C 90 03 04 08 21 A9 05 46 8D 46 BC 04 
#75

Updated by Jaroslav Kysela over 9 years ago

B C wrote:

8C and 8D EMMs are missing

[...]

Thanks correct 8C and 8D is merged with 8E and only whole reassembled EMM (8C + 8E or 8D + 8E) is sent through newcamd to oscam.

#76

Updated by Jaroslav Kysela over 9 years ago

You may look to https://github.com/tvheadend/tvheadend/blob/master/src/descrambler/cwc.c#L1500-L1603 for details. See that EMM is sent only from the 0x8E block..

#77

Updated by B C over 9 years ago

oscam's own reassemble
2015/05/13 21:34:02   563070 c   (reader)   8E 70 3C C4 1A 5E 00 90 03 04 08 21 9E 20 00 00 
2015/05/13 21:34:02   563070 c   (reader)   00 00 00 00 00 00 00 60 00 00 00 00 00 00 00 00 
2015/05/13 21:34:02   563070 c   (reader)   00 00 00 00 01 FF FF FF 5F FF FF FE 7F FF A9 05 
2015/05/13 21:34:02   563070 c   (reader)   46 *8B* 46 *BA* 04 F0 08 02 B1 FC 60 FA 8A 36 86

tvh's reassemble
2015/05/15 17:23:28   D740A0 c      (emm)   8E 70 3C C4 1A 5E 00 90 03 04 08 21 9E 20 00 00 
2015/05/15 17:23:28   D740A0 c      (emm)   00 00 00 00 00 00 00 60 00 00 00 00 00 00 00 00 
2015/05/15 17:23:28   D740A0 c      (emm)   00 00 00 00 01 FF FF FF 5F FF FF FE 7F FF A9 05 
2015/05/15 17:23:28   D740A0 c      (emm)   46 *8D* 46 *BC* 04 F0 08 02 B1 FC 60 FA 8A 36 86 

for a timestam to less has changed, for a shared group, I don't know :-), but maybe I'm completely off track....
#78

Updated by Jaroslav Kysela over 9 years ago

B C wrote:

[...]
for a timestam to less has changed, for a shared group, I don't know :-), but maybe I'm completely off track....

It's difficult to say if it's a problem without seeing the raw (before processing/reassembling) EMM data. TVH cwc code has also EMM cache, so only unique EMMs will be forwarded to oscam. I would test it for awhile.

#79

Updated by Jaroslav Kysela over 9 years ago

Perhaps Arthur may give a test also, because he has another provider id..

#80

Updated by B C over 9 years ago

Jaroslav Kysela wrote:

B C wrote:

[...]
for a timestam to less has changed, for a shared group, I don't know :-), but maybe I'm completely off track....

It's difficult to say if it's a problem without seeing the raw (before processing/reassembling) EMM data. TVH cwc code has also EMM cache, so only unique EMMs will be forwarded to oscam. I would test it for awhile.

well raw data is in dreambox.log and should be in tvhcwc.log also, I'll extract it later.

#81

Updated by Artur Averyanikhin over 9 years ago

Hi guys!

Sorry had a work.

Updated to the last master, applied all patches, add desc,cwc,linuxdvb to trace. Here we go:

#82

Updated by Artur Averyanikhin over 9 years ago

after update have successful multi streaming via internet using VLC transcoding like in #47. Jaroslav, did you fix anything? With last version i was not able to use multistream.

#83

Updated by B C over 9 years ago

so is your card updating now?
a) via capmt
b) via newcamd

#84

Updated by Artur Averyanikhin over 9 years ago

My card updated via capmt. There was 3 EMM received.
I don't know how to delete those emma, so don't know is it updating via newcamcd..
There is two options: 1) delete emms somehow, 2) wage until june 1st, when new period started and new emma will be send.

#85

Updated by Artur Averyanikhin over 9 years ago

Current oscam.log

#86

Updated by B C over 9 years ago

Artur Averyanikhin wrote:

My card updated via capmt. There was 3 EMM received.
I don't know how to delete those emma, so don't know is it updating via newcamcd..
There is two options: 1) delete emms somehow, 2) wage until june 1st, when new period started and new emma will be send.

the easiest way to verify is to close the capmt connection and enable just cwc, disable emm cache on oscams side and restart both. If you get emms written than it should be ok.

#87

Updated by Artur Averyanikhin over 9 years ago

done. but i'm not sure this is best way to test. I think as emm's stored on a smart card, disabling emm's cashing will bring just nothing.But i'm not shire about it. So now, a set emmcashing equal 0,3,15,0 in oscam.server, restart tvh and oscam (tvh tuned to use cwc only), and both worked. But I cannot see any emm's log in oscam,received from tvh..

#88

Updated by Artur Averyanikhin over 9 years ago

So maybe it takes to manually remove emm's from smart card. How do you think, is it possible?

#89

Updated by B C over 9 years ago

the effect of disabling emm cache is indeed 0, the only difference is that oscam will write previously written emms to the card again, which will make no difference from the point of view of the card, but you should see that oscam did write emms to the card successfully. If you didn't see any update than emms are not sent through cwc.

#90

Updated by Adam W over 9 years ago

Not sure if this is related, but I am currently running 3.9.2827 and my Viaccess card running in OSCam no longer works with TVHeadend. I get "cannot decode packets for service.." errors. It's a BIS Télévisions card, provid:042820. I've tested with a Linux satellite receiver connecting to OSCam in the same way (via newcamd) and that's all working fine. OSCam doesn't see TVHeadend making any CW requests at all. Before a few days ago this all worked fine!

@
2015-05-17 17:48:10.725 mpegts: 11681H in Eutelsat 13 - tuning on Montage DS3103/TS2022 : DVB-S #0

2015-05-17 17:48:11.057 subscription: 0134: "HTTP" subscribing on channel "TF1 HD", weight: 100, adapter: "Montage DS3103/TS2022 : DVB-S #0", network: "Eutelsat 13", mux: "11681H", provider: "Eutelsat", service: "TF1 HD", profile="pass", hostname="192.168.1.66", username="tvheadend", client="VLC/2.2.1 LibVLC/2.2.1"

2015-05-17 17:48:11.057 subscription: 012A: "scan" unsubscribing

2015-05-17 17:48:12.760 descrambler: cannot decode packets for service "TF1 HD"

2015-05-17 17:48:23.028 descrambler: cannot decode packets for service "TF1 HD"
@

#91

Updated by B C over 9 years ago

you should update as there have been some essential fixes to the recently broken pid filter.

#92

Updated by Artur Averyanikhin over 9 years ago

Tested for couple days, no emm's send on a card via newcamcd.

#93

Updated by Jaroslav Kysela over 9 years ago

Then use instructions from comment#69 .

#94

Updated by B C over 9 years ago

unfortunately also capmt is still not working properly for 040820, I still don't get any valid updates while 040810 is fine. Only 8E messages which seem to be incomplete. What version should I use for logging and which options?

#95

Updated by Jaroslav Kysela over 9 years ago

Comment#69 - also - it would be good to show the oscam's EMM reassembly logs for the same CAID to compare.

#96

Updated by B C over 9 years ago

so I just did some unconventional test. I alterd cwc_emm_viaccess so that it sends the message plain without any pre-processing to oscam where I now enabled emm reassembly. The result was a flood of skipped/failed emms which I expected + some valid emms which updated my card :-)

I have logged the reassembled emms in oscam and did take a look of what oscam is receiving from tvheadend if it sends emms reassembled.

emmlog:
2015/06/02 16:19:28   C41A5E0000000000   8E703CC41A5E0090030408219E20FFFBFFFBFFFFFFFF7F9FFFFFFF7FFFFFFFFFBFFFDF7FBE000000000000000000A90546B546E504F008A9C86B4D1A8FE28C   written
2015/06/02 16:19:36   C41A5E0000000000   8E703CC41A5E0090030408219E200004000000000000000000000000000000000000000000000000000000000000A905469A46CA04F00892BBC67F04ACE7E5   written
2015/06/02 16:19:49   C41A5E0000000000   8E703CC41A5E0090030408219E200004000000000000000000000000000000000000000000000000000000000000A905469346C304F008225881F146F94FC8   written
2015/06/02 16:20:24   C41A5E0000000000   8E703CC41A5E0090030408219E200000000000000000006000000000000000000000000001FFFFFF5FFFFFFE7FFFA90546B046DE04F008A312196AD37FB3C9   written
2015/06/02 16:20:27   C41A5E0000000000   8E703CC41A5E0090030408219E20FFFBFFFBFFFFFFFF7F9FFFFFFF7FFFFFFFFFBFFFDF7FBE000000000000000000A90546B346E204F008A9C86B4D1A8FE28C   written
2015/06/02 16:20:47   C41A5E0000000000   8E703CC41A5E0090030408219E200004000000000000000000000000000000000000000000000000000000000000A905469446C404F008225881F146F94FC8   written
2015/06/02 16:21:22   C41A5E0000000000   8E703CC41A5E0090030408219E200000000000000000006000000000000000000000000001FFFFFF5FFFFFFE7FFFA90546B246E204F008A312196AD37FB3C9   written

8E703CC41A5E0090030408219E200004000000000000000000000000000000000000000000000000000000000000A90546B946E904F00892BBC67F04ACE7E5   // emmlog
8E702CC41A5E000004000000000000000000000000000000000000000000000000000000000000                                92BBC67F04ACE7E5   // tvh

so it's quite obvious that tvh is not reassembling correctly in that case. The written emms look suspicious too :-), but at least the correct one to update my card was there too. Strange thing is that when I checked last time tvh did send at least the correct length of 63 bytes, now it looks just like the E8 message....
I know some logs will help us, just need a bit time for them

#97

Updated by Artur Averyanikhin over 9 years ago

Hello! Did not write to this ticket since last time i tried to update emm and got an error. But on may 31 - june 1st it was a good opportunity to make a test, because my provider performs an updates. So, EMMs did not pass through cwc in oscam like last time. When it was switched to dvbapi, everything was ok.

#98

Updated by B C over 9 years ago

actually dreambox.log (2015/05/13 21:34:02) has all data to reproduce emm reassembly, so plain emms + reassembled result. This should help to verify tvheadends emm reassemble function.

#99

Updated by Jaroslav Kysela over 9 years ago

  • Found in version changed from 3.4.28~geb79aee~trusty. to latest 4.1

The reassemble functions should be probably moved to another file using a more universal abstract interface to allow testing outside the tvheadend with the hexa data from logs.

When I find a little time, I'll try do that.

Updated by B C over 9 years ago

this was generally my idea behind. maybe an option to disable reassembly in tvh could be added in the future as it would have been handy in this case.
I have yet to find the reason why capmt is no longer working for 040820

Updated by Jaroslav Kysela over 9 years ago

I rewrote the EMM filtering/reassembly code in tvh for cwc. v4.1-159-gc656bde

You can also test own EMMs - see src/descrambler/emm_reass.c - EMM_REASS_TEST .

I added more strict input data length checks and for viacess - the shared_emm parts are now cached per provider id and the EMM type (first byte). It's similar behaviour as oscam does. Other reassembly code is not changed (oscam does things a little differently) - but it seems that it gives a proper result like oscam.

Updated by Jaroslav Kysela over 9 years ago

Can we close this one ?

Updated by B C over 9 years ago

I will give feedback on this soon, didn't check since my card was updated with my ugly hack.....

Updated by B C over 9 years ago

still not updating on 040820, i'll take a look at EMM_REASS_TEST.
Another option would be to disable reassembly completely as oscam is capable of doing it.

Also available in: Atom PDF