E2m3u2bouquet - discussion & support

There are 1,612 replies in this Thread which was already clicked 253,043 times. The last Post () by hajosch.

    Another thing, why this difference with the same list in 1.0.87 and 1.0.88:


    Code: 1.0.87
    [25.02 12:43:35] [e2m3u2b] [Storesat Brut wget]: Start update 🚩
[25.02 12:43:35] [e2m3u2b] [Storesat Brut wget]: Parsing m3u-playlist ...
[25.02 12:45:05] [e2m3u2b] [Storesat Brut wget]: Parsed 137454 channels from m3u-playlist
[25.02 12:45:05] [e2m3u2b] [Storesat Brut wget]: Process custom categories ...
[25.02 12:45:15] [e2m3u2b] Processed: 382 categories
[25.02 12:45:25] [e2m3u2b] Total processed 382 categories

    The parsed channels number in 1.0.87 is lower than the one in 1.0.88. The real number of channels from the m3u playlist is I think the 1.0.88 one.


    Quote from pepsik

    I will try to play with the "Pluto" playlist and repeat this error.... If it shows up, I'll fix it.

    For the process hang, perhaps adding a missing timeout will reveal the real problem. But I have no idea for the e2 crash.

    Octagon SF8008 IPTV / DVB-S2X / DVB-C / T2

    OpenATV multiboot 7.5.1 / 7.6

    Edited 2 times, last by jeepcook ().

    Another report:


    The channel "Pluto TV In Love" has been replaced by "Pluto TV Film Romantici" in the pluto it.m3u8 file (same done in the pluto all.m3u8 file). It's the same channel but with another name.

    The diff.override file mention only the new channel:

    <channel name="Pluto TV Film Romantici" nameOverride="" tvg-id="608aa4a4cc92820007b663af" enabled="1" reftypeOverride=""/>

    but how to detect the removed/replaced channel other than a manually research:

    <channel name="Pluto TV In Love" nameOverride="" tvg-id="608aa4a4cc92820007b663af" enabled="1" reftypeOverride=""/>


    I don't know how you can add the mention added and removed in the diff file or in another file.


    What do you think about that ?


    Thanks

    Octagon SF8008 IPTV / DVB-S2X / DVB-C / T2

    OpenATV multiboot 7.5.1 / 7.6

    Quote from jeepcook

    Have you reproduce my errors ?

    I can't reproduce the error you describe... But I set plutoTV to auto-update and I'm observing the behavior of the plugin

    Quote from jeepcook

    What do you think about that ?

    I don't understand what to think? diff-override.xml - contains the difference between the xml template and the playlist. Either way, diff-override.xml will contain differences... It's either (override.xml - m3u) or (m3u - override.xml) . What to do with the file "differences" - you think

    if you like it you can make donations

    Quote from pepsik

    I don't understand what to think? diff-override.xml - contains the difference between the xml template and the playlist. Either way, diff-override.xml will contain differences... It's either (override.xml - m3u) or (m3u - override.xml) . What to do with the file "differences" - you think

    My example describes the problem, one channel added, one deleted but just one displayed (the added) in the diff-override xml file.

    I'll give you other examples when I'll detect new ones.

    Octagon SF8008 IPTV / DVB-S2X / DVB-C / T2

    OpenATV multiboot 7.5.1 / 7.6

    Here is an example of a not take in account to categories changes.


    In the pluto fr m3u8 there is only one channel in the "Nouveau sur Pluto TV" category. But in the sort.override file there are 5 channels in this category.


    Here are m3u8 and sort-override files where you can see this problem. Note that no diff.override file has been created for this case.

    Quote from jeepcook

    Here are m3u8 and sort-override files where you can see this problem. Note that no diff.override file has been created for this case.

    No problem at all

    1) I added a link to the playlist provided by you

    2) Selected "custom" sorting for this playlist

    3) Generated bouquets and, accordingly, sort-override.xml file was created

    Снимок экрана 2023-03-02 в 16.30.48.pngСнимок экрана 2023-03-02 в 16.31.46.png

    Снимок экрана 2023-03-02 в 16.31.56.pngСнимок экрана 2023-03-02 в 16.32.17.png


    What am I doing wrong and why do I have only ONE channel in the category you specified, just like in the m3u playlist?


    If I manually move any channels to this category and generate bouquets again, then yes, these channels will be there and the diff-override.xml file will not be created, because there are channels in the playlist

    For example

    Снимок экрана 2023-03-02 в 16.39.27.png

    And the result

    Снимок экрана 2023-03-02 в 16.42.25.png

    if you like it you can make donations

    clapping hands 1

    So the only check you are doing is if the channel is in the playlist, not if a channel move to another category?


    Here is my sort-override xml, you can see channels in the wrong playlist because I can fix them because I don't have the information in the diff-override file.


    Seen on other m3ufiles. Deleted channels are not in the diff.override file and stay in the sort-override files. I think it's when the tvg-id is the same but the name of the channel is modified.

    Quote from jeepcook

    So the only check you are doing is if the channel is in the playlist, not if a channel move to another category?

    Certainly! Nothing prevents you from arbitrarily rearranging the channels according to your preferences. Nothing limits you in moving channels into categories, as well as in creating new categories. BUT! If the channel is present in m3u , then it is NOT included in diff-override.xml


    Quote from jeepcook

    Seen on other m3ufiles. Deleted channels are not in the diff.override file and stay in the sort-override files. I think it's when the tvg-id is the same but the name of the channel is modified.

    1) Created bouquets from original m3u

    Снимок экрана 2023-03-03 в 07.00.11.png

    Then I physically removed the lines with Telefe Noticias and Chilevision Noticias channels from m3u and generated bouquets again, the sort-override.xml template remained from the previous m3u file

    Снимок экрана 2023-03-03 в 07.05.17.png

    As you can see from the screenshots of the bouquets - in the News & Info group, the channels that were removed from m3u - disappeared, which is logical. They are not in the original m3u ... At the same time, dif-override.xml is not created. I believe that bouquets are primary and should only display what is in m3u . Apparently you want me to display the symmetrical difference between m3u and sort-override.xml in diff-override.xml ? Currently diff-override only displays channels that APPEAR in m3u that are not in sort-override.xml. Thus, informing you that the provider has new channels and you will be to decide where to put them in sort-override, because they DO NOT fall into bouquets


    When finding a symmetrical difference (it's not difficult at all) - it is not clear how to "mark" channels that are NEW and which are LOST from m3u ... Moreover, I deliberately made such an algorithm based on the fact that most providers very often experience a temporary disappearance of one or another channel from the broadcast grid ... What is the point in this case of "playing around" with an already configured template if after a while the channel reappears in m3u?

    if you like it you can make donations

    Pepsik, thanks for your tests and informations.


    What I'd like to have is the information of the deleted channels, of a moving category for each channel moved, the list of the new channels.

    The deleted channels are useful I think, because I make my own m3u list containing some channels from the original list and so if a channel is deleted I don't have the information to update my own list.


    Currently the way to find these informations is to rename the sort.override list , so your plugin will regenerated a new one and after that I make a diff with notepad++ between the renamed file and the new one. It's not funny !!


    Regards


    Edit1: a little update, if you want, should be to delete the log before a manual update. In fact the log is truncated automatically when a size is reached and we lost a part of the last batch log.


    Edit2: Add 2 plex xml files where you can see differences, some channels are deleted, others are renamed or created. Only the created channels would appear in the diff file.

    Quote from jeepcook

    a moving category for each channel moved

    A channel moved inside a playlist to another category is not a deleted one ... If you moved a channel from one category to another, then you needed it that way. What is the point of displaying this information in any form? Actually, you see this channel in bouquets exactly in the category where you moved it ... What is the informative value of the information output "from which category it was moved" ?



    Quote from jeepcook

    Edit1: a little update, if you want, should be to delete the log before a manual update. In fact the log is truncated automatically when a size is reached and we lost a part of the last batch log.

    Can be done. I'll think about it ... Perhaps I will delete earlier lines replacing them with new ones by fifo ... thus, when the maximum allowable size of the log file is reached, it will not be deleted, but will resemble something similar to a "stack" of constant size until you delete it manually



    Quote from jeepcook

    Edit2: Add 2 plex xml files where you can see differences, some channels are deleted, others are renamed or created. Only the created channels would appear in the diff file.

    I told you earlier that the key value is CHANNEL NAME. How can you understand that the renamed channel is not a new one?

    For example, suggest your logic for the following situation

    1)

    There was a channel name - "Discovery Nature HD"

    The same channel was "renamed" in m3u-playlist to - "World Nature HD"

    2)

    A new channel just appeared in the m3u-playlist - "World Nature HD"


    How are you going to tell if "World Nature HD" is a new channel or a renamed one?

    if you like it you can make donations

    Interesting informations:

    - when a channel move to another category. A channel can keep its name but can completely modify programs and so has to be moved to another category. It's the case with a lot of channels available on iptv providers.

    - when a channel change its name, generaly the tvg-id keep the same so we have to consider a changed name to affect the new picon.

    For your example with "Discovery nature HD" renamed to "world nature hd". The channel is a new one if the tvg-id is modified too, so we have to know somewhere that discovery hd has been deleted and a new one created, so 2 entries. Or the channel is just a renamed one because its tvg-id doesn't change, we need the information of the new name to affect the good picon and why not its old name to delete the affected picon.


    I think I can give you more and more examples why I'd like to have a real diff and complete file.


    Thanks

    Octagon SF8008 IPTV / DVB-S2X / DVB-C / T2

    OpenATV multiboot 7.5.1 / 7.6

    Quote from jeepcook

    - **** but can completely modify programs and so has to be moved to another category.

    What do you mean by "programs"? If we are talking about EPG events, then no. The position of the channel in the playlist or any of its affiliation to the group - does not affect the EPG in any way

    Quote from jeepcook

    - when a channel change its name, generaly the tvg-id keep the same so we have to consider a changed name to affect the new picon.

    Yes, this is true, the channel name is involved in obtaining a certain "hash" sum for uniquely identifying the channel in bouquets. The fact is that in any playlist there is a channel name, and the presence of a tvg-id tag with any value is not mandatory and may be completely absent ...

    As an example below - absolutely correct m3u playlist

    Code
    #EXTM3U
#EXTINF:[duration],TITLE
[URL]
#EXTINF:[duration],TITLE
[URL]
#EXTINF:[duration],TITLE
[URL]

    The plugin will "digest" it and create bouquets ... How should the logic you proposed with tvg-id work in this case?


    Therefore, if you have a new name in your m3u playlist, this is a new channel and a new picon file ... You must understand that when generating bouquets from an m3u playlist by the plugin, it is necessary to solve the problem of compatibility with the DVB standard and imitate the behavior in accordance with EN 300 468 - Digital Video Broadcasting (DVB); Specification for Service Information (SI) in DVB systems ... :exploding head: ...

    Quote from jeepcook

    For your example with "Discovery nature HD" renamed to "world nature hd". The channel is a new one if the tvg-id is modified too,

    Bad example ... There are a number of channels that have DIFFERENT names, but exactly the same tvg-id values ... Just like there are channels, with SAME names (slightly different) - but with completely different tvg-id

    As an example, in the NTV+ (Russia) package there is a channel - Первый, Первый HD - This is the same channel in SD and HD quality with the same tvg-id (EPG events) ... But at the same time ... This provider has a Bollywood channel and Bollywood HD - and these are channels with absolutely different content and different tvg-id (EPG events)

    if you like it you can make donations

    Quote from pepsik
    Quote from jeepcook

    - **** but can completely modify programs and so has to be moved to another category.

    What do you mean by "programs"? If we are talking about EPG events, then no. The position of the channel in the playlist or any of its affiliation to the group - does not affect the EPG in any way

    The programmation, so a channel is for example a news channel and become a movie channel (it's an arbitrary example) or a local channel....


    For the rest, I have to conclude that I will have to use my method for the other elements. To do a diff with notepad++. I expected better from the override functionality.

    Octagon SF8008 IPTV / DVB-S2X / DVB-C / T2

    OpenATV multiboot 7.5.1 / 7.6

    Quote from jeepcook

    for example a news channel and become a movie channel (it's an arbitrary example) or a local channel.

    Here I did not understand anything.

    Well, you move the channels from one group to another in the template file. Why in diff-override need to display information about which group the channel was moved from to which compared to the original m3u? For example, I created a group of favorite channels in sort-override , which is not in the original m3u ... I "thrown" the channels I needed there ... And ? What for each time to deduce in diff-override these channels?



    Quote from jeepcook

    I expected better from the override functionality.

    What else? A miracle that defies logic? Understand that the algorithm should be universal and applicable to any kind of playlists, and not "sharpened" for a specific option, for example, those playlists that only you and maybe another 10% of users have ... And what about the rest of the 90% who use playlists to which your logic does not apply? I gave you an example of a playlist in which there is NO tvg-id ... How can I track the change in the channel name, and not the appearance of a new one, if the original m3u does not contain the tvg-id tag? ... and there are thousands of such playlists ... as well as thousands of other options.


    sort-override template allows you to set an arbitrary order of channels without being tied to a group, rename channels and groups, create new groups, track the appearance of new channels in the original m3u, enable/disable the display of channels and groups in bouquets, set your own EPG sources, redefine the player according to specified channels e.t.c.


    What else?

    if you like it you can make donations

    jeepcook

    Below is part of the playlist of a very popular IPTV provider ... tens of thousands of "subscribers" use its services

    Do you see the tvg-id tags there? And now imagine that this provider changed the name of the channel "Russia-1 +2" to "Russia-1 HD +2" ... Is this a new channel or did the channel just change the name and how determine it with a 100% probability?

    if you like it you can make donations

    jeepcook

    Another example of an IPTV provider from Ukraine (https://omegatv.ua)

    Do you see the tvg-id tags there? And now imagine that this provider changed the name of the channel "History HD" to "Fairy Tails" ... Is this a new channel or did the channel just change the name and how determine it with a 100% probability?

    if you like it you can make donations

    Ok so I will back to my previous method that was to firstly affect a picon to each channel, and the new one and renamed ones are detected because they have no picon. By this way I have a part of my wanted informations.


    Other thing, I am still unable to use the 1.0.88 version. The plugin stop to work arbitrary after quantity of treatments. see the 1.087 and 1.088 log. No problem with 1.0.87 I 'm using daily for the moment.

    Quote from jeepcook

    The plugin stop to work arbitrary after quantity of treatments.

    Yes, I also see this from time to time. To catch the pattern - it does not work yet ... There are no logs or system errors. Most likely this is due to the joint use of threading and twisted in the Enigma2 framework (https://dreambox.de/board/inde…ugins-helper-code-inside/). And with a probability of 99.99% it's not the plugin code error ... If you disable the loading of piсons (checking their change) - this situation will not occur. The absence of any message in the system log and the randomness of the occurrence of this situation greatly complicates the search for the cause of it ... It can happen to me once or twice a week, or even less often ... Nevertheless, personally, this does not prevent me from using 1.88 ... In the next update of the bouquets - everything works as it should, and the bouquets and EPG are auto-updated once a day for me, and this one, yet an unexplained bug, does not affect functionality in any way and does not lead to any data loss

    Quote from jeepcook

    Ok so I will back to my previous method that was to firstly affect a picon to each channel, and the new one and renamed ones are detected because they have no picon. By this way I have a part of my wanted informations.

    How does this "method" apply to the above playlist where there are NO links to channel picons - RE: [Discussion] E2m3u2bouquet ? That provider, like some others, has links to channel icons in XMLTV (EPG), and not in m3u :flushed face: ... sort-override template for this kind of playlist - works =) and the plugin receives picons not from m3u , but from the specified XMLTV in the settings of this provider


    p.s. You are quite an interesting interlocutor =) I'm interested in your vision of the plugin's functionality

    if you like it you can make donations

    Quote from pepsik

    p.s. You are quite an interesting interlocutor =) I'm interested in your vision of the plugin's functionality

    I am like that, I always try to discuss with dev to obtain updates for my part and for all users. I very like your plugin. I want to have only one m3u8 to maintain my favorite tv list. And your plugin is built for that. But I have few problem for my specific uses.


    For me back to 1.087 is the only way to have a full batch without stop working. I never succeed to have a full treatment with the 1.0.88.

    For my method to detect the new/moved/deleted channels is to affect manually the picon, not using the plugin but with another tool like dreamboxedit or the new daemoneditor.

    From my memory (old memory ;-) ), a new channel has no picon but epg, a moved channel has no picon, a renamed channel has no epg. Something like that.

    Octagon SF8008 IPTV / DVB-S2X / DVB-C / T2

    OpenATV multiboot 7.5.1 / 7.6

    Edited 2 times, last by jeepcook ().

Get community help for all other Enigma2 plugins

This is your forum for support, questions, and guides for plugins not covered in our specialized sections. Support for uncategorized and miscellaneous Enigma2 plugins. Find help, troubleshooting, and discussions for plugins that don't fit other forum categories.

Participate now!

Don’t have an account yet? Register yourself now and be a part of our community!

Register Yourself Login