Posts by azman26

  • DVBsnoop EIT to XML to get EPG for channels

    I have this plugin installed and I tried to do something with it, unfortunately with no results.


    Log from Radio Times Emulator


    polsatbox_13.0.log


    Does anyone know how to check in what standard a given operator broadcasts its EPG data?

    From the information I have:

    13E, Cyfrowy Polsat S.A. (Polsat Box) - OpenTV

    13E, NC+ (now Warner Bros. Discovery) - MHW

    It would be best if I could somehow verify this because I have this information from several years ago.

  • DVBsnoop EIT to XML to get EPG for channels

    By modifying and improving epgsnoop, it would be possible to write conf files for each of the satellite operators.


    If using epgsnoop it was possible to create an xml file with the full schedule provided by a given operator for its platform, it could then be very easily merged in WG++ or EPG Importer.


    By obtaining a guide from EPGsnoop and from Rytec Team sources, we would get everything we want regarding EPG, even for channels for which no schedule can be found on websites.


    Then, using EPG Export (yes, version 1.5 works without any problem in PY3), the entire final EPG could be exported for e.g. KODI, VDR, Channels or other Android players.


    I'm just getting to know this epgsnoop but with the level of my knowledge it will probably take ages :)

  • DVBsnoop EIT to XML to get EPG for channels

    On another forum, one of the users @CocoJambo found a project on GitHub of something the author called "epgsnoop".


    GitHub - hadleyrich/epgsnoop
    Contribute to hadleyrich/epgsnoop development by creating an account on GitHub.
    github.com


    After a preliminary review of the files, it seems that these scripts would be very useful and would do what I am thinking about, which is downloading data from EIT and saving it in an XML file. Moreover, it seems that it also downloads data from IMDB.


    Due to the fact that this project is already old, it should be refreshed

    - convert to py3

    - change the tuner "tuning" procedure.

    - and probably a few other errors that will appear during use.


    Could someone more familiar with PY and SQL take a look at this project and assess its possible use in E2?

  • DVBsnoop EIT to XML to get EPG for channels

    Let's just stick to the question and try to do something with it.


    Where do I get this knowledge about EPG and plugins related to EPG, if not from this or another forum with topics that describe exactly how these plugins work.


    -----------------------------


    I ask the moderator to ban all subsequent posts that are not related to the initial topic.

  • DVBsnoop EIT to XML to get EPG for channels

    The topic concerns EIT included in TS sent by the operator via SAT.

    Please stick to the topic and do not argue about which is better or this or that.

    After reading for a while, you become familiar with the EPG topics and get what you want, whether from these sources or others.


    Gentlemen, we are discussing topics that are described on this or that forum and it is not a problem to obtain EPG from these or other sources.

    I repeat my request that we return to my main question about extracting EIT from the transmission stream and not deal with something that has been possible and easy to obtain for a long time.



    1_0_1_C25_1E78_71_820000_0_0_0_20230909000149.jpg1_0_1_C25_1E78_71_820000_0_0_0_20230909001427.jpg1_0_1_C25_1E78_71_820000_0_0_0_20230909001408.jpg1_0_1_C25_1E78_71_820000_0_0_0_20230909001350.jpg1_0_1_C25_1E78_71_820000_0_0_0_20230909001302.jpg1_0_1_C25_1E78_71_820000_0_0_0_20230909001211.jpg1_0_1_C25_1E78_71_820000_0_0_0_20230909001147.jpg1_0_1_C25_1E78_71_820000_0_0_0_20230909001108.jpg1_0_1_C25_1E78_71_820000_0_0_0_20230909001051.jpg1_0_1_C25_1E78_71_820000_0_0_0_20230909001026.jpg1_0_1_C25_1E78_71_820000_0_0_0_20230909000943.jpg



    Really, you can't find EPG for your channels in all these sources?

    That's millions of pieces of data for millions of channels.

  • DVBsnoop EIT to XML to get EPG for channels

    And again post after post, the admin of this forum probably doesn't like me anymore :)


    The topic moved away from the main question, which was how to obtain events for channels directly from the Transport Stream of a given transponder from the operator that transmits them in this transmission.


    There are channels for which it is not possible to obtain EPG from websites, but only from SAT or DVB-T broadcasts from the data that the operator transmits along with the video/audio stream.


    This data is in the EIT tables that are read by each Enigma2 receiver.

    In E2 we have something like epgcasche which reads this data and converts it to an EPG.DAT file


    I can read these EIT tables, but unfortunately only for now/next, and export them to a txt file.


    I started this thread so that maybe someone more familiar with the topic could tell me how to read more data from TS, at least for these 12 or 24 hours.


    With this data, I would be able to read the most important information about events and pass them through the IMDW and FW parsers, thus obtaining quite nice EPG for channels for which there is no guide on any website.



    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------


    I think so, or we'll split this topic into two.

    One regarding the current EPG support using existing solutions.


    And the second one deals exclusively with the issue of how to obtain EPG from the operator's transmitted data.


    Currently, there is chaos in this topic and everyone writes how to obtain EPG from external sources.

    As I mentioned above, it is not difficult and complicated.


    Let's focus on how to obtain and convert EIT data transmitted by the operator into XML data.



    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

    biko


    Zrzut ekranu 2023-09-08 225017.png


    EPG channels | WebGrab+Plus


    For which country and the operator providing satellite services there do you not have EPG.

    Please look at the list of websites with schedules and the countries for which they can be created in the WG+++ program.


    If you do not find what you are interested in on this list, please contact me and I will try to help you solve your problem.


    -----------------

    And finally, I apologize to everyone for my bad English.

  • Sourcing and translating Epg data chat thread

    I'll give you a step by step


    1 Guide grabber from websites - WG++

    A piece of the configuration file for this program.

    From which websites for which channels is the EPG collected?

    This is where the most important thing is in this configuration.

    Code
    xmltv_id="13Ulica.pl"

    This must be a unique ID because there are thousands of channels and a whole lot of channels with the same name but targeted at different regions.


    2.

    Then the EPG Importer plugin requires mapping the channels file, which explains that unique ID data should be assigned to one channel or another.

    Excerpt from the sources.file


    3.

    We also have a sources file pointing to the channels file where each unique ID is assigned to a specific channel by binding the ID to references.

    Excerpt from the channels file

    Now it's easy when it comes to DVB-Sat, DVB-T and DVB-C channels.

    However, for IPTV channels, no regulation specifies that they must have unique references.

    RytecTeam, back when there was no DVB-T, came up with the idea that it would be based on the area code for a given country.

    And it was very correct and, most importantly, it worked.

    Currently, when we have ITU regulations in the field of DVB-T, I personally decided to use the provisions contained in these regulations for each country.

    When an IPTV channel has its equivalent in a SAT, terrestrial or cable TV broadcast, I assign it the references given by the operator in these broadcasts.

    When there is no equivalent channel in these transmissions, I try to give it references in accordance with the ITU guidelines for DVB-T, but those that will never exist in terrestrial TV. This usually concerns ONID and TSID.


    4.


    Having the above files, i.e

    - looted guide from websites

    - sources file with links to this looted guide

    - channels file thanks to which the EPG Importer plugin will map the appropriate data from the schedule to a specific channel


    Our EPG is much richer than what the operator broadcasts

    I really recommend reading at least a little about WG++ and its possibilities.


    Of course, you can start grabbing EPG for your channels yourself and, following the above, place your sources and channels files in the EPG Importer plugin directories.

    I did this at the very beginning of my adventure with EPG



    There is no problem in creating EPG for SAT, DVB-T, DVB-C and IPTV channels, including FAST platforms such as RAKUTEN, PLUTO, PLEX, SAMSUNG PLUS, etc.

  • Sourcing and translating Epg data chat thread

    biko

    Indicate which platform operators do not have EPG and on which websites their schedule is presented.


    I will search the WG++ forum and try to prepare the necessary files for someone to start creating an EPG for this or that region.


    Due to the fact that I am a licensed user of the WG++ software, I can always ask the WG++ team to prepare files that will allow you to grab the guide from the indicated portal presenting as many channels from your region as possible.


    And back to the topic.

    How to get the EPG from the EIT tables sent via this stream from a given TS.

    At the moment I am logging EIT now/next but unfortunately for all channels broadcast from a given transponder.

    In DVBsnoop I have already used parameters such as sections, filters, masks.

    Unfortunately, I have too little knowledge and it did not bring me the intended results.


    The goal is that I log EIT / EPG for channels from a given transponder, all the channels I am interested in for which there is no guide in the network are on this one transponder.

    I set the read and dump parameters and have everything saved in a txt file.

    Unfortunately, I only have now/next event and not, as presented by the event operator, for 12-14 hours.


    Either I'm making a mistake in the DVBsnoop commands or something else I don't know how to log this EIT table for at least 12h


    Then crone and curl and export to ftp and then downloading this file and processing in the WG++ program and as a result I can provide EPG for channels that this guide is not on any website on the web.


    ------------------------------------------------------------------

  • Sourcing and translating Epg data chat thread

    Sorry for post after post.


    Gentlemen, if you want, in a separate thread about EPG al over the world, I can prepare you a step by step that will allow you to obtain EPG from most official sources existing on the web.

    And if someone is willing, I will help in obtaining your own EPG for channels from your region, as long as they are not in the sources or plugins I mentioned.


    My question was how to get EPG for channels for which no website shows us the schedule.


    By setting the channel in the receiver, we get TS in which there are data for the entire trnsponder, including EPG in the EIT tables for the current channel and channels from this transponder and even other channels of the given satellite platform, e.g. sky, nc+, nova.


    By logging these data, we sometimes even get a guide for the entire sat platform.


    In E2 we have sewn in the epgcasch system which reads the entire EIT provided by the currently selected transponder and converts it to the EPG.dat file

  • Sourcing and translating Epg data chat thread

    biko


    Currently, I am the creator of EPG for all Polish channels (SAT, DVB-T, IPTV, Rakuten TV).


    All plugins such as EPG Grabber by Ziko, Jedi EPG Xtream or Radio Times Emulator are ultimately based on the creation of files required by EPG Importer.

    These plugins are quite useful and thanks to the developers for creating and maintaining them, they are very useful.

    RytecTeam creates EPGs mostly for selected EU countries and thanks to these additional plugins we also have EPGs for the Middle East of Russia, Ukraine or Asia and CA and the USA.

    Each of these plugins creates channels files with unique IDs and a sources file with a lead to a file where the entire EPG for a given operator or satellite position or terrestrial TV or IPTV broadcaster is raked.


    To sum up, having these few plugins, and in particular you need to have EPG Importer, you can get EPG for many regions.


    I started by creating EPG for IPTV channels from Poland because it was not in RytecTeam sources. I created my own channels and sources file pointing to the data raked with WG++.

    Ultimately, it ended up with my friend @doglower from the same team asking me to take over and continue creating EPGs for Polish channels.

    I took over his work, developed it a bit and it seems to me that I updated it by adding ratings of events from IMDB and the local Polish portal on movies and series, which is FimWeb.

    I also work with another group that creates EPG but only for android applications and possibly for KODI.


    There are slightly different rules for E2 because in order to parse EPG for channels you need to use the channels file in which the ID of a given channel is assigned to specific references, be it sat or dvb-t.

    For Kodi and android apps, just enter the ID itself, even in several variants, and the app will match the EPG to the name of the channel you have.


    It's not that simple in E2.

    You grab the guide from the website that presents it and at this stage you need to establish a unique ID.

    You get an xml file with these unique IDs and now that Enigma2 knows what to assign to whom from these tens of thousands of events, you need to create a channels file which explains to the E2 parser that the AXN.PL ID is to be associated with the AXN channel which has references like this 1:0: 1:C25:1E78:71:820000:0:0:0

  • Sourcing and translating Epg data chat thread

    We're getting a bit off topic and my question.


    With the help of EPG Importer and additionally supporting plugins EPG Grabber by Ziko or Jedi EPG Xtream by Kiddac


    which will create the appropriate channels and sources files for you to use in the EPG Importer plugin.


    Anyway, everything in E2 is based on this one perfectly working EPG Importer plugin.


    You can also add your own sources prepared in an external WG++ program


    My question concerned how to obtain EIT from the TS (transport Stream) stream (i.e. EPG broadcast by the operator in a specific DVB standard) when there is no other possibility to obtain this EPG, either on websites presenting a guide or other portals with guides for channels.


    --------------------

    From what I have recently learned, VTI is said to have its own SmartEPGvu+ which allows you to choose from which source a specific channel is to obtain EPG.

    It's like you indicate 10 channels that take EPG from EIT and other 200 channels get EPG from EPG Import plugin which has a guide from external sources.


    I don't know how it works because I don't have any VU+ to check it, much less it works in PY2



    ---------------------------------------

    1_0_1_3DD2_640_13E_820000_0_0_0_20230906190049.jpg1_0_1_3E20_2EE0_13E_820000_0_0_0_20230906234735.jpg

    1_0_1_3DD2_640_13E_820000_0_0_0_20230906190121.jpg1_0_1_3DD2_640_13E_820000_0_0_0_20230906190049.jpg1_0_1_3E20_2EE0_13E_820000_0_0_0_20230906235245.jpg1_0_1_3E20_2EE0_13E_820000_0_0_0_20230906235231.jpg1_0_1_3E20_2EE0_13E_820000_0_0_0_20230906235204.jpg1_0_1_3E20_2EE0_13E_820000_0_0_0_20230906235712.jpg


  • DVBsnoop EIT to XML to get EPG for channels

    Quote from jenseneverest

    text: "..magazyn<BR>Prowadz±: Rafa³ Dꢩ񳫩, Micha³ Wodzi񳫩<BR>Rafa³ Dꢩ񳫩 wraz z zaproszonym ekspertem przedstawia wydarzenia ka¿dej kolejki spotka񠰩³karskiej Ekstraklasy. Program rozpoczyna si꠴u¿ po zako񣺥niu ostatniego z sobotnich mecz󷮼BR>Od lat" -- Charset: ISO/IEC 8859 special table


    As for errors in the description of the event, these are Polish diacritics (ą, ć, ę, ł, ń, ó, ś, ż, ź).


    ------------

    Edit


    I'm looking at the Radiotimes Xml Emulator plugin you recommended.


    I need to decipher how to add more operators, e.g. "Cyfrowy Polsat"

    conf, dict and theme files.

    jenseneverest Do you know where I could read about it and learn a bit.


    If I managed to add the Cyfrowy Polsat operator, this plugin would do everything I want to achieve.

  • DVBsnoop EIT to XML to get EPG for channels

    VOD202-208 channels are the only channels of the Polsat operator for which I cannot get EPG from other sources.

    I have a license for WG++ so I have access to ini files of various platforms from all over the world.


    I have DVBsnoop installed on the Octagon SF8008 receiver.


    Attached are the files from dvbsnoop logged 1000 lines from the transponder that broadcasts these channels.


    I only care about these channels.


    snoop_0x00.txt

    snoop_0x11.txt

    snoop_0x12.txt

    snoop_sec_nph_0x12.txt


    I create EPG for all channels dedicated to the region of Poland, including fixed channels, terrestrial TV, cable TV as well as for IPTV channels (TVP VOD, Rakuten TV and local niche regional IPTV channels)

    And just to be completely happy, I lack EPG for these few VOD channels of the Polsat Box platform.

    They are supposedly Video on Demand channels by name, but there is one movie broadcast 24/h for 7 days and then a change and so on each of these channels.


    I would appreciate any help in obtaining a guide from the EIT data. The next step will be to extract interesting data from these files and add them to EPG Poland sources. I think that together with my colleague doglover from RytecTeam, we will be able to enter the obtained data into the sources, and even if it were possible, I will get ratings from IMDB and from the Polish FilmWeb portal for events.


    -----------------------

    Some basic commands I use in dvbsnoop

    Other simple filter examples:

    dvbsnoop \-s sec \-f 0x4E \-m 0xFF 0x12


    Simple filter for some PID values, some examples:

    dvbsnoop \-n 5 \-nph 0x00 | grep \-i "PID: "

    dvbsnoop \-spiderpid \-nph \-n 10 0x00 | grep \-i "PID: " | sort | uniq

    dvbsnoop \-s signal \-pd 9 | ./perl-statistics-prog.pl


    Display EPG, 10 sections:

    dvbsnoop \-s sec \-nph \-n 10 0x12

    dvbsnoop \-s sec \-ph 3 \-n 10 -crc 0x12

  • DVBsnoop EIT to XML to get EPG for channels

    I need to extract EPG/EIT for channels from HB 13E transponder 12015 H using Octagon SF808 receiver.

    Channels VOD202 - VOD208.

    Currently, I manage to log everything that the transponder transmits.

    I'm only interested in EIT for VOD channels.

    I use filters and ae masks, I think I don't know enough about this tool (dvbsnoop) to use it effectively.


    My goal is to get the EPG for these channels and then add it to the sources of the EPG Importer plugin.

    I have been creating EPG for the Poland region for almost a year now and in cooperation with RytecTeam I am providing a guide for channels received in Poland.


    I miss the full happiness of mine and my EPG recipients of these VOD202-208 channels.


    So recently I came up with about DVBsnoop and EIT and I thought that with your help I could get a guide to the operator via sat and merge it with what I generate using WG++

  • DVBsnoop EIT to XML to get EPG for channels

    DVBsnoop powerful stream analysis tool.


    I need to extract EIT from the transport stream of a given transponder and then convert this data to xml format so that it can be included in the sources of the EPG Importer plugin.


    Is there anyone I could talk to and work out a solution together?dvbsnoop -n 1 -nph 0x0000 >/tmp/snoop_0x00.txt

    Code
    dvbsnoop -n 1 -nph 0x0000 >/tmp/snoop_0x00.txt
dvbsnoop -n 500 0x11 >/tmp/snoop_0x11.txt
dvbsnoop -n 500 0x12 >/tmp/snoop_0x12.txt


    I get to log the EPG from the TS stream on a given transponder.

    It only needs to get EPG/EIT for one channel and that for 12/24h

  • Jedi EPG Xtream

    It's not about the EPGImport.py file because each team does it a bit differently, but about the sources from which the EPG is downloaded.

    And these sources are saved in the file "rytec.sources.xml" and it doesn't matter how the plugin is modified because the sources are one and the same regardless of whether the original EPGImport.py has been modified or not.


    This is the latest release of the Jedi EPG Xtream plugin.

    Rytec Poland XMLTV has been defunct for over half a year, it has been replaced by [azman] Poland XMLTV.

    1_0_1_3393_3390_71_820000_0_0_0_20230803231858.jpg


    And this is how it looks in the original latest release of EPG Importer.

    1_0_1_3393_3390_71_820000_0_0_0_20230803231940.jpg