Posts by msatter

    pepsik Then you have to wait for iet8 for his log. This is what I got creating the log with the by you suggested command and pressing the yellow button to import a Rytec file.


    This is on my 7080 and in March this year I was testing it on my 920. Both have Gemini installed and are on the latest firmware's available from Dream Multimedia. Then it was with switching to the 1.6 version of EPGimport.


    Iets8 has solved this exact problem by disabling Twisted and when I use it I can import any file. Above 1.87 I get problems with connecting to epg.db so I keep using 1.87 with DreamOS adaptation to disable Twisted.


    I am perfectly happy now and as written before I can do away of two plug-ins of three. Just using the adapted EPGimport 1.87 version.

    pepsik I think you are looking for this. And I use 1.87 and enabled twisted thread again by removing the detection for DreamOS.


    Pressing Yellow button and selecting a Rytec source.

    Code
    FATAL!: addTimer must be called from thread 7313 but is called from thread 7489

    I remember writing about this earlier but I don't know if it was in this forum.


    And indeed the Dreambox freezes completely and I can only restart by issuing a reboot from the prompt or switch off the power.


    The whole log that was lost during reboot.

    Thanks for looking into to this and it seems that it can't resolved for now and I have reverted to 1.84 already. I can also now import Rytec and other files now twisted is being disabled on DreamOS. Thanks to iet8 for suggesting this.


    The current location of the epg.db is not a symlink. From settings: config.misc.epgcache_filename=/media/SanDisk240GB/XMLTV-EPG/epg.db


    Dreambox development is very unreliable and they seems to work on a universal version for One, Two and Seven. Having a 7080 and 920 I have to do with the breadcrumbs they throw. Getting a malformed epg.db is known on the Dreambox when you start extra imports after an earlier import. I did not notice that lately.


    I was using three different EPG importers (EPGload, EPGimport, OpenIPG) and now due to iet8 I can use EPGimport 1.84 again to do that in one go. Maybe even go to version 1.87

    I can confirm that and not isDreamOS is allowing to import the Rytec resources again. Before the Dreambox restarted Enigma2.



    Thanks iet8 for sharing this.


    This afternoon al work fine during import but now it can't connect to the database again and I set the time 10 and 20 to 150 to no avail:


    Aug 24 11:48:42 dm7080 enigma2[290]: [EPGDB] not connected, retrying

    Aug 24 11:48:42 dm7080 enigma2[290]: [EPGDB] /media/SanDisk240GB/XMLTV-EPG/epg.db exists

    Aug 24 11:48:42 dm7080 enigma2[290]: [EPGDB] connect to /media/SanDisk240GB/XMLTV-EPG/epg.db failed

    All I can do for with such a log of the system kernel is NOT to import the EPG or "knock" a number of times trying to connect to the target SQL file and in case of failure - refuse to import events .... There is no other option.

    Thanks and I use now version 1.90 and changed the timeout from 20 to 150 in epgdb.py and it then connects, but still receiving that exception:


    I found back the tread about EpgImport and I already posted this in an other forum.


    Version 1.89 on a dreambox


    uname -a


    Linux dm7080 3.4-4.0-dm7080 #1 SMP Fri Feb 9 15:16:04 UTC 2018 mips mips mips GNU/Linux


    I have a working 1.84 and this is holding me back to update to a later version of EPGimport. Using 1.89 there is noting added to the database.


    Cheers.

    I have tested now which version works with the current Rytec EPG and that is 1.6. Later versions trows the error stated in my previous posting here.


    RE: EPG Import mod from Dorik1972 Support Thread


    dm920 enigma2[388]: FATAL!: addTimer must be called from thread 388 but is called from thread 622


    Update: thinking about what is different I taught about that in later files links are present to Picons. When I try to read a XML file with Picon links in there then the 1.6 version just ignore all and import is made.

    This is last is the last iteration tested. Normally I would use <url>/media/hdd/epg.xml</url>

    XML
    <?xml version="1.0" encoding="utf-8"?>
    <!-- Automatically generated by the e2m3u2b for GREEN -->
    <sources>
        <sourcecat sourcecatname="E2m3u2BouquetMaker/GREEN">
            <source type="gen_xmltv" nocheck="1" channels="">
                <description>RED XMLTV</description>
                <url>file:///media/hdd/epg.xml</url>
            </source>
        </sourcecat>
    </sources>


    In /etc/epgimport a file with the name: e2m3u2b_iptv_red.sources.xml gets erased so I created a new one named: do_not_erase.sources.xml


    Logs:


    That lines where present but the EPGImport switch was slready on. So I have to try again with disabling and enabling again.


    I have it working with downloading the file manually and reading it in and I am trying this for someone on a other forum.


    The file downloaded is in my case a plain XML file and I tried it with and XML extension and later with xml.gz extension.


    As I wrote there was no mention about EPImport in the trace ( journalctl -f ).


    Then in the end, by disabling the checks on the extensions all works out of the box and without any manually interventions and having the need for any fantasies. :smiling face with sunglasses:

    I tried it, exactly as you stated it, but EPGImport is then not working. I think because, in /etc/epgimport and /media/SD-card/E2m3ubouquet no files are created or a link created to the ...E2m3ubouquet/epg/ directory. The trace (journalctl -f) does not show EPGImport, despite it is activated.


    The file I downloaded I saved to: /media/hdd/epg.xml.gz and entered the link in the config.xml file.


    <epgurl><![CDATA[file:///media/hdd/epg.xml.gz]]></epgurl><!-- Forced loading events from the specified XMLTV EPG URL -->


    I could create that all manually including using a backup of the channels file so that EPGImport is able to import from the file.

    When storing the file in advance, that works with the EPGImport (stand-alone) but not e2m3ubouquet due to that each time the e2m3u2b_iptv_green.sources.xml file is recreated when e2m3ubouquet is being executed.


    If you say that the epg.xml is read in with despite not being mentioned in e2m3u2b_iptv_green.sources.xml then I will give that on that user of e2m3ubouquet.


    It will work in the stand-alone version of EPGImport, if the sources config file is adapted accordingly.


    I am pleased that I can have it working in my situation and that EPGImport is that flexible that it handles that correctly. I would rather see that the EPG provider, would just provide according to what EPGImport is expecting and put it behind a login.

    Then.....I read , in an other forum, about a URL that is not filterable to my knowledge:


    http://example.com:8086/epg/user/pass


    The retrieved filename is: epg.xml


    Is it then a more suitable option, to add a menu option in the plugin menu, allowing to skip the extension checks?

    This if the user wants to run the risk that the file downloaded is not importable at all, and that he has to restart the whole device and not use again that source as EPG source.


    Something like: No filename checking (DANGEROUS)  NO/YES


    Default is then, still checking for the correct filename extension. And if the user want to run the risk, have EPGImport try to import the file that is download even if the filename extension is know up front. This only works, I think, for plain XML files.

    Thank you so much for your reply and I can't even imagine what is happening to Ukraine and the people of Ukraine.


    I was a bit naughty and looked at the code and the only thing that is stopping the read-in the check on the extension of the file. The file is plain XML and seems to be renamed to epgimport.gz after downloading.


    I am not a programmer and I came up with a change despite it works, it is not working correctly because it also accepts checking for lets say ".phptest" while that is not in the URL.


    These lines are in EPGConfig.py and EPGImport.py


    Trace of a successful import:


    I am not in a hurry and a workaround for it. The Plug-in is that flexible that is has no problem with the unexpected format of the URL in the end.


    Keep strong and all the best to you, your hold dear and to all the people that are suffering because of stupid this war!


    ps. I am still feeling stupid about my earlier conclusion :pleading face:

    I made traces of the script running, and to my astonishment all is working as you wrote. I don't know why I had success when I removed the "amp;". I am really sorry for my mistake.


    However, the way I have to download the EPG XML from my provider causes the problem shown underneath. It is an XML but has not a correct extension: "php?username=USER&password=PASS" and is so invalid to import as EPG XMLTV file.


    I now download the file with wget and store it the /tmp directory and import it manually. On storing I can give it a valid name like xmltv.xml


    These are the traces I got when creating the bouquets and the EPGimport and underneath the trace of the stand alone EPGimport.


    And again, sorry that I got it that wrong the first time.


    And the journalctl of processing:


    EPGimport 1.86 dorik 1972 (stand alone)

    Code
    Mar 10 21:12:22 dm920 enigma2[1110]: [EPGImport] afterDownload /media/hdd/epgimport.php?username=USER&password=PASS
    Mar 10 21:12:22 dm920 enigma2[1110]: [EPGImport] download failed: Exception('Unsupported compression type or file: php?username=USER&password=PASS',)
    Mar 10 21:12:22 dm920 enigma2[1110]: [EPGDB] still not connected, sorry
    Mar 10 21:12:22 dm920 enigma2[1110]: [EPGImport] imported 0 events per 0:00:05.354035
    Mar 10 21:12:22 dm920 enigma2[1110]: [EPGImport] EPG cache time updated ...
    Mar 10 21:12:22 dm920 enigma2[1110]: [EPGImport] Load the database file /media/SD-card/XMLTV-EPG/epg.db to EPG cache ...
    Mar 10 21:12:22 dm920 enigma2[1110]: [EPGImport] Save last import date and count event
    Mar 10 21:12:22 dm920 enigma2[1110]: [EPGImport] Run check deep standby after import
    Mar 10 21:12:22 dm920 enigma2[1110]: [EPGImport] #### Finished ####

    Thanks for your reply especially in these horrendous and difficult times.


    I looked again at the EPGimport config and the string sent out to servers (WireShark) then the "&" is replaced by "&amp;" and the server is expecting only a "&" and trows a 403 because the URL is not valid.


    So the problem is then on the site where the EPG data is en they have to accept (or rewrite) "&amp;" . Till then I will have to edit the EPGimport file manually each time.


    Thanks and stay strong!

    I found a problem with the URL stored in E2m3u2b_iptv_iptv.sources.xml which contains an "&". This I also wrote an other forum where I downloaded the plug-in originally.


    This is what I noticed:


    I want to also read the EPG and that did not work for me. I tried it with stand-alone EPGimporter and that did also not read any events in.


    I looked in the E2m3u2b_iptv_iptv.sources.xml file and noticed that in the URL's the "&" was replaced with "&". After removing "amp;" the import with the standalone works again. I can't test it with the E2m3u2Bouquet plugin because during the processing the E2m3u2b_iptv_iptv.sources.xml is overwritten.

    I am totally new here and am using EPGImport since ages. Using now the new one which is much faster. It works fine importing a XML from E2m3u2bouquet.


    Using

    Only are systemctl restart enigma2 or reboot helps to exit the frozen EPGImport screen.

    Image: DreamOS 4.3.3r3-2021-10-29 Experimental

    Plugin: EPGImport 1.86 Dorik 1972


    I have now this when I want to import my old lists:



    Thread 388 = /usr/bin/enigma2 and 622 is unknown.


    I hope that I have the right Plugin and that I am in the tread about it.


    Update: I get now also crash logs, and this are extracts from it.