I seem to be missing columns on the left side, and the right side seems off by one.
From "Flavor" till "Price EUR" seems to be the issue. I think im missing the "Ability" column.
But i can see it on the app and i have all of the text downloaded.
@Maqui : Many thanks for the bug report. It is indeed a bug in the display of the column of item texts, due to recent addition of "defense" characteristics. This bug does not affect exports. It is now fixed in release 7.2b.
@The Piley One : Welcome to the Gatherer Extractor Community. It looks like you are doing things correctly... but maybe you forget to save your database and reload it when you re-open the software. It seems you start from scratch each time. Thus, if you want to resume the download process from a previous task, you first need to reload your database. Then, by selecting "Select all unprocessed sets" and starting the extraction, fully processed sets will still be there in the database, but they will not be extracted for a second time.
I hope this helps. feel free to reply if you need further support.
Hi,
I'm using last version of the software. Since (more or less) Wilds of Eldrain "mana value" column is zero for most of the cards. Adventure cards mana value is correct. If I try to download data for older sets, problem persists.
Thanks for your support.
@Cyber-Bix: Thank you for the report! WotC finally replaced "Converted Mana Cost" by "Mana Value" on the Gatherer
I will fix this in the next release (basically when Lost Caverns of Ixalan is released). I will also update the set list with the 'Dr who Commander' sets (basic set + planes + collector boosters).
I've been using this app for longer than I care to remember (now installed on my third computer!) and I do have one little request (which would make my life a whole lot easier. Is there any way that it can be configured to pull down two sets of images? At the moment I have to run the app once to pull down the cropped images, then again after changing all the settings to pull down the full art images?
Even if it's not possible, I'll keep doing it by hand, but it would make life a lot easier for me to just run it once, and also easier to keep updated when new sets are released. Thank you for all your incredible work on one of the main magic apps I use!
@Sylvester Temple: Many thanks for your comment. Great idea! This is a functionality that I would personally use as well!
However, this is not easy to do given the present code architecture. But is seems to be achievable!
In details, the user may define several parameter sets in the image preference panel (making sure extensions are different so that the image files will not overwrite each other!), and then, tick the ones to use for the extraction.
By the way, for WHO & LCI, I will release a new version of GEx with all the set parameters up-to-date. I am just waiting that multiverseIDs of LCI & LCC sets are available on Scryfall.
I guess a lot would also boil down to how people store the extracted data - For me, I've got a top level folder which holds everything, then subfolders for Full Art, Cropped images and extracted CSV files. If you don't separate out the full art and cropped images, then I could see card-art overwriting being an issue. Either way, looking forwards to the new version coming out.
@Sylvester Temple: There is currently only one column to show local scan status. How would you manage that if several parameter sets are now available for the image extraction? Would you implement one column per parameter set? If yes, this is a significant work.
By the way, checking the existence of files in local folders can take some time on very long database, and slow down the peformance (as you might experience when you load a big database with activated display of scan status). If there are several columns to show the local scan status, I am afraid of poor performance at database loading.
One way to do it would be to keep it as a single column, but use different colours for indicators - so Red for none, Orange for crop but not full, Blue for full but not cropped and Green for both? I'm not sure how much of an overhead that would be, and it would probably mean scanning for both the full art and the crop art at the same time, which as you say, runs into overheads with how long it takes to pull the data in, especially for us still living with spinning rust.
(I'll freely admit, I'm not a programmer, best I can do is bad psuedo code, and then googling to try and translate to machine usable code!)
@Sylvester Temple: That is a possibility, but I would prefer to go to one column per scan parameter set. Keep in mind one may want to process with the original scans, the full scans, the border crops, and the cropped versions alltogether! This will be a great work to do, but I would need some time for it. I cannot promise it is available for the next release, but I will keep you informed about the progress, for sure.
That shows how much I use the other two settings - I always forget about the border crop and the originals, I just use the Crop and the XL scan (whichever that one is!)
In all honesty, I never expected my request to be taken seriously, so if it's one of those things that doesn't appear for another 12 versions, I'll still use the app and be happy. Thank you for everything!
Amazing application I'd like to say firstly. Having an issue when exporting multiple sets to .sql the sets with an apostrophe (Brothers'' War, Urza''s Saga) are exporting with 2 '' and the VALUES are completely empty:
INSERT INTO Nsets VALUES
('Commander Legends: Battle for Baldur''''s Gate Collector Boosters','CCLB','06/2022','True','1','1','3','10','2','0.125','0.875','1','2',NULL,NULL,'True','0.167','False','0.00695',NULL);
@Chaudakh
First off, thank you very much for developing this program. Well worth the donation!
I seem to be stuck. I'm doing a large first time download. I have all the pictures which is amazing! I was able to do smaller downloads of all data, so I went for a big one. Everything looked great until this morning when I noticed that I am passed the remaining time, but the elapsed time in continuing. I tried to interrupt it to see what I was doing wrong, but now it has been in Cancellation Pending for a while. Any idea what I should do?
@Just 4 Fun: Many thanks for the donation, it's greatly appreciated
What you describe sometimes happens when a server is not responding anymore (usually, gatherer (!), and very rarely, scryfall). Thus, the program is stuck at a given card, waiting for data to come.
I acknowledge this situation is not well managed at the moment, and the code has to be improved. Skipping the blocking cards (with a time out) and continuing the extraction might not be a relevant solution, because many sets will probably be not completed accordingly. But I admit, the software should give you the control back and should not freeze. I will work on this in the coming weeks to get rid of this limitation.
What you can do in the meantime is to kill the program, then restart it. Normally, the pending database is automatically recovered during restart and you can resume the download, after having selected only the non-completed sets (with the preset). It is not ideal, but at least, you do not lose your former work.
I'm a little stuck : for a few weeks now, I've been trying to get all the datas from all the sets of Wilds of Eldraine and Lost Cavern of Ixalan in English and French (WOE, CWOE, WOC, WOT, LCO, CLCI and LCC) but, when I launch "download all datas", I only get WOT and WOC in French. Everything else is fine (all the datas are correct, the CSV is coorect, etc), it just seems that I'm not able to download them in another langage than English (I tried other langages too with the same result).
I use the last version of your software (7.2c), do you know what could cause this issue ?
@Hastorlin: Many thanks for your feedback. This is because data in foreign languages are not yet available on Scryfall (cf. screenshot hereafter). This is more or less normal for Lost Caverns of Ixalan as the set has just been released. But for Wilds of Eldraine, released on Sept., that's rather strange. Especially since Commander & Enchanting Tales have cards in French but not the main set. It may be worth opening a ticket at Scryfall to report it.
Just to let you know, I think I'm done with the development of the new functionalities. I am still in the test phase, though. Below some screenshots how it looks like.
Any feedback is very welcome!
Version 7.3 is released in beta version. I tested quite a lot the new scan management, but I cannot guarantee it's free of any bugs.
If you find some, feel free to report them in the forum and I will fix them quickly.
I've just noticed that I non-intentionally added my personal settings in the setting folder in the software deployer.
Installing the software at the same location of a former installation will likely overwrite your personal settings. Thus, you will have to set again manually your settings in the Option tab. I apoligize for those who are impacted. I corrected this in 7.3a. The deployer is now clean.
Lol discovered that when I finished downloading everything and found all the filenames were the ID numbers instead of card names - 360k+ files deleted, start again! No biggie, just a slight time issue, and I really didn't mind too much.
Actually, I've just thought of a quick question - is there any way for the app to pick up the art cards? Or is that something that is a vast amount of work that might not be possible? I can always go and grab all the images manually, but if there's any way this can do the art cards as well it would be fantastic.
Private Mod Note
():
Rollback Post to RevisionRollBack
To post a comment, please login or register a new account.
Im having an issue when i want to export to SQL.
I seem to be missing columns on the left side, and the right side seems off by one.
From "Flavor" till "Price EUR" seems to be the issue. I think im missing the "Ability" column.
But i can see it on the app and i have all of the text downloaded.
I think the image is quite helpful.
Anyways, thanks for the program!
@The Piley One : Welcome to the Gatherer Extractor Community. It looks like you are doing things correctly... but maybe you forget to save your database and reload it when you re-open the software. It seems you start from scratch each time. Thus, if you want to resume the download process from a previous task, you first need to reload your database. Then, by selecting "Select all unprocessed sets" and starting the extraction, fully processed sets will still be there in the database, but they will not be extracted for a second time.
I hope this helps. feel free to reply if you need further support.
Regards,
I'm using last version of the software. Since (more or less) Wilds of Eldrain "mana value" column is zero for most of the cards. Adventure cards mana value is correct. If I try to download data for older sets, problem persists.
Thanks for your support.
I will fix this in the next release (basically when Lost Caverns of Ixalan is released). I will also update the set list with the 'Dr who Commander' sets (basic set + planes + collector boosters).
Even if it's not possible, I'll keep doing it by hand, but it would make life a lot easier for me to just run it once, and also easier to keep updated when new sets are released. Thank you for all your incredible work on one of the main magic apps I use!
However, this is not easy to do given the present code architecture. But is seems to be achievable!
In details, the user may define several parameter sets in the image preference panel (making sure extensions are different so that the image files will not overwrite each other!), and then, tick the ones to use for the extraction.
By the way, for WHO & LCI, I will release a new version of GEx with all the set parameters up-to-date. I am just waiting that multiverseIDs of LCI & LCC sets are available on Scryfall.
By the way, checking the existence of files in local folders can take some time on very long database, and slow down the peformance (as you might experience when you load a big database with activated display of scan status). If there are several columns to show the local scan status, I am afraid of poor performance at database loading.
(I'll freely admit, I'm not a programmer, best I can do is bad psuedo code, and then googling to try and translate to machine usable code!)
In all honesty, I never expected my request to be taken seriously, so if it's one of those things that doesn't appear for another 12 versions, I'll still use the app and be happy. Thank you for everything!
INSERT INTO Nsets VALUES
('Commander Legends: Battle for Baldur''''s Gate Collector Boosters','CCLB','06/2022','True','1','1','3','10','2','0.125','0.875','1','2',NULL,NULL,'True','0.167','False','0.00695',NULL);
INSERT INTO cards VALUES
Any help would be appreciated
[EDIT]: I found the issue and fixed it. It should be OK now with the latest version (7.2c, released today). Have fun!
First off, thank you very much for developing this program. Well worth the donation!
I seem to be stuck. I'm doing a large first time download. I have all the pictures which is amazing! I was able to do smaller downloads of all data, so I went for a big one. Everything looked great until this morning when I noticed that I am passed the remaining time, but the elapsed time in continuing. I tried to interrupt it to see what I was doing wrong, but now it has been in Cancellation Pending for a while. Any idea what I should do?
What you describe sometimes happens when a server is not responding anymore (usually, gatherer (!), and very rarely, scryfall). Thus, the program is stuck at a given card, waiting for data to come.
I acknowledge this situation is not well managed at the moment, and the code has to be improved. Skipping the blocking cards (with a time out) and continuing the extraction might not be a relevant solution, because many sets will probably be not completed accordingly. But I admit, the software should give you the control back and should not freeze. I will work on this in the coming weeks to get rid of this limitation.
What you can do in the meantime is to kill the program, then restart it. Normally, the pending database is automatically recovered during restart and you can resume the download, after having selected only the non-completed sets (with the preset). It is not ideal, but at least, you do not lose your former work.
I'm a little stuck : for a few weeks now, I've been trying to get all the datas from all the sets of Wilds of Eldraine and Lost Cavern of Ixalan in English and French (WOE, CWOE, WOC, WOT, LCO, CLCI and LCC) but, when I launch "download all datas", I only get WOT and WOC in French. Everything else is fine (all the datas are correct, the CSV is coorect, etc), it just seems that I'm not able to download them in another langage than English (I tried other langages too with the same result).
I use the last version of your software (7.2c), do you know what could cause this issue ?
Any feedback is very welcome!
I presume that if you have full_art and artcropped, the fields in the main window would reflect that?
If you find some, feel free to report them in the forum and I will fix them quickly.
Enjoy
I've just noticed that I non-intentionally added my personal settings in the setting folder in the software deployer.
Installing the software at the same location of a former installation will likely overwrite your personal settings. Thus, you will have to set again manually your settings in the Option tab. I apoligize for those who are impacted. I corrected this in 7.3a. The deployer is now clean.