1/ I found the bug concerning the "Length error" for card "Omniclown/Pie-roclasm". The card is bugged on the WotC Gatherer (the pie-roclasm part is missing...). Thid will e fixed in the next release.
2/ The "out of memory error" is a mystery to me. I cannot reproduce it by changing the image settings as you suggest. Could you provide more info with a printscreen?
3/ The "DBNull error" is fixed. For an odd reason, some cards from Scryfall have defined multiverseID that seems not to exist on the Gatherer.
For instance:
[UNF] Katerina of Myra's Marvel has a multiverseID defined here : https://scryfall.com/card/unf/245/katerina-of-myras-marvels
But Gatherer returns the front page instead of the card page : https://gatherer.wizards.com/Pages/Card/Details.aspx?multiverseid=580587
Then errors are naturally raised because card info (type, ability etc.) are not found in the card-page logs.
The bug is now fixed and the fixing is available in the next release.
Sorry for those late answers. With many professional missions over the last months, it was pretty difficult for me to dedicate some time to Gatherer Extractor.
@ Kendeaux:
Thank you Kendeaux for your suggestions!
1/ automatic fetching/update of the Set Codes when a new set comes out is a difficult task. Because:
-- Collector booster sets are set manually and defined from Scryfall in the set menu
-- Double-faced card list and other special card lists that need a special management must be updated manually as well in the dedicated table.
That is why I always provide a small update when a new set comes out with updated parameter definitions so that the data extraction is correct. This update is usully available up to 5 working days after the set release on Scryfall.
2/ Save in separate csv is a good suggestion. I will implement it for next release. Loading multiple csv files or one after the other is already possible.
3/ Filtering the database by format seems achievable. However this would require a complete database with calculated legalities (this data is calculated based on the format definitions and not extracted by default)
@ MTGEpicurean:
Thanks MTGEpicurean for your feedback. It is much appreciated.
1/ That is right and I am currently working on it. I will try to see what slows down the opening of the panel and optimize this.
2/ I am sorry for the inconvenience. Unfortunately, I am not able to reproduce the bug. Could you describe in detail what you are doing to raise the unhandled exception? Many thanks in advance.
3/ Would you have a concrete example that would help me to fix the issue? Using card IDs remains the most secure way to manage cards and scans.
4/ I do not have any Discord group or so dedicated to Gatherer Extractor. I develop and maintain it on my spare time and provide the software to the MTG community for free. As a consequence, I do not want to put too much pressure on me with a highly-reactive support. I just do not have time for that given my professional-and-private life. Along with this point, I cannot commit on delivery dates about the implementation of requested services/options/developments and bug fixes.
Anyway, for a direct contact, feel free to send me a private message here.
Ok, the problem is more about overwritten files than the extraction itself. Normally, if alternative/variant entries are found — and if files are supposed to be stored by names — then you should have the file naming you describe (as the Alt. column should contain data like "1", "2" etc.). I'll check that and let you know.
@verdealex79: That's correct... and intentional All those crazy cards are stored in a dedicated set called "Magic 2021 Core Set Collector Boosters". I acknowledge this is a bit messy, but there are so many special cards now at each set release...
Concerning the tokens, the software seems to correctly extract the 30 tokens.
1/ You ought to download the last version of the software which includes an updated set databse. You should not leave set codes empty. Indeed, Scryfall set codes are mandatory to well extract foreign database and pics. You can either manually edit the sets (by clicking on the warning sign in the toolbar just above the set list) or download a software update;
2/ To activate the extraction in French, you have to tick the relevant item with the button with the flags on it. The software then extracts ticked foreign database from Scryfall (if available);
3/ The strange symbol you mention are just brackets with an empty set code in between
For collection management, I would strongly recommend you to use my other software "The Vault", as it is fully dedicated to that task. Gatherer Extractor is a database & pics manager.
Nonetheless, you ought to be able to extract the cards of the "Midnight Hunt" set in French. As you mention, French translations are available on Scryfall, thus I don't see any reason GEx won't extract them. Which export do you try to use?
Yes, you are right. Many of you reported those missing cards in private messages. Thanks again for having reported them.
The issue has been fixed in the new gamepack release (ATR, v1.82).
@ nickman55: Thanks for your report. I would love to solve the bug, but I cannot reproduce it. I was able to get fresh full databases from scratch without errors. In addition, the crash description is rather difficult to work with (data could not be decrypted). I googled help about what could raise those kind of errors, and I think it is raised by a certificate error with Scryfall or Gatherer which remains unmanaged in Gatherer Extractor. So I definitely have to fix that, but it is hard to troubleshoot without the possibility to reproduce the issue. I need more time to further investigate. But I am working on it.
Does it occur for you always for this card? Or rather randomly after a quite long period of data extraction?
In 7.0f when I export to .xls file and try to open it I get the following message from Excel:
"The file format and extension filename.xls don't match. The file could be corrupted or unsafe. Unless you trust its source, don't open it."
And if you continue, it should be OK. The file is safe. I must have a look at the library I am using in GEx to check why the file format and the extension filename (.xls) don't match for Excel.
In 7.0f when I export to .xls file and try to open it I get the following message from Excel:
"The file format and extension filename.xls don't match. The file could be corrupted or unsafe. Unless you trust its source, don't open it."
Why not directly using the SQL output of GEx? The ID column is listed as text as all the other columns.
@Fingersniffer: I have not written a wiki/user manual so far. It is an overwhelming task, but I know I have to.
1/ New sets are automatically added once those are available on the Gatherer. You have nothing to do. Nonetheless, I invite you to wait for an update, because I specify in this the new booster package, new legalities etc.
2/ There are some slight discrepancies between Gatherer database and Scryfall database. The Mana order ({R}{W} vs. {W}{R}) etc. is sometimes different for some cards. Harmonizing the database means for each card extracted from Scryfall, if the same card name exists from the Gatherer source, then the manacost and oracle ability text are overwritten. This ensures to remove all the small typos.
Here it is: https://app.box.com/s/w6xr1sjkx3jmtisphquxb793k5d5fyf5 the settings I'm using is: skip the tokens, download from gatherer (XLoriginal, xloriginal.png) in Spanish and the box to look for them in Scryfall if they not exist ticked. With that db the exceptions happened every time when it was trying to download the MDI set and the out of memory happened after some time when the app was scrapping all the other unprocessed sets (except for the MDI as it was throwing the first error), though it happened only once as I only tried once and then started a new db.
Thanks for your support. I will have a look and let you know about the outcome.
In addition, what are your settings concerning the scan naming? Named by card name ? card number ? I suspect the "forbidden character" may come from the 'crazy' numbering system of Scryfall for promos, with sometimes strange characters.
@ darkID:
1/ Yes I will see how to implement the download of localized images from Scryfall. It is not as straightforward and may not be available as soon as the next release.
2/ Many thanks for your bug report. I will fix the app based on your report, if I can reproduce all bugs. EDIT:
I cannot reproduce the first two reported bugs. They may be raised by a non-responding API from scryfall. Is it random or do you encounter this error always at the same card?
For the bug about missing spanish image from gatherer, the error is raised during scan saving, because the image is empty. I fixed it and it will be available in the next release.
For the ordering issue, this is because it is always sorted according to the user defined setcodes and not by the default setcodes as you seem to desire based on the option. I corrected this bug so as to get the relevant sorting based on the user option; it will be available in the next release.
@Dezconocido : I don't manage to reproduce the bug. could you give me a printscreen of your scan settings and tell me which card raises the error? thank you in advance.
1/ I found the bug concerning the "Length error" for card "Omniclown/Pie-roclasm". The card is bugged on the WotC Gatherer (the pie-roclasm part is missing...). Thid will e fixed in the next release.
2/ The "out of memory error" is a mystery to me. I cannot reproduce it by changing the image settings as you suggest. Could you provide more info with a printscreen?
3/ The "DBNull error" is fixed. For an odd reason, some cards from Scryfall have defined multiverseID that seems not to exist on the Gatherer.
For instance:
[UNF] Katerina of Myra's Marvel has a multiverseID defined here : https://scryfall.com/card/unf/245/katerina-of-myras-marvels
But Gatherer returns the front page instead of the card page : https://gatherer.wizards.com/Pages/Card/Details.aspx?multiverseid=580587
Then errors are naturally raised because card info (type, ability etc.) are not found in the card-page logs.
The bug is now fixed and the fixing is available in the next release.
Thanks a lot for your support.
@ Kendeaux:
Thank you Kendeaux for your suggestions!
1/ automatic fetching/update of the Set Codes when a new set comes out is a difficult task. Because:
-- Collector booster sets are set manually and defined from Scryfall in the set menu
-- Double-faced card list and other special card lists that need a special management must be updated manually as well in the dedicated table.
That is why I always provide a small update when a new set comes out with updated parameter definitions so that the data extraction is correct. This update is usully available up to 5 working days after the set release on Scryfall.
2/ Save in separate csv is a good suggestion. I will implement it for next release. Loading multiple csv files or one after the other is already possible.
3/ Filtering the database by format seems achievable. However this would require a complete database with calculated legalities (this data is calculated based on the format definitions and not extracted by default)
@ MTGEpicurean:
Thanks MTGEpicurean for your feedback. It is much appreciated.
1/ That is right and I am currently working on it. I will try to see what slows down the opening of the panel and optimize this.
2/ I am sorry for the inconvenience. Unfortunately, I am not able to reproduce the bug. Could you describe in detail what you are doing to raise the unhandled exception? Many thanks in advance.
3/ Would you have a concrete example that would help me to fix the issue? Using card IDs remains the most secure way to manage cards and scans.
4/ I do not have any Discord group or so dedicated to Gatherer Extractor. I develop and maintain it on my spare time and provide the software to the MTG community for free. As a consequence, I do not want to put too much pressure on me with a highly-reactive support. I just do not have time for that given my professional-and-private life. Along with this point, I cannot commit on delivery dates about the implementation of requested services/options/developments and bug fixes.
Anyway, for a direct contact, feel free to send me a private message here.
The Vault 70.22c is recommended for full compatibility with new Phyrexian Hybrid manas.
Enjoy!
I forgot to post it, but for sure, the gamepack has been updated up to Kamigawa Neon Dynasty. Enjoy !
Concerning the tokens, the software seems to correctly extract the 30 tokens.
1/ You ought to download the last version of the software which includes an updated set databse. You should not leave set codes empty. Indeed, Scryfall set codes are mandatory to well extract foreign database and pics. You can either manually edit the sets (by clicking on the warning sign in the toolbar just above the set list) or download a software update;
2/ To activate the extraction in French, you have to tick the relevant item with the button with the flags on it. The software then extracts ticked foreign database from Scryfall (if available);
3/ The strange symbol you mention are just brackets with an empty set code in between
Best regards,
For collection management, I would strongly recommend you to use my other software "The Vault", as it is fully dedicated to that task. Gatherer Extractor is a database & pics manager.
Nonetheless, you ought to be able to extract the cards of the "Midnight Hunt" set in French. As you mention, French translations are available on Scryfall, thus I don't see any reason GEx won't extract them. Which export do you try to use?
Best regards,
The issue has been fixed in the new gamepack release (ATR, v1.82).
Does it occur for you always for this card? Or rather randomly after a quite long period of data extraction?
Many thanks for your support.
And if you continue, it should be OK. The file is safe. I must have a look at the library I am using in GEx to check why the file format and the extension filename (.xls) don't match for Excel.
Why not directly using the SQL output of GEx? The ID column is listed as text as all the other columns.
1/ New sets are automatically added once those are available on the Gatherer. You have nothing to do. Nonetheless, I invite you to wait for an update, because I specify in this the new booster package, new legalities etc.
2/ There are some slight discrepancies between Gatherer database and Scryfall database. The Mana order ({R}{W} vs. {W}{R}) etc. is sometimes different for some cards. Harmonizing the database means for each card extracted from Scryfall, if the same card name exists from the Gatherer source, then the manacost and oracle ability text are overwritten. This ensures to remove all the small typos.
Thanks for your support. I will have a look and let you know about the outcome.
In addition, what are your settings concerning the scan naming? Named by card name ? card number ? I suspect the "forbidden character" may come from the 'crazy' numbering system of Scryfall for promos, with sometimes strange characters.
1/ Yes I will see how to implement the download of localized images from Scryfall. It is not as straightforward and may not be available as soon as the next release.
2/ Many thanks for your bug report. I will fix the app based on your report, if I can reproduce all bugs.
EDIT: