Hey there, I just downloaded the Magic Origins data, and the Double Faced Planeswalkers didn't come through correctly. Here are the problems that I see (I'm exporting to Excel, so I'm only looking at the columns I chose to export)
CMC, Mana Cost and Rules Text of both sides show the CMC and Mana Cost of the front
Power, Toughness and Loyalty of both sides show information from the other side (both Kytheon and Gideon are shown as a 2/2 with 3 loyalty)
Variation of both sides show the same thing (I assume the front side)
[*}Neither side has anything in the "ID (back)" column
As always, great work. This is a great tool that I'm sure will only continue to get better
Private Mod Note
():
Rollback Post to RevisionRollBack
--
Reliquary for iOS
Your Magic Collection Anywhere You Go reliquaryapp.com
Hi !
This is because the set is not available from magiccards.info.
Cards numbers are grabbed from magiccards.info (they offer the real card numbers for elder sets such as Tempest etc which is not the case of the gatherer, that's why those are overwritten by the ones from magiccards.info, not gatherer). A double-face card number contains a or b to distinguish between the two faces.
As double-card extraction works great for the Innistrad set, it should also be the case for ORI as soon as the card numbers are available from magiccard.info. Just be patient, it's a question of days!
When I attempt to export Magic Origins, it's only returning 103 of the cards. I think there's supposed to be about 272. Is this a known bug or am I doing something incorrectly?
(I looked in the thread of an answer to my question but I couldn't find one. Apologies if I overlooked it and this has already been answered.)
Edit: I really need this information, so if anyone is not having this problem and could provide me with an export of all of the Magic Origins data, I would really appreciate it.
Origins cards seem to not have any set ID in the exported XML, nor does it seem to be fetching prices for the cards? I'm guessing those are related to the same issue.
Well... I just typed out a very long, detailed, and courteous sounding post, and then previewed it.. I then made an adjustment, and thought I'd have to hit "Cancel Preview" to view the change, and apparently hitting that also cancels your "post in progress".... So yeh, I'll probably be much briefer this time, and it may not sound as friendly as it previously did Lol.. But I'm both very short on time now, and also frustrated.
Two possible bugs, that may or may NOT be the Extractors fault:
It lists the wrong version with virtually all of the cards that have multiple versions (lands and other cards both). Example: http://prntscr.com/82w2ap
Sometimes when there are multiple versions of a certain card (usually promo cards, but also the lands from certain sets), it will only download the image for one of them, even though magiccards.info has the images for all of them. One example is Super Series cards.
Thanks, and sorry for the briefness this time around!
Hello dear Chaudakh I have been using ur software since 2011 and always have been very satisfied ! This is awesome work ! But I have a question can I have a retro build ? I am builing a web librry of my cards collection and I use MySQL to insert and retrieve data, I was used to a previous build u had back in January and now the data I received is not the exactly the same. If I could get back to this build make my life a lot easier !!
@ philod : This can occur during an update of the WotC Gatherer Website. It's only a question of minutes, and the 'bug' disappears without any actions from your side.
@ HanClinto : this is because you need to define a set code for Magic Origins. You should see a "warning icon" on the main panel informing you that some set code are missing. The sets with a missing set codes are highlighted in red.
@ Joshuamtgprice : This is because you don't launch the "Download all data" process. this process looks for alternate versions when extracting data, and create new rows for them.
@ Mitraglia : Some fields are extracted from the gatherer, the others are computed. the "original" column is a computed column that indicates if the card is a reprint or an original card. Just tell me which fields need to be further described.
Concerning the set codes, as already mentionned, The 1-or-2-letter set codes are a legacy of elder unofficial set codes massively spread out the MtG community. I know those set codes were updated by WotC and replaced by a 3-letter acronyms. But people are definitely familiar with those former set codes and I don't want to change this by default. If you do want the 3-letter set codes, you can edit the set datatable as you wish(Action menu > Edit set codes).
@ Alex M : the issue with elder version is that some data will not be properly extracted from the gatherer website because of multiple modification of the code sources. What changes impacted you in the last GEx updates ?
@ brine : Is the MS Office Web Component 11 installed on your computer? You need to be able to export in Excel. If you updated your old windows for Windows 10, I would suggest you to resinstall property the MS .NET Framework, as well as MS OWC11 (links are given at the top of this thread).
@ ShMk : This will be fixed in the next released. Thanks for having reported!
I've been notified that there are some Scheme and Planechase cards that are missing from the most recent extraction that I have.
Archenemy Promo Schemes:
Plots That Span Centuries
Your Inescapable Doom
Perhaps You've Meet My Cohort
Imprison This Insolent Wretch
Planchase and Planechase 2012 Promos:
Horizon Boughs
Tember City
Celestine Reef
Mirrored Depths
Stairs to Infinity
These cards are listed on magiccards.info, however Gatherer Extractor does not know about them. I would like to manually add them into Gatherer Extractor, is this recommended, or could it lead to all sorts of bad things when it tries to open is's saved database?
Thanks!
Private Mod Note
():
Rollback Post to RevisionRollBack
--
Reliquary for iOS
Your Magic Collection Anywhere You Go reliquaryapp.com
@ Mitraglia :
variation is filled when you download all data. It is an integer representing the copy ID in the set. Useful to discern between all the different versions of basic lands within a set for example.
rating is a double representing the public rating as displayed on the Gatherer. the range is [0,5]
watermark is the name of the visible watermark on the card. Ex: Dimir, Golgari, Simic, Phyrexian, Mirran, Sultai, Mardu etc.
Number of prints is a computed column counting the number of (re)prints of a given card;
Yes, you can change the setcode as you want, and GEx will still work. The 'magiccards.info set code' must be compliant with the setcode on that website, otherwise, prices and other data will not be correctly extracted.
@ nickman55 : You can add it manually in the .csv file. you must respect the formatting. The database format is checked when loading, and you have a warning message if something goes wrong.
As the added cards will not be parsed by GEx when extracting data, those cards will never be overwritten in the data downloading process.
@ dan : It will be available when the set is officially released on the Wotc Gatherer, as well as on magiccards.info.
@ Pridwen : This is odd... What are your settings in Options > Scans ? Are all the cards like this or only the first one? Have you changed something between Original/Fullscan/Cropped in the Option menu prior to the download of the scans?
I actually had the same thing happen with some of the promo cards. The most recent one was the WCQ Geist of Saint Traft.
Also, I can't seem to get Gatherer Extractor to overwrite the existing data. It saved the incorrect data from the DFC in Origins, and now when I try to download the data again, it will not replace it with the correct data. I do not have "Not overwrite existing data" checked in Options, but it does not seem to want to follow that. Here is a link to my database file if that will help.
Thanks!
Private Mod Note
():
Rollback Post to RevisionRollBack
--
Reliquary for iOS
Your Magic Collection Anywhere You Go reliquaryapp.com
@ Pridwen : This is odd... What are your settings in Options > Scans ? Are all the cards like this or only the first one? Have you changed something between Original/Fullscan/Cropped in the Option menu prior to the download of the scans?
I don't change anithing, but i see - picture properites changed: high and weight changed.
@ Joshuamtgprice : This is because you don't launch the "Download all data" process. this process looks for alternate versions when extracting data, and create new rows for them.
I'm sorry, I totally forgot about this post until just now lol.. Got so damn busy, I barely had time to breathe. But actually, that's not the case here I'm fairly certain, since I always use the "Download all data + Download Scans" option (and sometimes without the scans). Go and download umm.. an 8th Edition magic workstation format file. Then go down to the lands at the bottom of the list, starting with "Plains". Notice that the 1st Plains listed, is Plains (3). But then look at the "Card #" and follow the card number (which goes in order) where-as the lands have the wrong numbers. Maybe I've described it a little better this time.
How it is now:
Plains (1) = Card #332
Plains (2) = Card #334
Plains (3) = Card #331
Plains (4) = Card #333
How it should be:
Plains (1) = Card #331
Plains (2) = Card #332
Plains (3) = Card #333
Plains (4) = Card #334
As always, great work. This is a great tool that I'm sure will only continue to get better
Reliquary for iOS
Your Magic Collection Anywhere You Go
reliquaryapp.com
This is because the set is not available from magiccards.info.
Cards numbers are grabbed from magiccards.info (they offer the real card numbers for elder sets such as Tempest etc which is not the case of the gatherer, that's why those are overwritten by the ones from magiccards.info, not gatherer). A double-face card number contains a or b to distinguish between the two faces.
As double-card extraction works great for the Innistrad set, it should also be the case for ORI as soon as the card numbers are available from magiccard.info. Just be patient, it's a question of days!
Reliquary for iOS
Your Magic Collection Anywhere You Go
reliquaryapp.com
(Notice the column counts.)
the second line is longer than the first one but it has exactly the same number of columns...
I fixed a minor bug in the SQL extraction in release 3.18c
(I looked in the thread of an answer to my question but I couldn't find one. Apologies if I overlooked it and this has already been answered.)
Edit: I really need this information, so if anyone is not having this problem and could provide me with an export of all of the Magic Origins data, I would really appreciate it.
This is opposed to other sets which don't have a blank CDATA for the <set> field:
This is running with version 3.18c
Two possible bugs, that may or may NOT be the Extractors fault:
Thanks, and sorry for the briefness this time around!
~Joshua
And actually, the second line DOES have one less column then the first line, from how it looks.
Thx again for this awesome work !
@ philod : This can occur during an update of the WotC Gatherer Website. It's only a question of minutes, and the 'bug' disappears without any actions from your side.
@ HanClinto : this is because you need to define a set code for Magic Origins. You should see a "warning icon" on the main panel informing you that some set code are missing. The sets with a missing set codes are highlighted in red.
@ Joshuamtgprice : This is because you don't launch the "Download all data" process. this process looks for alternate versions when extracting data, and create new rows for them.
@ Mitraglia : Some fields are extracted from the gatherer, the others are computed. the "original" column is a computed column that indicates if the card is a reprint or an original card. Just tell me which fields need to be further described.
Concerning the set codes, as already mentionned, The 1-or-2-letter set codes are a legacy of elder unofficial set codes massively spread out the MtG community. I know those set codes were updated by WotC and replaced by a 3-letter acronyms. But people are definitely familiar with those former set codes and I don't want to change this by default. If you do want the 3-letter set codes, you can edit the set datatable as you wish(Action menu > Edit set codes).
@ Alex M : the issue with elder version is that some data will not be properly extracted from the gatherer website because of multiple modification of the code sources. What changes impacted you in the last GEx updates ?
@ ShMk : This will be fixed in the next released. Thanks for having reported!
oh btw, you can take the OCTGN export stuff out of the code if you wish, we don't use that format for our sets anymore.
I've been notified that there are some Scheme and Planechase cards that are missing from the most recent extraction that I have.
These cards are listed on magiccards.info, however Gatherer Extractor does not know about them. I would like to manually add them into Gatherer Extractor, is this recommended, or could it lead to all sorts of bad things when it tries to open is's saved database?
Thanks!
Reliquary for iOS
Your Magic Collection Anywhere You Go
reliquaryapp.com
Thanks,
-Dan
variation is filled when you download all data. It is an integer representing the copy ID in the set. Useful to discern between all the different versions of basic lands within a set for example.
rating is a double representing the public rating as displayed on the Gatherer. the range is [0,5]
watermark is the name of the visible watermark on the card. Ex: Dimir, Golgari, Simic, Phyrexian, Mirran, Sultai, Mardu etc.
Number of prints is a computed column counting the number of (re)prints of a given card;
Yes, you can change the setcode as you want, and GEx will still work. The 'magiccards.info set code' must be compliant with the setcode on that website, otherwise, prices and other data will not be correctly extracted.
@ nickman55 : You can add it manually in the .csv file. you must respect the formatting. The database format is checked when loading, and you have a warning message if something goes wrong.
As the added cards will not be parsed by GEx when extracting data, those cards will never be overwritten in the data downloading process.
@ dan : It will be available when the set is officially released on the Wotc Gatherer, as well as on magiccards.info.
Innistrad (I've checked ISD, not DKA / AVR yet) flip cards are not picking up rulings. E.g. Delver has a ruling, but nothing in Gatherer Extractor.
Also, I can't seem to get Gatherer Extractor to overwrite the existing data. It saved the incorrect data from the DFC in Origins, and now when I try to download the data again, it will not replace it with the correct data. I do not have "Not overwrite existing data" checked in Options, but it does not seem to want to follow that. Here is a link to my database file if that will help.
Thanks!
Reliquary for iOS
Your Magic Collection Anywhere You Go
reliquaryapp.com
...and Dragon's Maze split cards are also not including rulings.
I don't change anithing, but i see - picture properites changed: high and weight changed.
Some minor bugs have been corrected.
@ Pridwen: I have no damn idea of why you have this. I need further info to track that minor bug.
I'm sorry, I totally forgot about this post until just now lol.. Got so damn busy, I barely had time to breathe. But actually, that's not the case here I'm fairly certain, since I always use the "Download all data + Download Scans" option (and sometimes without the scans). Go and download umm.. an 8th Edition magic workstation format file. Then go down to the lands at the bottom of the list, starting with "Plains". Notice that the 1st Plains listed, is Plains (3). But then look at the "Card #" and follow the card number (which goes in order) where-as the lands have the wrong numbers. Maybe I've described it a little better this time.
How it is now:
Plains (1) = Card #332
Plains (2) = Card #334
Plains (3) = Card #331
Plains (4) = Card #333
How it should be:
Plains (1) = Card #331
Plains (2) = Card #332
Plains (3) = Card #333
Plains (4) = Card #334
You should be able to fix that, if you go and change the setting I've pointed out in this screenshot: http://prntscr.com/8cyinp
I had that same problem once also, and that's how I fixed mine. And yeah, it did seem to usually happen to promo cards the worst for me also.