Here is my software "Gatherer Extractor", which can easily be downloaded at the following URL:
------------------------------ www.mediafire.com/?3akc6mtapnar2
------------------------------ Version: 7.3e2
Release Date: 28/09/2024
------------------------------
The software helps you to:
- Get a full or partial MtG Database. The software gathers information from gatherer.wizards.com and magiccards.info.
The card database can be saved as CSV or XML. I could see that many people are looking for MtG Database for MTG online shops, personal websites or applications. Here is a good tool to get it!
- Get card scans in the language of your choice, and in the format of your choice (original, fullscan, cropped), and save them on your computer.
The source website can be chosen by the users, so that are accessible low quality scans from the Gatherer, and semi-HQ scans from magiccards.info (English only)
- Compile a Spoiler List text file for MagicWorkstation. Very useful to get a clean and bug-free spoiler text with correct formating.
- Get a MWS Text Spoiler for home-made sets, as long as the original CSV file is correctly formated for Gatherer Extractor
------------------------------
REQUIREMENTS
------------------------------
- OS : Windows XP, Vista, Seven, 8, 10.
- Microsoft Framework .NET 4.7.2 If you don't have it installed on your computer, please download it for free at: https://dotnet.microsoft.com/download/dotnet-framework/net472 - Screen resolution at least 1024x768
- Execution as Administrator for Windows Vista and Windows 7/8/10.
For those interested in, it is possible to add others supported languages. Translate directly EN.lang into a target foreign language and add the new .lang file into the "/data/language" folder!
Please let me know if you translate the software in another foreign language, so that I can add your translation to the next versions!
Enjoy, and feel free to report bugs, post comment, and to suggest improvement!
Some screenshots:
-----------------------------------
To be done :
- JSON exportation
Perhaps some sort of custom filters could be added? For example, the Color column will export as G, R, W, etc. Having a filter that says something like "convert all instances of G in Color to Green" would be useful.
There was not even thinking about UTF-8 ... edited in the "textpad"! Thanks for the correction!
I'm planning to put this program on my compilation "MWS EasyInstall" but I have a doubt. Would like all the program settings (folder options / selected and all the rest) be loaded from an external file for the program? (file ".ini" for example)
The spoiler is raised with the language I choose? (eg Portuguese)
From what I noticed only displays the name of cards, without the text. Is that right?
2/ Gatherer Extractor provides internal default settings. Nevertheless, you'd better add the .../Gatherer Extractor/data/Abreviations.cfg file. This file contains all information about MtG sets. Including it will prevent the user from keyboarding all set codes (internal and from MagicCards.info) and all released dates.
Note that when an additional set is available (from gatherer or magiccards.info), the program send you an alert to invite you to keyboard the corresponding codes.
3/ You may include Gatherer Extractor to you MWS EasyInstall project, but you'd better include the Gatherer Extractor Installer.exe to ensure a bug-free iinstallation
4/ The language you choose in the "General" Option Tab is for the displayed language for the software. The language you choose in the "Scan" Option Tab is the language used for scans. The replacement language is always English, when a scan is required in another foreign language but not available from gatherer or magiccards.info
Unfortunately, the magiccards.info & gatherer database are very incomplete. Only the foreign card name are available. I'm currently working on finding a way to extract from other sources an additional database in a given foreign language (French, German or Portuguese for example)
I opened your installation file so I had access to all command lines that you used for installation (inno setup).
This way I can compile into a single installer, without having any bug.
My idea is to make your program in the root folder MWS, so that the folder "pics" of his program and the MWS would be the same.
It also includes a shortcut to your start menu program, such as "extra " MWS. Obviously, your program will integrate the file of "special thanks" along with a link to this forum.
If you want some more information to be included (maybe email) send me a private message.
When to my questions, I understood everything perfectly! Once you have new updates let me know so I update the "extra " in EasyInstall.
I'm expecting just another confirmation (another feature of MWS) to upgrade to version 1.2 EasyInstall that already include your program
The acronyms of the issues change much from program to program, or even from site to site.
Would put a "filter " that took a letter "X"of the site and time to save save the hard drive as the letter "Y" (current filter)?
Example:
From the Vault: Exiled
In Gatherer = EXL;
In Magic Cards Info = FVE;
In Filter (and therefore what will be generated regardless of the source in HD) = 123
The acronym Edition From the Vault: Exiled to the "Gatherer"is "EXL"
And for the "Magic Cards Info is FVE
And the program I use the acronym for the edition is "123" (Exemple: Magic Workstation)
If I download the images for the "Gatherer" or "Magic Card Info" program will create a folder "EXL" or "EVP" (which are different from my program).
What I mean is: Include a "filter" where, regardless of the site that its program to download the image, he will play this file in a folder defined by this filter.
Example:
From the Vault: Exiled
Balance -> download by Gatherer
Berserk -> download by Magic Cards Info
(continues like this with all cards)
Regardless of which source (or magic cards info gatherer), the program will include this file in the folder defined by the filter "123"
In fact, you can edit the code file (Menu : Edit > Edit Set Code) as you wish. The first column contains the full name of sets. The second column is not the set codes for the gatherer, but contains the codes you want! The third is the official magiccards.info codes.
The program doesn't need codes to download data and scans from the gatherer, as the ID is the only data required to get cards. Set codes (magiccards.info column) are however required for magiccards.info as cards can be retrieved on the website only with their set codes and card #.
The name of the folder created to store card scans is the code you decide in the 2nd column of the code editor.
It should be enough for a customizable definition of sets, or you still want a "filter" ?
I thought the acronym present in the editor affected directly download the information and scans.
If I can freely change the second column ("Set Code"), then do not really need any "filter" or additional application.
One more doubt (I do hope that is the last to stop wasting your time LOL!)
There is also, in a next update, you put the default option "FULLSCAN" and format ".full.jpg". Instead of the current options "Original" and ".original.jpg"?
Thus the user does not need (in the case of MWS) to make any further adjustment to download the information and images.
I was also thinking about if, instead of using the shift key to select more than one edition, one could use "check-box". He thought it would make more intuitive for the end user.
Moreover, the future could include an option to export to "netDraft"?
This program is good, but suffers from the lack of updates the database of "sets" (expansions).
If you include this option (to export) I could include NetDraft updated, too, in EasyInstall.
Sorry so many questions! Is that really liked the application!
Very good and useful! Unfortunately for me, I had almost finished my own (personal) code before finding this :-/, but that's not your fault obv. I so hate text parsers now!
Unfortunately, the magiccards.info & gatherer database are very incomplete. Only the foreign card name are available.
What do you mean? They are incomplete set wise, but for any card that you can get a foreign name, there is also the full text in Gatherer. It's very easy to miss, but if you set the 'printed' var to 'true' you get printed text, which for foreign cards mean native (translated) text.
So, you append the foreign card's ID (as you now, they have unique multiverse IDs) to this URL:
I know about foreign printed text. But see for example old cards, like Vindicate in French. You got this : http://gatherer.wizards.com/Pages/Card/Details.aspx?multiverseid=179210
Only the flavor text and name is translated. not the type and ability. This is in that way I say Gatherer is very incomplete for foreign cards. You may notice portuguese and spanish translation is also lacking form the Gatherer. The situation is even worst for set like Tempest or Urza, in which cards are available only in English despite many foreign issue (at least German, Italian, French, Spanish, Portuguese, Japanese, Chinese and Korean).
The situation is much better for more recent cards, as you mentioned.
The program gets access to foreign scans via foreign ID. I can add columns to store the foreign ID. But there is more work to store a complete database in a foreign language.
I get the foreign name from magiccards.info, whose foreign database is complete for foreign name. But many foreign types and abilities are lacking...
I'm not doubting you, but I see french Vindicate fine? Click on "Printed" in your link of just add '&printed=true'. What am I missing?
Screenshot:
Maybe some cookie or wotc.com Language issue? You know, I spent four+ months thinking gatherer was down and I just needed to change Language to English when searching english card names (I'm spanish). Or something, I can't remember. Gatherer is so annoying sometimes...
Yeah, the new gatherer gave me headaches too about language cookies...
However, the fact that some language are missing (Spanish and Portuguese for Apocalypse for instance), and that some sets are not translated (Tempest block for example) is very redhibitory for an accurate extraction of a foreign database from the Gatherer. That's the main problem.
I noticed a little bug in spoiler text extraction from Duel Decks editions : some token cards are included in the Gatherer spoiler text, but should not be.
I added a token filter in the v2.2 to avoid tokens in extracted database.
To download things, you just need to select in the listbox all the sets you want to download (press ctrl or maj for multiselection)
Then uncheck "Extract additional card information" if you want only card IDs and names. Check this option if you want to download all card data (ie ability, mana cost etc.).
When you get the list, you can download all scans from the list by clicking on the "Download scans" button. Make sure you choose the websource you wanted in "Options" menu for the scan extraction.
You can save your list as xml or csv. A former list can be recovered as csv is the program native format.
— First, may you open the /data/Abreviations.cfg file with Notepad. This file is UTF-8 encoded. Can you see all the sets registered in the file with lines like "Arabian Nights // AN // AN // 12/1993" ?
Normally, that file should be OK.
— Is the connectivity to the gatherer and to magiccards.info OK?
I'm pretty sure you don't have connectivity. If not, 3 possibilites:
1/ Can you access to the gatherer or magiccards.info from your web browser? If not, you may have a problem with your Internet connexion on your computeur.
2/ Please check your firewall settings and make sure you allowed Gatherer Extractor to access the Internet.
3/ If you still have no connectivity to the gatherer or magiccards.info with Gatherer Extractor, you may have a malware or trojan running on your computer which prevent svhost.exe from authorizing applications you run to access the Internet (such as your firewall/antivirus upgrades etc.) Install Malwarebytes' anti-malware, run it and clean your computer from malwares.
Everything is installed fine and I have connectivity.
The file you mentioned abbreviations.cfg is completely empty!
Well it only has the following line:
" // // // "
There is nothing else in the file at all.
You probably tried to edit and save the Abreviations file from the "Edit" menu and you had no permission to write the file, resulting in a empty file.
1/ Please reinstall the program: it will overwrite the current file so that you'll get a safe Abreviations.cfg file.
2/ Make sure you run the program as administrator, so that you will have all permissions to write files.
Note that when new sets are available, you'll get an alert almost like the one you have to invite you to complete the abreviations.cfg thanks to the editor provided in the "Edit" menu.
In your case, you told me the Set listbox was empty. It was only disable which is not at all the same, for bug finding and fixing
Private Mod Note
():
Rollback Post to RevisionRollBack
To post a comment, please login or register a new account.
Hello !
Here is my software "Gatherer Extractor", which can easily be downloaded at the following URL:
------------------------------
www.mediafire.com/?3akc6mtapnar2
------------------------------
Version: 7.3e2
Release Date: 28/09/2024
------------------------------
The software helps you to:
- Get a full or partial MtG Database. The software gathers information from gatherer.wizards.com and magiccards.info.
The card database can be saved as CSV or XML.
I could see that many people are looking for MtG Database for MTG online shops, personal websites or applications. Here is a good tool to get it!
- Get card scans in the language of your choice, and in the format of your choice (original, fullscan, cropped), and save them on your computer.
The source website can be chosen by the users, so that are accessible low quality scans from the Gatherer, and semi-HQ scans from magiccards.info (English only)
- Compile a Spoiler List text file for MagicWorkstation. Very useful to get a clean and bug-free spoiler text with correct formating.
- Get a MWS Text Spoiler for home-made sets, as long as the original CSV file is correctly formated for Gatherer Extractor
------------------------------
REQUIREMENTS
------------------------------
- OS : Windows XP, Vista, Seven, 8, 10.
- Microsoft Framework .NET 4.7.2 If you don't have it installed on your computer, please download it for free at: https://dotnet.microsoft.com/download/dotnet-framework/net472
- Screen resolution at least 1024x768
- Execution as Administrator for Windows Vista and Windows 7/8/10.
------------------------------
OPTIONALS
------------------------------
- Microsoft Office Web Components 11 (OWC11). This is mandatory if you want exportation to xlsx format to work properly. If you don't have it installed on your computer, please download it for free at: https://download.cnet.com/Office-2003-Add-in-Office-Web-Components/3000-2070_4-10742090.html
For those interested in, it is possible to add others supported languages. Translate directly EN.lang into a target foreign language and add the new .lang file into the "/data/language" folder!
Please let me know if you translate the software in another foreign language, so that I can add your translation to the next versions!
Enjoy, and feel free to report bugs, post comment, and to suggest improvement!
Some screenshots:
-----------------------------------
To be done :
- JSON exportation
— Fixed extraction bug with flipping cards
— Fixed extraction bug of B.F.M. (Big Fury Master
— Fixed extraction bug of */* creatures from magiccards.info
Feel free to let me know if you find bugs, or for any remarks or suggestions.
Enjoy!
http://www.mediafire.com/?pcljjlv8xdumt9o
Please include this file in the next update.
How do I get the program to recognize Latin characters?
Thanks.
All Sources For MWS
The file must be UTF-8 encoded, but I will do the correct encoding from your file.
The BR.lang will be of course added in the next update!
I'm planning to put this program on my compilation "MWS EasyInstall" but I have a doubt. Would like all the program settings (folder options / selected and all the rest) be loaded from an external file for the program? (file ".ini" for example)
Allow me to include your program in this build?
(To give the project follow the link: http://forum.mtgbr.com/viewtopic.php?f=27&t=337 second post)
One last doubt:
The spoiler is raised with the language I choose? (eg Portuguese)
From what I noticed only displays the name of cards, without the text. Is that right?
Tks for all
All Sources For MWS
2/ Gatherer Extractor provides internal default settings. Nevertheless, you'd better add the .../Gatherer Extractor/data/Abreviations.cfg file. This file contains all information about MtG sets. Including it will prevent the user from keyboarding all set codes (internal and from MagicCards.info) and all released dates.
Note that when an additional set is available (from gatherer or magiccards.info), the program send you an alert to invite you to keyboard the corresponding codes.
3/ You may include Gatherer Extractor to you MWS EasyInstall project, but you'd better include the Gatherer Extractor Installer.exe to ensure a bug-free iinstallation
4/ The language you choose in the "General" Option Tab is for the displayed language for the software. The language you choose in the "Scan" Option Tab is the language used for scans. The replacement language is always English, when a scan is required in another foreign language but not available from gatherer or magiccards.info
Unfortunately, the magiccards.info & gatherer database are very incomplete. Only the foreign card name are available. I'm currently working on finding a way to extract from other sources an additional database in a given foreign language (French, German or Portuguese for example)
This way I can compile into a single installer, without having any bug.
My idea is to make your program in the root folder MWS, so that the folder "pics" of his program and the MWS would be the same.
It also includes a shortcut to your start menu program, such as "extra " MWS. Obviously, your program will integrate the file of "special thanks" along with a link to this forum.
If you want some more information to be included (maybe email) send me a private message.
When to my questions, I understood everything perfectly! Once you have new updates let me know so I update the "extra " in EasyInstall.
I'm expecting just another confirmation (another feature of MWS) to upgrade to version 1.2 EasyInstall that already include your program
I am available whenever you need it!
Bye and thanks again!
All Sources For MWS
The acronyms of the issues change much from program to program, or even from site to site.
Would put a "filter " that took a letter "X"of the site and time to save save the hard drive as the letter "Y" (current filter)?
Example:
From the Vault: Exiled
In Gatherer = EXL;
In Magic Cards Info = FVE;
In Filter (and therefore what will be generated regardless of the source in HD) = 123
All Sources For MWS
The acronym Edition From the Vault: Exiled to the "Gatherer"is "EXL"
And for the "Magic Cards Info is FVE
And the program I use the acronym for the edition is "123" (Exemple: Magic Workstation)
If I download the images for the "Gatherer" or "Magic Card Info" program will create a folder "EXL" or "EVP" (which are different from my program).
What I mean is: Include a "filter" where, regardless of the site that its program to download the image, he will play this file in a folder defined by this filter.
Example:
From the Vault: Exiled
Balance -> download by Gatherer
Berserk -> download by Magic Cards Info
(continues like this with all cards)
Regardless of which source (or magic cards info gatherer), the program will include this file in the folder defined by the filter "123"
It was explained better now?
Tks
All Sources For MWS
In fact, you can edit the code file (Menu : Edit > Edit Set Code) as you wish. The first column contains the full name of sets. The second column is not the set codes for the gatherer, but contains the codes you want! The third is the official magiccards.info codes.
The program doesn't need codes to download data and scans from the gatherer, as the ID is the only data required to get cards. Set codes (magiccards.info column) are however required for magiccards.info as cards can be retrieved on the website only with their set codes and card #.
The name of the folder created to store card scans is the code you decide in the 2nd column of the code editor.
It should be enough for a customizable definition of sets, or you still want a "filter" ?
I thought the acronym present in the editor affected directly download the information and scans.
If I can freely change the second column ("Set Code"), then do not really need any "filter" or additional application.
One more doubt (I do hope that is the last to stop wasting your time LOL!)
There is also, in a next update, you put the default option "FULLSCAN" and format ".full.jpg". Instead of the current options "Original" and ".original.jpg"?
Thus the user does not need (in the case of MWS) to make any further adjustment to download the information and images.
I was also thinking about if, instead of using the shift key to select more than one edition, one could use "check-box". He thought it would make more intuitive for the end user.
Moreover, the future could include an option to export to "netDraft"?
This program is good, but suffers from the lack of updates the database of "sets" (expansions).
If you include this option (to export) I could include NetDraft updated, too, in EasyInstall.
Sorry so many questions! Is that really liked the application!
Thanks again!
All Sources For MWS
What do you mean? They are incomplete set wise, but for any card that you can get a foreign name, there is also the full text in Gatherer. It's very easy to miss, but if you set the 'printed' var to 'true' you get printed text, which for foreign cards mean native (translated) text.
So, you append the foreign card's ID (as you now, they have unique multiverse IDs) to this URL:
Blue Sun's Zenith in spanish would be:
http://gatherer.wizards.com/Pages/Card/Details.aspx?printed=true&multiverseid=240700
If this software saved the foreign multiverse IDs and printed texts too (even english), it would be perfect for my goals!
http://gatherer.wizards.com/Pages/Card/Details.aspx?multiverseid=179210
Only the flavor text and name is translated. not the type and ability. This is in that way I say Gatherer is very incomplete for foreign cards. You may notice portuguese and spanish translation is also lacking form the Gatherer. The situation is even worst for set like Tempest or Urza, in which cards are available only in English despite many foreign issue (at least German, Italian, French, Spanish, Portuguese, Japanese, Chinese and Korean).
The situation is much better for more recent cards, as you mentioned.
The program gets access to foreign scans via foreign ID. I can add columns to store the foreign ID. But there is more work to store a complete database in a foreign language.
I get the foreign name from magiccards.info, whose foreign database is complete for foreign name. But many foreign types and abilities are lacking...
Screenshot:
Maybe some cookie or wotc.com Language issue? You know, I spent four+ months thinking gatherer was down and I just needed to change Language to English when searching english card names (I'm spanish). Or something, I can't remember. Gatherer is so annoying sometimes...
However, the fact that some language are missing (Spanish and Portuguese for Apocalypse for instance), and that some sets are not translated (Tempest block for example) is very redhibitory for an accurate extraction of a foreign database from the Gatherer. That's the main problem.
I added a token filter in the v2.2 to avoid tokens in extracted database.
All Sources For MWS
Where can I get this file?
Thank you.
Then uncheck "Extract additional card information" if you want only card IDs and names. Check this option if you want to download all card data (ie ability, mana cost etc.).
When you get the list, you can download all scans from the list by clicking on the "Download scans" button. Make sure you choose the websource you wanted in "Options" menu for the scan extraction.
You can save your list as xml or csv. A former list can be recovered as csv is the program native format.
After running the application I am told that there are 126 sets missing.
I have hunted through every menu option and button click in the application and all ofthe lists that appear are empty.
Please can you help me?
Thanks,
Robert
Normally, that file should be OK.
— Is the connectivity to the gatherer and to magiccards.info OK?
I'm pretty sure you don't have connectivity. If not, 3 possibilites:
1/ Can you access to the gatherer or magiccards.info from your web browser? If not, you may have a problem with your Internet connexion on your computeur.
2/ Please check your firewall settings and make sure you allowed Gatherer Extractor to access the Internet.
3/ If you still have no connectivity to the gatherer or magiccards.info with Gatherer Extractor, you may have a malware or trojan running on your computer which prevent svhost.exe from authorizing applications you run to access the Internet (such as your firewall/antivirus upgrades etc.) Install Malwarebytes' anti-malware, run it and clean your computer from malwares.
The file you mentioned abbreviations.cfg is completely empty!
Well it only has the following line:
" // // // "
There is nothing else in the file at all.
You probably tried to edit and save the Abreviations file from the "Edit" menu and you had no permission to write the file, resulting in a empty file.
1/ Please reinstall the program: it will overwrite the current file so that you'll get a safe Abreviations.cfg file.
2/ Make sure you run the program as administrator, so that you will have all permissions to write files.
Note that when new sets are available, you'll get an alert almost like the one you have to invite you to complete the abreviations.cfg thanks to the editor provided in the "Edit" menu.
In your case, you told me the Set listbox was empty. It was only disable which is not at all the same, for bug finding and fixing