They have been disregarded. The qualifiers could be mostly considered negligible as they are probably <1% of total graded cards. Looking back the PSA 8.5+ does seem to be about 5-15% the amount of the total PSA 8’s at the couple sets I checked. Not really negligible. May have to go back and add this in next time I am working on it.
1 Like
Would you end up doing this for Japanese sets ever?
Japanese Base 35%
rest of the WOTC up to Neo Destiny 50%+
E series and VS - 60%
Ex series around 50%
BW and XY sets 90% PSA 10 rate
I don’t collect them at this time so probably not. If however in the next couple months the English spreadsheet gets completed and is self-updating then perhaps I could extend it out to that, or find a member willing to do so.
I have a program built in python that can scrap PSA of their data. I had this done yesterday, but someone added a 1st ed charizard to the DNA part of the site and it completely ruined he program, (if that person is here I slightly hate you).
The main issue I’m getting is the limitations of the PSA website. For example, if I scrap through the 16 1st edition base holos I don’t get any issues 90% of the time, however; I’ve tried three time to do the entire 102 set and every time I’ve ended up getting a time out error on PSA’s side. Also if I let the program go too fast it won’t even get through the 16 holos. PSA’s site needs time to load its ajax, and (my internet connection) doesn’t allow it to come in as fast as I need it for a speedy program. It’s still much faster then I could do by hand no doubt, but just not as fast as it could be.
The other issue I have is the only way for me to get it to work in a way that’s manageable is I need exact PSA Names (aka tedious to set up).
I’m not very familiar with any Python modules that can write the data to a spreadsheet, so maybe over the week I can read up on one and finish the project. I’ll also try and get a GUI to it so people like Gary could even use it. No promises for any of this, I also reserve the right to abandon the this project for any reason.
Here’s a sample of it working:[details=“SPOILER: Click to show”]
[/details]
2 Likes
My curiosity is piqued on how you are going about getting the info with the script, would you perhaps be willing to divulge a little either here or over PM/IM somewhere? I was having an issue with the AJAX loading for running functions from Google sheets, which is where I hit a dead end. Is your script something that provides a search parameter and then scrapes results, or does it go straight to a result page (ie: the set page for Base or a specific result page for a card) and pull from there? Just curious on how you are going about it for the results. The more I think about it the more I feel like PSA should consider building an API for people to access the data.
1 Like
It uses a chrome driver and selenium module to search the pages in for what’s needed (this is why it doesn’t go as fast as I could make it) It goes to www.psacard.com/pop/Search, enters the exact card name that appears on the PSA label, waits for the table to appear, enters teh exact card name that appears on the PSA label again to the search box to narrow the results to one, then it clicks on the show pop, waits for the page to load and then scraps.
It would be faster to go to the set pages where I could have the data limited to semi relevant data. I didn’t do that because sorting the data out is a nightmare. There’s no class, or id to separate any of the date from the rest, so you have to go by tags and it pull everything from the name, variation, grade, etc all as a singe data point and you end up with over 40,000 different data with no exact pattern to sort through. Also, the route I’m going it allows anyone to search for whatever card they want, it doesn’t even have to be limited to pokemon.
2 Likes
That is awesome work. If you get to where you feel like bailing on it let me know and I could pick up. My programming is not the best and out of practice, but having some working code to go from and only having to deal with the tedious part of duplicating but for different cards I could do.
1 Like
The tedious work has to be done by the user. If you want to get started on that what you need to do is getting the exact PSA label for every card you plan on keeping track of. Copy the name into a text document (notepad) and make sure each name is on it’s own line. I would save them into multiple files per set, aka one text document for 1st edition base, shadowless, 1st edition jungle, etc. Example
Spoiler
If you get to something like Base unlimited all you need to make sure is that the first result is the correct result.
Possibly me sending in every unlimited holo 9 worthy & above. Sometimes cards are worth grading even if you know they won’t get a 10.
Haha perhaps, btw bud someone in the UK has listed up 36 Base set packs that look like UK packs so maybe 1999-2000. Thought you’d be interested but didn’t know how to tag you in the auction thread.
I have the program created that as long as someone has OpenOffice, Google Chrome, Chromedriver (all free downloads) and runs Windows it will work.
If anyone wants it pm me your email I’ll send it to you. If anyone wants the python code to edit I can send that as well.
The only thing I don’t like about it is I was unable to find a spreadsheet module that would be able to update cells without completely overwriting the entire file. (I did find a way around this but didn’t think it was worth the effort) This is why you’ll need OpenOffice. OpenOffice can open the .xlsx file the program will create and seperate the data by the cammas, this allows whomever is using the software to copy the cells and places them into their spreadsheets that have functions built into them.
For those intested in it here are the steps you’ll need to take to make it work. You’ll need a .txt file that has all the search results you’ll be searching for. Each search result needs to be on it’s own seperate line, see my last post for an example of this. The results need to be the exact label that appears on PSA’s website. (I’ve fixed to program so it can search the page without the results needing to be on the first line)
After extracting from the download file I send you click on the PSA_Web_Scraper.exe inside the file. It’ll have four buttons on it, click on the button that’s not disables and locate your chromedriver.exe file. The next button will enable that you use to search for your .txt file. The next enabled button will be where you want the file that gets created to be placed and named. After that the run button will enable. After the program if finished open the created file with OpenOffice’s calc and it’ll create the spreadsheet for you.
I’ve tested it multiple times and on average I can pull an entire 102 1st ed base set + red cheeks pika in 6 min.
I send in cards for PSA 9’s in English. If I happen to get 10’s, then I’m estatic. I expect 10’s on Japanese B&W and XY Series sets. But, sometimes I get 9’s on them…
1 Like
Here is a viewable link docs.google.com/spreadsheets/d/1f5Ne3a9XNDX4JAdkowcpuVZYXVTbCtHQpt8g2m3HNr0/edit?usp=sharing
1 Like
Very cool reference guide.
An interesting note. The only card that has more 8s than 9s is the Shadowless Chansey:)
1 Like
Updated added Legendary collection through ex series sets.
If you grade Legendary collection regular holos, you are gonna have a bad time. Grade Skyridge instead! Only set with over 50% PSA 10 rate.
Oooh really interesting. Whoever’s heading this send me a PM happy to give it a go in PHP and curl. Written a few scraping codes for bulbapedia and serebii for my own database purposes…
1 Like
Interested what you all think accounts for the huge percentage difference between the base Unl Charizard and all the rest of that sets holos.
( ͡° ͜ʖ ͡°)
I would say people are more willing to send in a Charizard that they know won’t get a 10 because PSA 9s and 8s still hold value.
3 Likes