How to Gather Batches of Base58 Addresses?

9 replies 151 views
Posts: 15 · Reputation: 29
#1May 17, 2021, 04:06 AM
Hey everyone, what's the best way to scrape large batches of Base58 addresses? Looking for methods to check their TXs and balances. Any ideas?
6 Reply Quote Share
mr_apeNewbie
Posts: 401 · Reputation: 35
#2May 17, 2021, 06:06 AM
Best bet is to run a full node with some tweaks. You can index the blockchain like block explorers do, so you’ll have an updated list of addresses and UTXOs. Otherwise, you're stuck with third-party services, which can be limiting.
0 Reply Quote Share
stacksatsHero Member
Posts: 404 · Reputation: 2023
#3May 17, 2021, 12:03 PM
Check out Blockchair.com for data dumps. They have a link for Bitcoin addresses, but it’s a big file. You can filter for legacy addresses later.
0 Reply Quote Share
Posts: 15 · Reputation: 29
#4May 17, 2021, 01:26 PM
Thanks for the tips, everyone!
6 Reply Quote Share
gang2015Member
Posts: 682 · Reputation: 62
#5May 17, 2021, 04:32 PM
You could also set up a block explorer or an Electrum server. Then you can access the database directly. But yeah, the LoyceV site seems to be down for me. Pretty annoying.
2 Reply Quote Share
mr_apeNewbie
Posts: 401 · Reputation: 35
#6May 18, 2021, 03:43 AM
It’s working for me! I accessed it via Tor. Just can’t get to it normally, which is odd.
1 Reply Quote Share
orbit1337Senior Member
Posts: 434 · Reputation: 941
#7May 18, 2021, 07:18 AM
I had to restart Apache2 on my end. Took way too long, not sure why. Try dropping the "http://" part. That worked for me.
2 Reply Quote Share
Posts: 15 · Reputation: 29
#8May 18, 2021, 09:15 AM
Thanks for that, LoyceV. Super helpful! Is there a command to filter Base58 addresses from the TSV file into a text file?
4 Reply Quote Share
orbit1337Senior Member
Posts: 434 · Reputation: 941
#9May 18, 2021, 01:41 PM
Just use grep for that. I made a file for you: legacy_and_balance.tsv. But it’ll be deleted in a day.
1 Reply Quote Share
Posts: 15 · Reputation: 29
#10May 18, 2021, 03:33 PM
Thanks, LoyceV! This is great, now I can do it myself.
1 Reply Quote Share

Related topics