How to Gather Batches of Base58 Addresses?

9 replies 415 views
Posts: 15 · Reputation: 29
#1May 17, 2021, 04:06 AM
Hey everyone, what's the best way to scrape large batches of Base58 addresses? Looking for methods to check their TXs and balances. Any ideas?
10 Reply Quote Share
mr_apeNewbie
Posts: 407 · Reputation: 35
#2May 17, 2021, 06:06 AM
Best bet is to run a full node with some tweaks. You can index the blockchain like block explorers do, so you’ll have an updated list of addresses and UTXOs. Otherwise, you're stuck with third-party services, which can be limiting.
5 Reply Quote Share
stacksatsHero Member
Posts: 404 · Reputation: 2023
#3May 17, 2021, 12:03 PM
Check out Blockchair.com for data dumps. They have a link for Bitcoin addresses, but it’s a big file. You can filter for legacy addresses later.
7 Reply Quote Share
Posts: 15 · Reputation: 29
#4May 17, 2021, 01:26 PM
Thanks for the tips, everyone!
14 Reply Quote Share
gang2015Member
Posts: 693 · Reputation: 62
#5May 17, 2021, 04:32 PM
You could also set up a block explorer or an Electrum server. Then you can access the database directly. But yeah, the LoyceV site seems to be down for me. Pretty annoying.
10 Reply Quote Share
mr_apeNewbie
Posts: 407 · Reputation: 35
#6May 18, 2021, 03:43 AM
It’s working for me! I accessed it via Tor. Just can’t get to it normally, which is odd.
11 Reply Quote Share
orbit1337Senior Member
Posts: 434 · Reputation: 941
#7May 18, 2021, 07:18 AM
I had to restart Apache2 on my end. Took way too long, not sure why. Try dropping the "http://" part. That worked for me.
11 Reply Quote Share
Posts: 15 · Reputation: 29
#8May 18, 2021, 09:15 AM
Thanks for that, LoyceV. Super helpful! Is there a command to filter Base58 addresses from the TSV file into a text file?
9 Reply Quote Share
orbit1337Senior Member
Posts: 434 · Reputation: 941
#9May 18, 2021, 01:41 PM
Just use grep for that. I made a file for you: legacy_and_balance.tsv. But it’ll be deleted in a day.
3 Reply Quote Share
Posts: 15 · Reputation: 29
#10May 18, 2021, 03:33 PM
Thanks, LoyceV! This is great, now I can do it myself.
2 Reply Quote Share

Related topics