Most likely, they wanna check a bunch of empty addresses. If you have a list in a.csv file, filtering through 10,000 addresses isn’t too bad. But imagine millions. Your computer might choke on that.
Businesses flip this around. They watch their mempool for new transactions and check against a small list of outputs they care about. They don't get swamped, so it's way easier for them.
But what if their system goes down? And what about those edge cases? The script OP is sharing could actually help businesses confirm their coin holdings too, you know.
I've tried a super quick method before: get funded addresses, make a list of the ones you want, merge, sort, and check for duplicates. Easy on Linux with just a few commands!
I ran a test on my old laptop: checking 300k addresses against 30 million took just 6 seconds. Blockchair's slow though, and Bitcoin Core could be a better bet.
Yup, syncing Bitcoin Core and parsing blocks is a mission. Not easy at all. Which parser are you using now? I updated my address list a while back, but it was a slog.
I started with a different approach, but splitting tasks helps manage CPU load. I can set up a mirror for those files with better speeds if anyone wants.
First step is finding exposed Insight servers online. Search Shodan for "port:3001 insight bitcoin". I registered but can’t seem to figure out the right command.