Lightweight Public Key Database for Brute Force Searching

24 replies 430 views
m1kes4tFull Member
Posts: 167 · Reputation: 252
#1Aug 11, 2021, 11:27 PM
Just started working on a lightweight database for public keys. Planning to generate billions of keys.
2 Reply Quote Share
wagmiNewbie
Posts: 301 · Reputation: 14
#2Aug 12, 2021, 01:52 AM
So, the idea is to create a binary file that represents public keys in 0s and 1s. 0s are even, 1s are odd. Pretty straightforward.
5 Reply Quote Share
m1kes4tFull Member
Posts: 167 · Reputation: 252
#3Aug 12, 2021, 06:26 AM
If your memory can’t handle all the data, just slice it up. Like, if your limit is 100 million keys, divide it down and manage in chunks.
0 Reply Quote Share
wagmiNewbie
Posts: 301 · Reputation: 14
#4Aug 12, 2021, 07:42 AM
But dude, be careful with that. If you mess with the last digits, you might end up with invalid private keys.
2 Reply Quote Share
m1kes4tFull Member
Posts: 167 · Reputation: 252
#5Aug 12, 2021, 01:49 PM
Yeah, we managed to build a massive database without using tons of disk space. Kinda proud!
6 Reply Quote Share
d4ve69Senior Member
Posts: 6 · Reputation: 892
#6Aug 12, 2021, 02:58 PM
What’s the point of this over just storing full public keys, though? Scanning for sequences might take ages without a better structure.
4 Reply Quote Share
m1kes4tFull Member
Posts: 167 · Reputation: 252
#7Aug 12, 2021, 07:57 PM
Generating sequences like 01001 is a smart approach. The chances of finding duplicates is super low, right?
4 Reply Quote Share
d4ve69Senior Member
Posts: 6 · Reputation: 892
#8Aug 12, 2021, 09:19 PM
But traditional methods also limit your space. If you set a collision margin at 64, you still get faster results, even with a giant database.
3 Reply Quote Share
d4ve69Senior Member
Posts: 6 · Reputation: 892
#9Aug 13, 2021, 01:22 AM
Using binary search to split and store keys is a big deal. It cuts down search time significantly when you’re dealing with large datasets.
0 Reply Quote Share
pixel_stakeSenior Member
Posts: 23 · Reputation: 1132
#10Aug 13, 2021, 06:02 PM
Remember, storing keys sequentially can mess up efficiency. Just saying.
0 Reply Quote Share
m1kes4tFull Member
Posts: 167 · Reputation: 252
#11Aug 13, 2021, 11:52 PM
You’re only keeping binary sequences in a big space to distribute your database evenly. Be strategic about your jumps.
0 Reply Quote Share
d4ve69Senior Member
Posts: 6 · Reputation: 892
#12Aug 14, 2021, 01:36 AM
I ran tests with a 35-bit range and 50 million keys. Your low false collision probability doesn’t seem right.
3 Reply Quote Share
m1kes4tFull Member
Posts: 167 · Reputation: 252
#13Aug 14, 2021, 06:35 AM
Wait, are you saying there are false positives? If so, just increase that margin! 128 should do it.
1 Reply Quote Share
0xNodeMember
Posts: 671 · Reputation: 80
#14Aug 14, 2021, 11:16 PM
Nah, I had good results using 64. Maybe you messed something up. If you changed the code, let’s troubleshoot.
6 Reply Quote Share
dan.walletSenior Member
Posts: 12 · Reputation: 848
#15Aug 15, 2021, 04:42 AM
For the 40-bit range, I had zero collisions. What’s the size needed for higher ranges, though? Can we parallelize this work?
4 Reply Quote Share
m1kes4tFull Member
Posts: 167 · Reputation: 252
#16Aug 15, 2021, 06:54 AM
Saw your deleted message, but I caught a glimpse. You still don’t see the differences, huh? Knowing the first digit helps a lot.
0 Reply Quote Share
dan.walletSenior Member
Posts: 12 · Reputation: 848
#17Aug 15, 2021, 10:11 AM
Stop sharing anything public! No working script should be out there like that. Using 1 bit for keys sounds wild. Imagine storing 100TB with enough power!
1 Reply Quote Share
orbit_viperHero Member
Posts: 4 · Reputation: 3505
#18Aug 15, 2021, 11:28 AM
You can tweak the parameters to check limits using secp256k1, like you said. There shouldn’t be floats.
2 Reply Quote Share
m1kes4tFull Member
Posts: 167 · Reputation: 252
#19Aug 15, 2021, 02:36 PM
I deleted it because I wasn’t sure if it was right. Here’s a potential fix you could try.
3 Reply Quote Share
Posts: 3523 · Reputation: 35
#20Aug 15, 2021, 08:02 PM
Yeah, it’s the jump in subtraction that’s throwing things off, not the collision margin. Trying to fix that.
5 Reply Quote Share

Related topics