Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[EPIC] V1 #28

Open
wants to merge 83 commits into
base: master
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
83 commits
Select commit Hold shift + click to select a range
5be6805
puppeteer scrape address page properly
dawsbot Feb 5, 2024
514baa8
scrape account pages effectively
dawsbot Feb 5, 2024
429c95a
Add todo
dawsbot Mar 6, 2024
de8526c
Copy readme over from main
dawsbot Mar 6, 2024
7261b25
Update contributing readme
dawsbot Mar 6, 2024
135ae11
fix error parsing and add dynamic hostname generation (#18)
kylewandishin Mar 9, 2024
3715502
working log in info from dotenv. scraping pages of 25 frmo each label
kylewandishin Mar 12, 2024
75588f1
added automatic sign in and scraping capabilities for signed in user\…
kylewandishin Mar 12, 2024
b9780a2
scrape every account 'main' labels into json files
kylewandishin Mar 12, 2024
e94f3b7
pull all main accounts from etherscan. parse as json in /data\n\nclos…
kylewandishin Mar 12, 2024
3638263
add runtime automated testing for scraping and speed up pulling proce…
kylewandishin Mar 19, 2024
d008efb
fix timeout
kylewandishin Mar 19, 2024
47ebe10
data checkpoint
kylewandishin Mar 19, 2024
4618c6a
sorting added
kylewandishin Mar 19, 2024
acbebef
sorted data
kylewandishin Mar 19, 2024
ac57f73
rename data folders
kylewandishin Mar 19, 2024
0466900
pull data from all labels with all subcatagories. depreciates length …
kylewandishin Mar 19, 2024
f628968
format all code files
kylewandishin Mar 19, 2024
235e770
clean up workspace
kylewandishin Mar 19, 2024
c0f9dd6
turned etherscan pulling into a component to begin refactoring
kylewandishin Mar 19, 2024
1832675
turned etherscan-pulling into a component to begin refactoring
kylewandishin Mar 19, 2024
2d93cfc
restyle code with prettier
kylewandishin Mar 19, 2024
4961767
Move etherscan to class and add eslint
dawsbot Mar 20, 2024
e4b0073
Fresh pull without lowercase re-ordering
dawsbot Mar 20, 2024
450d9ca
improve function names
dawsbot Mar 20, 2024
2c5186f
Pull accounts
dawsbot Mar 24, 2024
cd1e4b3
Sort all tokens, improve logging
dawsbot Mar 25, 2024
f5bdfab
alternative oop approach in components folder
kylewandishin Mar 26, 2024
d03c616
Revert "alternative oop approach in components folder"
dawsbot Mar 26, 2024
60323d2
🤓 Stricter eslint rules (#32)
dawsbot Mar 26, 2024
5e2c9b4
🧪 Add unit testing via vitest (#30)
dawsbot Mar 26, 2024
367e5f7
npm audit fix
dawsbot Mar 26, 2024
fb07c71
🤓 Add pull script to package.json (#38)
kylewandishin Mar 26, 2024
b6c0f6c
✨🤓 Pull Basescan and use OOP inheritance (#39)
dawsbot Mar 26, 2024
4de8c76
✨ Pull optimism labels (#41)
dawsbot Mar 26, 2024
53b4dfa
Update readme to organize labels (#43)
dawsbot Mar 26, 2024
6dee432
✨ Combine label files in new combined.json (#44)
kylewandishin Mar 27, 2024
a89f0f9
✨ Add Arbitrum and lowercase all addresses (#46)
dawsbot Mar 28, 2024
e4f08a9
✨ celoscan init (#48)
dawsbot Apr 12, 2024
10f29da
Add celo image to readme
dawsbot Apr 12, 2024
239ce57
✨ Fix celo image in readme (#49)
dawsbot Apr 12, 2024
7d94baa
Insert last edited date to readme (#50)
dawsbot Apr 13, 2024
dc8e4af
✨ Add Gnosis chain data (#55)
kylewandishin Apr 30, 2024
490d722
✨ Add bscscan (#56)
kylewandishin Apr 30, 2024
bb973e1
📓 Add star graph to readme
dawsbot May 3, 2024
f66e979
🧪 Test BSCScan (#61)
dawsbot May 18, 2024
b5a6687
🧪 add gnosis test close #57 (#63)
kylewandishin May 20, 2024
be3cc7c
🧪🐛 Test & expand token names for arbiscan (#64)
dawsbot May 22, 2024
69b31a7
✨ Add token image etherscan (#67)
kylewandishin May 22, 2024
7f21273
🤓 Concurrently test (#69)
kylewandishin May 22, 2024
e32d5c9
🤓 migrate to bun (#71)
kylewandishin May 29, 2024
45cbca7
🤓 Replace rest of npm with bun
dawsbot May 29, 2024
c3fa9dd
Merge branch 'v1' of github.com:Earnifi/etherscan-labels into v1
dawsbot May 29, 2024
1a41382
✨ Add etherscan api (#70)
kylewandishin May 29, 2024
bab0453
🤓 Remove old npm module bloat (#72)
kylewandishin May 29, 2024
0101b4f
🤓 Add api unit tests (#74)
kylewandishin Jun 3, 2024
0b0b198
🤓 Feat: Add pre-alpha API docs
dawsbot Jun 4, 2024
d6c1f6a
add config menu (#76)
kylewandishin Jun 10, 2024
33a7fc0
🧼 Pull expanded token names for Etherscan (#79)
kylewandishin Jun 13, 2024
97227d5
Remove fileformatting
dawsbot Jun 14, 2024
44def3d
🧼 cleanup: Scan config refactor (#85)
kylewandishin Jun 14, 2024
af153cd
✨ feat: Combine all accounts from fs into one json object (#90)
dawsbot Jun 17, 2024
40edf8a
🧪 chore: Test filesystem reading (#91)
dawsbot Jun 19, 2024
2011ec2
Rename to Eth Labels (#92)
dawsbot Jun 19, 2024
9cf94c0
📓 feat: add rest of chain logos to readme (#88)
kylewandishin Jun 19, 2024
9eb9d09
✨ feat: accounts label searching api init
michaelgreen06 Jun 23, 2024
ffbe616
🐛 Pull in PORT from process.env for remote deployments
dawsbot Jun 24, 2024
f850111
🐳 Dockerize init (#97)
dawsbot Jun 24, 2024
a999124
🤓 feat: sqlite as data storage replicate (#93)
dawsbot Jun 26, 2024
dafae2e
🤓 Fix spelling in error message
dawsbot Jun 26, 2024
8406a7b
📓 feat: added loadAllTokensFromFS() and updated the address api so it…
michaelgreen06 Jun 26, 2024
8e33887
🤓 stricter eslint
dawsbot Jun 28, 2024
4226962
🤓 Remove rollup from deps
dawsbot Jun 28, 2024
d183fc5
🤓 Remove excess typing
dawsbot Jun 28, 2024
98b046a
Move from vitest to bun:test
dawsbot Jun 28, 2024
2a3aa9c
✨ Move to sqlite source of truth (#98)
dawsbot Jun 30, 2024
f88858d
Add labels API endpoint (#100)
dawsbot Jun 30, 2024
61ee228
🐛 fix: Bun run pull (no more missing tsx)
dawsbot Jul 1, 2024
846c741
✨ Pull missing tokens and addresses on-chain (#101)
dawsbot Jul 3, 2024
71d8a50
🐛 Deduplicate labels on GET to /labels (#102)
dawsbot Jul 3, 2024
0015700
🧼 Remove all browser related code & pull full pages for tokens (#103)
dawsbot Jul 3, 2024
85a15be
🤓 move html fetching to shared function
dawsbot Jul 5, 2024
bdbdccc
Api search (#104)
kylewandishin Jul 24, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
scrape every account 'main' labels into json files
  • Loading branch information
kylewandishin committed Mar 12, 2024
commit b9780a26609e5fec83cb847629e5caf222c0d289
50 changes: 50 additions & 0 deletions data/0x-protocol-ecosystem.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,50 @@
[
{
"address": "0x0e8ba001a821f3ce0734763d008c9d7c957f5852",
"nameTag": "AmadeusRelay"
},
{
"address": "0xc898fbee1cc94c0ff077faa5449915a506eff384",
"nameTag": "Bamboo Relay"
},
{
"address": "0x58a5959a6c528c5d5e03f7b9e5102350e24005f1",
"nameTag": "ERC dEX"
},
{
"address": "0x2cc42d1cd65af27cc999e41ef93d1a763dc821f8",
"nameTag": "IDT Exchange"
},
{
"address": "0x4524baa98f9a3b9dec57caae7633936ef96bd708",
"nameTag": "LedgerDex"
},
{
"address": "0xc22d5b2951db72b44cfb8089bb8cd374a3c354ea",
"nameTag": "OpenRelay"
},
{
"address": "0xd2045edc40199019e221d71c0913343f7908d0d5",
"nameTag": "Paradex"
},
{
"address": "0xa258b39954cef5cb142fd567a46cddb31a670124",
"nameTag": "Radar Relay"
},
{
"address": "0x55890b06f0877a01bb5349d93b202961f8e27a9b",
"nameTag": "Shark Relay"
},
{
"address": "0x0681e844593a051e2882ec897ecd5444efe19ff2",
"nameTag": "Star Bit Ex"
},
{
"address": "0x7219612be7036d1bfa933e16ca1246008f38c5fe",
"nameTag": "The Ocean"
},
{
"address": "0x5e150a33ffa97a8d22f59c77ae5487b089ef62e9",
"nameTag": "TokenJar"
}
]
106 changes: 106 additions & 0 deletions data/0x-protocol.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,106 @@
[
{
"address": "0xdffe798c7172dd6deb32baee68af322e8f495ce0",
"nameTag": "0x: Asset Proxy Owner"
},
{
"address": "0x45797531b873fd5e519477a070a955764c1a5b07",
"nameTag": "0x: Coordinator Registry V3"
},
{
"address": "0x38a795580d0f687e399913a00ddef6a17612c722",
"nameTag": "0x: Coordinator V3"
},
{
"address": "0xccc2431a7335f21d9268ba62f0b32b0f2efc463f",
"nameTag": "0x: Dev Utils"
},
{
"address": "0x7eefbd48fd63d441ec7435d024ec7c5131019add",
"nameTag": "0x: ERC1155 Proxy V3"
},
{
"address": "0x8ed95d1746bf1e4dab58d8ed4724f1ef95b20db0",
"nameTag": "0x: Erc20 Bridge Proxy"
},
{
"address": "0x95e6f48254609a6ee006f7d493c8e5fb97094cef",
"nameTag": "0x: ERC20 Proxy V3"
},
{
"address": "0xefc70a1b18c432bdc64b596838b4d138f6bc6cad",
"nameTag": "0x: ERC721 Proxy V3"
},
{
"address": "0x0ac2d6f5f5afc669d3ca38f830dad2b4f238ad3f",
"nameTag": "0x: Eth2Dai Bridge"
},
{
"address": "0xdef1c0ded9bec7f1a1670819833240f027b25eff",
"nameTag": "0x: Exchange Proxy"
},
{
"address": "0xf740b67da229f2f10bcbd38a7979992fcc71b8eb",
"nameTag": "0x: Exchange Proxy Allowance Target"
},
{
"address": "0x080bf510fcbf18b91105470639e9561022937712",
"nameTag": "0x: Exchange v2.1"
},
{
"address": "0x61935cbdd02287b511119ddb11aeb42f1593b7ef",
"nameTag": "0x: Exchange v3"
},
{
"address": "0x206376e8940e42538781cd94ef024df3c1e0fd43",
"nameTag": "0x: Ext Dev Pool"
},
{
"address": "0xa3ac9844514b96bb502627ca9dceb57c4be289e3",
"nameTag": "0x: Forwarder 2"
},
{
"address": "0x7d3455421bbc5ed534a83c88fd80387dc8271392",
"nameTag": "0x: Governor V3"
},
{
"address": "0xef701d5389ae74503d633396c4d654eabedc9d78",
"nameTag": "0x: Multi Asset Proxy V3"
},
{
"address": "0xa09329c6003c9a5402102e226417738ee22cf1f2",
"nameTag": "0x: Order Validator"
},
{
"address": "0x2a17c35ff147b32f13f19f2e311446eeb02503f3",
"nameTag": "0x: Staking"
},
{
"address": "0xa26e80e7dea86279c6d778d702cc413e6cffa777",
"nameTag": "0x: Staking Proxy V3"
},
{
"address": "0x3517b88c19508c08650616019062b898ab65ed29",
"nameTag": "0x: Static Call Proxy V3"
},
{
"address": "0x926a74c5c36adf004c87399e65f75628b0f98d2c",
"nameTag": "0x: Token Registry"
},
{
"address": "0x8da0d80f5007ef1e431dd2127178d224e32c2ef4",
"nameTag": "0x: Token Transfer Proxy"
},
{
"address": "0xa6baaed2053058a3c8f11e0c7a9716304454b09e",
"nameTag": "0x: Uniswap Bridge"
},
{
"address": "0xe41d2489571d322189246dafa5ebde1f4699f498",
"nameTag": "0x: ZRX Token"
},
{
"address": "0xba7f8b5fb1b19c1211c5d49550fcd149177a5eaf",
"nameTag": "0x: ZRX Vault V3"
}
]
14 changes: 14 additions & 0 deletions data/0xsplits.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
[
{
"address": "0xf8843981e7846945960f53243ca2fd42a579f719",
"nameTag": "0xSplits: Donate"
},
{
"address": "0x2ed6c4b5da6378c7897ac67ba9e43102feb694ee",
"nameTag": "0xSplits: Split Main"
},
{
"address": "0xd94c0ce4f8eefa4ebf44bf6665688edeef213b33",
"nameTag": "0xSplits: Split Wallet"
}
]
26 changes: 26 additions & 0 deletions data/0xuniverse.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,26 @@
[
{
"address": "0xe73480759efb6731d133b382ab8df02774e3a265",
"nameTag": "0xUniverse: Contract 1"
},
{
"address": "0xf91d60c576fc809bea7a08d45ee3d6d77fbf5ff7",
"nameTag": "0xUniverse: Contract 2"
},
{
"address": "0xe658e6eb4b478da2cf36d9e3712ba0c1b33786a1",
"nameTag": "0xUniverse: Contract 3"
},
{
"address": "0x06a6a7af298129e3a2ab396c9c06f91d3c54aba8",
"nameTag": "0xUniverse: PLANET Token"
},
{
"address": "0xa36a81e47d032cb5608175cf884d079ff7b2fb42",
"nameTag": "0xUniverse: Wallet 1"
},
{
"address": "0x28fbe46d43ae10f0afe84e393368b891a3de98ea",
"nameTag": "0xUniverse: Wallet 2"
}
]
26 changes: 26 additions & 0 deletions data/1inch.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,26 @@
[
{
"address": "0x111111125434b319222cdbf8c261674adb56f3ae",
"nameTag": "1inch v2: Aggregation Router"
},
{
"address": "0x11111112542d85b3ef69ae05771c2dccff4faa26",
"nameTag": "1inch v3: Aggregation Router"
},
{
"address": "0x1111111254fb6c44bac0bed2854e76f90643097d",
"nameTag": "1inch v4: Aggregation Router"
},
{
"address": "0x0000000000004946c0e9f43f4dee607b0ef1fa1c",
"nameTag": "1inch: CHI Token"
},
{
"address": "0x11111254369792b2ca5d084ab5eea397ca8fa48b",
"nameTag": "1inch: Exchange 2"
},
{
"address": "0xe069cb01d06ba617bcdf789bf2ff0d5e5ca20c71",
"nameTag": "1inch: Router 2"
}
]
Loading