Scrape all KOL wallet data from kolscan.io leaderboard + GMGN smart money
npm installCapabilities documented in this repository.
See the full documentation for details.
See the full documentation for details.
See the full documentation for details.
See the full documentation for details.
See the full documentation for details.
See the full documentation for details.
Install it, then run your first command.
npm install| Command | Runs |
|---|---|
npm run dev | cd site && npm run dev |
npm run build | cd site && npm run build |
Taken directly from this repository's documentation.
┌─────────────────┐ ┌──────────────────┐ ┌─────────────────┐ ┌──────────────────┐
│ DATA SOURCES │ │ INGESTION │ │ STORAGE │ │ APPLICATION │
│ │ │ │ │ │ │ │
│ KolScan.io │────>│ scrape.js │────>│ JSON files │────>│ Next.js 14 │
│ GMGN API │────>│ scrape-axiom.js │ │ (leaderboard, │ │ (React 18, TS) │
│ X / Twitter │────>│ scrape-x.js │ │ wallets, X) │ │ │
│ │ │ │ │ │ │ Leaderboards │
│ │ │ ingest-trades │────>│ PostgreSQL │────>│ Tracking │
│ │ │ (batch + poll) │ │ (trades, │ │ Feed │
│ │ │ │ │ submissions, │ │ Community │
│ │ │ │ │ watchlists, │ │ Auth │
│ │ │ │ │ users) │ │ │
└─────────────────┘ └──────────────────┘ └─────────────────┘ └──────────────────┘
│
│
┌──────────────────────┴──────────┐
│ │
┌─────┴──────┐ ┌─────────┴──────┐
│ Bun API │ │ MCP Server │
│ :3002 │ │ (stdio) │
│ REST/JSON │ │ AI assistants │
└────────────┘ └────────────────┘# Clone the repo
git clone https://github.com/nirholas/kol-quest.git
cd kol-quest
# Root dependencies (scrapers)
npm install
# Site dependencies (Next.js app)
cd site && npm install && cd ..
# Playwright for scraping
npx playwright install chromium
sudo npx playwright install-deps chromium # Linux onlynpm run setup