arxivkb
由 camopel 提供
DevOps & Cloud简介
Local arXiv paper manager with semantic search.
描述
该技能的功能
ArXivKB crawls arXiv's public API by category, downloads PDFs, and indexes their full text using FAISS vector search with Ollama embeddings. Semantic search runs against chunked PDF content rather than just abstracts, and all data stays on-device in SQLite and FAISS files.
Indexes full PDF text in 500-token chunks rather than just abstracts, so searches find papers by what they actually discuss, not only how they were titled or tagged.
何时使用
- Tracking new ML papers published in specific arXiv categories each week
- Searching paper content by concept when you can't recall the title or authors
- Building a private research library without uploading PDFs to any cloud service
- Reviewing all papers ingested on a topic over a custom date range
- Checking how many papers and chunks are indexed across enabled categories
示例工作流
User asks: Find recent papers about contrastive learning in vision transformers
- 1
Run
/akb add cs.CV cs.LGto enable relevant categories - 2
Run
akb ingest --days 14to crawl arXiv, download PDFs, and embed chunks - 3
Query the FAISS index with the natural language phrase
- 4
Retrieve top-scoring chunks grouped by paper
- 5
Return paper titles, abstracts, and matching text excerpts
A ranked list of papers whose PDF content matches the query, with relevant excerpts showing where each paper discusses the topic
前置要求
- Ollama installed and running locally (`ollama serve`)
安装
clawhub install camopel/arxivkb运行 CLI 命令,或把这段提示词粘贴到 Claude Code、Cursor、Codex 或你在用的任意编程智能体里。