arxivkb
camopel 제작
DevOps & Cloud요약
Local arXiv paper manager with semantic search.
설명
이 스킬이 하는 일
ArXivKB crawls arXiv's public API by category, downloads PDFs, and indexes their full text using FAISS vector search with Ollama embeddings. Semantic search runs against chunked PDF content rather than just abstracts, and all data stays on-device in SQLite and FAISS files.
Indexes full PDF text in 500-token chunks rather than just abstracts, so searches find papers by what they actually discuss, not only how they were titled or tagged.
사용 시점
- Tracking new ML papers published in specific arXiv categories each week
- Searching paper content by concept when you can't recall the title or authors
- Building a private research library without uploading PDFs to any cloud service
- Reviewing all papers ingested on a topic over a custom date range
- Checking how many papers and chunks are indexed across enabled categories
예시 워크플로
User asks: Find recent papers about contrastive learning in vision transformers
- 1
Run
/akb add cs.CV cs.LGto enable relevant categories - 2
Run
akb ingest --days 14to crawl arXiv, download PDFs, and embed chunks - 3
Query the FAISS index with the natural language phrase
- 4
Retrieve top-scoring chunks grouped by paper
- 5
Return paper titles, abstracts, and matching text excerpts
A ranked list of papers whose PDF content matches the query, with relevant excerpts showing where each paper discusses the topic
요구 사항
- Ollama installed and running locally (`ollama serve`)
설치
clawhub install camopel/arxivkbCLI 명령을 실행하거나, 프롬프트를 Claude Code, Cursor, Codex 등 사용하는 코딩 에이전트에 붙여넣으세요.