Skip to main content

Index Command

Bulk index GitHub issues and pull requests to the vector database for semantic search.

Syntax

Options

Examples

Index last 30 days

Index since specific date

Limit results

Index at most 200 issues:

Parallel processing

Use more workers for faster indexing:

Index everything (issues only)

Index with PR collection

When qdrant.pr_collection is set in config, PRs are routed to a dedicated collection:

Output

Date format

ISO 8601 dates

  • 2024-01-01
  • 2024-01-01T12:00:00Z

Performance

Typical Speed:
  • With 1 worker: ~2-3 issues/second
  • With 5 workers: ~10-15 issues/second
  • With 10 workers: ~20-25 issues/second
Depends on:
  • Issue complexity and comment count
  • API response times
  • Network latency

Process

For each issue:
  1. Fetch issue details from GitHub
  2. Fetch all comments
  3. Combine title + body + comments
  4. Split into chunks (recursive character splitter)
  5. Generate embeddings for each chunk
  6. Upsert to Qdrant with metadata
For PRs (when --include-prs is enabled):
  1. Fetch PR details and changed file paths
  2. Embed: Title: ...\n\nBody: ...\n\nChanged Files:\n- path/a
  3. Route to pr_collection if configured, otherwise to main collection

Configuration

Requires a valid configuration with:
  • Qdrant connection details
  • Gemini or OpenAI API key
  • Target repository
See Configuration Overview.

Tips

  1. Start with a small batch
  2. Use multiple workers for large repos
  3. Run during off-hours to avoid API rate limits
  4. Set a PR collection to separate PR and issue search results

Troubleshooting

Rate limited

Reduce worker count:

Out of memory

Reduce workers or use --limit to process in batches.

Collection already exists

Re-indexing is safe — upsert updates existing vectors.

Next steps

Process command

Process individual issues

PR duplicate command

Detect duplicate pull requests