ANALYTICS & AI EVALS

Know what your docs are missing

BeforeQuery analytics show which questions succeed, which ones expose gaps, and how your AI answers score on automated groundedness evals — so your docs keep getting better with every user interaction.

Get Started Free

Six dimensions of knowledge health

From raw question volume to automated AI quality scoring

Unanswered Questions

Questions BeforeQuery could not answer with confidence are flagged as knowledge gaps. These are your highest-priority docs improvements.

Feedback Scores

Users can rate any answer with a thumbs up or down. Negative feedback is surfaced with the original question and the answer that failed.

Daily Trends

Track conversation volume, feedback ratio, and unanswered rate day over day. Spot the impact of a docs update or a new product release instantly.

Latency Metrics

P50, P95, and P99 response times for retrieval and generation. Broken down by project, source type, and time period.

Groundedness Evals

Automated LLM-as-judge evaluation that scores each answer for faithfulness to retrieved sources. Catch hallucinations before users do.

Citation Quality

Evaluates whether cited sources actually support the answer. Low citation quality scores indicate retrieval returning irrelevant chunks.

AI EVALS

Automated quality scoring on every answer

BeforeQuery runs LLM-as-judge evals asynchronously after each response. Groundedness score measures whether the answer stays within the retrieved context. Citation quality score measures whether the cited sources actually support each claim. Both scores trend over time so you can see the impact of docs improvements.

Groundedness: answer vs. retrieved context faithfulness
Citation quality: cited sources vs. answer claims
Completeness: does the answer address the full question
Eval scores exportable via API for custom dashboards

ANALYTICS OVERVIEW — LAST 30 DAYS

4,821

Questions asked

92%

Answered

387

Gaps found

Groundedness score94%

Citation quality89%

User satisfaction87%

Frequently Asked Questions

Common questions about BeforeQuery Analytics

Free plan retains 30 days of analytics. Pro retains 12 months. Enterprise has configurable retention up to unlimited.

Yes. All analytics are accessible via the Analytics API as JSON. You can pipe data into your own BI tools, Datadog, or Grafana dashboards.

Questions where BeforeQuery returned a low-confidence answer or explicitly said it did not know. These are the questions your documentation fails to address — the most actionable signal for improving your docs.

Evals use a separate, specialized judge LLM that is prompted to evaluate faithfulness to context rather than general accuracy. Scores are calibrated and normalized so you get a consistent 0–100 score per dimension.

Yes. Configure webhook alerts when the groundedness score drops below a threshold, or when the unanswered question rate exceeds a defined percentage. Alerts support Slack, email, and PagerDuty.

Start learning from your questions

Analytics are available on all plans from day one.