Announcing Bastio Observability: Full Visibility Into Every AI Request

We are proud to share that we have released a powerful new observability suite for Bastio. This has been one of our most requested features, and we worked hard to build something genuinely useful.

The core idea is simple: you should be able to see exactly what is happening in your AI stack. Every request, every conversation, every pattern. No more guessing why costs spiked last Tuesday or trying to debug a conversation that went sideways.

What We Built

The observability suite has three main pillars:

1. Traces - Every single request logged with full context
2. Sessions - Group related requests into conversations
3. Analytics - Dashboards showing volume, cost, latency, and security trends

Plus a bonus: Evaluation tools to score and test your AI outputs.

Let me walk you through each one.

Traces: Every Request, Full Context

Every request that flows through Bastio is now captured as a trace. You get:

• Trace ID - Unique identifier for each request
• Status - Success, error, blocked, or cached
• Latency - How long the request took in milliseconds
• Tokens - Input and output token counts
• Cost - Actual cost in USD based on model pricing
• Session ID - Which conversation this belongs to
• Security - Any threats detected or blocked

The dashboard updates in real-time with 5-second polling. You can filter by status, model, time range, or search by trace ID. When something goes wrong, you can find exactly which request caused the issue.

Here is what a trace looks like:

{
  "trace_id": "tr_7kL9mN2pQr",
  "status": "success",
  "latency_ms": 847,
  "tokens": {
    "input": 1234,
    "output": 567
  },
  "cost_usd": 0.0023,
  "session_id": "sess_abc123",
  "security": {
    "threats": [],
    "blocked": false
  }
}

Sessions: Group Conversations Together

AI applications are rarely single-turn. Users have conversations. Agents run multi-step workflows. You need to see the full context, not just isolated requests.

Sessions group related requests together automatically. By default, requests from the same user within 30 minutes are grouped into one session. You can also pass explicit session IDs if you want more control.

This is useful for:

• Debugging - See the full conversation flow that led to an issue
• Understanding usage - How long are typical conversations? How many turns?
• Cost analysis - What does a complete user session actually cost?
• Quality review - Review entire conversations, not just individual responses

Click into any session and you see every request in sequence, with timestamps, tokens, and costs for each turn.

Analytics: See the Patterns

The analytics dashboard gives you charts and trends for:

• Request volume - How many requests per hour, day, week
• Cost breakdown - Spending by model, by day, total over time
• Latency distribution - P50, P95, P99 response times
• Security metrics - Threats detected, requests blocked, risk scores
• Session statistics - Average session length, turns per session

You can view 7, 30, or 90 day windows depending on your plan. Everything is exportable to CSV for your own analysis or reporting.

This is where you will spot trends. Maybe costs are climbing because users are sending longer prompts. Maybe latency spikes every day at 2pm. Maybe a specific model is getting blocked more often. The data is there.

Evaluation: Test Your AI Outputs

We also built evaluation tools into the observability suite. You can:

• Score sessions - Run quality checks on conversations
• Compare models - See how different models perform on the same inputs
• Track metrics - Accuracy, relevance, safety scores over time

This is still early, but the idea is that observability should not just show you what happened. It should help you understand whether your AI is actually working well.

Pricing and Limits

Observability is included in every Bastio plan with different retention limits:

Free tier gives you enough to test and debug. Paid plans give you the retention you need for production analysis and compliance.

Getting Started

The observability dashboard is available now in your Bastio account. Go to the Observe section in your dashboard to see traces, sessions, and analytics.

If you are not on Bastio yet, sign up for free and start seeing what is happening in your AI stack.

Check out the Observability documentation for detailed guides on using traces, sessions, and analytics.

We are really proud of this release. Visibility into your AI stack should not be an afterthought. It should be built in from the start. That is what we have done here.

Questions or feedback? Reach out at support@bastio.com. We would love to hear how you are using it.