# Phoenix

## Docs

- [What is Arize Phoenix?](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix.md): AI Observability and Evaluation
- [Agent-Assisted Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/agent-assisted-setup.md): Use a coding agent to automatically add Phoenix tracing to your application.
- [Cookbooks](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook.md): Cookbooks & tutorials to help you build with Phoenix
- [Agent Workflow Patterns](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/agent-workflow-patterns.md): Workflows are the backbone of many successful LLM applications. They define how language models interact with tools, data, and users—often through a sequence of clearly orchestrated steps. Unlike fully autonomous agents, workflows offer structure and predictability, making them a practical choice fo…
- [AutoGen](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/agent-workflow-patterns/autogen.md): Use Phoenix to trace and evaluate AutoGen agents
- [CrewAI](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/agent-workflow-patterns/crewai.md): **CrewAI** is an open-source framework for building and orchestrating collaborative AI agents that act like a team of specialized virtual employees. Built on LangChain, it enables users to define roles, goals, and workflows for each agent, allowing them to work together autonomously on complex tasks…
- [Google GenAI SDK (manual orchestration)](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/agent-workflow-patterns/google-genai-sdk-manual-orchestration.md): Everything you need to know about Google's GenAI framework
- [LangGraph](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/agent-workflow-patterns/langgraph.md): Use Phoenix to trace and evaluate agent frameworks built using Langgraph
- [OpenAI Agents](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/agent-workflow-patterns/openai-agents.md): [**OpenAI-Agents**](https://openai.github.io/openai-agents-python/) is a lightweight Python library for building agentic AI apps. It includes a few abstractions:
- [Smolagents](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/agent-workflow-patterns/smolagents.md): **SmolAgents** is a lightweight Python library for composing tool-using, task-oriented agents. This guide outlines common agent workflows we've implemented—covering routing, evaluation loops, task orchestration, and parallel execution. For each pattern, we include an overview, a reference notebook,…
- [Analyzing Customer Review Evals with Repetition Experiments](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/ai-engineering-workflows/analyzing-customer-review-evals-with-repetition-experiments.md)
- [Iterative Evaluation & Experimentation Workflow (Python)](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/ai-engineering-workflows/iterative-evaluation-and-experimentation-workflow-python.md): Phoenix Tracing, Evaluating, and Experimentation Walkthrough
- [Iterative Evaluation & Experimentation Workflow (TypeScript)](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/ai-engineering-workflows/iterative-evaluation-and-experimentation-workflow-typescript.md): Phoenix Tracing, Evaluating, and Experimentation Walkthrough
- [Analyzing Customer Review Evals with Repetition Experiments](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/datasets-and-experiments/analyzing-customer-review-evals-with-repetition-experiments.md): Large Language Models (LLMs) are probabilistic; the same prompt can yield different outputs across runs. This variability makes it hard to tell if a change truly improves performance or is just random noise.
- [Comparing LlamaIndex Query Engines with a Pairwise Evaluator](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/datasets-and-experiments/comparing-llamaindex-query-engines-with-a-pairwise-evaluator.md): This tutorial sets up an experiment to determine which LlamaIndex query engine is preferred by an evaluation LLM. Using the `PairwiseEvaluator` module, we compare responses from different engines and identify which one produces more helpful or relevant outputs.
- [More Cookbooks](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/datasets-and-experiments/cookbooks.md)
- [Experiment with a Customer Support Agent](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/datasets-and-experiments/experiment-with-a-customer-support-agent.md): This guide shows you how to create and evaluate agents with Phoenix to improve performance.
- [Prompt Template Iteration for a Summarization Service](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/datasets-and-experiments/summarization.md): Imagine you're deploying a service for your media company's summarization model that condenses daily news into concise summaries to be displayed online. One challenge of using LLMs for summarization is that even the best models tend to be verbose.
- [Text2SQL Experiments](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/datasets-and-experiments/text2sql.md): Building effective text-to-SQL systems requires rigorous evaluation and systematic experimentation. In this tutorial, we'll walk through the complete evaluation-driven development process, starting from scratch without pre-existing datasets of questions or expected responses.
- [Code Readability Evaluation](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/evaluation/code-readability-evaluation.md): Evaluate the readability of code generated by LLM applications using Phoenix's evaluation framework.
- [More Cookbooks](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/evaluation/cookbooks.md): Use Phoenix Evals to evaluate your application for faithfulness, toxicity, relevance of retrieved documents, and more.
- [Evaluate a Talk-to-Your-Data Agent](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/evaluation/evaluate-an-agent.md)
- [Evaluate RAG](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/evaluation/evaluate-rag.md): Building a RAG pipeline and evaluating it with Phoenix Evals.
- [OpenAI Agents SDK Cookbook](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/evaluation/openai-agents-sdk-cookbook.md): This guide shows you how to create and evaluate agents with Phoenix to improve performance.
- [Relevance Classification Evaluation](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/evaluation/relevance-classification-evaluation.md): Evaluate the relevance of documents retrieved by RAG applications using Phoenix's evaluation framework.
- [Using Ragas to Evaluate a Math Problem-Solving Agent](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/evaluation/using-ragas-to-evaluate-a-math-problem-solving-agent.md)
- [Aligning LLM Evals with Human Feedback (TypeScript)](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/human-in-the-loop-workflows-annotations/aligning-llm-evals-with-human-annotations-typescript.md): In this tutorial, we’ll run a Mastra agent and build a custom evaluator for it. The goal is to understand the workflow for creating evaluators that align with specific use cases.
- [Creating a Custom LLM Evaluator with a Benchmark Dataset](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/human-in-the-loop-workflows-annotations/creating-a-custom-llm-evaluator-with-a-benchmark-dataset.md): Learn how to build a custom LLM-as-a-Judge evaluator by creating a benchmark dataset tailored to your use case, enabling rigorous evaluation beyond standard templates.
- [Using Human Annotations for Eval Driven Development](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/human-in-the-loop-workflows-annotations/using-human-annotations-for-eval-driven-development.md): How to leverage human annotations to build evaluations and experiments that improve your system
- [Chain of Thought Prompting](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/prompt-engineering/chain-of-thought-prompting.md)
- [Few Shot Prompting](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/prompt-engineering/few-shot-prompting.md): Few-shot prompting is a powerful technique in prompt engineering that helps LLMs perform tasks more effectively by providing a few examples within the prompt.
- [LLM-as-a-Judge Prompt Optimization](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/prompt-engineering/llm-as-a-judge-prompt-optimization.md)
- [Optimizing Coding Agent Prompts - Prompt Learning](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/prompt-engineering/optimizing-coding-agent-prompts-prompt-learning.md): Optimizing coding agent prompts and tracking coding agent improvement
- [Optimizing Prompts for LLM Classification - Prompt Learning](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/prompt-engineering/prompt-learning-optimizing-prompts-for-classification.md): Using Prompt Learning to boost accuracy on a classification dataset
- [Prompt Optimization Techniques](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/prompt-engineering/prompt-optimization.md): This tutorial will use Phoenix to compare the performance of different prompt optimization techniques.
- [ReAct Prompting](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/prompt-engineering/react-prompting.md): **ReAct (Reasoning + Acting)** is a prompting technique that enables LLMs to think step-by-step before taking action. Unlike traditional prompting, where a model directly provides an answer, ReAct prompts guide the model to reason through a problem first, then decide which tools or actions are neces…
- [Agentic RAG Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/tracing/agentic-rag-tracing.md): This tutorial demonstrates building an agentic RAG system using LlamaIndex's ReAct agent framework combined with vector and SQL query tools.
- [More Cookbooks](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/tracing/cookbooks.md): Trace through the execution of your LLM application to understand its internal structure and to troubleshoot issues with retrieval, tool execution, LLM calls, and more.
- [Generating Synthetic Datasets for LLM Evaluators & Agents](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/tracing/generating-synthetic-datasets-for-llm-evaluators-and-agents.md): Learn different strategies for dataset generation and show how they can be used to run experiments and test evaluators
- [Product Recommendation Agent: Google Agent Engine & LangGraph](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/tracing/product-recommendation-agent-google-agent-engine-and-langgraph.md): This notebook is adapted from Google's "Building and Deploying a LangGraph Application with Agent Engine in Vertex AI"
- [Structured Data Extraction](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/cookbook/tracing/structured-data-extraction.md)
- [Concepts: Datasets](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/datasets-and-experiments/concepts-datasets.md)
- [How to: Datasets](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/datasets-and-experiments/how-to-datasets.md): Datasets are critical assets for building robust prompts, evals, fine-tuning,
- [Creating Datasets](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/datasets-and-experiments/how-to-datasets/creating-datasets.md)
- [Exporting Datasets](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/datasets-and-experiments/how-to-datasets/exporting-datasets.md)
- [How to: Experiments](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/datasets-and-experiments/how-to-experiments.md)
- [Dataset Evaluators](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/datasets-and-experiments/how-to-experiments/how-to-dataset-evaluators.md): Attach evaluators to datasets for automatic scoring during experiments.
- [Repetitions](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/datasets-and-experiments/how-to-experiments/repetitions.md): How to leverage repetitions to get an understanding of indeterminate LLM outputs
- [Run Experiments](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/datasets-and-experiments/how-to-experiments/run-experiments.md): Run experiments from the Playground or programmatically with the SDK.
- [Splits](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/datasets-and-experiments/how-to-experiments/splits.md): How to run experiments over select splits of your dataset for targeted experimentation
- [Using Evaluators](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/datasets-and-experiments/how-to-experiments/using-evaluators.md)
- [Overview: Datasets & Experiments](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/datasets-and-experiments/overview-datasets.md)
- [Defining the Dataset That Powers Your Experiments](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/datasets-and-experiments/tutorial/defining-the-dataset.md): A dataset is the foundation for systematic evaluation and iterative improvement in your AI workflow.
- [Iterating with Experiments in Your Workflow](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/datasets-and-experiments/tutorial/iteration-workflow-experiments.md): Learn how to use experiments to systematically validate changes to your AI application and compare different versions over time.
- [Run Experiments with Code Evals](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/datasets-and-experiments/tutorial/run-experiments-with-code-evals.md): Learn how to define and run experiments to systematically evaluate your AI application using code-based evaluators and ground truth data.
- [Run Experiments with LLM as a Judge](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/datasets-and-experiments/tutorial/run-experiments-with-llm-judge.md): Learn how to define and run experiments to systematically evaluate your AI application using LLM as a Judge evaluators for subjective quality assessments.
- [End to End Features Notebook](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/end-to-end-features-notebook.md)
- [Environments](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/environments.md)
- [LLM as a Judge](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/concepts-evals/llm-as-a-judge.md): Evaluating tasks performed by LLMs can be difficult due to their complexity and the diverse criteria involved. Traditional methods like rule-based assessment or similarity metrics (e.g., ROUGE, BLEU) often fall short when applied to the nuanced and varied outputs of LLMs.
- [Client-Side Evals (SDK)](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/how-to-evals.md)
- [Batch Evaluations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/how-to-evals/batch-evaluations.md)
- [Code Evaluators](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/how-to-evals/code-evaluators.md)
- [Configuring the LLM](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/how-to-evals/configuring-the-llm.md)
- [Custom LLM Evaluators](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/how-to-evals/custom-llm-evaluators.md)
- [Eval Prompt Templates](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/how-to-evals/prompt-formats.md)
- [Using Evals with Phoenix](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/how-to-evals/using-evals-with-phoenix.md): The evals library is designed to work independently — you can run evaluations without any other part of Phoenix. That said, it integrates naturally with tracing, datasets, and experiments when you need it. For more information about how to use the evals library with other Phoenix features, reference…
- [Evaluation](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/llm-evals.md)
- [SDK Eval Metrics](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/pre-built-metrics.md): Ready-to-use evaluation metrics for measuring LLM application quality
- [Conciseness](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/pre-built-metrics/conciseness.md): Evaluate whether LLM responses are concise and free of unnecessary content.
- [Correctness](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/pre-built-metrics/correctness.md): Evaluate whether LLM responses are generally correct and complete.
- [Document Relevance](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/pre-built-metrics/document-relevance.md): Evaluate whether retrieved documents are relevant to user queries
- [Exact Match](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/pre-built-metrics/exact-match.md): Evaluate if output exactly matches expected value
- [Faithfulness](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/pre-built-metrics/faithfulness.md): Evaluate whether LLM responses are faithful to the provided context.
- [Matches Regex](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/pre-built-metrics/matches-regex.md): Evaluate if output matches a regular expression pattern
- [Precision / Recall / F-Score](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/pre-built-metrics/precision-recall-fscore.md): Compute precision, recall, and F-beta scores for classification tasks
- [Q&A on Retrieved Data](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/pre-built-metrics/q-and-a-on-retrieved-data.md)
- [Refusal](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/pre-built-metrics/refusal.md): Detect when an LLM refuses or declines to answer a user query.
- [Retrieval (RAG) Relevance](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/pre-built-metrics/retrieval-rag-relevance.md)
- [SQL Generation](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/pre-built-metrics/sql-generation-eval.md): SQL Generation is a common approach to using an LLM. In many cases the goal is to take a human description of the query and generate matching SQL to the human description.
- [Summarization](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/pre-built-metrics/summarization-eval.md)
- [Agent Function Calling Eval](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/pre-built-metrics/tool-calling-eval.md): The Agent Function Call eval can be used to determine how well a model selects a tool to use, extracts the right parameters from the user query, and generates the tool call code.
- [Tool Invocation](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/pre-built-metrics/tool-invocation.md): Evaluate whether LLM tool calls have correct arguments and formatting
- [Tool Response Handling](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/pre-built-metrics/tool-response-handling.md): Evaluate whether AI agents correctly process tool results, including error handling, data extraction, and safe information disclosure
- [Tool Selection](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/pre-built-metrics/tool-selection.md): Evaluate whether LLMs select the correct tools for given tasks
- [Toxicity](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/pre-built-metrics/toxicity.md)
- [Input Mapping](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/server-evals/input-mapping.md): Control how dataset and task output values flow into evaluator inputs using JSONPath expressions and literal values.
- [LLM Evaluators](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/server-evals/llm-evaluators.md): LLM-as-a-judge evaluators that use Phoenix-managed prompts to label and score experiment outputs with full version control and traceability.
- [Server Evals](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/server-evals/overview.md): Attach evaluators directly to a dataset and run them automatically on every experiment.
- [Pre-Built Metrics](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/server-evals/pre-built-metrics.md): Ready-to-use server-side evaluators for common evaluation tasks.
- [Contains](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/server-evals/pre-built-metrics/contains.md): Check whether a text contains one or more specified words.
- [Correctness](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/server-evals/pre-built-metrics/correctness.md): Evaluate whether LLM responses are generally correct and complete using a Phoenix-managed judge model.
- [Exact Match](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/server-evals/pre-built-metrics/exact-match.md): Check whether two strings are identical.
- [JSON Distance](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/server-evals/pre-built-metrics/json-distance.md): Measure the number of structural differences between two JSON values.
- [Levenshtein Distance](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/server-evals/pre-built-metrics/levenshtein-distance.md): Measure the edit distance between two strings.
- [Regex Match](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/server-evals/pre-built-metrics/regex.md): Check whether a text matches a regular expression pattern.
- [Tool Invocation](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/server-evals/pre-built-metrics/tool-invocation.md): Evaluate whether LLM tool calls have correct arguments and formatting using a Phoenix-managed judge model.
- [Tool Selection](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/server-evals/pre-built-metrics/tool-selection.md): Evaluate whether LLMs select the correct tools for given tasks using a Phoenix-managed judge model.
- [Customize Your Evaluation Template](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/tutorials/customize-eval-template.md)
- [Customize Your LLM Endpoint](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/tutorials/customize-your-llm-endpoint.md)
- [Run Evals With Built-In Eval Templates](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/evaluation/tutorials/run-evals-with-built-in-evals.md)
- [Optimize Your App with Experiments](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/get-started/get-started-datasets-and-experiments.md)
- [Measure Performance with Evaluations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/get-started/get-started-evaluations.md)
- [Iterate on Your Prompts](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/get-started/get-started-prompt-playground.md)
- [Send Traces From Your App](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/get-started/get-started-tracing.md)
- [Optimize Your App with Experiments](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/get-started/ts-get-started-datasets-and-experiments.md)
- [Measure Performance with Evaluations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/get-started/ts-get-started-evaluations.md)
- [Iterate on Your Prompts](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/get-started/ts-get-started-prompt-playground.md)
- [Send Traces From Your App](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/get-started/ts-get-started-tracing.md)
- [Integrations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations.md): Connect Phoenix with your favorite AI frameworks, LLM providers, and tools
- [Coding Agents](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/developer-tools/coding-agents.md): Integrate Phoenix with AI coding assistants using CLI, MCP, and skills in a single workflow guide.
- [Cleanlab](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/evaluation-integrations/cleanlab.md)
- [MLflow](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/evaluation-integrations/mlflow.md): Use Phoenix evaluators as MLflow scorers for GenAI evaluation workflows.
- [Ragas](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/evaluation-integrations/ragas.md): This guide will walk you through the process of creating and evaluating agents using Ragas and Arize Phoenix.
- [UQLM Confidence & Hallucination Risk](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/evaluation-integrations/uqlm.md)
- [Arconia](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/java/arconia.md): Arconia is an open-source framework and set of tools for building modern, cloud-native enterprise applications using Java and the Spring Boot framework
- [Arconia Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/java/arconia/arconia-tracing.md): How to use OpenInference instrumentation with Arconia and export traces to Arize Phoenix.
- [LangChain4j](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/java/langchain4j.md): LangChain4j is a Java library that provides APIs, tools, and patterns to easily build and integrate LLM-powered Java applications.
- [LangChain4j Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/java/langchain4j/langchain4j-tracing.md): How to use OpenInference instrumentation with LangChain4j and export traces to Arize Phoenix.
- [Spring AI](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/java/springai.md): Spring AI extends the Spring Framework, making it easier to integrate AI capabilities into Java applications using familiar Spring patterns.
- [Spring AI Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/java/springai/springai-tracing.md): How to use OpenInference instrumentation with Spring AI and export traces to Arize Phoenix.
- [Amazon Bedrock](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/amazon-bedrock.md): Amazon Bedrock is a managed service that provides access to top AI models for building scalable applications.
- [Amazon Bedrock Agent Runtime JavaScript](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/amazon-bedrock/amazon-bedrock-agent-runtime-js.md): Instrument and observe AWS Bedrock Agent Runtime calls in JavaScript/Node.js
- [Amazon Bedrock Agents Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/amazon-bedrock/amazon-bedrock-agents-tracing.md): Instrument LLM calls to AWS Bedrock via the boto3 client using the BedrockInstrumentor
- [Amazon Bedrock SDK for JavaScript](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/amazon-bedrock/amazon-bedrock-sdk-js.md): Instrument and observe AWS Bedrock calls using the AWS SDK for JavaScript
- [Amazon Bedrock Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/amazon-bedrock/amazon-bedrock-tracing.md): Instrument LLM calls to AWS Bedrock via the boto3 client using the BedrockInstrumentor
- [Anthropic](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/anthropic.md): Anthropic is an AI research company that develops LLMs, including Claude, with a focus on alignment and reliable behavior.
- [Anthropic SDK TypeScript](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/anthropic/anthropic-sdk-typescript.md): Instrument and observe Anthropic calls in TypeScript/Node.js
- [Anthropic Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/anthropic/anthropic-tracing.md)
- [Google](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/google-gen-ai.md): Google GenAI is a suite of AI tools and models from Google Cloud, designed to help businesses build, deploy, and scale AI applications.
- [Google Gen AI Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/google-gen-ai/google-genai-tracing.md): Instrument LLM calls made using the Google Gen AI Python SDK
- [Groq](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/groq.md): Groq provides ultra-low latency inference for LLMs through its custom-built LPU™ architecture.
- [Groq Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/groq/groq-tracing.md): Instrument LLM applications built with Groq
- [LiteLLM](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/litellm.md): LiteLLM is an open-source platform that provides a unified interface to manage and access over 100 LLMs from various providers.
- [LiteLLM Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/litellm/litellm-tracing.md)
- [MistralAI](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/mistralai.md): Mistral AI develops open-weight large language models, focusing on efficiency, customization, and cost-effective AI solutions.
- [MistralAI Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/mistralai/mistralai-tracing.md): Instrument LLM calls made using MistralAI's SDK via the MistralAIInstrumentor
- [OpenAI](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/openai.md): OpenAI provides state-of-the-art LLMs for natural language understanding and generation.
- [OpenAI Agents SDK Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/openai/openai-agents-sdk-tracing.md): Use Phoenix and OpenAI Agents SDK for powerful multi-agent tracing
- [OpenAI Node.js SDK](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/openai/openai-node-js-sdk.md): Instrument and observe OpenAI calls
- [OpenAI Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/openai/openai-tracing.md): Phoenix provides auto-instrumentation for the [OpenAI Python Library](https://github.com/openai/openai-python).
- [OpenRouter](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/openrouter.md): OpenRouter is a platform that connects developers to multiple AI models through a unified API, making it easier to compare, switch between, and integrate different models.
- [OpenRouter Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/openrouter/openai-tracing.md): Phoenix provides auto-instrumentation for OpenRouter through the OpenAI Python Library since OpenRouter provides a fully OpenAI-compatible API endpoint.
- [VertexAI](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/vertexai.md): Vertex AI is a fully managed platform by Google Cloud for building, deploying, and scaling machine learning models.
- [VertexAI Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/llm-providers/vertexai/vertexai-tracing.md): Instrument LLM calls made using VertexAI's SDK via the VertexAIInstrumentor
- [MCP Servers](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/phoenix-mcp-server.md): Connect AI assistants to Phoenix documentation and platform capabilities via the Model Context Protocol (MCP).
- [Dify](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/platforms/dify.md): Dify lets you visually build, orchestrate, and deploy AI-native apps using LLMs, with low-code workflows and agent frameworks for fast deployment.
- [Dify Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/platforms/dify/dify-tracing.md): Configure your Dify application to view traces in Phoenix
- [Flowise](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/platforms/flowise.md): Flowise is a low-code platform for building customized chatflows and agentflows.
- [Flowise Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/platforms/flowise/flowise-tracing.md): Analyzing and troubleshooting what happens under the hood can be challenging without proper insights. By integrating your Flowise application with Phoenix, you can monitor traces and gain robust observability into your chatflows and agentflows.
- [LangFlow](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/platforms/langflow.md): Langflow is an open-source visual framework that enables developers to rapidly design, prototype, and deploy custom applications powered by large language models (LLMs)
- [LangFlow Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/platforms/langflow/langflow-tracing.md)
- [Prompt flow](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/platforms/prompt-flow.md): PromptFlow is a framework for designing, orchestrating, testing, and monitoring end-to-end LLM prompt workflows with built-in versioning and analytics
- [Prompt Flow Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/platforms/prompt-flow/prompt-flow-tracing.md): Create flows using Microsoft PromptFlow and send their traces to Phoenix
- [Agent Spec](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/agentspec.md): Open Agent Spec (Agent Spec) is a portable language for defining agentic systems. It defines building blocks for standalone agents and structured agentic workflows as well as common ways of composing them into multi-agent systems.
- [Agent Spec Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/agentspec/agentspec-tracing.md): How to use the python AgentSpecInstrumentor to trace Agent Spec workflows
- [Agno](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/agno.md): Agno is an open-source Python framework for building lightweight, model-agnostic AI agents with built-in memory, knowledge, tools, and reasoning capabilities
- [Agno Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/agno/agno-tracing.md): Phoenix provides seamless observability and tracing for Agno agents through the OpenInference instrumentation package. This integration automatically captures agent interactions, tool usage, reasoning steps, and multi-agent conversations, giving you complete visibility into your Agno applications. M…
- [AutoGen](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/autogen.md): AutoGen is an open-source Python framework for orchestrating multi-agent LLM interactions with shared memory and tool integrations to build scalable AI workflows
- [AutoGen AgentChat Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/autogen/autogen-agentchat-tracing.md): Auto-instrument your AgentChat application for seamless observability
- [AutoGen Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/autogen/autogen-tracing.md)
- [BeeAI](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/beeai.md): BeeAI is an open-source platform that enables developers to discover, run, and compose AI agents from any framework, facilitating the creation of interoperable multi-agent systems
- [BeeAI Tracing (Python)](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/beeai/beeai-tracing-python.md): Instrument and observe BeeAI agents
- [Claude Agent SDK (Python)](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/claude-agent-sdk.md): Trace Anthropic's Claude Agent SDK applications in Python with Phoenix
- [CrewAI](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/crewai.md): CrewAI is an open-source Python framework for orchestrating role-playing, autonomous AI agents into collaborative "crews" and "flows," combining high-level simplicity with fine-grained control.
- [CrewAI Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/crewai/crewai-tracing.md): Instrument multi-agent applications using CrewAI
- [DSPy](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/dspy.md): DSPy is an open-source Python framework for declaratively programming modular LLM pipelines and automatically optimizing prompts and model weights
- [DSPy Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/dspy/dspy-tracing.md): Instrument and observe your DSPy application via the DSPyInstrumentor
- [Google ADK](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/google-adk.md): Google ADK is a Python SDK for building AI applications with Google's Gemini models and agent framework capabilities
- [Google ADK Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/google-adk/google-adk-tracing.md): Instrument LLM calls made using the Google ADK Python SDK
- [Graphite](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/graphite.md): Graphite is an open-source Python framework for designing and orchestrating multi-agent LLM workflows with a visual builder and node-based composition.
- [Graphite Integration Guide](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/graphite/graphite-integration-guide.md)
- [Guardrails AI](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/guardrails-ai.md): Guardrails is an open-source Python framework for adding programmable input/output validators to LLM applications, ensuring safe, structured, and compliant model interactions
- [Guardrails AI Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/guardrails-ai/guardrails-ai-tracing.md): Instrument LLM applications that use the Guardrails AI framework
- [Haystack](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/haystack.md): Haystack is an open-source framework for building scalable semantic search and QA pipelines with document indexing, retrieval, and reader components
- [Haystack Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/haystack/haystack-tracing.md): Instrument LLM applications built with Haystack
- [Hugging Face Smolagents](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/hugging-face-smolagents.md): Hugging Face smolagents is a minimalist Python library for building powerful AI agents with simple abstractions, tool integrations, and flexible LLM support
- [Smolagents Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/hugging-face-smolagents/smolagents-tracing.md): How to use the SmolagentsInstrumentor to trace smolagents by Hugging Face
- [Instructor](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/instructor.md): Instructor is a library that helps you define structured output formats for LLMs.
- [Instructor Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/instructor/instructor-tracing.md)
- [LangChain](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/langchain.md): LangChain is an open-source framework for building language model applications with prompt chaining, memory, and external integrations
- [LangChain Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/langchain/langchain-tracing.md): How to use the python LangChainInstrumentor to trace LangChain
- [LangGraph](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/langgraph.md): LangGraph is an open-source framework for building graph-based LLM pipelines with modular nodes and seamless data integrations
- [LangGraph Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/langgraph/langgraph-tracing.md)
- [LlamaIndex](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/llamaindex.md): LlamaIndex is an open-source framework that streamlines connecting, ingesting, indexing, and retrieving structured or unstructured data to power efficient, data-aware language model applications.
- [LlamaIndex Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/llamaindex/llamaindex-tracing.md): How to use the python LlamaIndexInstrumentor to trace LlamaIndex
- [LlamaIndex Workflows Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/llamaindex/llamaindex-workflows-tracing.md): How to use the python LlamaIndexInstrumentor to trace LlamaIndex Workflows
- [MCP Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/mcp-tracing.md): Phoenix provides tracing for MCP clients and servers through OpenInference. This includes the unique capability to trace client to server interactions under a single trace in the correct hierarchy.
- [NVIDIA](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/nvidia.md): NVIDIA NeMo Agent Toolkit is a flexible, lightweight library for connecting enterprise agents to data sources and tools across any framework
- [NeMo Agent Toolkit Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/nvidia/nemo-agent-tracing.md): Instrument and observe NVIDIA NeMo Agent Toolkit workflows
- [Portkey](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/portkey.md): Portkey is an AI Gateway and observability platform that provides routing,  guardrails, caching, and monitoring for 200+ LLMs with enterprise-grade  security and reliability features.
- [Portkey Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/portkey/portkey-tracing.md): How to trace Portkey AI Gateway requests with Phoenix for comprehensive LLM observability
- [Pydantic AI](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/pydantic.md): PydanticAI is a Python agent framework designed to make it less painful to  build production-grade applications with Generative AI, built by the team  behind Pydantic with type-safe structured outputs
- [Pydantic Evals](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/pydantic/pydantic-evals.md): How to use Pydantic Evals with Phoenix to evaluate AI applications using structured evaluation frameworks
- [Pydantic AI Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/pydantic/pydantic-tracing.md): How to use the python PydanticAIInstrumentor to trace PydanticAI agents
- [Restate](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/restate.md): Restate is a durable execution platform that makes AI agents and workflows resumable and resilient, with built-in OpenTelemetry tracing
- [Restate Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/restate/restate-tracing.md): Trace durable AI agent executions powered by Restate with Phoenix for full observability into LLM calls, tool invocations, and workflow steps.
- [Strands Agents](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/strands-agents.md): Strands Agents is an open-source AI agent SDK that uses model-driven orchestration to build production-ready agents in a few lines of code
- [Strands Agents Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/python/strands-agents/strands-agents-tracing.md): Phoenix provides tracing support for Strands Agents through a span processor that transforms Strands' native OpenTelemetry spans into OpenInference format.
- [BeeAI](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/typescript/beeai.md): BeeAI is an open-source platform that enables developers to discover, run, and compose AI agents from any framework, facilitating the creation of interoperable multi-agent systems
- [BeeAI Tracing (JS)](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/typescript/beeai/beeai-tracing-js.md): Auto-instrument and observe BeeAI agents
- [Claude Agent SDK (TypeScript)](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/typescript/claude-agent-sdk.md): Trace Anthropic's Claude Agent SDK applications in TypeScript/Node.js with Phoenix
- [LangChain](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/typescript/langchain.md): LangChain is an open-source framework for building language model applications with prompt chaining, memory, and external integrations
- [Langchain.js](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/typescript/langchain/langchain-js.md)
- [Mastra](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/typescript/mastra.md): Mastra is an open-source TypeScript AI agent framework designed for building production-ready AI applications with agents, workflows, RAG, and observability
- [Mastra Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/typescript/mastra/mastra-tracing.md): Instrument agent applications built with Mastra
- [MCP](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/typescript/mcp.md): Model Context Protocol (MCP) is an open protocol that enables secure connections between AI assistants and data sources.
- [MCP Tracing (TypeScript)](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/typescript/mcp/mcp-tracing-typescript.md): Trace MCP (Model Context Protocol) clients and servers in TypeScript/Node.js
- [Vercel](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/typescript/vercel.md): Vercel is a cloud platform that simplifies building, deploying, and scaling modern web applications with features like serverless functions, edge caching, and seamless Git integration
- [Vercel AI SDK Tracing (JS)](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/integrations/typescript/vercel/vercel-ai-sdk-tracing-js.md)
- [Getting Started](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/phoenix-cloud.md)
- [Phoenix Demo](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/phoenix-demo.md)
- [Production Guide](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/production-guide.md): Moving your application to production: steps for reliability and scale
- [Context Engineering Basics](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/prompt-engineering/concepts-prompts/context-engineering-basics.md)
- [Prompts Concepts](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/prompt-engineering/concepts-prompts/prompts-concepts.md)
- [How to: Prompts](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/prompt-engineering/how-to-prompts.md): Guides on how to do prompt engineering with Phoenix
- [Configure AI Providers](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/prompt-engineering/how-to-prompts/configure-ai-providers.md): Phoenix natively integrates with OpenAI, Azure OpenAI, Anthropic, and Google AI Studio (gemini) to make it easy to test changes to your prompts. In addition to the above, since many AI providers (deepseek, ollama) can be used directly with the OpenAI client, you can talk to any OpenAI compatible LLM…
- [Create a prompt](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/prompt-engineering/how-to-prompts/create-a-prompt.md): Store and track prompt versions in Phoenix
- [Tag a prompt](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/prompt-engineering/how-to-prompts/tag-a-prompt.md): How to deploy prompts to different environments safely
- [Test a prompt](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/prompt-engineering/how-to-prompts/test-a-prompt.md): Testing your prompts before you ship them is vital to deploying reliable AI applications
- [Using a prompt](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/prompt-engineering/how-to-prompts/using-a-prompt.md)
- [Using the Playground](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/prompt-engineering/how-to-prompts/using-the-playground.md): General guidelines on how to use Phoenix's prompt playground
- [Overview: Prompts](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/prompt-engineering/overview-prompts.md)
- [Prompt Management](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/prompt-engineering/overview-prompts/prompt-management.md): Version and track changes made to prompt templates
- [Prompt Playground](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/prompt-engineering/overview-prompts/prompt-playground.md)
- [Prompts in Code](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/prompt-engineering/overview-prompts/prompts-in-code.md): Pull and push prompt changes via Phoenix's Python and TypeScript Clients
- [Span Replay](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/prompt-engineering/overview-prompts/span-replay.md): Replay LLM spans traced in your application directly in the playground
- [Tutorial](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/prompt-engineering/tutorial.md): Phoenix Prompts Tutorial
- [Compare Prompt Versions](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/prompt-engineering/tutorial/compare-prompt-versions.md): Build New Prompt Versions and Compare
- [Identify & Edit Prompts](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/prompt-engineering/tutorial/identify-and-edit-prompts.md): Fix and store bad prompts from your spans
- [Optimize Prompts Automatically](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/prompt-engineering/tutorial/optimize-prompts-automatically.md): Automatically Optimize Prompts with Prompt Learning
- [Test Prompts at Scale](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/prompt-engineering/tutorial/test-prompts-at-scale.md): Measure and Edit Prompts at Scale
- [Release Notes](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes.md): The latest from the Phoenix team.
- [01.18.2025: Automatic & manual span tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/01-2025/01-18-2025-automatic-and-manual-span-tracing.md): Available in Phoenix 7.9+
- [01.17.2026 Phoenix CLI: Terminal Access for AI Coding Assistants](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/01-2026/01-17-2026-phoenix-cli-ai-agent-debugging.md)
- [02.18.2025: One line instrumentation](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/02-2025/02-18-2025-one-line-instrumentation.md): Available in Phoenix 8.0+
- [02.19.2025: Prompts](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/02-2025/02-19-2025-prompts.md): Available in Phoenix 8.0+
- [Phoenix 13.0](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/02-2026/02-14-2026-phoenix-13-0.md): Dataset Evaluators, custom model providers, OpenAI Responses API support, and major Playground and experiment UX improvements.
- [02.27.2026 Sessions API and CLI Support](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/02-2026/02-27-2026-cli-sessions-and-rest-api.md)
- [03.06.2025: Project improvements](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/03-2025/03-06-2025-project-improvements.md): Available in Phoenix 8.5+
- [03.07.2025: Model config enhancements for prompts](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/03-2025/03-07-2025-model-config-enhancements-for-prompts.md): Available in Phoenix 8.11+
- [03.07.2025: New prompt playground, evals, and integration support](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/03-2025/03-07-2025-new-prompt-playground-evals-and-integration-support.md): Available in Phoenix 8.9+
- [03.14.2025: OpenAI agents instrumentation](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/03-2025/03-14-2025-openai-agents-instrumentation.md): Available in Phoenix 8.13+
- [03.18.2025: Resize span, trace, and session tables](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/03-2025/03-18-2025-resize-span-trace-and-session-tables.md): Available in Phoenix 8.14+
- [03.19.2025: Access to new integrations in projects](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/03-2025/03-19-2025-access-to-new-integrations-in-projects.md): Available in Phoenix 8.15+
- [03.20.2025: Delete experiment from action menu](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/03-2025/03-20-2025-delete-experiment-from-action-menu.md): Available in Phoenix 8.19+
- [03.21.2025: Environment variable based admin user configuration](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/03-2025/03-21-2025-environment-variable-based-admin-user-configuration.md): Available in Phoenix 8.17+
- [03.24.2025: Tracing configuration tab](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/03-2025/03-24-2025-tracing-configuration-tab.md): Available in Phoenix 8.19+
- [03.27.2025 span view improvements](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/03-2025/03-27-2025-span-view-improvements.md): Available in Phoenix 8.20+
- [03.05.2026 SDK Session Retrieval](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/03-2026/03-05-2026-sdk-session-retrieval.md): Get and list sessions programmatically from Python and TypeScript.
- [03.08.2026 New Playground Providers and Project Settings](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/03-2026/03-08-2026-new-playground-providers-and-project-settings.md): Phoenix v13.10.0 adds Cerebras, Fireworks AI, Groq, and Moonshot as first-class playground providers, plus editable project settings.
- [Release Notes](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/03-2026/03-11-2026-session-turns-api.md)
- [Release Notes](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/03-2026/03-13-2026-rest-api-improvements.md)
- [Release Notes](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/03-2026/03-22-2026-cli-and-user-api.md)
- [Release Notes](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/03-2026/03-24-2026-prompt-version-diff-and-evals-updates.md)
- [Release Notes](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/03-2026/03-30-2026-delete-prompts-api.md)
- [04.01.2025: Support for MCP span tool info in OpenAI agents SDK](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2025/04-01-2025-support-for-mcp-span-tool-info-in-openai-agents-sdk.md): Available in Phoenix 8.20+
- [04.02.2025 improved span annotation editor](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2025/04-02-2025-improved-span-annotation-editor.md): Available in Phoenix 8.21+
- [04.03.2025: Phoenix client prompt tagging](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2025/04-03-2025-phoenix-client-prompt-tagging.md): Available in Phoenix 8.22+
- [04.09.2025: New REST API for projects with RBAC](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2025/04-09-2025-new-rest-api-for-projects-with-rbac.md): Available in Phoenix 8.23+
- [04.09.2025: Project management API enhancements](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2025/04-09-2025-project-management-api-enhancements.md): Available in Phoenix 8.24+
- [04.15.2025: Display tool call and result ids in span details](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2025/04-15-2025-display-tool-call-and-result-ids-in-span-details.md): Available in Phoenix 8.25+
- [04.16.2025: API key generation via API](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2025/04-16-2025-api-key-generation-via-api.md): Available in Phoenix 8.26+
- [04.18.2025: Tracing for MCP client server applications](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2025/04-18-2025-tracing-for-mcp-client-server-applications.md): Available in Phoenix 8.26+
- [04.25.2025: Scroll selected span into view](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2025/04-25-2025-scroll-selected-span-into-view.md): Available in Phoenix 8.27+
- [04.28.2025: Improved shutdown handling](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2025/04-28-2025-improved-shutdown-handling.md): Available in Phoenix 8.28+
- [04.28.2025: TLS support for Phoenix server](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2025/04-28-2025-tls-support-for-phoenix-server.md): Available in Phoenix 8.29+
- [04.30.2025: Span querying & data extraction for Phoenix client](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2025/04-30-2025-span-querying-and-data-extraction-for-phoenix-client.md): Available in Phoenix 8.30+
- [Release Notes](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2026/04-01-2026-get-traces-secrets-api-and-python-314.md)
- [04.03.2026 ATIF Trajectory Upload](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2026/04-03-2026-atif-trajectory-upload.md): Upload Harbor ATIF agent trajectories as structured Phoenix traces.
- [Release Notes](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2026/04-07-2026-phoenix-v14-breaking-changes.md): Breaking changes in Phoenix v14.0.0: CLI restructuring, legacy client removal, evaluations endpoint removal, evals 1.0 removal, and GraphQL pagination.
- [04.07.2026 PostgreSQL Read Replica Routing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2026/04-07-2026-postgresql-read-replica.md): Route read-only queries to a PostgreSQL read replica to reduce load on the primary under high ingestion.
- [04.10.2026 Shareable Project URLs](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2026/04-10-2026-shareable-url-redirects.md): Link to Phoenix projects by name without looking up internal IDs.
- [04.13.2026 @arizeai/phoenix-otel 1.0](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2026/04-13-2026-phoenix-otel-ts-1-0.md): Tracing helpers, decorators, context setters, and OpenInference semantic conventions ship from a single @arizeai/phoenix-otel import.
- [04.14.2026 CLI Annotation Commands](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2026/04-14-2026-cli-annotation-commands.md): Write span and trace annotations from the terminal with px span annotate and px trace annotate.
- [04.16.2026 Azure Managed Identity for PostgreSQL](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2026/04-16-2026-azure-managed-identity-postgres.md): Connect Phoenix to Azure Database for PostgreSQL using managed identity — no static passwords required.
- [04.20.2026 Span Attribute Filtering, CLI Notes, and Claude Opus 4.7](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2026/04-20-2026-span-attribute-filter-cli-notes-and-opus-4-7.md): Filter spans by attributes across Python, TypeScript, REST, and CLI; add notes to spans via `px span add-note`; use Claude Opus 4.7 in the Playground.
- [04.22.2026 Secrets Settings Page and Evaluator Trace ID](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2026/04-22-2026-secrets-ui-and-evaluator-trace-id.md): Manage LLM provider secrets in the UI; pass trace IDs to experiment evaluators for correlation and debugging.
- [04.24.2026 arize-phoenix-otel 0.16](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/04-2026/04-24-2026-phoenix-otel-python-0-16.md): OpenInference context managers and semantic conventions ship from a single phoenix.otel import — no second install required.
- [05.05.2025: OpenInference Google GenAI instrumentation](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/05-2025/05-05-2025-openinference-google-genai-instrumentation.md)
- [05.09.2025: Annotations, data retention policies, hotkeys](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/05-2025/05-09-2025-annotations-data-retention-policies-hotkeys.md): Available in Phoenix 9.0.0+
- [05.14.2025: Experiments in the JS client](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/05-2025/05-14-2025-experiments-in-the-js-client.md)
- [05.20.2025: Datasets and experiment evaluations in the JS client](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/05-2025/05-20-2025-datasets-and-experiment-evaluations-in-the-js-client.md)
- [05.30.2025: XAI and deepseek support in playground](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/05-2025/05-30-2025-xai-and-deepseek-support-in-playground.md): Available in Phoenix 10.5+
- [06.03.2025: Deploy via helm](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/06-2025/06-03-2025-deploy-via-helm.md): Available in Phoenix 10.6+
- [06.04.2025: Ollama support in playground](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/06-2025/06-04-2025-ollama-support-in-playground.md): Available in Phoenix 10.7+
- [06.06.2025: Experiment progress graph](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/06-2025/06-06-2025-experiment-progress-graph.md): Available in Phoenix 10.9+
- [06.12.2025: Dataset filtering](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/06-2025/06-12-2025-dataset-filtering.md): Available in Phoenix 10.11+
- [06.13.2025: Enhanced span creation and logging](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/06-2025/06-13-2025-enhanced-span-creation-and-logging.md): Available in Phoenix 10.12+
- [06.13.2025: Session filtering](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/06-2025/06-13-2025-session-filtering.md): Available in Phoenix 10.12+
- [06.25.2025: Amazon Bedrock support in playground](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/06-2025/06-25-2025-amazon-bedrock-support-in-playground.md): Available in Phoenix 10.15+
- [06.25.2025: Cost tracking](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/06-2025/06-25-2025-cost-tracking.md): Available in Phoenix 11.0+
- [06.25.2025: New Phoenix Cloud](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/06-2025/06-25-2025-new-phoenix-cloud.md)
- [07.02.2025: Cursor MCP button](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/07-2025/07-02-2025-cursor-mcp-button.md): Available in Phoenix 11.3+
- [07.03.2025: Cost summaries in trace headers](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/07-2025/07-03-2025-cost-summaries-in-trace-headers.md): Available in Phoenix 11.4+
- [07.07.2025: Database disk usage monitor](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/07-2025/07-07-2025-databse-disk-usage-monitor.md): Available in Phoenix 11.5+
- [07.09.2025: Baseline for experiment comparisons](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/07-2025/07-09-2025-baseline-for-experiment-comparisons.md): Available in Phoenix 11.4+
- [07.13.2025: Experiments module in phoenix-client](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/07-2025/07-13-2025-experiments-module-in-phoenix-client.md): Available in Phoenix 11.7+
- [07.18.2025: OpenInference Java](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/07-2025/07-18-2025-openinference-java.md)
- [07.21.2025: Project and trace management via GraphQL](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/07-2025/07-21-2025-project-and-trace-management-via-graphql.md): Available in Phoenix 11.9+
- [07.25.2025: Average metrics in experiment comparison table](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/07-2025/07-25-2025-average-metrics-in-experiment-comparison-table.md): Available in Phoenix 11.12+
- [07.25.2025: Project dashboards](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/07-2025/07-25-2025-project-dashboards.md): Available in Phoenix 11.12+
- [07.29.2025: Google GenAI evals](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/07-2025/07-29-2025-google-genai-evals.md)
- [08.03.2025: Delete Spans via REST API](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/08-2025/08-03-2025-delete-spans-via-rest-api.md): Available in Phoenix 11.19+
- [08.04.2025: Manual Project Creation & Trace Duplication](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/08-2025/08-04-2025-manual-project-creation-and-trace-duplication.md): Available in Phoenix 11.19+
- [08.05.2025: Claude Opus 4-1 Support](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/08-2025/08-05-2025-claude-opus-4-1-support.md): Available in Phoenix 11.19+
- [08.06.2025: Expanded Search Capabilities](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/08-2025/08-06-2025-expanded-search-capabilities.md): Available in Phoenix 11.19+
- [08.07.2025: Improved Error Handling in Prompt Playground](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/08-2025/08-07-2025-improved-error-handling-in-prompt-playground.md): Available in Phoenix 11.20+
- [08.09.2025: Playground Support for GPT-5](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/08-2025/08-09-2025-playground-support-for-gpt-5.md): Available in Phoenix 11.21+
- [08.12.2025: UI Design Overhauls](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/08-2025/08-12-2025-ui-design-overhauls.md): Available in Phoenix 11.22+
- [08.14.2025: Trace Transfer for Long-Term Storage](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/08-2025/08-14-2025-trace-transfer-for-long-term-storage.md): Available in Phoenix 11.23+
- [08.15.2025: Enhance Experiment Comparison Views](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/08-2025/08-15-2025-enhance-experiment-comparison-views.md): Available in Phoenix 11.24+
- [08.20.2025: New Experiment and Annotation Quick Filters](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/08-2025/08-20-2025-new-experiment-and-annotation-quick-filters.md): Available in Phoenix 11.25+
- [08.22.2025: New Trace Timeline View](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/08-2025/08-22-2025-new-trace-timeline-view.md): Available in Phoenix 11.26+
- [08.28.2025: New arize-phoenix-client Package](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/08-2025/08-28-2025-new-arize-phoenix-client-package.md): We’re excited to announce the release of **`arize-phoenix-client`**, a lightweight, fully-featured package for interacting with Phoenix. With this client, you no longer need to install `arize-phoenix` unless running a local instance.
- [09.03.2025: Add Methods to Log Document Annotations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/09-2025/09-03-2025-add-methods-to-log-document-annotations.md): Available in Phoenix 11.31+
- [09.04.2025: Experiment Lists Page Frontend Enhancements](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/09-2025/09-04-2025-experiment-lists-page-frontend-enhancements.md): Available in Phoenix 11.32+
- [09.08.2025: Experiment Annotation Popover in Detail View](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/09-2025/09-08-2025-experiment-annotation-popover-in-detail-view.md): Available in Phoenix 11.33+
- [09.12.2025: Enable Paging in Experiment Compare Details](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/09-2025/09-12-2025-enable-paging-in-experiment-compare-details.md): Available in Phoenix 11.33+
- [09.15.2025: Prompt Labels](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/09-2025/09-15-2025-prompt-labels.md): Available in Phoenix 11.33+
- [09.17.2025: Experiment compare details slideover in list view](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/09-2025/09-17-2025-experiment-compare-details-slideover-in-list-view.md): Available in Phoenix 11.34+
- [09.22.2025: Helm configurable image registry & IPv6 support](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/09-2025/09-22-2025-helm-configurable-image-registry-and-ipv6-support.md): Available in Phoenix 11.35+
- [09.23.2025: Repetitions in experiment compare slideover](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/09-2025/09-23-2025-repetitions-in-experiment-compare-slideover.md): Available in Phoenix 11.35+
- [09.24.2025: Custom HTTP headers for requests in Playground](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/09-2025/09-24-2025-custom-http-headers-for-requests-in-playground.md): Available in Phoenix 11.36+
- [09.25.2025: Repetitions](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/09-2025/09-25-2025-repetitions.md): Available in Phoenix 11.38+
- [09.26.2025: Session Annotations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/09-2025/09-26-2025-session-annotations.md): Available in Phoenix 12.0+
- [09.27.2025: Dataset Splits](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/09-2025/09-27-2025-dataset-splits.md): Available in Phoenix 12.0+
- [09.29.2025: Day 0 support for Claude Sonnet 4.5](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/09-2025/09-29-2025-day-0-support-for-claude-sonnet-4.5.md): Available in Phoenix 12.1+
- [10.03.2025: Prompt Version Editing in Playground](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/10-2025/10-03-2025-prompt-version-editing-in-playground.md): Available in Phoenix 12.2+
- [10.05.2025: Load Prompt by Tag into Playground](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/10-2025/10-05-2025-load-prompt-by-tag-into-playground.md): Available in Phoenix 12.2+
- [10.06.2025: Paginate Compare Experiments](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/10-2025/10-06-2025-paginate-compare-experiments.md): Available in Phoenix 12.3+
- [10.08.2025: Dataset Labels](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/10-2025/10-08-2025-dataset-labels.md): Available in Phoenix 12.3+
- [10.10.2025: Viewer Role](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/10-2025/10-10-2025-viewer-role.md): Available in Phoenix 12.5+
- [10.13.2025: View Traces in Compare Experiments](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/10-2025/10-13-2025-view-traces-in-compare-experiments.md): Available in Phoenix 12.5+
- [10.15.2025: Enhanced Filtering for Examples Table](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/10-2025/10-15-2025-enhanced-filtering-for-examples-table.md): Available in Phoenix 12.5+
- [10.18.2025: Filter Annotations in Compare Experiments Slideover](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/10-2025/10-18-2025-filter-annotations-in-compare-experiments-slideover.md): Available in Phoenix 12.7+
- [10.20.2025: Splits ䷖](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/10-2025/10-20-2025-splits.md): Available in Phoenix 12.7+
- [10.24.2025: Filter Prompts Page by Label](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/10-2025/10-24-2025-filter-prompts-page-by-label.md): Available in Phoenix 12.7+
- [10.26.2025: Add Split Edit Menu to Examples ䷖](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/10-2025/10-26-2025-add-split-edit-menu-to-examples.md): Available in Phoenix 12.8+
- [10.28.2025: Enable AWS IAM Auth for DB Configuration](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/10-2025/10-28-2025-enable-aws-iam-auth-for-db-configuration.md): Available in Phoenix 12.9+
- [10.30.2025: Metadata Support for Experiment Run Annotations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/10-2025/10-30-2025-metadata-support-for-experiment-run-annotations.md): Available in Phoenix 12.9+
- [11.01.2025: Resume Experiments and Evaluations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/11-2025/11-01-2025-resume-experiments-and-evaluations.md): Available in Phoenix 12.10+
- [11.03.2025: Playground Dataset Label Display](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/11-2025/11-03-2025-playground-dataset-label-display.md): Available in Phoenix 12.10+
- [11.05.2025: Metadata for Prompts](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/11-2025/11-05-2025-metadata-for-prompts.md): Available in Phoenix 12.10+
- [11.07.2025: Timezone Preference](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/11-2025/11-07-2025-timezone-preference.md): Available in Phoenix 12.11+
- [11.09.2025 OpenInference TypeScript 2.0](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/11-2025/11-09-2025-openinference-typescript-2-0.md)
- [11.12.2025: Updated Anthropic Model List](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/11-2025/11-12-2025-updated-anthropic-model-list.md): Available in Phoenix 12.15+
- [11.14.2025: Expanded Provider Support with OpenAI 5.1 + Gemini 3](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/11-2025/11-19-2025-expanded-provider-support-with-openai-5-1-+-gemini-3.md): Available in Phoenix 12.15+
- [11.23.2025: Repetitions for Manual Playground Invocations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/11-2025/11-23-2025-repetitions-for-manual-playground-invocations.md): Available in Phoenix 12.17+
- [11.25.2025: Split Assignments When Uploading a Dataset](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/11-2025/11-25-2025-split-assignments-when-uploading-a-dataset.md): Available in Phoenix 12.18+
- [11.27.2025: Show Server Credential Setup in Playground API Keys](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/11-2025/11-27-2025-show-server-credential-setup-in-playground-api-keys.md): Available in Phoenix 12.18+
- [11.29.2025: Add support for Claude Opus 4-5](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/11-2025/11-29-2025-add-support-for-claude-opus-4-5.md): Available in Phoenix 12.18+
- [12.01.2025: Splits on Experiments Table](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/12-2025/12-01-2025-splits-on-experiments-table.md): Available in Phoenix 12.20+
- [12.03.2025: TypeScript createEvaluator](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/12-2025/12-03-2025-typescript-create-evaluator.md): Available in @arizeai/phoenix-evals 2.0+
- [12.04.2025: Evaluator Message Formats](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/12-2025/12-04-2025-evaluator-message-formats.md): Available in phoenix-evals 0.22+ (Python) and @arizeai/phoenix-evals 2.0+ (TypeScript)
- [12.06.2025: LDAP Authentication Support](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/12-2025/12-06-2025-ldap-authentication-support.md): Available in Phoenix 12.20+
- [12.09.2025: Span Notes API](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/12-2025/12-09-2025-span-notes-api.md): Available in Phoenix 12.21+
- [12.12.2025: Support for Gemini Tool Calls](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/12-2025/12-12-2025-support-for-gemini-tool-calls.md): Available in Phoenix 12.25+
- [12.20.2025: Improved User Preferences](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/12-2025/12-20-2025-improved-user-preferences.md): Available in Phoenix 12.27+
- [07.02.2024: Function call evaluations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/2024/07-02-2024-function-call-evaluations.md): Available in Phoenix 4.6+
- [07.03.2024: Datasets & experiments](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/2024/07-03-2024-datasets-and-experiments.md): Available in Phoenix 4.6+
- [07.11.2024: Hosted Phoenix and llamatrace](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/2024/07-11-2024-hosted-phoenix-and-llamatrace.md): Phoenix is now available for deployment as a fully hosted service.
- [07.18.2024: Guardrails AI integrations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/2024/07-18-2024-guardrails-ai-integrations.md): Available in Phoenix 4.11+
- [09.26.2024: Authentication & RBAC](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/2024/09-26-2024-authentication-and-rbac.md): Available in Phoenix 5.0+
- [11.18.2024: Prompt playground](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/2024/11-18-2024-prompt-playground.md): Available in Phoenix 6.0+
- [12.09.2024: Sessions](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/release-notes/2024/12-09-2024-sessions.md): Available in Phoenix 7.0+
- [Contribute to Phoenix](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/contribute-to-phoenix.md): If you want to contribute to the cutting edge of LLM and ML Observability, you've come to the right place!
- [Frequently Asked Questions](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/frequently-asked-questions.md)
- [Braintrust Open Source Alternative? LLM Evaluation Platform Comparison](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/frequently-asked-questions/braintrust-open-source-alternative-llm-evaluation-platform-comparison.md): Braintrust is an evaluation platform that serves as an alternative to Arize Phoenix. Both platforms support core AI application needs, such as: evaluating AI applications, prompt management, tracing executions, and experimentation. However, there are a few major differences.
- [Can I add other users to my Phoenix Instance?](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/frequently-asked-questions/can-i-add-other-users-to-my-phoenix-instance.md)
- [Can I persist data in a notebook?](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/frequently-asked-questions/can-i-persist-data-in-a-notebook.md): You can persist data in the notebook by either setting the `use_temp_dir` flag to false in `px.launch_app` which will persist your data in SQLite on your disk at the **PHOENIX WORKING DIR**. Alternatively you can deploy a phoenix instance and point to it via **PHOENIX COLLECTOR ENDPOINT**.
- [Can I run Phoenix on Sagemaker?](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/frequently-asked-questions/can-i-run-phoenix-on-sagemaker.md): With SageMaker notebooks, phoenix leverages the jupyter-server-proy to host the server under `proxy/6006.`Note, that phoenix will automatically try to detect that you are running in SageMaker but you can declare the notebook runtime via a parameter to `launch_app` or an environment variable
- [Can I use Azure OpenAI?](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/frequently-asked-questions/can-i-use-azure-openai.md)
- [Can I use gRPC for trace collection?](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/frequently-asked-questions/can-i-use-grpc-for-trace-collection.md): Phoenix does natively support gRPC for trace collection post 4.0 release. See [Configuration](/docs/phoenix/self-hosting/configuration) for details.
- [Can I use Phoenix locally from a remote Jupyter instance?](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/frequently-asked-questions/can-i-use-phoenix-locally-from-a-remote-jupyter-instance.md): Yes, you can use either of the two methods below.
- [How can I configure the backend to send the data to the phoenix UI in another container?](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/frequently-asked-questions/how-can-i-configure-the-backend-to-send-the-data-to-the-phoenix-ui-in-another-container.md): _If you are working on an API whose endpoints perform RAG, but would like the phoenix server not to be launched as another thread._
- [How do I resolve Phoenix Evals showing NOT PARSABLE?](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/frequently-asked-questions/how-do-i-resolve-phoenix-evals-showing-not_parsable.md): `NOT_PARSABLE` errors often occur when LLM responses exceed the `max_tokens` limit or produce incomplete JSON.
- [Langfuse alternative? Arize Phoenix vs Langfuse: Key differences](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/frequently-asked-questions/langfuse-alternative-arize-phoenix-vs-langfuse-key-differences.md)
- [Open Source LangSmith Alternative: Arize Phoenix vs. LangSmith](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/frequently-asked-questions/open-source-langsmith-alternative-arize-phoenix-vs.-langsmith.md)
- [Phoenix Cloud Migration Guide: Legacy to New Version](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/frequently-asked-questions/phoenix-cloud-migration-guide-legacy-to-new-version.md): To move to the new Phoenix Cloud, simply [create a new Phoenix account](https://app.arize.com/auth/phoenix/login) with a different email address. From there, you can start using a new Phoenix instance immediately. Your existing projects in your old (legacy) account will remain intact and independent…
- [What is LlamaTrace vs Phoenix Cloud?](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/frequently-asked-questions/what-is-llamatrace-vs-phoenix-cloud.md): LlamaTrace and Phoenix Cloud are the same tool. They are the hosted version of Phoenix provided on app.phoenix.arize.com.
- [What is my Phoenix Endpoint?](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/frequently-asked-questions/what-is-my-phoenix-endpoint.md)
- [What is the difference between GRPC and HTTP?](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/frequently-asked-questions/what-is-the-difference-between-grpc-and-http.md): gRPC and HTTP are communication protocols used to transfer data between client and server applications.
- [What is the difference between Phoenix and Arize?](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/frequently-asked-questions/what-is-the-difference-between-phoenix-and-arize.md): Arize is the company that makes Phoenix. Phoenix is an open source LLM observability tool offered by Arize. It can be access in its Cloud form online, or self-hosted and run on your own machine or server.
- [Will Phoenix Cloud be on the latest version of Phoenix?](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/frequently-asked-questions/will-phoenix-cloud-be-on-the-latest-version-of-phoenix.md): We update the Phoenix version used by Phoenix Cloud on a weekly basis.
- [Github](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/github.md)
- [OpenInference](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/openinference.md)
- [Phoenix to Arize AX Migration](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/phoenix-to-arize-ax-migration.md): Seamlessly migrate your data from Phoenix to Arize AX
- [Python SDK](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/python-api.md)
- [TypeScript SDK](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/resources/typescript-api.md)
- [Python SDK](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference.md): Lightweight Python packages for tracing, evaluation, and platform interaction
- [OpenInference Java](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/openinference-sdk/openinference-java.md)
- [OpenInference JS](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/openinference-sdk/openinference-javascript.md)
- [OpenInference Python](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/openinference-sdk/openinference-python.md)
- [arize-phoenix-client](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/python/arize-phoenix-client.md): Phoenix Client is a comprehensive SDK for interacting with the Phoenix
- [arize-phoenix-evals](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/python/arize-phoenix-evals.md): Tooling to evaluate LLM applications including faithfulness, correctness, relevance, and more.
- [arize-phoenix-otel](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/python/arize-phoenix-otel.md): Lightweight OpenTelemetry wrapper with Phoenix-aware defaults
- [Create an annotation configuration](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/annotation-configs/create-an-annotation-configuration.md)
- [Delete an annotation configuration](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/annotation-configs/delete-an-annotation-configuration.md)
- [Get an annotation configuration by ID or name](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/annotation-configs/get-an-annotation-configuration-by-id-or-name.md)
- [List annotation configurations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/annotation-configs/list-annotation-configurations.md): Retrieve a paginated list of all annotation configurations in the system.
- [Update an annotation configuration](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/annotation-configs/update-an-annotation-configuration.md)
- [Get span annotations for a list of span_ids.](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/annotations/get-span-annotations-for-a-list-of-span_ids.md)
- [Get trace annotations for a list of trace_ids.](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/annotations/get-trace-annotations-for-a-list-of-trace_ids.md)
- [Delete dataset by ID](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/datasets/delete-dataset-by-id.md)
- [Download dataset examples as CSV file](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/datasets/download-dataset-examples-as-csv-file.md)
- [Download dataset examples as OpenAI evals JSONL file](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/datasets/download-dataset-examples-as-openai-evals-jsonl-file.md)
- [Download dataset examples as OpenAI fine-tuning JSONL file](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/datasets/download-dataset-examples-as-openai-fine-tuning-jsonl-file.md)
- [Get dataset by ID](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/datasets/get-dataset-by-id.md)
- [Get examples from a dataset](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/datasets/get-examples-from-a-dataset.md)
- [List dataset versions](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/datasets/list-dataset-versions.md)
- [List datasets](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/datasets/list-datasets.md)
- [Upload dataset from JSON, JSONL, CSV, or PyArrow](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/datasets/upload-dataset-from-json-csv-or-pyarrow.md)
- [Create experiment on a dataset](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/experiments/create-experiment-on-a-dataset.md)
- [Create or update evaluation for an experiment run](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/experiments/create-or-update-evaluation-for-an-experiment-run.md)
- [Create run for an experiment](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/experiments/create-run-for-an-experiment.md)
- [Download experiment runs as a CSV file](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/experiments/download-experiment-runs-as-a-csv-file.md)
- [Download experiment runs as a JSON file](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/experiments/download-experiment-runs-as-a-json-file.md)
- [Get experiment by ID](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/experiments/get-experiment-by-id.md)
- [List experiments by dataset](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/experiments/list-experiments-by-dataset.md): Retrieve a paginated list of experiments for the specified dataset.
- [List runs for an experiment](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/experiments/list-runs-for-an-experiment.md): Retrieve a paginated list of runs for an experiment
- [Create a new project](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/projects/create-a-new-project.md): Create a new project with the specified configuration.
- [Delete a project by ID or name](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/projects/delete-a-project-by-id-or-name.md): Delete an existing project and all its associated data. The project identifier is either project ID or project name. The default project cannot be deleted. Note: When using a project name as the identifier, it cannot contain slash (/), question mark (?), or pound sign (#) characters.
- [Get project by ID or name](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/projects/get-project-by-id-or-name.md): Retrieve a specific project using its unique identifier: either project ID or project name. Note: When using a project name as the identifier, it cannot contain slash (/), question mark (?), or pound sign (#) characters.
- [List all projects](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/projects/list-all-projects.md): Retrieve a paginated list of all projects in the system.
- [Update a project by ID or name](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/projects/update-a-project-by-id-or-name.md): Update an existing project with new configuration. Project names cannot be changed. The project identifier is either project ID or project name. Note: When using a project name as the identifier, it cannot contain slash (/), question mark (?), or pound sign (#) characters.
- [Add tag to prompt version](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/prompts/add-tag-to-prompt-version.md): Add a new tag to a specific prompt version. Tags help identify and categorize different versions of a prompt.
- [Create a new prompt](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/prompts/create-a-new-prompt.md): Create a new prompt and its initial version. A prompt can have multiple versions.
- [Get latest prompt version](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/prompts/get-latest-prompt-version.md): Retrieve the most recent version of a specific prompt.
- [Get prompt version by ID](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/prompts/get-prompt-version-by-id.md): Retrieve a specific prompt version using its unique identifier. A prompt version contains the actual template and configuration.
- [Get prompt version by tag](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/prompts/get-prompt-version-by-tag.md): Retrieve a specific prompt version using its tag name. Tags are used to identify specific versions of a prompt.
- [List all prompts](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/prompts/list-all-prompts.md): Retrieve a paginated list of all prompts in the system. A prompt can have multiple versions.
- [List prompt version tags](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/prompts/list-prompt-version-tags.md): Retrieve all tags associated with a specific prompt version. Tags are used to identify and categorize different versions of a prompt.
- [List prompt versions](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/prompts/list-prompt-versions.md): Retrieve all versions of a specific prompt with pagination support. Each prompt can have multiple versions with different configurations.
- [Upsert or delete secrets](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/secrets/upsert-or-delete-secrets.md): Atomically upsert or delete a batch of secrets. Entries with a non-null `value` are created or updated; entries with `value: null` are deleted. The `value` field is required for every entry, and omitting it returns 422. When the same key appears more than once, the last occurrence wins. Deleting a n…
- [Create session annotations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/sessions/create-session-annotations.md)
- [Get session by ID or session_id](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/sessions/get-session-by-id.md)
- [List sessions for a project](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/sessions/list-project-sessions.md)
- [Get session annotations for a list of session_ids.](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/sessions/list-session-annotations.md)
- [Annotate Span Documents](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/spans/annotate-span-documents.md)
- [Create span annotations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/spans/create-span-annotations.md)
- [Create spans](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/spans/create-spans.md): Submit spans to be inserted into a project. If any spans are invalid or duplicates, no spans will be inserted.
- [Delete a span by span_identifier](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/spans/delete-a-span-by-span_identifier.md): Delete a single span by identifier.
- [List spans with simple filters (no DSL)](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/spans/list-spans-with-simple-filters-no-dsl.md): Return spans within a project filtered by time range. Supports cursor-based pagination.
- [Search spans with simple filters (no DSL)](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/spans/search-spans-with-simple-filters-no-dsl.md): Return spans within a project filtered by time range. Supports cursor-based pagination.
- [Create trace annotations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/traces/create-trace-annotations.md)
- [Delete a trace by identifier](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/traces/delete-a-trace-by-identifier.md): Delete an entire trace by its identifier. The identifier can be either: 1. A Relay node ID (base64-encoded) 2. An OpenTelemetry trace_id (hex string)
- [Create a new user](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/users/create-a-new-user.md): Create a new user with the specified configuration.
- [Delete a user by ID](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/users/delete-a-user-by-id.md): Delete an existing user by their unique GlobalID.
- [List all users](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/api-reference/users/list-all-users.md): Retrieve a paginated list of all users in the system.
- [REST API Overview](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/rest-api/overview.md): Start here to call the Phoenix REST API: endpoint setup, authentication, and your first request.
- [@arizeai/openinference-core](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/arizeai-openinference-core.md): OpenInference Core utilities for LLM tracing in TypeScript
- [@arizeai/phoenix-cli](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/arizeai-phoenix-cli.md): Command-line interface for retrieving trace data from Arize Phoenix projects.
- [@arizeai/phoenix-client](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/arizeai-phoenix-client.md)
- [@arizeai/phoenix-evals](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/arizeai-phoenix-evals.md)
- [@arizeai/phoenix-otel](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/arizeai-phoenix-otel.md): Register OpenTelemetry with Phoenix and use the full OpenInference helper surface from one package
- [@arizeai/phoenix-mcp](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/mcp-server.md): MCP server implementation for Arize Phoenix providing unified interface to Phoenix's capabilities.
- [TypeScript SDK](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/overview.md): Lightweight TypeScript packages for tracing, evaluation, and platform interaction
- [Annotations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-client/annotations.md): Attach structured feedback to spans, documents, and sessions with @arizeai/phoenix-client
- [Datasets](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-client/datasets.md): Create and inspect datasets with @arizeai/phoenix-client
- [Document Annotations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-client/document-annotations.md): Log document-level annotations for RAG evaluation with @arizeai/phoenix-client
- [Experiments](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-client/experiments.md): Run experiments with @arizeai/phoenix-client
- [Overview](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-client/overview.md): Typed TypeScript client for Phoenix platform APIs
- [Prompts](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-client/prompts.md): Manage prompts with @arizeai/phoenix-client
- [Session Annotations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-client/session-annotations.md): Log session-level annotations for conversation evaluation with @arizeai/phoenix-client
- [Sessions](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-client/sessions.md): Work with sessions in @arizeai/phoenix-client
- [Span Annotations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-client/span-annotations.md): Log and retrieve span-level annotations with @arizeai/phoenix-client
- [Spans](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-client/spans.md): Search and manage spans with @arizeai/phoenix-client
- [Traces](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-client/traces.md): Retrieve traces with @arizeai/phoenix-client
- [Classification](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-evals/classification.md): Classification helpers in @arizeai/phoenix-evals
- [Create Evaluator](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-evals/create-evaluator.md): Build custom evaluators with @arizeai/phoenix-evals
- [LLM Evaluators](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-evals/llm-evaluators.md): Use LLM-backed evaluators in @arizeai/phoenix-evals
- [Overview](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-evals/overview.md): Bundled docs for @arizeai/phoenix-evals
- [Phoenix Integration](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-evals/phoenix-integration.md): Use @arizeai/phoenix-evals with Phoenix experiments
- [Templates](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-evals/templates.md): Template helpers in @arizeai/phoenix-evals
- [Context Attributes](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-otel/context-attributes.md): Propagate session IDs, user IDs, metadata, tags, prompt templates, and custom attributes to child spans
- [Manual Spans](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-otel/manual-spans.md): Create raw OpenTelemetry spans, build OpenInference attributes, and redact sensitive data with @arizeai/phoenix-otel
- [Overview](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-otel/overview.md): Register OpenTelemetry with Phoenix and use OpenInference helpers from @arizeai/phoenix-otel
- [Tracing Helpers](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/sdk-api-reference/typescript/packages/phoenix-otel/tracing-helpers.md): Wrap functions and methods with OpenInference spans using withSpan, traceChain, traceAgent, traceTool, and observe
- [Self-Hosting](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/self-hosting.md): How to self-host a Phoenix instance
- [Architecture](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/self-hosting/architecture.md)
- [Overview](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/self-hosting/configuration.md): How to customize your self-hosted deployment of Phoenix
- [Using Amazon Aurora](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/self-hosting/configuration/using-amazon-aurora.md): Phoenix supports IAM database authentication for PostgreSQL connections to Amazon Aurora/RDS.
- [Using Azure Database for PostgreSQL](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/self-hosting/configuration/using-azure-managed-identity.md): Phoenix supports Microsoft Entra managed-identity authentication for Azure Database for PostgreSQL.
- [AWS with CloudFormation](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/self-hosting/deployment-options/aws-with-cloudformation.md): Phoenix can be deployed on AWS Fargate using CloudFormation
- [Docker](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/self-hosting/deployment-options/docker.md): Deploy using docker compose for a local or cloud deployment
- [Kubernetes (kustomize)](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/self-hosting/deployment-options/kubernetes.md): Phoenix can be deployed on Kubernetes with PostgreSQL using kustomize.
- [Kubernetes (helm)](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/self-hosting/deployment-options/kubernetes-helm.md): Deploy Phoenix via Helm
- [Railway](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/self-hosting/deployment-options/railway.md): Use this guide to deploy Arize Phoenix on Railway via the prebuilt template.
- [Terminal](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/self-hosting/deployment-options/terminal.md): Run Phoenix via the CLI on your local machine
- [Authentication](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/self-hosting/features/authentication.md)
- [Email](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/self-hosting/features/email.md)
- [Management](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/self-hosting/features/management.md): How to manage your Phoenix instance
- [Provisioning](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/self-hosting/features/provisioning.md): How to provision Phoenix at deploy time
- [License](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/self-hosting/license.md): Arize Phoenix is fully open-source free to self-host
- [FAQs](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/self-hosting/misc/frequently-asked-questions.md)
- [Privacy](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/self-hosting/security/privacy.md): Understanding privacy and telemetry in self-hosted Phoenix deployments
- [Migrations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/self-hosting/upgrade/migrations.md): How Phoenix manages database migrations and how to run them safely in production
- [Access Control (RBAC)](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/settings/access-control-rbac.md)
- [API Keys](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/settings/api-keys.md)
- [Custom AI Providers](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/settings/custom-ai-providers.md): Configure server-managed AI providers for shared use across the Phoenix platform.
- [Data Retention](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/settings/data-retention.md)
- [Secrets](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/settings/secrets.md): Store and manage encrypted API keys and credentials in Phoenix.
- [Annotations Concepts](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/concepts-tracing/annotations-concepts.md)
- [FAQs: Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/concepts-tracing/faqs-tracing.md)
- [How Tracing Works](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/concepts-tracing/how-tracing-works.md)
- [Translating Semantic Conventions](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/concepts-tracing/translating-conventions.md): Convert traces from OpenLIT, OpenLLMetry, and OpenTelemetry GenAI to OpenInference format so they appear in Phoenix
- [What are Traces](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/concepts-tracing/what-are-traces.md)
- [How to: Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing.md): Guides on how to use traces
- [Add metadata](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/add-metadata.md): Tracing can be augmented and customized by adding Metadata. Metadata includes your own custom attributes, user ids, session ids, prompt templates, and more.
- [Add Attributes, Metadata, Users](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/add-metadata/customize-spans.md)
- [Instrument Prompt Templates and Prompt Variables](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/add-metadata/instrumenting-prompt-templates-and-prompt-variables.md)
- [Advanced](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/advanced.md)
- [Mask Span Attributes](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/advanced/masking-span-attributes.md): In some situations, you may need to modify the observability level of your tracing. For instance, you may want to keep sensitive information from being logged for security reasons, or you may want to limit the size of the base64 encoded images logged to reduced payload size.
- [Filter Spans to Export](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/advanced/modifying-spans.md)
- [Capture Multimodal Traces](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/advanced/multimodal-tracing.md): Phoenix supports displaying images that are included in LLM traces.
- [Suppress Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/advanced/suppress-tracing.md)
- [Cost Tracking](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/cost-tracking.md)
- [Annotate Traces](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/feedback-and-annotations.md)
- [Annotating Auto-Instrumented Spans](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/feedback-and-annotations/annotating-auto-instrumented-spans.md): Use the capture_span_context context manager to annotate auto-instrumented spans
- [Annotating in the UI](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/feedback-and-annotations/annotating-in-the-ui.md): How to annotate traces in the UI for analysis and dataset curation
- [Annotating via the Client](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/feedback-and-annotations/capture-feedback.md): Use the phoenix client to capture end-user feedback
- [Running Evals on Traces](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/feedback-and-annotations/evaluating-phoenix-traces.md): How to use an LLM judge to label and score your application
- [Log Evaluation Results](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/feedback-and-annotations/llm-evaluations.md)
- [Importing & exporting traces](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/importing-and-exporting-traces.md)
- [Exporting Annotated Spans](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/importing-and-exporting-traces/exporting-annotated-spans.md): Span annotations can be an extremely valuable basis for improving your application. The Phoenix client provides useful ways to pull down spans and their associated annotations.
- [Export Data & Query Spans](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/importing-and-exporting-traces/extract-data-from-spans.md): Various options for to help you get data out of Phoenix
- [Import ATIF Trajectories](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/importing-and-exporting-traces/importing-atif-trajectories.md): Upload agent trajectories in ATIF (Agent Trajectory Interchange Format) to Phoenix and visualize them as traces.
- [Import Existing Traces](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/importing-and-exporting-traces/importing-existing-traces.md): Phoenix supports loading data that contains [OpenInference traces](/docs/phoenix/references/openinference). This allows you to load an existing dataframe of traces into your Phoenix instance.
- [Retrieve Traces via CLI](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/importing-and-exporting-traces/retrieve-traces-via-cli.md): Fetch trace data from Phoenix using the command-line interface for debugging, analysis, and integration with AI coding assistants.
- [Setup Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/setup-tracing.md): Configure tracing for your application
- [Using Tracing Helpers](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/setup-tracing/instrument.md): OpenInference packages provide helpful abstractions to make manual instrumentation of agents simpler.
- [Setup Projects](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/setup-tracing/setup-projects.md)
- [Setup Sessions](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/setup-tracing/setup-sessions.md): How to track sessions across multiple traces
- [Setup OTEL](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/how-to-tracing/setup-tracing/setup-using-phoenix-otel.md): Configure OpenTelemetry tracing with Phoenix-aware defaults
- [Overview: Tracing](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/llm-traces.md): Tracing the execution of LLM applications using Telemetry
- [Annotations](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/llm-traces/how-to-annotate-traces.md)
- [Metrics Dashboard](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/llm-traces/metrics.md): Each project comes with a pre-defined metrics dashboard
- [Projects](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/llm-traces/projects.md): Use projects to organize your LLM traces
- [Sessions](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/llm-traces/sessions.md): Track and analyze multi-turn conversations
- [Tracing Tutorial](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/tutorial.md): Build a fully observable AI agent from scratch - trace every operation, measure quality, and debug conversations
- [Annotations and Evaluation](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/tutorial/annotations-and-evaluations.md): Is your agent actually good? Use annotations and LLM-as-Judge to find out.
- [Sessions](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/tutorial/sessions.md): Track multi-turn conversations as cohesive units in Phoenix
- [Your First Traces](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/tracing/tutorial/your-first-traces.md): Build a support agent and trace every LLM call, tool execution, and RAG retrieval
- [User Guide](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/docs/phoenix/user-guide.md): Phoenix is a comprehensive platform designed to enable observability across every layer of an LLM-based system, empowering teams to build, optimize, and maintain high-quality applications and agents efficiently.

## OpenAPI Specs

- [openapi](https://arizeai-433a7140-mikeldking-12899-providers-and-secrets.mintlify.app/schemas/openapi.json)