Add Arize and Phoenix LLM observability skills (#1204)

* Add 9 Arize LLM observability skills

Add skills for Arize AI platform covering trace export, instrumentation,
datasets, experiments, evaluators, AI provider integrations, annotations,
prompt optimization, and deep linking to the Arize UI.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

* Add 3 Phoenix AI observability skills

Add skills for Phoenix (Arize open-source) covering CLI debugging,
LLM evaluation workflows, and OpenInference tracing/instrumentation.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

* Ignoring intentional bad spelling

* Fix CI: remove .DS_Store from generated skills README and add codespell ignore

Remove .DS_Store artifact from winmd-api-search asset listing in generated
README.skills.md so it matches the CI Linux build output. Add queston to
codespell ignore list (intentional misspelling example in arize-dataset skill).

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

* Add arize-ax and phoenix plugins

Bundle the 9 Arize skills into an arize-ax plugin and the 3 Phoenix
skills into a phoenix plugin for easier installation as single packages.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

* Fix skill folder structures to match source repos

Move arize supporting files from references/ to root level and rename
phoenix references/ to rules/ to exactly match the original source
repository folder structures.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

* Fixing file locations

* Fixing readme

---------

Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

plugins/arize-ax/.github/plugin/plugin.json

@@ -0,0 +1,32 @@
+{
+  "name": "arize-ax",
+  "description": "Arize AX platform skills for LLM observability, evaluation, and optimization. Includes trace export, instrumentation, datasets, experiments, evaluators, AI provider integrations, annotations, prompt optimization, and deep linking to the Arize UI.",
+  "version": "1.0.0",
+  "author": {
+    "name": "Arize AI"
+  },
+  "repository": "https://github.com/github/awesome-copilot",
+  "license": "MIT",
+  "keywords": [
+    "arize",
+    "llm",
+    "observability",
+    "tracing",
+    "evaluation",
+    "instrumentation",
+    "datasets",
+    "experiments",
+    "prompt-optimization"
+  ],
+  "skills": [
+    "./skills/arize-ai-provider-integration/",
+    "./skills/arize-annotation/",
+    "./skills/arize-dataset/",
+    "./skills/arize-evaluator/",
+    "./skills/arize-experiment/",
+    "./skills/arize-instrumentation/",
+    "./skills/arize-link/",
+    "./skills/arize-prompt-optimization/",
+    "./skills/arize-trace/"
+  ]
+}

plugins/arize-ax/README.md

@@ -0,0 +1,26 @@
+# Arize AX Plugin
+
+Arize AX platform skills for LLM observability, evaluation, and optimization. Includes trace export, instrumentation, datasets, experiments, evaluators, AI provider integrations, annotations, prompt optimization, and deep linking to the Arize UI.
+
+## Installation
+
+```bash
+# Using Copilot CLI
+copilot plugin install arize-ax@awesome-copilot
+```
+
+## What's Included
+
+### Skills
+
+| Skill | Description |
+|-------|-------------|
+| `arize-trace` | Export and analyze Arize traces and spans for debugging LLM applications using the ax CLI. |
+| `arize-instrumentation` | Add Arize AX tracing to applications using a two-phase agent-assisted workflow. |
+| `arize-dataset` | Create, manage, and query versioned evaluation datasets using the ax CLI. |
+| `arize-experiment` | Run experiments against datasets and compare results using the ax CLI. |
+| `arize-evaluator` | Create and run LLM-as-judge evaluators for automated scoring of spans and experiments. |
+| `arize-ai-provider-integration` | Store and manage LLM provider credentials for use with evaluators. |
+| `arize-annotation` | Create annotation configs and bulk-apply human feedback labels to spans. |
+| `arize-prompt-optimization` | Optimize LLM prompts using production trace data, evaluations, and annotations. |
+| `arize-link` | Generate deep links to the Arize UI for traces, spans, sessions, datasets, and more. |

plugins/phoenix/.github/plugin/plugin.json

@@ -0,0 +1,25 @@
+{
+  "name": "phoenix",
+  "description": "Phoenix AI observability skills for LLM application debugging, evaluation, and tracing. Includes CLI debugging tools, LLM evaluation workflows, and OpenInference tracing instrumentation.",
+  "version": "1.0.0",
+  "author": {
+    "name": "Arize AI"
+  },
+  "repository": "https://github.com/github/awesome-copilot",
+  "license": "MIT",
+  "keywords": [
+    "phoenix",
+    "arize",
+    "llm",
+    "observability",
+    "tracing",
+    "evaluation",
+    "openinference",
+    "instrumentation"
+  ],
+  "skills": [
+    "./skills/phoenix-cli/",
+    "./skills/phoenix-evals/",
+    "./skills/phoenix-tracing/"
+  ]
+}

plugins/phoenix/README.md

@@ -0,0 +1,20 @@
+# Phoenix Plugin
+
+Phoenix AI observability skills for LLM application debugging, evaluation, and tracing. Includes CLI debugging tools, LLM evaluation workflows, and OpenInference tracing instrumentation.
+
+## Installation
+
+```bash
+# Using Copilot CLI
+copilot plugin install phoenix@awesome-copilot
+```
+
+## What's Included
+
+### Skills
+
+| Skill | Description |
+|-------|-------------|
+| `phoenix-cli` | Debug LLM applications using the Phoenix CLI. Fetch traces, analyze errors, review experiments, inspect datasets, and query the GraphQL API. |
+| `phoenix-evals` | Build and run evaluators for AI/LLM applications using Phoenix. |
+| `phoenix-tracing` | OpenInference semantic conventions and instrumentation for Phoenix AI observability. |