Microsoft.Testing.Extensions.OpenTelemetry 2.4.0

Microsoft.Testing.Extensions.OpenTelemetry

Microsoft.Testing.Extensions.OpenTelemetry is an extension for Microsoft.Testing.Platform that instruments test execution with OpenTelemetry-compatible traces and metrics.

Microsoft.Testing.Platform is open source. You can find Microsoft.Testing.Extensions.OpenTelemetry code in the microsoft/testfx GitHub repository.

Install the package

dotnet add package Microsoft.Testing.Extensions.OpenTelemetry

About

This package extends Microsoft.Testing.Platform with:

• OpenTelemetry integration: exposes the Microsoft Testing Platform activity source and meter (both named Microsoft.Testing.Platform) so test execution can be observed via the OpenTelemetry .NET SDK.
• Semantic conventions: where an OpenTelemetry convention exists it is used verbatim — test.case.name, test.case.result.status (upstream pass/fail), test.suite.name, code.function.name, code.file.path, code.line.number, code.stacktrace, error.type, plus an exception span event and an Error span status on failures. The pre-existing attribute and instrument names are still emitted by default so existing dashboards keep working; set TESTINGPLATFORM_OTEL_EMIT_LEGACY_ATTRIBUTES=0 to drop them.
• Platform extensions: OpenTelemetry does not define any test.* metrics or test-case span conventions (as of semantic conventions 1.43.0), and test.case.result.status upstream only defines pass and fail. The instruments listed below, the additional result statuses (skipped, error, timeout, cancelled, unknown), cicd.provider.name, and the test.case.* attributes not listed above are therefore Microsoft.Testing.Platform extensions, deliberately placed in the namespace where an upstream definition would land.
• Resource attributes: AddTestingPlatformResource() describes where the run happened — test assembly, host, OS, runtime — and detects the CI provider, pipeline run, branch and commit (cicd.* / vcs.*) from GitHub Actions, Azure Pipelines, GitLab CI and Jenkins.
• Turnkey configuration: AddOpenTelemetryProviderFromEnvironment() wires instrumentation, resource and an OTLP exporter purely from the standard OTEL_* environment variables, so a run can be exported without writing configuration code.
• Trace context propagation: when the process that started the test run publishes a TRACEPARENT environment variable (CI runners, dotnet test, IDEs), the whole run nests under that trace instead of starting an orphan one.
• Lifecycle management: ties the lifetime of a TracerProvider and MeterProvider to the test application, so they are disposed alongside the test host.
• Observability: lets you route test execution data, via your own OpenTelemetry exporter configuration, into observability backends (e.g. Jaeger, Prometheus, Grafana).
• Standards-based: leverages the OpenTelemetry .NET SDK so that data is sent only to the telemetry exporters and endpoints that you configure.

Note: AddOpenTelemetryProvider does not register any instrumentation or exporter by default. To actually collect MTP telemetry you must, from the withTracing / withMetrics delegates:

• call AddTestingPlatformInstrumentation() on both the TracerProviderBuilder and the MeterProviderBuilder to subscribe to the Microsoft Testing Platform source/meter, and
• register at least one exporter (for example AddOtlpExporter, AddConsoleExporter, or a vendor-specific exporter).

Without instrumentation, no MTP activities or metrics are collected; without an exporter, collected telemetry is not emitted anywhere.

Use AddOpenTelemetryProviderFromEnvironment() instead if you want all of that configured for you from the standard OTEL_* variables. It only installs the instrumentation when an exporter is actually configured (via OTEL_TRACES_EXPORTER / OTEL_METRICS_EXPORTER / OTEL_EXPORTER_OTLP_ENDPOINT) or when you pass a configuration delegate, so leaving it in Program.cs unconditionally costs nothing on machines that do not opt in.

Emitted metrics

Metric dimensions are deliberately kept low-cardinality. Unbounded values such as the per-run test counts are set on the root span (test.run.total, test.run.failed, test.run.skipped) rather than used as metric dimensions. Span durations are reported in milliseconds under test.case.duration_ms, distinct from the seconds-valued test.case.duration metric.

The legacy tests.discovered / tests.started / tests.completed / tests.passed / tests.failed / tests.skipped / tests.unknown counters and the tests.duration histogram (in milliseconds) are still emitted unless legacy attributes are disabled.

Configuration

Data exported and controlling sensitive values

Telemetry is only ever sent to the exporters and endpoints you configure — nothing leaves the process unless you register an exporter (directly, or via AddOpenTelemetryProviderFromEnvironment and the OTEL_* variables). Once an exporter is configured, the following attributes can carry environment-specific or sensitive values, so review them against your exporter's destination:

Only the captured output, the result explanation and the exception message and stack trace are truncated to TESTINGPLATFORM_OTEL_ATTRIBUTE_VALUE_LENGTH_LIMIT (8192 characters by default); all other listed values are exported verbatim unless the Control column notes otherwise, so truncation is a size guard rather than redaction. Set TESTINGPLATFORM_OTEL_CAPTURE_TEST_OUTPUT=0 on any job whose test output can contain secrets, and prefer sending telemetry to a backend you control.

Documentation

For this extension, see https://learn.microsoft.com/dotnet/core/testing/microsoft-testing-platform-open-telemetry.

For comprehensive documentation, see https://aka.ms/testingplatform.

Feedback & contributing

Microsoft.Testing.Platform is an open source project. Provide feedback or report issues in the microsoft/testfx GitHub repository.