Skip to content

Releases: DataDog/dd-trace-go

v1.53.0

31 Jul 20:05
5b4682b
Compare
Choose a tag to compare

What's Changed

This release includes several new features for various APM integrations, including a new opt-in service naming schema, improvements to contrib/gocql and the ability to add HTTP headers to traces in several integrations. In addition, there are a number of small bug fixes and improvements for APM, ASM and the Profiler.

Application Security Management (ASM) no longer requires CGO to be compiled. The appsec build tag is still required for now for a progressive roll-out and will be removed in the next few months. Read more in below's ASM section.

Application Performance Monitoring (APM)

Peer Service naming schema

This release introduces a new opt-in service naming approach, aiming to make service names more consistent. You can opt-in to this new service naming setting DD_TRACE_PEER_SERVICE_DEFAULTS_ENABLED="true" and DD_TRACE_REMOVE_INTEGRATION_SERVICE_NAMES_ENABLED=true.

For fine-tuned control of your service names, you can configure DD_TRACE_PEER_SERVICE_MAPPING, providing comma-separated key:value mapping rule pairs, similar to how DD_SERVICE_MAPPING is configured today.

HTTP Header Tags

This release includes a new feature to add HTTP headers as trace tags for several integrations:

  • contrib/emicklei/go-restful
  • contrib/gin-gonic/gin
  • contrib/go-chi/chi.v5
  • contrib/go-chi/chi
  • contrib/gorilla/mux
  • contrib/labstack/echo.v4
  • contrib/labstack/echo
  • contrib/urfave/negroni
  • contrib/net/http

The feature can be configured globally with the WithHeaderTags option to tracer.Start(), or individually for each integration with the WithHeaderTags options available in each integration package. It accepts a map of case-insensitive header keys to tag names and automatically applies matching header values as tags on traces, e.g. CASE-insensitive-Header:my-tag-name,User-ID:userId,My-Header-And-Tag-Name. Also accepts entries without a specified tag name that are automatically mapped to tags of the form http.request.headers.<header-name>.

APM Changelog

Application Security Management (ASM)

We're happy to release the first version of ASM for Go that no longer requires CGO. This reduces the setup requirements to the bare minimum for Go development: the Go toolchain and nothing more!
Note that even if you disable CGO with CGO_ENABLED=0, the resulting compiled program will still be dynamically linked against the C library, libm, and libdl. Already existing ASM users are not impacted by this new implementation and can upgrade to this version transparently, as these libraries were already required by the previous implementation using CGO.

This release also includes the ability to configure at run time your HTTP protection behaviour at https://app.datadoghq.com/security/configuration/asm/protection-behaviour

  • internal/appsec: remove unnecessary remoteconfig updates specifications by @Hellzy in #2084
  • appsec: integrate the new purego-based go-libddwaf by @Julio-Guerra in #2090
  • appsec: remotely configurable HTTP protection behaviour by @Hellzy in #2044

Profiling

  • contrib/database/sql: properly annotate DB operations with execution trace tasks by @nsrip-dd in #2060
  • profiler: Add profiler.enabled tag by @felixge in #2065
  • profiler: Reduce execution trace period to 15min by @felixge in #2091

General

New Contributors

Full Changelog: v1.52.0...v1.53.0

v1.52.0

22 Jun 16:08
Compare
Choose a tag to compare

What's Changed

Application Security Management (ASM) updated its default blocking page templates to get rid of UTF-8 characters (HTML) and minify the content (JSON). The security rules have also been updated to the latest version, which introduces a new rule type for rules related to specific security scanners.

Application Performance Monitoring (APM) adds several new features, including support for confluent-kafka-go/v2/kafka, a WithResourceNamer option in contrib/go-chi/chi.v5, and support for the sql comment extract implementation. It also contains a few fixes, including introducing a fallback to dynamic service names if no global is found in contrib/google.golang.org/grpc, and removes the restriction requiring a call to Register before Open in contrib/database/sql.

Application Performance Monitoring (APM)

  • ddtrace/tracer: sql comment extract implementation by @barbinimichael in #1964
  • ddtrace/opentelemetry: Enabled OTel benchmark in CI by @dianashevchenko in #1970
  • contrib/google.golang.org/api: update google.golang.org/api version by @rarguelloF in #1971
  • contrib: add support for confluent-kafka-go/v2/kafka by @dferstay in #1889
  • contrib: peer.service precursors for confluentinc kafka integrations by @zarirhamza in #2008
  • contrib/google.golang.org/api: change gen_endpoints script to generate a json file by @rarguelloF in #2009
  • contrib: GRPC peer.service precursor tags by @zarirhamza in #1994
  • contrib: mongoDB peer.service precursor tags by @zarirhamza in #1996
  • contrib/hashicorp/* peer.service precursor tags by @zarirhamza in #1998
  • contrib/globalsign/mgo: Precursor Fix by @zarirhamza in #2011
  • contrib/go-chi: customize span resource name for go-chi by @opsengine in #1950
  • contrib/net/http: add host and port tags for roundTripper by @rarguelloF in #2016
  • contrib/database/sql: do not require users to Register before Open by @knusbaum in #2022
  • contrib/go-chi/chi.v5: add WithResourceNamer option by @taowata in #2024
  • contrib/google.golang.org/grpc: Fallback to dynamic service names if no global is found by @ajgajg1134 in #2048

Application Security Management (ASM)

  • internal/appsec: use latest HTML/JSON blocked response template by @Hellzy in #1952
  • internal/appsec: security rules v1.7.1 by @Hellzy in #2000

Profiling

  • profiler: remove old delta implementation by @nsrip-dd in #1860
  • profiler: add tag to indicate whether execution tracing is enabled by @nsrip-dd in #1997

General

  • go.mod: fix opentelemetry dependency issue by @knusbaum in #2005
  • ci: use reviewdog and use gci linter for imports instead of goimports by @rarguelloF in #2010
  • internal/gitmetadata: log failed read build info as debug by @ahmed-mez in #2012
  • internal/dockerfiles: Follow dockerfile security best practices by @ajgajg1134 in #1973
  • build(deps): bump github.com/gin-gonic/gin from 1.7.7 to 1.9.1 by @dependabot in #2017
  • go.mod: update datadog-agent/pkg/remoteconfig/state by @Hellzy in #2032
  • tracer: fix telemetry metrics to align with spec (#2049) by @katiehockman in #2052

New Contributors

Full Changelog: v1.51.0...v1.52.0

v1.51.0

24 May 08:56
Compare
Choose a tag to compare

⚠️ v1.51.0 contains a regression where a small number of integrations was not configured properly with environment variables, if they were initialized before starting the tracer. Such integrations include contrib/google.golang.org/grpc. Please upgrade to v1.52.0 if you're experiencing issues.

What's Changed

Application Performance Monitoring (APM) fixes a few minor OpenTelemetry-related bugs with W3C trace context propagation, 128 bit trace ids propagation, and the use of the Datadog OTel API. There are also bug fixes in contrib/database/sql, contrib/go-redis/redis.v8, and contrib/gomodule/redigo. It also improves span and service naming across several library integrations. Note that this release adds a deprecation notice to contrib/labstack/echo.
There are also several new features, including support for the redis/go-redis.v9 tracing integration and a new WithErrorCheck option in contrib/aws/aws-sdk-go.

Application Security Management (ASM) now allows users to configure their own custom security rules. These custom security rules get added to the list of security rules used by the In-App WAF. This release also includes a couple of bug fixes.

General

Application Performance Monitoring (APM)

  • ddtrace/tracer: don't set empty tracestate propagation tag by @ahmed-mez in #1910
  • ddtrace/{opentelemetry,opentracer}: add telemetry by @ahmed-mez in #1909
  • internal/telemetry: track tracer init time metric by @lievan in #1896
  • ddtrace/tracer: reset decision maker during fallback behavior of w3c header extraction by @ahmed-mez in #1933
  • ddtrace/tracer: ensure access to trace tags is concurrency-safe by @knusbaum in #1948
  • ddtrace/tracer: mark context updated when SetUser is called by @knusbaum in #1949
  • Set keyTraceID128 on first span in the chunk only by @dianashevchenko in #1946
  • ddtrace/opentelemetry: parent start span options shouldn't be propagated and used during child span creation by @dianashevchenko in #1958
  • contrib/mongodb: use naming schema by @rarguelloF in #1908
  • contrib/syndtr/goleveldb/leveldb: use naming schema by @rarguelloF in #1914
  • contrib/tidwall/buntdb: use naming schema by @rarguelloF in #1913
  • contrib/cassandra: use naming schema by @rarguelloF in #1911
  • contrib/redis: use naming schema by @rarguelloF in #1906
  • contrib/kafka: refactor tests by @rarguelloF in #1907
  • contrib/google.golang.org/grpc: use naming schema by @rarguelloF in #1919
  • contrib/twitchtv/twirp: use naming schema by @rarguelloF in #1920
  • contrib/http: use naming schema by @rarguelloF in #1929
  • contrib/redis/go-redis.v9: support v9 by @taowata in #1730
  • contrib/net/http: don't set empty string values as span tags by @knusbaum in #1956
  • contrib/internal/httptrace: remove naming schema from init by @rarguelloF in #1960
  • contrib/graphql: use naming schema by @rarguelloF in #1926
  • contrib/database/sql: fix bug where options were always overwritten by register options by @rarguelloF in #1904
  • contrib/aws: use naming schema by @rarguelloF in #1931
  • contrib/cloud.google.com/go/pubsub.v1: use naming schema by @rarguelloF in #1937
  • contrib/labstack/echo: Add warning and deprecation notice by @ajgajg1134 in #1974
  • contrib/gomodule/redigo: don't ignore the context given as first argument (#1935) by @lbcjbb in #1936
  • contrib/aws/aws-sdk-go: add WithErrorCheck option by @delca85 in #1682
  • contrib/go-redis/redis.v8: fix broken parsing of redis commands by @knusbaum in #1783
  • contrib: peer.service precursors for elasticsearch integrations by @zarirhamza in #1981
  • contrib: peer.service precursors for confluentinc/segmentio integrations by @zarirhamza in #1979
  • contrib/aws/aws-sdk-go-v2: add aws_service, region, and resourcename by @zARODz11z in #1888
  • internal/telemetry: trim the dependencies version prefix v by @Julio-Guerra in #1963

Application Security Management (ASM)

  • internal/appsec: handle user custom rules through remote config by @Hellzy in #1961
  • internal/appsec: fix user ID event detection & other appsec tests by @Hellzy in #1918
  • internal/appsec/remoteconfig: fix rules overrides by @Julio-Guerra in #1921
  • internal/appsec: do not ignore the appsec events rate limiter by @Julio-Guerra in #1927
  • internal/appsec: security rules v1.7.0 by @Hellzy in #1983
  • contrib/gin-gonic: abort context when the request is blocked by appsec by @Hellzy in #1976

Profiling

  • ddtrace/trace: only tag fully-covered spans as execution traced by @nsrip-dd in #1943
  • profiler: support reconfiguring execution tracing at runtime by @nsrip-dd in #1978

New Contributors

Full Changelog: v1.50.1...v1.51.0

v1.50.1

02 May 17:06
Compare
Choose a tag to compare

What's Changed

  • ddtrace/tracer: ensure access to trace tags is concurrency-safe (#1948) by @knusbaum in #1951

Full Changelog: v1.50.0...v1.50.1

v1.50.0

26 Apr 15:25
2e31956
Compare
Choose a tag to compare

Summary

Application Security Management (ASM) now provides an In-App WAF (Web Application Firewall) which allows you to block suspicious HTTP requests based on your security rules. The main difference with a classic WAF comes from the fact we leverage the full run-time application context and not only the raw wire-format HTTP protocol payloads (eg. the actual Go values parsed from the raw HTTP request). This release also allows you to remotely configure your ASM configuration on the fly, without redeploying your Go services. This makes it possible to customize the In-App WAF rules to apply to each of your services and configure them in blocking mode. You can read more about our new In-App WAF feature in our documentation, and check out the new In-App WAF configuration page.

Application Performance Monitoring (APM) has added several new larger features: support for 128-bit trace IDs, as well as an Open Telemetry compatible tracer provider API. Note this wrapper is a "beta" feature, it may contain bugs and is not recommended for production use yet.

Changes

Breaking changes

General

  • go.mod: upgrade gorm.io/driver/postgres to resolve downstream vuln by @ajgajg1134 in #1865
  • contrib: upgrade labstack/echo/v4 from v4.2.0 to v4.9.0 by @ahmed-mez in #1891
  • contrib: upgrade emicklei/go-restful to v2.16.0 by @ahmed-mez in #1885
  • internal/telemetry: collect telemetry info for gorilla/mux integration by @lievan in #1861

Application Performance Monitoring (APM)

Application Security Management (ASM)

New Contributors

Full Changelog: v1.49.1...v1.50.0

v1.49.1

05 Apr 18:34
Compare
Choose a tag to compare

What's Changed

  • contrib/google.golang.org/grpc: Add WithMetadataTags & WithRequestTags to grpc server stream interceptor. It differs with the unary interceptor implementation only in the span the data is added to. Thanks @radykal-com for the contribution!

Full Changelog: v1.49.0...v1.49.1

v1.49.0

04 Apr 16:00
Compare
Choose a tag to compare

Summary

Application Performance Monitoring (APM) ships various new features and bug fixes such as support for elastic/go-elasticsearch/v8 and for dimfeld/httptreemux/v5. Additional features include new tags for mssql in database/sql, and new tags for mgo. This release also includes a bug fix to how baggage is propagated when using W3C trace context injection/extraction.

Application Security Monitoring (ASM) adds support for multiple IP-related HTTP headers as well as fixing HTTP status code reporting for blocked users in labstack/echo.

Telemetry information is now enabled by default, to disable set DD_INSTRUMENTATION_TELEMETRY_ENABLED to false. Additional information can be found here.

Breaking Changes

This change fixes our lookup of OS name in linux systems that is used for our startup logging. If you are parsing those startup logs and relying on the value of os_name you may experience a breaking change as the value may shift from "Linux (Unknown Distribution)" to the now correctly identified OS name.

The PprofDiff function is deprecated and will be removed from the profiler package in the next release.

Changes

General

Application Performance Monitoring (APM)

  • contrib/database/sql: add mssql instance name tag by @rarguelloF in #1731
  • contrib/globalsign/mgo: add mongodb collection tag by @rarguelloF in #1725
  • contrib/elastic/go-elasticsearch: Add support for elasticsearch v8 (Follow-up) by @VJean in #1763
  • tracer: small refactor for SQL tracing by @katiehockman in #1777
  • database/sql: Export TracedConn, as we need it when using the db.Conn Raw() API call. by @samsm in #1779
  • contrib/google.golang.org/{grpc, grpc.v12}: add support for WithSpanOptions by @mackjmr in #1159
  • internal/telemetry: enable instrumentation telemetry in the tracer and profiler by @lievan in #1769
  • contrib/julienschmidt/httprouter: add http.route tag to span by @asdftamir in #1795
  • contrib/dimfeld/httptreemux/v5: add support for httptreemux by @devillexio in #1546
  • contrib/net/http: errCheck function by @johanneswuerbach in #1716

Application Security Management (ASM)

Profiling

Fixes & Improvements

General

  • go.mod: upgrade golang.org/x/net by @katiehockman in #1747
  • internal/hostname: Add tracer side hostname detection by @ajgajg1134 in #1712 This can be disabled by setting DD_CLIENT_HOSTNAME_ENABLED to false
  • go.mod: Bump deps that used otel to not need v0 of otel by @ajgajg1134 in #1787
  • .gitlab/scripts: add more benchmarks to benchmarking platform by @lievan in #1672
  • profiler: document/test that Start restarts the profiler by @nsrip-dd in #1805
  • ci: run pull request workflows for merge groups by @nsrip-dd in #1809
  • internal/log: allow RecordLogger to ignore certain logs by @lievan in #1810
  • go.mod: upgrade datadog-agent/pkg/obfuscate by @felixge in #1774
  • ddtrace/tracer: fix a race condition on span.SetUser by @pobo380 in #1564

Application Performance Monitoring (APM)

  • contrib/database/sql: Fix sample code in document to prevent panic on OpenDB by @tsbkw in #1635
  • ddtrace/tracer/textmap: always extract baggage when using w3c for compatability by @ajgajg1134 in #1759
  • ddtrace/tracer: fix traceparent length check by @ahmed-mez in #1815

Application Security Monitoring (ASM)

  • contrib/echo: appsec: fix status code reporting when blocking users by @Hellzy in #1757

New Contributors 🎉

Full Changelog: v1.48.0...v1.49.0

v1.48.0

27 Feb 08:57
34ff763
Compare
Choose a tag to compare

Summary

In this release, dd-trace-go moves from go 1.17 to go 1.18 as the lowest supported Go version.

Application Performance Monitoring (APM) ships various new features, bug fixes, and hardening measures, such as the addition of new tags for database and messaging integrations, middleware registration changes for the Gin example, and the addition of fuzzing and benchmarking for injection and extraction in the tracer. It also includes bug fixes for W3C trace context propagation and better error handling and retry functionality. Other changes include the ability to modify resource names in the Go-Chi integration, tag spans when execution trace is enabled, and more.

Application Security Management (ASM) introduces authenticated user blocking thanks to its new public appsec.SetUser() API, allowing to block requests based on the authenticated user ID. This change also affects the previously released user login events, where appsec.TrackUserLoginSuccessEvent() is now also able to block the given user.

Changes

General

Application Performance Monitoring (APM)

  • contrib/go-chi/chi.v5: add an option to modify the resource name by @kpurdon in #1615
  • contrib: add db.system tag for all db integrations by @rarguelloF in #1711
  • contrib: adds 'messaging.system' tag by @zhamza99 in #1697
  • ddtrace/tracer: Add fuzzing and benchmarking for injection and extraction by @lievan in #1704
  • ddtrace/tracer: add usr.id span tag even with propagation by @Julio-Guerra in #1702
  • ddtrace/tracer: enable trace writer to optionally retry on failure. by @purple4reina in #1636
  • ddtrace/tracer: replace Windows path characters in fake UDS host by @nsrip-dd in #1713
  • ddtrace/tracer: update origin substitution in composeTracestate by @lievan in #1694

Application Security Management (ASM)

  • internal/appsec: request blocking based on user ID by @Hellzy in #1706
  • internal/appsec: update security rules to v1.5.1 by @Hellzy in #1750

Fixes & Improvements

General

  • internal/telemetry: uniformize language name with other ways it's reported by @paullegranddc in #1692

Application Performance Monitoring (APM)

  • Rename partition tag from kafka integrations to follow unified naming conventions by @rarguelloF in #1684
  • contrib/gin-gonic/gin/example: middleware must be registered before registering routes by @maxday in #1698
  • contrib/miekg/dns: fix span kind for dns server traces by @rarguelloF in #1696
  • contrib/net/http: Add an example for wrap client by @ajgajg1134 in #1695
  • ddtrace/tracer: fix UDS/http url configuration and error messages by @knusbaum in #1604
  • ddtrace/tracer/textmap: always extract baggage when using w3c for compatability by @ajgajg1134 in #1759
  • tracer: small refactor for single span sampling by @katiehockman in #1718

Application Security Monitoring (ASM)

  • contrib/echo: fix status code reporting when blocking users by @Hellzy in #1757
  • contrib/echo: wrap appsec error in echo.HTTPError by @Hellzy in #1744
  • contrib: stop caching appsec.Enabled() value for gin/echo by @Hellzy in #1732

New Contributors 🎉

Full Changelog: v1.47.0...v1.48.0

v1.47.0

31 Jan 15:59
e1c5b70
Compare
Choose a tag to compare

Summary

In this release, Application Performance Monitoring (APM) adds W3C trace context propagation support. The new default propagation list is tracecontext,Datadog for injection and extraction. See the docs for more configuration details.
APM also re-introduces the collection of client ip address as an opt-in feature, even when ASM isn't configured. This can be enabled by setting DD_TRACE_CLIENT_IP_ENABLED.

Application Security Management (ASM) introduces IP blocking to Gin and Echo, along with a new public API to log security-related events.

The profiler now uses the faster delta profile implementation by default, first introduced in version 1.44.0. This significantly reduces the memory allocations from profile manipulation.

Changes

Application Performance Monitoring (APM)

  • ddtrace/tracer: add W3C context propagator support by @dianashevchenko in #1630
  • ddtrace/tracer : allowed equals sign in propagated tag values by @dianashevchenko in #1650
  • ddtrace/tracer: remove some networking from unit tests by @nsrip-dd in #1656
  • contrib/bradfitz/gomemcache/memcache: bump client TO in tests by @ahmed-mez in #1673
  • tracer: enable stats flushing when Flush() is called by @lievan in #1661
  • ddtrace/tracer: annotate execution trace with span IDs by @nsrip-dd in #1674
  • tracer: add PII protection for runtime/trace data by @felixge in #1690
  • contrib/internal/httptrace: collect client ip if DD_TRACE_CLIENT_IP_ENABLED is set to true by @lievan in #1679

Application Security Management (ASM)

Profiler

  • profiler: enable fastdelta by default by @felixge in #1657
  • profiler: return copy of delta profile data to avoid race by @nsrip-dd in #1660

Fixes

Application Performance Monitoring (APM)

Full Changelog: v1.46.1...v1.47.0

v1.46.1

20 Jan 04:17
8ef9537
Compare
Choose a tag to compare

Summary

This is a patch release containing a minor fix that ensures userinfo strings are not present in URLs sent in the http.url tag.

What's Changed

Application Performance Monitoring (APM)

Full Changelog: v1.46.0...v1.46.1