[Bug]: Could not start container: creating reaper failed

[sebastianbuechler]

Testcontainers version

0.30.0

Using the latest Testcontainers version?

Yes

Host OS

Windows 11

Host arch

amd64

Go version

1.21.6

Docker version

$ docker version
Client:
 Cloud integration: v1.0.35+desktop.11
 Version:           25.0.3
 API version:       1.44
 Go version:        go1.21.6
 Git commit:        4debf41
 Built:             Tue Feb  6 21:13:02 2024
 OS/Arch:           windows/amd64
 Context:           default

Server: Docker Desktop 4.28.0 (139021)
 Engine:
  Version:          25.0.3
  API version:      1.44 (minimum version 1.24)
  Go version:       go1.21.6
  Git commit:       f417435
  Built:            Tue Feb  6 21:14:25 2024
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          1.6.28
  GitCommit:        ae07eda36dd25f8a1b98dfbf587313b99c0190bb
 runc:
  Version:          1.1.12
  GitCommit:        v1.1.12-0-g51d5e94
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0

Docker info

$ docker info
Client:
 Version:    25.0.3
 Context:    default
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.12.1-desktop.4
    Path:     C:\Program Files\Docker\cli-plugins\docker-buildx.exe
  compose: Docker Compose (Docker Inc.)
    Version:  v2.24.6-desktop.1
    Path:     C:\Program Files\Docker\cli-plugins\docker-compose.exe
  debug: Get a shell into any image or container. (Docker Inc.)
    Version:  0.0.24
    Path:     C:\Program Files\Docker\cli-plugins\docker-debug.exe
  dev: Docker Dev Environments (Docker Inc.)
    Version:  v0.1.0
    Path:     C:\Program Files\Docker\cli-plugins\docker-dev.exe
  extension: Manages Docker extensions (Docker Inc.)
    Version:  v0.2.22
    Path:     C:\Program Files\Docker\cli-plugins\docker-extension.exe
  feedback: Provide feedback, right in your terminal! (Docker Inc.)
    Version:  v1.0.4
    Path:     C:\Program Files\Docker\cli-plugins\docker-feedback.exe
  init: Creates Docker-related starter files for your project (Docker Inc.)
    Version:  v1.0.1
    Path:     C:\Program Files\Docker\cli-plugins\docker-init.exe
  sbom: View the packaged-based Software Bill Of Materials (SBOM) for an image (Anchore Inc.)
    Version:  0.6.0
    Path:     C:\Program Files\Docker\cli-plugins\docker-sbom.exe
  scout: Docker Scout (Docker Inc.)
    Version:  v1.5.0
    Path:     C:\Program Files\Docker\cli-plugins\docker-scout.exe

Server:
 Containers: 44
  Running: 0
  Paused: 0
  Stopped: 44
 Images: 22
 Server Version: 25.0.3
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Cgroup Version: 1
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runc.v2 runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: ae07eda36dd25f8a1b98dfbf587313b99c0190bb
 runc version: v1.1.12-0-g51d5e94
 init version: de40ad0
 Security Options:
  seccomp
   Profile: unconfined
 Kernel Version: 5.15.146.1-microsoft-standard-WSL2
 Operating System: Docker Desktop
 OSType: linux
 Architecture: x86_64
 CPUs: 32
 Total Memory: 15.58GiB
 Name: docker-desktop
 ID: d6a66196-edce-47b4-86af-8679687c5b0c
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 HTTP Proxy: http.docker.internal:3128
 HTTPS Proxy: http.docker.internal:3128
 No Proxy: hubproxy.docker.internal
 Experimental: false
 Insecure Registries:
  hubproxy.docker.internal:5555
  127.0.0.0/8
 Live Restore Enabled: false

WARNING: No blkio throttle.read_bps_device support
WARNING: No blkio throttle.write_bps_device support
WARNING: No blkio throttle.read_iops_device support
WARNING: No blkio throttle.write_iops_device support
WARNING: daemon is not using the default seccomp profile

What happened?

I ran an integration test that spins up a PostgreSQL database which usually works without any issue on other systems. But on this machine it says:

2024/04/10 13:59:43 github.com/testcontainers/testcontainers-go - Connected to docker: 
  Server Version: 25.0.3
  API Version: 1.44
  Operating System: Docker Desktop
  Total Memory: 15951 MB
  Resolved Docker Host: tcp://127.0.0.1:50934
  Resolved Docker Socket Path: //./pipe/docker_engine
  Test SessionID: 5fa5f11f9fba7e7d7f5af0266e5babf8bc7030bec98b3d7607c4f7fd6ae973bb
  Test ProcessID: e97481d1-d819-42e3-bc0f-f07aad00f7a0
2024/04/10 13:59:43 Failed to get image auth for https://index.docker.io/v1/. Setting empty credentials for the image: testcontainers/ryuk:0.7.0. Error is:credentials not found in native keychain
2024/04/10 13:59:46 🐳 Creating container for image testcontainers/ryuk:0.7.0
2024/04/10 13:59:46 ✅ Container created: 9433fe236771
2024/04/10 13:59:46 🐳 Starting container: 9433fe236771
2024/04/10 13:59:46 ✅ Container started: 9433fe236771
2024/04/10 13:59:46 🚧 Waiting for container id 9433fe236771 image: testcontainers/ryuk:0.7.0. Waiting for: &{Port:8080/tcp timeout:<nil> PollInterval:100ms}
2024/04/10 13:59:47 failed accessing container logs: Error response from daemon: No such container: 9433fe2367714ff9aa681c31b776f9ceead5f282e8413c846641de31afd6e5ea
2024/04/10 13:59:47 Error response from daemon: No such container: 9433fe2367714ff9aa681c31b776f9ceead5f282e8413c846641de31afd6e5ea: could not start container: creating reaper failed: failed to create container

Relevant log output

No response

Additional information

No response

[dmakushin]

Same for me. Started after update to 0.30.0

[weeco]

V0.30.0 has been causing issues in my team as well. Different setups running Docker Desktop and Rancher - both running consistently into:

port not found: creating reaper failed: failed to create container

or

dial tcp [::1]:32810: connect: connection refused: Connecting to Ryuk on localhost:32810 failed: connecting to network reaper failed: failed to create network

Downgrading to v0.29.2 fixed it.

[mdelapenya]

Mmm I'm going to prioritise this, as it should work.... Please check the +100 usages of this new release without issue (I supose) https://github.com/search?q=%22testcontainers-go+v0.30%22+path%3Ago.mod+NOT+is%3Afork+NOT+org%3Atestcontainers+&type=code

From the logs, it seems Ryuk dies before the next container is started. Could you try enabling the verbose mode in Ryuk and trying to capture Ryuk logs and see if the connections are happening?

[miparnisari]

👋 seeing the same issue. https://github.com/openfga/openfga/actions/runs/8926586012/job/24517945125.