Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DeviceMapper error for some operations. - Centos 6.4 #6368

Closed
thisiskarthikj opened this issue Jun 11, 2014 · 13 comments
Closed

DeviceMapper error for some operations. - Centos 6.4 #6368

thisiskarthikj opened this issue Jun 11, 2014 · 13 comments

Comments

@thisiskarthikj
Copy link

I have been experimenting with Docker commands and now, when i run the following command,

docker run -i -t 0c752394b855 echo "ThisIsTest"

where "0c752394b855" is the image ID of the centOS image(but works on Fedora image), i get the following error.

Error: Error mounting '/dev/mapper/docker-253:0-1050490-5e3f19abff6825c39e0e51b0dd78b3f77d12cae354ebce97110ec8a36e3b9689-init'
on '/var/lib/docker/devicemapper/mnt/5e3f19abff6825c39e0e51b0dd78b3f77d12cae354ebce97110ec8a36e3b9689-init': invalid argument

When i deleted all the centos images and pulled one using

sudo docker pull centos

I get an error -

Error pulling image (latest) from centos, Driver devicemapper failed to get image rootfs 34e94e67e63a0f079d9336b3c2a52e814d138e5b3f1f614a0cfe273814ed7c0a: mkdir /var/lib/docker/devicemapper/mnt/34e94e67e63a0f079d9336b3c2a52e814d138e5b3f1f614a0cfe273814ed7c0a/rootfs: input/output error 614a0cfe273814ed7c0a/rootfs: input/output error

Docker Version

Client version: 0.11.1
Client API version: 1.11
Go version (client): go1.2.1
Git commit (client): fb99f99/0.11.1
Server version: 0.11.1
Server API version: 1.11
Git commit (server): fb99f99/0.11.1
Go version (server): go1.2.1
Last stable version: 1.0.0, please update docker

CentOS release 6.4 (Final)

kernel version : Linux 2.6.32-358.el6.x86_64 x86_64

@thisiskarthikj
Copy link
Author

I updated my OS to CentOS 6.5 still get the following error when i try the command "docker pull centos"

0c752394b855: Error pulling image (latest) from centos, Driver devicemapper failed to get image rootfs 34e94e67e63a0f079d9336b3c2a52e814d138e5b3f1f614a0cfe273814539c0211cd76: Error pulling image (6.4) from centos, mkdir /var/lib/docker/devicemapper/mnt/539c0211cd76cdeaedbecf9f023ef774612e331137ce7ebe4ae1b61088e7edbe/rootfs/usr/share/doc/iproute-2.6.32: invalid argument /usr/share/doc/iproute-2.6.32: invalid argument
34e94e67e63a: Error downloading dependent layers
2014/06/11 16:58:54 Could not find repository on any of the indexed registries.

@thisiskarthikj
Copy link
Author

Please find the dmesg log below:

Command : docker pull tutum/tomcat
[root@tves lib]# dmesg
EXT4-fs (dm-23): mounted filesystem with ordered data mode. Opts:
EXT4-fs error (device dm-23): ext4_mb_generate_buddy: EXT4-fs: group 64: 32768 blocks in bitmap, 24544 in gd
EXT4-fs error (device dm-23): ext4_add_entry: bad entry in directory #2: rec_len is smaller than minimal - block=8865offset=0(0), inode=0, rec_len=0, name_len=0
EXT4-fs error (device dm-23): ext4_free_blocks: Freeing blocks in system zone - Block = 2097152, count = 1
EXT4-fs (dm-23): mounted filesystem with ordered data mode. Opts:
EXT4-fs error (device dm-23): ext4_mb_generate_buddy: EXT4-fs: group 64: 32768 blocks in bitmap, 24544 in gd
EXT4-fs error (device dm-23): ext4_add_entry: bad entry in directory #2: rec_len is smaller than minimal - block=8865offset=0(0), inode=0, rec_len=0, name_len=0
EXT4-fs error (device dm-23): ext4_free_blocks: Freeing blocks in system zone - Block = 2097152, count = 1
EXT4-fs (dm-23): mounted filesystem with ordered data mode. Opts:
EXT4-fs error (device dm-23): ext4_mb_generate_buddy: EXT4-fs: group 64: 32768 blocks in bitmap, 24544 in gd
EXT4-fs error (device dm-23): ext4_add_entry: bad entry in directory #2: rec_len is smaller than minimal - block=8865offset=0(0), inode=0, rec_len=0, name_len=0
EXT4-fs error (device dm-23): ext4_free_blocks: Freeing blocks in system zone - Block = 2097152, count = 1
__ratelimit: 319 callbacks suppressed
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
__ratelimit: 481 callbacks suppressed
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
__ratelimit: 481 callbacks suppressed
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
__ratelimit: 394 callbacks suppressed
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
__ratelimit: 481 callbacks suppressed
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
__ratelimit: 394 callbacks suppressed
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
__ratelimit: 482 callbacks suppressed
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
__ratelimit: 401 callbacks suppressed
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
__ratelimit: 481 callbacks suppressed
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: ioctl: unable to remove open device docker-253:0-1050490-5e66087f3ffe002664507d225d07b6929843c3f0299f5335a70c1727c8833737
device-mapper: table: 253:23: thin: Couldn't open thin internal device
device-mapper: ioctl: error adding target to table
device-mapper: thin: Deletion of thin device 264 failed.
EXT4-fs (dm-23): mounted filesystem with ordered data mode. Opts:
EXT4-fs error (device dm-23): ext4_mb_generate_buddy: EXT4-fs: group 64: 32768 blocks in bitmap, 24544 in gd
EXT4-fs error (device dm-23): ext4_add_entry: bad entry in directory #2: rec_len is smaller than minimal - block=8865offset=0(0), inode=0, rec_len=0, name_len=0
EXT4-fs error (device dm-23): ext4_free_blocks: Freeing blocks in system zone - Block = 2097152, count = 1

@thisiskarthikj
Copy link
Author

Guys. Waiting for PROs to comment on this issue. I saw a few users reporting this issue in the mailing list as well.

@unclejack
Copy link
Contributor

@karthikus You're running an outdated kernel on your system and you're also running an old version of Docker.

Please update the kernel to the latest kernel version provided by the CentOS repos. A CentOS 6 box I'm running is running kernel 2.6.32-431.17.1.el6 and that's newer than what you're running.

Always update to the latest kernel packages provided by your Linux distribution - that applies to everyone who's running RHEL, CentOS, Debian, Ubuntu and many other Linux distributions which provide kernel packages with long term support.

Please update Docker to Docker 1.0. 0.11.1 and older aren't supported any more.

I'll close this issue now since we don't provide support for CentOS 6. CentOS 7 should be out soon and that should be much better.

@thisiskarthikj
Copy link
Author

I have updated the kernel to the latest version and CentOS to 6.5 but still having this issue. And docker update shows me no package to update. Is the Docker 1.0 build released for CentOS ?

@stevenschlansker
Copy link

I can confirm that this issue is not CentOS related, I am having it on Ubuntu 14.04

Linux ip-10-70-6-181 3.13.0-24-generic #46-Ubuntu SMP Thu Apr 10 19:11:08 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux

Can we please re-open this issue?

Example output:

[182699.315850] EXT4-fs error (device dm-59): ext4_find_dest_de:1648: inode #2: block 8865: comm docker: bad entry in directory: rec_len is smaller than minimal - offset=0(0), inode=0, rec_len=0, name_len=0
[182704.467144] EXT4-fs (dm-60): mounted filesystem with ordered data mode. Opts: discard
[182704.468562] EXT4-fs error (device dm-60): ext4_find_dest_de:1648: inode #2: block 8865: comm docker: bad entry in directory: rec_len is smaller than minimal - offset=0(0), inode=0, rec_len=0, name_len=0
[182709.535047] EXT4-fs (dm-61): mounted filesystem with ordered data mode. Opts: discard
[182709.536287] EXT4-fs error (device dm-61): ext4_find_dest_de:1648: inode #2: block 8865: comm docker: bad entry in directory: rec_len is smaller than minimal - offset=0(0), inode=0, rec_len=0, name_len=0
[182713.529385] EXT4-fs (dm-62): mounted filesystem with ordered data mode. Opts: discard
[182713.530777] EXT4-fs error (device dm-62): ext4_find_dest_de:1648: inode #2: block 8865: comm docker: bad entry in directory: rec_len is smaller than minimal - offset=0(0), inode=0, rec_len=0, name_len=0
[182719.030110] EXT4-fs (dm-63): mounted filesystem with ordered data mode. Opts: discard
[182719.031548] EXT4-fs error (device dm-63): ext4_find_dest_de:1648: inode #2: block 8865: comm docker: bad entry in directory: rec_len is smaller than minimal - offset=0(0), inode=0, rec_len=0, name_len=0
[182725.232891] EXT4-fs (dm-64): mounted filesystem with ordered data mode. Opts: discard

@SyBernot
Copy link

All roads for me currently seem to point to this as the core problem
https://bugzilla.redhat.com/show_bug.cgi?id=1112242
but I can't confirm, at this point for me it will be easier to reprovision the host with XFS

@ghost
Copy link

ghost commented Sep 8, 2016

This is also happening on Fedora 24, kernel 4.6.7, EXT4 formatted SSD with LUKS, docker 1.12.0-rc4. Can this be reopened?

Someone else also mentioned seeing this on Ubuntu, and this has been popping up for a while now.

Or is this a catch all error for all sorts of hidden, unrelated filesystem issues?

[297141.032710] XFS (dm-5): Unmounting Filesystem
[297155.257505] dev_remove: 40 callbacks suppressed
[297155.257514] device-mapper: ioctl: unable to remove open device docker-253:1-2099754-5bce907c5ccee2fc54b60fc1e1d89e010c99abbae8e9f8171e843e03f2f0e38a
[297155.358304] device-mapper: ioctl: unable to remove open device docker-253:1-2099754-5bce907c5ccee2fc54b60fc1e1d89e010c99abbae8e9f8171e843e03f2f0e38a
[...]

@daikaixian
Copy link

daikaixian commented Sep 18, 2016

centos 7 & docker 1.10.3
it's my 'dmesg | tail' output:

[4751446.951119] dev_remove: 37 callbacks suppressed
[4751446.951122] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751447.051436] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751447.151753] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751447.252070] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751447.352399] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751447.452718] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751447.553017] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751447.653343] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751447.753691] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751447.854038] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751452.068451] dev_remove: 41 callbacks suppressed
[4751452.068454] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751452.168791] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751452.269140] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751452.369493] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751452.469839] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751452.570148] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751452.670504] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751452.770823] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751452.871174] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751452.971530] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751457.209874] dev_remove: 41 callbacks suppressed
[4751457.209877] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751457.310220] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751457.410581] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751457.510972] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751457.611316] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751457.711662] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751457.812041] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751457.912340] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751458.012684] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751458.113035] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751462.327596] dev_remove: 41 callbacks suppressed
[4751462.327599] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751462.427957] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751462.528308] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751462.628657] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751462.729006] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751462.829369] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751462.929717] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751463.030067] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751463.130426] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd
[4751463.230786] device-mapper: ioctl: unable to remove open device docker-253:0-202014655-80c893075ee1dc5648c28775ccd3ce7525f2d4e83d26d8db8b7bf6ae52871ebd

@ghost
Copy link

ghost commented Oct 26, 2016

same error i'm getting with centos 7.0 and 3.10.0-123.el7.x86_64
[435384.463358] device-mapper: ioctl: unable to remove open device docker-253:0- 446864-a38e9a2e35c77280796dd1cf6224b22da573ef492b4f9b464653e9d84680a4b5

@roiofthesuisse
Copy link

roiofthesuisse commented Nov 28, 2016

Same error here with Centos 7.2 and 3.10.0-327.36.3.el7.x86_64

sudo service docker start
Redirecting to /bin/systemctl start docker.service
Job for docker.service failed because the control process exited with error code. See "systemctl status docker.service" and "journalctl -xe" for details.
journalctl -xe
kernel: device-mapper: ioctl: unable to remove open device docker-253:0-19468577-d6f74dd67f106d6bfa483df4ee534dd9545dc8ca
...
systemd[1]: docker.service: main process exited, code=exited, status=1/FAILURE
systemd[1]: Failed to start Docker Application Container Engine.
systemd[1]: Unit docker.service entered failed state.
systemd[1]: docker.service failed.
polkitd[896]: Unregistered Authentication Agent for unix-process:22551:34177094 (system bus name :1.290, object path /org
ESCESC
kernel: dev_remove: 41 callbacks suppressed
kernel: device-mapper: ioctl: unable to remove open device docker-253:0-19468577-fc63401af903e22d05a4518e02504527f0d7883f9d997d7d97fdfe72ba789863
...
dockerd[22566]: time="2016-11-28T10:18:09.840268573+01:00" level=fatal msg="Error starting daemon: timeout"
systemd[1]: docker.service: main process exited, code=exited, status=1/FAILURE
systemd[1]: Failed to start Docker Application Container Engine.

@ghost
Copy link

ghost commented Nov 28, 2016

Guys , issue been solved for me by updating my kernel as well as Docker Engine ... thanks...

@roiofthesuisse
Copy link

roiofthesuisse commented Nov 28, 2016

Indeed. I had to reboot my server in order to restart my daemon properly. Now it's working again.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants