Docker For Mac Ext File System
Osxfs is a new shared file system solution, exclusive to Docker Desktop for Mac. Osxfs provides a close-to-native user experience for bind mounting macOS file system trees into Docker containers. To this end, osxfs features a number of unique capabilities as well as differences from a classical Linux file system.
I'm trying to sift through a hefty amount of logs with a Splunk container but Splunk is refusing to index them because storage in its container quickly falls below the minimum 5GB Splunk requires to work. I realised the reason for this is that my Splunk container has only 10GB of storage capacity allotted to it. I want to increase this number. Now I've seen how it's done with the devicemapper storage driver. Something on the lines of dockerd --storage-opt dm.basesize=20G But this option is specific to that driver. Is there an equivalent of this option in overlay2? Any help appreciated!
Thanks for the help, man. The command you referenced ( --storage-opt) only allows you to resize the partition if the backing filesystem is XFS, which means I won't be able to resize containers in my laptop directly, as it uses ext4. I got around this by using a CentOS Vagrant VM which uses XFS by default and it worked, which is good enough for me. It'd be really interesting to learn what the resize threshold is for overlay2 storage driver, since you mentioned it will grow the partition if I happen to write more than its current capacity would allow. The problem with it not allowing me to pre-emptively resize is that Splunk has a minimum for the amount of free storage you must have in order for it to work. This minimum can be decreased though, so perhaps I could adjust it around overlay2 resize threshold. Most containers have a default 10GB rootfs size when the container is built, so you'll have to use the --storage-opt to resize that.
I've encountered containers that have a >10GB rootfs by default, so it can also be set on build if you're building those containers. Overlay2 won't resize the rootfs of the container automatically, it just uses the underlying fs of the host so you don't have to configure the storage driver specifically in that case like you do with the devicemapper driver. One option is to just build a xfs partition on your laptop and move storage to that so overlay2 will handle resizing. Generally for these cases I'd use an external volume to decouple the container size from the data size so you can adjust as needed. Keep the rootfs small and make the splunk data dir as large as needed and swappable.
Overview The best way to include the required startup options without editing the systemd unit file in place is to use a systemd drop-in file. Resolution After completing these steps, you will have enabled the remote API for dockerd, without editing the systemd unit file in place: • Create a file at /etc/systemd/system/docker.service.d/startup_options.conf with the below contents: # /etc/systemd/system/docker.service.d/override.conf [Service] ExecStart= ExecStart=/usr/bin/dockerd -H fd:// -H tcp://0.0.0.0:2376 Note: The -H flag binds dockerd to a listening socket, either a Unix socket or a TCP port. You can specify multiple -H flags to bind to multiple sockets/ports. The default -H fd:// uses systemd's socket activation feature to refer to /lib/systemd/system/docker.socket.
• Reload the unit files: $ sudo systemctl daemon-reload • Restart the docker daemon with new startup options: $ sudo systemctl restart docker.service • Ensure that anyone that has access to the TCP listening socket is a trusted user since access to the docker daemon is root-equivalent. Additional Documentation •. Add email account to outlook mac.