<div dir="ltr"><div class="gmail_extra"><div class="gmail_quote">On Mon, Dec 7, 2015 at 2:52 PM, Samuel Cantero <span dir="ltr"><<a href="mailto:scanterog@gmail.com" target="_blank">scanterog@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><span>On Mon, Dec 7, 2015 at 1:27 PM, Bernie Innocenti <span dir="ltr"><<a href="mailto:bernie@codewiz.org" target="_blank">bernie@codewiz.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><span>On 12/07/2015 11:13 AM, Samuel Cantero wrote:<br> > I tried reproducing the problem in the Sandbox page, but editing does<br> > not work at all because the docker container with the node.js app needed<br> > by Parsoid is not running. Odd, the other containers are all up.<br> ><br> > Parsoid container is not running. I tried to start it, but Docker<br> > complains that is not enough disk space to build this container. Its<br> > partition has 1.3 GB available, so we should remove old and unused<br> > images. I have a meeting now and I'm leaving now, but I will fix it as<br> > soon as posible. Sorry.<br></span></blockquote><div><br></div></span><div>There is something strange with our docker partition inodes.</div><div><br></div><div><font face="monospace, monospace" size="1">Filesystem Inodes IUsed IFree IUse% Mounted on<br></font></div><div><font face="monospace, monospace" size="1">/dev/mapper/freedom--lvm-docker_extra_storage 0 0 0 - /var/lib/docker</font><br></div><div><br></div><div>Anyone with experience about this? I was expecting an inode exhaustion. I will try to find out what is going on here.</div></div></div></div></blockquote><div><div><br></div><div>Indeed the docker partition was full. DF is not expected to give accurate results for btrfs. So, to get the total use I had to execute: <font face="monospace, monospace">btrfs filesystem df /var/lib/docker. </font><font face="arial, helvetica, sans-serif">The true disk usage is the sum of all 'used' values.</font></div></div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><span><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><span> <br> </span>Also, I found three parsoid images:<br> <br> org.sugarlabs.wiki_parsoid latest 0cf030b154df 4 months ago 298.1 MB<br> wiki.sugarlabs.org-parsoid latest 0cf030b154df 4 months ago 298.1 MB<br> parsoid latest 0cf030b154df 4 months ago 298.1 MB<br> <br> SamP, could you please delete the unused images and update the<br> documentation to match reality?<br> <br> <a href="https://wiki.sugarlabs.org/go/Service/wiki#Visual_Editor" rel="noreferrer" target="_blank">https://wiki.sugarlabs.org/go/Service/wiki#Visual_Editor</a><br> <span><br></span></blockquote></span></div></div></div></blockquote><div><div>You can't delete images when the partition is full. Apparently, docker creates a tmp folder inside its partition when executing remove, so it wasn't possible. I had to remove it manually. Also, it is not possible to use <font face="monospace, monospace">rm</font>. You must use <font face="monospace, monospace">btrfs subvolume</font><font face="arial, helvetica, sans-serif">.</font></div><div><font face="arial, helvetica, sans-serif"><br></font></div><div><font face="arial, helvetica, sans-serif">Sometimes Docker doesn't allow you to remove containers with snapshots. So, I've written this little script to remove all the snapshots related to a container ID.</font></div><div><font face="arial, helvetica, sans-serif"><br></font></div><div><div><font face="monospace, monospace">sudo btrfs subvol list -ao /var/lib/docker | grep DOCKER_CONTAINER_ID | awk '{ print $9 }' | sort -r | while read vol; do echo "sudo btrfs subvolume delete $vol"; done | bash -x</font><br></div><div><br></div></div><div>After removing all the snapshots and the container disks, you can execute docker rm -v container. It is important to delete a container using the -v parameter. By default, docker doesn't remove the volumes associated with a container. By executing rm with -v, all the volumes associated with the container are also removed. If we don't do this, we are leaving a lot of orphan disks and snapshots.</div><div><br></div><div>I removed some containers to put back online the parsoid container, but I couldn't start it. I built and started it again but no success. There is an error in the log associated with a node.js module. Sam have you done some update? In case you didn't, I guess that the parsoid git repo (inside the dockerfile) probably has been changed.</div></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><span><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><span> <br> > Adding Sam to the thread since he's been improving the wiki lately so he<br> > probably knows how to fix this.<br> ><br> > For my own information, where is the list of images that should be<br> > autostarted when the docker daemon starts?<br> ><br> > Using the sam's script container.yml every container is configured with<br> > autostart. Anyway, it would be good to write some doc about our docker<br> > infra in our wiki.<br> <br> </span>Indeed, I'm never sure what to do when a container is down, or even<br> which containers should be running.<br> <br> It's also my fault for living under a (Google) rock for the past 4 years<br> while all the cool kids are using Docker :-)<br> <div><div><br> --<br> _ // Bernie Innocenti<br> \X/ <a href="http://codewiz.org" rel="noreferrer" target="_blank">http://codewiz.org</a><br> </div></div></blockquote></span></div><br></div></div> </blockquote></div><br></div></div>