The recovery button works just as unreliably even on my device. Apparently it's a bug.
After the box got into the boot loop while testing new image, I wasn't able to call up the recovery menu and I had to solve everything using telnet.
Thank you for the tip regarding the possibility of calling up the recovery menu using the remote control at startup!
