Alpine Linux has announced their new 3.6 release which includes s390x support. Alpine is a minimal Linux distro. Contrary to other distributions, it uses musl as runtime library (not glibc), helping in downsizing images.
A Docker image named s390x/alpine is available at Docker Hub and while being a fully functional base, it is just 5 MB (!) in size: