hydra-server: Fix and simplify robots.txt

Created by  Eelco Dolstra  on November 17, 2016
ZXTDFDQBXCFP6EIEBIQDWQH3FKBRNUBF5K2MKX37TOKVDCF2GRUAC
Change contents