* Generate a robots.txt.

Dependencies

• [2] AKAZKCR6 * At top-level and for each project, provide two channels: "latest"
• [*] J5UVLXOK * Start of a basic Catalyst web interface.
• [*] FPK5LF53 * Put the project-related actions in a separate controller. Put the

Change contents

• edit in src/lib/Hydra/Controller/Root.pm at line 243
  [2.823]

  [5.9650]
  + }

  +

  +

  + sub robots_txt : Path('robots.txt') {

  + my ($self, $c) = @_;

  +

  + # Put actions that are expensive or not useful for indexing in

  + # robots.txt. Note: wildcards are not universally supported in

  + # robots.txt, but apparently Google supports them.

  + my @rules =

  + ( "User-agent: *"

  + , "Disallow: /*/nix/closure/*"

  + , "Disallow: /*/channel/*/MANIFEST.bz2"

  + , "Disallow: /*/nar/*"

  + , "Disallow: /*.nixpkg"

  + , "Disallow: /build/*/buildtime-deps"

  + , "Disallow: /build/*/runtime-deps"

  + , "Disallow: /build/*/nixlog/*/tail"

  + );

  +

  + $c->stash->{'plain'} = { data => join("\n", @rules) };

  + $c->forward('Hydra::View::Plain');