This file is indexed.

/usr/lib/python2.7/dist-packages/klaus/static/robots.txt is in python-klaus 1.2.1-3.

This file is owned by root:root, with mode 0o644.

The actual contents of the file can be viewed below.

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
User-agent: *
Allow: /*/blob/master/
Allow: /*/tree/master/
Allow: /*/raw/master/
Disallow: /*/tree/
Disallow: /*/blob/
Disallow: /*/raw/
Disallow: /*/blame/
Disallow: /*/commit/
Disallow: /*/tarball/