How to block User-Agent in robots.txt?

[munkerjs]

Hello,

We want to block some bots as User-Agent in the robots.txt file. How do we do this?

User-Agent: W3C-checklink
Disallow: /

User-Agent: W3C_Validator
Disallow: /

User-Agent: W3C_CSS_Validator
Disallow: /

These are a few examples. When we write these examples from the management panel, the result is as follows;

How can we block this type of User-Agent data?

[Michael-Herzog]

Currently this ain't possible by out of the box settings. We would have to add onther setting for this purpose. Until we have done this you could edit ths RobotsTextFile Action in the CommonController.
Regards,
Michael

[muratcakir]

I added the setting in a quick and dirty way. ExtraRobotsLines is a string setting and will be appended to the output as is, without prefixes.

The setting is currently hidden and must be added/edited via Configuration / Settings / All settings.

[Michael-Herzog]

Replace button Show items for 'Allow' below the textarea with a button group.