DEPRECATION WARNING

This documentation is not using the current rendering mechanism and is probably outdated. The extension maintainer should switch to the new system. Details on how to use the rendering mechanism can be found here.

simpliRobots¶

Author:	Michael Reuber
Created:	2011-07-23T20:04:07.060000000
Changed:	2013-03-18T09:37:44.980000000
Classification:	simplirobots
Description:	Generates a robots.txt fully configarable by Typoscript. Usefull for multidomain and multilingual sites. Requires RealURL or CoolURI ---- forAdmins (use this for Administrators) forIntermediates (manuals going into more depth) see more: http://wiki.typo3.org/doc_template#tags ----
Keywords:	robots, seo, multidomain, multilingual, cooluri, realurl
Author:	Michael Reuber
Email:	michael.reuber@gmx.de
Info 4:
Language:	en

simpliRobots - simplirobots

simpliRobots¶

Extension Key: simplirobots

Language: en

Keywords: robots, seo, multidomain, multilingual, cooluri, realurl

This document is published under the Open Content License

available from http://www.opencontent.org/opl.shtml

The content of this document is related to TYPO3

- a GNU/GPL CMS/Framework available from www.typo3.org

Table of Contents¶

simpli robots.txt 1

`Introduction 3 <#__RefHeading__1259_827271995>`_

What does it do? 3

Sponsors 3

`Administration 4 <#__RefHeading__1263_827271995>`_

FAQ 4

`Configuration 5 <#__RefHeading__1267_827271995>`_

Reference 5

RealURL 5

CoolURI 6

`Known problems 7 <#__RefHeading__1275_827271995>`_

`To-Do list 8 <#__RefHeading__1277_827271995>`_

`ChangeLog 9 <#__RefHeading__1279_827271995>`_

Introduction¶

What does it do?¶

SimpliRobots generates a robots.txt fully configurable by Typoscript. Usefull for multidomain and multilingual sites.
Like weeaar_robotstxt realurl or cooluri is needed.

Sponsors¶

The development of this extension is sponsored by Simpli Cissimus Werbeatelier .

Administration¶

Make sure that either RealURL (realurl) or CoolURI (cooluri) is installed.
Just install simpliRobots and add the static template from extension.
Use dd_googlesitemap or some other extension for your google sitemap.
SimpliRobots can be configured by constants or by typoscript.
Add the configuration for realurl or cooluri.

FAQ¶

Q: I have no simpliRobots in the constants.A: Please check if you add the static template!
Q: I don't see a robots.txt.

A: Check your configuration of realurl or cooluri. Check if realurl or cooluri is activated.

Configuration¶

((generated))¶

Configuration by constants¶

Configuration by constants is easy: Just enter the value you want.

Configuration by typoscript¶

The configuration by typoscript setup is a little bit tricky because of the static template:After adding the values in typoscrit add the line:

robots.10 < plugin.tx_simplirobots_pi1

Or edit directly the section robots.10

Reference¶

plugin.tx_simplirobots_pi1: TS configuration

domain¶

Property

domain

Data type

string

Description

The domain name without http:// and without trailing slash.

If empty the value TYPO3_REQUEST_HOST is used

Default

allow¶

Property

allow

Data type

bool

Description

Adds “Allow: /” to the robots.txt if true

Default

1

sitemap¶

Property

sitemap

Data type

string

Description

list of sitemap files, comma separated or separated by a delimeter ( see delimit)Example:

?eID=dd_googlesitemap&L=0,?eID=dd_googlesitemap&L=1

Default

typeNum¶

Property

typeNum

Data type

int

Description

The typeID of the robots.txt. Used in realurl and cooluri. If you use the default value for other pages you can change it.

Default

202

delimit¶

Property

delimit

Data type

string

Description

Delimiter string to explode the sitemap string, default is ','

If you use dd_googlesitemap_dmf you have sitemaps like

?EID=dd_googlesitemap&sitemap=dmf&pidList=10&selector=news&singlePid=12&catMMList=8,9,11

there you can't use the comma as delimiter use the pipe '|' or semicolon ';' or what you want as delimiter

Default

,

[tsref:(cObject).TEST]

plugin.tx_simplirobots_pi1.disallow: TS configuration

t3lib¶

Property

t3lib

Data type

bool

Description

Adds “Disallow: /t3lib/” to the robots.txt if true

Default

1

typo3¶

Property

typo3

Data type

bool

Description

Adds “Disallow: /typo3/” to the robots.txt if true

Default

1

typo3temp¶

Property

typo3temp

Data type

bool

Description

Adds “Disallow: /typo3conf/” to the robots.txt if true

Default

1

fileadmin¶

Property

fileadmin

Data type

bool

Description

Adds “Disallow: /typo3temp/” to the robots.txt if true

Default

0

additional¶

Property

additional

Data type

string

Description

additional folders to disallow, comma separated or separated by a delimeter ( see delimit)

Default

[tsref:(cObject).TEST]

((generated))¶

Example¶

plugin.tx_simplirobots_pi1 {
  domain = www.yourdomain.tld
  allow =  1
  disallow {
    t3lib       = 1
    typo3       = 1
    typo3conf   = 1
    typo3temp   = 1
    fileadmin   = 0
    additional  = fileadmin/folder1NotInGoogle,  fileadmin/folder2NotInGoogle
  }
  sitemap       = ?eID=dd_googlesitemap&L=0,?eID=dd_googlesitemap&L=1
  typeNum = 202
  delimit = ,
}

RealURL¶

To make the robots.txt available under the URL http://domain.tld/robots.txt you have to configure your RealUrl. Add the robots.txt part.Note: If you change your typeID you have to change it here too!

'index' => array(
                'rss.xml' => array(
                    'keyValues' => array(
                        'type' => '100',
                    ),
                ),
                'robots.txt' => array(
                    'keyValues' => array(
                        'type' => '202',
                    ),
                ),
),

CoolURI¶

To make the robots.txt available under the URL http://domain.tld/robots.txt you have to configure your CoolURI. Add the robots.txt part.Note: If you change your typeID you have to change it here too!

<valuemaps>
  <valuemap>
    <parameter>L</parameter>
    <value key="">0</value>
    <value key="en">1</value>
  </valuemap>
  <valuemap>
    <parameter>type</parameter>
    <value key="robots.txt">202</value>
  </valuemap>
</valuemaps>

then go to the CoolURI module in the backend and select “New Link”. Enter the following information there:

URI: robots.txt

Parameters: type=202

Sticky: check

If you're working with a multidomain setup you have to use the ID of an existing site in the rootline of this domain or you have to make a new site.

E. g. the ID of the root page of domain1 is 166 and the ID of the root page of domain2 is 172 you have to use:

URI: robots.txt

Parameters: id=166&type=202

Sticky: check

and

URI: robots.txt

Parameters: id=172&type=202

Sticky: check

that's all.

Known problems¶

No known problems. If you find one please report it to http://forge.typo3.org/projects/extension-simplirobots

To-Do list¶

If you have any suggestions or bugs please send a report at http://forge.typo3.org/projects/extension-simplirobots

ChangeLog¶

0.1.0¶

Version

0.1.0

Changes

Initial release

0.1.1¶

Version

0.1.1

Changes

Changed typeNum to 202 to avoid conflicts with EXT:toi_category

0.2.0¶

Version

0.2.0

Changes

Changed to beta, set version to 0.2.0

1.0.0¶

Version

1.0.0

Changes

Add SponsorChanged to stable, set version to 1.0.0First official release

1.1.0¶

Version

1.1.0

Changes

Delete the suggestion during the installationadd a delimiter in TS

9