snipt

Ctrl+h for KB shortcuts

Text only

Magento first steps - settings for dev server

Robots.txt

User-agent: *
Disallow: /magento/
or
User-agent: *
Disallow: /
or
User-agent: Googlebot
Disallow: /magento/

Source info: http://helloit.webege.com/2010/07/como-instalar-magento/
https://snipt.net/embed/12ea9f0843653ddd83492459412d912c/
/raw/12ea9f0843653ddd83492459412d912c/
12ea9f0843653ddd83492459412d912c
text
Text only
12
2019-07-18T15:11:16
True
False
False
/api/public/snipt/28481/
magento-first-steps
<table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><a href="#L-1"> 1</a> <a href="#L-2"> 2</a> <a href="#L-3"> 3</a> <a href="#L-4"> 4</a> <a href="#L-5"> 5</a> <a href="#L-6"> 6</a> <a href="#L-7"> 7</a> <a href="#L-8"> 8</a> <a href="#L-9"> 9</a> <a href="#L-10">10</a> <a href="#L-11">11</a> <a href="#L-12">12</a></pre></div></td><td class="code"><div class="highlight"><pre><span></span><span id="L-1"><a name="L-1"></a>Robots.txt </span><span id="L-2"><a name="L-2"></a> </span><span id="L-3"><a name="L-3"></a>User-agent: * </span><span id="L-4"><a name="L-4"></a>Disallow: /magento/ </span><span id="L-5"><a name="L-5"></a>or </span><span id="L-6"><a name="L-6"></a>User-agent: * </span><span id="L-7"><a name="L-7"></a>Disallow: / </span><span id="L-8"><a name="L-8"></a>or </span><span id="L-9"><a name="L-9"></a>User-agent: Googlebot </span><span id="L-10"><a name="L-10"></a>Disallow: /magento/ </span><span id="L-11"><a name="L-11"></a> </span><span id="L-12"><a name="L-12"></a>Source info: http://helloit.webege.com/2010/07/como-instalar-magento/ </span></pre></div> </td></tr></table>
magento, robots