Re: Robots.txt vs JS

Robots.txt abd javascript are two very different issues:
1 - robots.txt are used by robots, more precisely by "spiders" for finding which url/pages should be visited (eg, thru a sitemap) or not (eg: thru a disallow), although this is to be seen not as a final forbide but as a recommendation ("please be polite enough not to visit")
2 - the URLs found by the spider are then visited by the "indexers" which READ the content (they do not RUN it) and index it

Therefore if any javascript in "included" in an html page, it is loaded, since this is part of the reading (but it is not run, since robots are javascript-disabled).

They are read as a part of an html file, but not read as stand-alone (javascript) files, which might be "disallowed" by robots.txt. As far as the indexers are concerned, they are just reading "html" source code, not any other programming language...

2009/5/13 Impy <wynnemail@gmail.com>

Well, I think the key to understanding why I am correlating them is
because I thought that is how they worked. :-).  I take it I have more
reading to do - to understand what a robot does. I thought the robot
was the gatherer of the analytics. Apparently not.

On May 1, 6:46 am, Bernard Savonet <bernard.savo...@gmail.com> wrote:

> Not sure to understand why you correlate your robots.txt file with
> javascript and Google Analytics... these are diffrent unrelated issues
>

> 2009/5/1 Bernard Savonet <bernard.savo...@gmail.com>

>
>
>
>
>
> > You are just asking robots not to index your site.
> > A rather unusal move, except if you are in a developement stage; as soon as
> > you switch to pre-launch, you should remove this disallow...
>

> > 2009/4/29 Impy <wynnem...@gmail.com>

>
> >> Hi, I thought I posted this yesterday but don't see it. If it's a
> >> repeat - I apologize.
>
> >> I was hoping to find out what kind of impact setting robots.txt to:
>
> >> User-agent: *
> >> Disallow: /
>
> >> has on google analytics/ranking if the header of the file contains the
> >> urchin.js javascript?  i.e.
>
> >> <script src="http://www.google-analytics.com/urchin.js" type="text/
> >> javascript">
> >> </script>
> >> <script type="text/javascript">
> >> try {
> >>        _uacct = "UA-XXXXXX-X";
> >>        urchinTracker();
>
> >> Thanks,
> >> Wynne
> >> p.s. I put the X in the UA number for posting this online.
>
> > --

> > --------------
> > Ventes privées des peintures de Marine et d'autres artistes:
> >http://www.labaleine.org/actualites.htm -
> >http://markaonline.free.fr/accueil.htm
>
> --
> --------------

> Ventes privées des peintures de Marine et d'autres artistes:http://www.labaleine.org/actualites.htm -http://markaonline.free.fr/accueil.htm- Hide quoted text -
>
> - Show quoted text -

--
--------------
Ventes privées des peintures de Marine et d'autres artistes:
http://www.labaleine.org/actualites.htm  - http://markaonline.free.fr/accueil.htm



--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups "Google Search Engine Optimization SEO Google - MSN - Yahoo" group.
To post to this group, send email to SEO1@googlegroups.com
To unsubscribe from this group, send email to SEO1+unsubscribe@googlegroups.com
For more options, visit this group at http://groups.google.com/group/SEO1?hl=en
-~----------~----~----~----~------~----~------~--~---