Re: robots.txt with a 301 redirect

You could also move the disallow to below the redirect, so visitors
will be redirected, but as bots continue to read the content of the
page, they will not index any content following the disallow.

On Jun 8, 8:39 am, Bernard Savonet <bernard.savo...@gmail.com> wrote:
> 2009/6/4 Ed Galligan <ed.galli...@gmail.com>
>
>
>
> > @Bernard
> > Unfortunately, it does not currently work fine. Google reads the
> > robots.txt file BEFORE attempting to follow the 301 - once it reads
> > the Disallow: / it then stops and never accesses the 301 at all,
> > meaning the second domain never gets indexed.
>
> B-)) so remove the disallow or the robots.txt
> Then the htaccess and redirect will work
>
>
>
>
>
> > On Jun 4, 12:09 pm, Bernard Savonet <bernard.savo...@gmail.com> wrote:
> > > 2009/6/2 Ed Galligan <ed.galli...@gmail.com>
>
> > > > I already have a generic regexp mod_rewrite 301 in .htaccess doing
> > > > this. Is that what you meant?
>
> > > Yes.
> > > So eveything should be fine.
>
> > > > On Jun 1, 9:41 pm, Bernard Savonet <bernard.savo...@gmail.com> wrote:
> > > > > 1- It's possible
>
> > > > > 2 - If you don't want to get mad, it would be better to have some
> > generic
> > > > > mechanism so that you 301 redirect each page to the correct page on
> > the
> > > > new
> > > > > domain.
>
> > > > > 2009/6/1 Ed Galligan <ed.galli...@gmail.com>
>
> > > > > > I'm trying to figure out how to do something that might just be
> > > > > > impossible. Before I give up, I'll see if anyone here can possibly
> > add
> > > > > > some insight.
>
> > > > > > I have two domains:
> > > > > > 1) domainone.com which I don't want indexed by search engines
> > > > > > 2) domaintwo.com which I do want indexed by search engines
>
> > > > > > Any content I have on domainone.com, I want to hide from search
> > > > > > engines, but then I have a 301 .htaccess redirect sending visitors
> > to
> > > > > > domaintwo.com for any addresses that don't match content on
> > > > > > domainone.com
>
> > > > > > So for example, say I have a file called privatephoto.jpg that's at
> > > > > >http://domainone.com/privatephoto.jpg
> > > > > > The I have another file called information.html at
> > > > > >http://domaintwo.com/information.html
>
> > > > > > I want to hidehttp://domainone.com/privatephoto.jpgfromGoogle, BUT
> > > > > > I want Google to be able to seehttp://
> > domainone.com/information.html
> > > > > > (which is a 301 redirect)
>
> > > > > > Is this completely impossible?
>
> > > > > --
> > > > > --------------
> > > > > Les peintures de Marine:http://markaonline.free.fr/accueil.htm
>
> > > --
> > > --------------
> > > Les peintures de Marine:http://markaonline.free.fr/accueil.htm
>
> --
> --------------
> Les peintures de Marine:http://markaonline.free.fr/accueil.htm

--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups "Google Search Engine Optimization SEO Google - MSN - Yahoo" group.
To post to this group, send email to SEO1@googlegroups.com
To unsubscribe from this group, send email to SEO1+unsubscribe@googlegroups.com
For more options, visit this group at http://groups.google.com/group/SEO1?hl=en
-~----------~----~----~----~------~----~------~--~---