Проблемы С Robots.txt

Тема в разделе "SEO-вопросы (оптимизация и продвижение магазина)", создана пользователем denisa1988, 4 мар 2017.

  1. TopicStarter Overlay
    Offline

    denisa1988 Пользователь

    Сообщения:
    13
    Симпатии:
    0
    Репутация:
    0
    Добрый день уважаемые!столкнулся с проблемой с гугл, индексирует ограничения в файле robots.txt
    В панели вебмастер появились дубли такого рода:
    /kompyuternye-stoly/steklyannye?limit=25
    /kompyuternye-stoly?limit=25&page=12
    /kompyuternye-stoly?page=10
    /detskaya-mebel?limit=25&page=2
    /detskaya-mebel?limit=25&page=3
    /detskaya-mebel?limit=25&page=8
    /detskaya-mebel?page=3
    Вот сам файл:
    User-agent: *
    Disallow: /*route=account/
    Disallow: /*route=affiliate/
    Disallow: /*route=checkout/
    Disallow: /*route=product/search
    Disallow: /index.php?route=product/product*&manufacturer_id=
    Disallow: /download
    Disallow: /search
    Disallow: /system
    Disallow: /login
    Disallow: /*&sort=
    Disallow: /?sort=
    Disallow: /?sort*
    Disallow: /?order=*
    Disallow: /?order*
    Disallow: /*&order=
    Disallow: /*&limit=
    Disallow: /?limit=*
    Disallow: /*?limit=
    Disallow: /?filter_name=*
    Disallow: /*&filter_name=
    Disallow: /*&filter_sub_category=
    Disallow: /?filter_sub_category=*
    Disallow: /*&filter_description=
    Disallow: /?filter_description=*
    Disallow: /*&tracking=
    Disallow: /index.php?
    Disallow: /?keyword*
    Disallow: /index.php?route=product*
    Disallow: /index.php?route=caregory*
    Disallow: /index.php?route=manufacturer*
    Disallow: /?tag=
    Disallow: /?page=*
    Disallow: /?route=common/home
    Disallow: /index.php?route=common/home

    User-agent: Yandex
    Disallow: /*route=account/
    Disallow: /*route=affiliate/
    Disallow: /*route=checkout/
    Disallow: /*route=product/search
    Disallow: /index.php?route=product/product*&manufacturer_id=
    Disallow: /download
    Disallow: /search
    Disallow: /system
    Disallow: /login
    Disallow: /*&sort=
    Disallow: /?sort=
    Disallow: /?sort*
    Disallow: /?order=*
    Disallow: /?order*
    Disallow: /*&order=
    Disallow: /*&limit=
    Disallow: /?limit=*
    Disallow: /*?limit=
    Disallow: /?filter_name=*
    Disallow: /*&filter_name=
    Disallow: /*&filter_sub_category=
    Disallow: /?filter_sub_category=*
    Disallow: /*&filter_description=
    Disallow: /?filter_description=*
    Disallow: /*&tracking=
    Disallow: /index.php?
    Disallow: /?keyword*
    Disallow: /index.php?route=product*
    Disallow: /index.php?route=caregory*
    Disallow: /index.php?route=manufacturer*
    Disallow: /?page=*
    Disallow: /?tag=
    Disallow: /?route=common/home
    Disallow: /index.php?route=common/home
    Clean-param: tracking

    User-agent: Googlebot
    Allow: *.css
    Allow: *.js
    Allow:/catalog/view/theme/lexus_superstore/stylesheet
    Disallow: /*route=account/
    Disallow: /*route=affiliate/
    Disallow: /*route=checkout/
    Disallow: /*route=product/search
    Disallow: /index.php?route=product/product*&manufacturer_id=
    Disallow: /download
    Disallow: /search
    Disallow: /system
    Disallow: /login
    Disallow: /*&sort=
    Disallow: /?sort=
    Disallow: /?sort*
    Disallow: /?order=*
    Disallow: /?order*
    Disallow: /*&order=
    Disallow: /*&limit=
    Disallow: /?limit=*
    Disallow: /*?limit=
    Disallow: /?filter_name=*
    Disallow: /*&filter_name=
    Disallow: /*&filter_sub_category=
    Disallow: /?filter_sub_category=*
    Disallow: /*&filter_description=
    Disallow: /?filter_description=*
    Disallow: /*&tracking=
    Disallow: /index.php?
    Disallow: /?keyword*
    Disallow: /index.php?route=product*
    Disallow: /index.php?route=caregory*
    Disallow: /index.php?route=manufacturer*
    Disallow: /index.php?route=common/home
    Disallow: /?page=*
    Disallow: /?tag=
    Disallow: /?route=common/home
     
  2. Offline

    Faraon Команда форума

    Сообщения:
    871
    Симпатии:
    1.927
    Репутация:
    58
    я лично использую такой и все нормально, попробуйте его.Косяков не наблюдал
    User-agent: *
    Disallow: /*route=account/
    Disallow: /*route=affiliate/
    Disallow: /*route=checkout/
    Disallow: /*route=product/search
    Disallow: /index.php?route=product/product*&manufacturer_id=
    Disallow: /admin
    Disallow: /catalog
    Disallow: /system
    Disallow: /*?sort=
    Disallow: /*&sort=
    Disallow: /*?order=
    Disallow: /*&order=
    Disallow: /*?limit=
    Disallow: /*&limit=
    Disallow: /*?filter_name=
    Disallow: /*&filter_name=
    Disallow: /*?filter_sub_category=
    Disallow: /*&filter_sub_category=
    Disallow: /*?filter_description=
    Disallow: /*&filter_description=
    Disallow: /*?tracking=
    Disallow: /*&tracking=
    Disallow: /*compare-products
    Disallow: /*search
    Disallow: /*cart
    Disallow: /*checkout
    Disallow: /*login
    Disallow: /*logout
    Disallow: /*vouchers
    Disallow: /*wishlist
    Disallow: /*my-account
    Disallow: /*order-history
    Disallow: /*newsletter
    Disallow: /*?mfp=
    Disallow: /*&mfp=
    Disallow: /*return-add
    Disallow: /*forgot-password
    Disallow: /*downloads
    Disallow: /*returns
    Disallow: /*transactions
    Disallow: /*create-account
    Disallow: /*recurring
    Disallow: /*address-book
    Disallow: /*reward-points
    Disallow: /*affiliate-forgot-password
    Disallow: /*create-affiliate-account
    Disallow: /*affiliate-login
    Disallow: /*affiliates
    Allow: /catalog/view/javascript/
    Allow: /catalog/view/theme/*/


    User-agent: Yandex
    Disallow: /*route=account/
    Disallow: /*route=affiliate/
    Disallow: /*route=checkout/
    Disallow: /*route=product/search
    Disallow: /index.php?route=product/product*&manufacturer_id=
    Disallow: /admin
    Disallow: /catalog
    Disallow: /system
    Disallow: /*?sort=
    Disallow: /*&sort=
    Disallow: /*?order=
    Disallow: /*?mfp=
    Disallow: /*&mfp=
    Disallow: /*&order=
    Disallow: /*?limit=
    Disallow: /*&limit=
    Disallow: /*?filter_name=
    Disallow: /*&filter_name=
    Disallow: /*?filter_sub_category=
    Disallow: /*&filter_sub_category=
    Disallow: /*?filter_description=
    Disallow: /*&filter_description=
    Disallow: /*compare-products
    Disallow: /*search
    Disallow: /*cart
    Disallow: /*checkout
    Disallow: /*login
    Disallow: /*logout
    Disallow: /*vouchers
    Disallow: /*wishlist
    Disallow: /*my-account
    Disallow: /*order-history
    Disallow: /*newsletter
    Disallow: /*return-add
    Disallow: /*forgot-password
    Disallow: /*downloads
    Disallow: /*returns
    Disallow: /*transactions
    Disallow: /*create-account
    Disallow: /*recurring
    Disallow: /*address-book
    Disallow: /*reward-points
    Disallow: /*affiliate-forgot-password
    Disallow: /*create-affiliate-account
    Disallow: /*affiliate-login
    Disallow: /*affiliates
    Allow: /catalog/view/javascript/
    Allow: /catalog/view/theme/*/
    Clean-param: tracking
    Host: http://ваш сайт.com.ua

    Sitemap: http://ваш сайт/sitemap.xml
     
    Pavlik и admin нравится это.