User-agent: * Allow: / Disallow: /*?q=* Disallow: /on/demandware.store/* Disallow: /default/ Disallow: /Search-ShowAjax Disallow: /login/ Disallow: /dashboard/ Disallow: /?q=search* Disallow: /Search-Show Disallow: Baiduspider Disallow: +Baiduspider Disallow: Sosospider+ Disallow: ezooms Disallow: sogou spider Disallow: 008 Disallow: Wotbox/2.01 Disallow: dwbot Disallow: asterias Disallow: BackDoorBot/1.0 Disallow: Black Hole Disallow: BlowFish/1.0 Disallow: BotALot Disallow: BuiltBotTough Disallow: Bullseye/1.0 Disallow: BunnySlippers Disallow: Cegbfeieh Disallow: CheeseBot Disallow: CherryPicker Disallow: CopyRightCheck Disallow: cosmos Disallow: Crescent Disallow: Crescent Internet ToolPak HTTP OLE Control v.1.0 Disallow: DittoSpyder Disallow: EroCrawler Disallow: ExtractorPro Disallow: Foobot Disallow: Harvest/1.5 Disallow: hloader Disallow: httplib Disallow: humanlinks Disallow: ia_archiver Disallow: InfoNaviRobot Disallow: JennyBot Disallow: Kenjin Spider Disallow: Keyword Density/0.9 Disallow: LexiBot Disallow: libWeb/clsHTTP Disallow: MIIxpc Disallow: Mister PiX Disallow: moget Disallow: NetAnts Disallow: NICErsPRO Disallow: Offline Explorer Disallow: Openfind Disallow: Openfind data gathere Disallow: ProPowerBot/2.14 Disallow: ProWebWalker Disallow: QueryN Metasearch Disallow: RepoMonkey Disallow: RepoMonkey Bait & Tackle/v1.01 Disallow: RMA Disallow: SiteSnagger Disallow: SpankBot Disallow: suzuran Disallow: Szukacz/1.4 Disallow: Teleport Disallow: TeleportPro Disallow: Telesoft Disallow: The Intraformant Disallow: TheNomad Disallow: TightTwatBot Disallow: Titan Disallow: toCrawl/UrlDispatcher Disallow: True_Robot Disallow: True_Robot/1.0 Disallow: turingos Disallow: URLy Warning Disallow: VCI Disallow: VCI WebViewer VCI WebViewer Win32 Disallow: WebStripper Disallow: WebZip Disallow: WebZip/4.0 Disallow: Wget Disallow: Wget/1.5.3 Disallow: Wget/1.6 Disallow: WWW-Collector-E Disallow: Xenu's Disallow: Xenu's Link Sleuth 1.1c Disallow: Zeus Disallow: Zeus 32297 Webster Pro V2.9 Win32 # SEO-related bots User-agent: mj12bot Disallow:/ User-agent: dotbot Disallow:/ User-agent: mauibot Disallow:/ User-agent: AhrefsBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: SemrushBot Disallow: / sitemap: https://www.andindia.com/sitemap_index.xml sitemap: https://www.andindia.com/sitemap_0.xml