Niriv Trending Entertainment Lifestyle National Sports Technology World Finance

NirivBot

Our official web crawler that powers Nepal's premier search engine, discovering and indexing Nepali websites to make local content easily discoverable.

User-Agent String:

NirivBot/1.0 (+https://www.niriv.com/bot)

What is NirivBot?

NirivBot is the official web crawler developed by Niriv, Nepal's homegrown internet company. It powers our search engine currently available at niriv.com/search (and in the future at search.niriv.com).

Its role is to discover and index Nepali websites and their pages, helping users easily find reliable, locally relevant information that matters most to the Nepali community.

Built specifically for Nepal's digital ecosystem, NirivBot understands the unique needs of Nepali websites and content.

Crawling Process

Discovers websites
Follows internal links
Collects page information
Builds searchable index

How NirivBot Works

Our crawler follows industry standards while being optimized for Nepal's web ecosystem.

Crawling Process

Visits websites starting from homepage and follows internal links systematically

Respect Standards

Follows robots.txt directives just like Googlebot or Bingbot

Polite Crawling

Crawls gradually with delays to prevent server overload

Secure Indexing

Stores information securely and makes it searchable via our API

Data We Collect

Page Information

  • URL of each page
  • Page title and meta description

Visual Assets

  • Favicon and preview images
  • Social media images (og:image)

Link Structure

  • Outgoing links with anchor text
  • Linked images and their context

Why We Crawl

NirivBot is fundamental to building a Nepali-first search experience that serves our local community.

Local Visibility

Make local Nepali content more visible and easier to discover for users seeking relevant information.

Nepali-First Search

Provide a reliable search alternative optimized for Nepali language, culture, and user preferences.

Support Websites

Help website owners by driving more traffic and visibility to their platforms through our search results.

Control for Website Owners

Website owners have full control over NirivBot's access through standard robots.txt configurations.

User-Agent String

NirivBot identifies itself with this user-agent string:

User-Agent: NirivBot/1.0 (+https://www.niriv.com/bot)

robots.txt Support

Configure your robots.txt file exactly as you would for any other search engine crawler like Googlebot or Bingbot.

To Block All Crawling

User-agent: NirivBot
Disallow: /

To Allow Crawling

User-agent: NirivBot
Allow: /

Advanced Control

You can also specify which directories to allow or disallow, set crawl delays, and more using standard robots.txt syntax.

Transparency & Early Stage

Our Commitment

Niriv Search is currently in an early stage. We are actively improving our technology and ensuring responsible crawling practices.

We fully recognize that website systems may be sensitive to automated requests. If you notice any issue caused by NirivBot, please contact us, and we will adjust our crawl settings promptly.

Responsible Crawling

Built with respect for website owners and server resources

Contact

Have questions about NirivBot or need to report any crawling-related issues? We're here to help.

Email Support

For inquiries regarding NirivBot or to report any crawling-related issues

support@niriv.com

Visit Our Website

Learn more about Niriv and our mission to build Nepal's digital future

www.niriv.com