Country of origin

TL;DR

If you expect a product with a German title and EUR as its currency, you must specify country='DE' in all requests that crawl, otherwise you might get an English title with GBP or USD for the same URL where you would expect German data.

When it matters

Many shops are international. Some sell the same products in multiple countries, while others have different product subsets for each country. They all geolocate their users based on the source IP addresses these have.

When a user visits a shop's page (initial URL), the shop's server looks up the user's IP address and either redirects them to a country-specific final URL, or serves a content in the user's language, using their specific currency.

Why it matters

The UB Crawler can visit shops' pages using multiple IP addresses, from various countries. It follows all redirects and grabs (crawls) the final content as it is presented, then returns the results to its caller.

When you ask for crawls and actions which require crawling, it is important to specify the country to be crawled from to get the expected results, such as English product attributes for country=GB crawls, and German product titles for country=DE adds to basket.

What about affiliate links?

Affiliates usually redirect the visitors to a generic URL, and then the shop geolocates the user and serves the content, so actions which require crawling affiliate links must also include the country parameter, to make sure our crawler returns the content in the expected languages and currencies.