The project \u201cScraping the Web for Evidence of Price Personalization\u201d was conducted by Maria Garcia da Fonseca Veiga and Tom\u00e1s Henrique Rijo Mendes, under the supervision of professors Qiwei Han and Fabrizio Esposito. It aimed to study the practice of price personalization \u2013 meaning, the act of using specific characteristics of the customer to advertise the most relevant products (price steering) and the most adequate prices in terms of consumer\u2019s willingness to pay (price discrimination) \u2013 on websites.
For this project, eleven websites were analyzed, namely: Nike, Adidas, New Balance, Farfetch, Worten, Decathlon, Pingo Doce, Booking, Expedia, TripAdvisor and Airbnb. Moreover, the \u201cspecific characteristics\u201d simulated were the device the consumer was on (phone or computer), the operating system they were using \u2013 meaning, the software the device, in question, ran (MacOS or Windows for computer; IOS or Android for phone) \u2013, the type of browser used \u2013 the \u201cmain\u201d website used to access to the specific websites analyzed (Safari, Google Chrome, Firefox or Microsoft Edge) \u2013, and the location of the visiting user (Portugal, Spain, the Netherlands, and the United Kingdom region). These features represent the possible data that websites can gather on users interacting with them, in order to enhance and adapt what they display in terms of products and prices, with the objective of maximizing the possibility of selling something.
Such analysis was possible using the method of web scraping: meaning, extracting the data of the website that is shown to a user whenever they emit any sort of command, like clicking on a page or searching for a product. Such data was, however, extracted before it was translated into a visual form (meaning, the form a usual user sees), directly from the server (the \u201cbrain\u201d) of the website. In fact, it is through this command that the website collects the data of the user, to accommodate its response to it. Therefore, for the purposes of this investigation, seven different \u201cuser profiles\u201d were created, with different combinations of the features described, who then \u201caccessed\u201d the selected websites to study the response given to the same command (meaning, the same search).<\/p>\n\n\n\n
In terms of price discrimination (conducted by Tom\u00e1s), it was concluded that only three websites \u2013 Expedia, TripAdvisor, and Booking \u2013 showed different prices to different \u201cuser profiles\u201d. However, although Booking was found to have the most significant number of products with different prices between users, it also showed the smallest amount of price variation within said different prices. The custom pricing algorithm of Expedia, on the other hand, was found to be more aggressive, having a higher price variation between users for a lower difference in the number of different prices shown. Furthermore, users using computers received higher prices, especially those using the combination of Windows-Google Chrome. However, users using iPhones (and, therefore, the combination of IOS-Safari) saw higher prices than users with the combination Android-Google Chrome. The product being searched was also found, in some degree, to have an impact on the price being shown to each user \u2013 with TripAdvisor and Expedia showing different prices for hotels in Rome and Istanbul, respectively. Finally, the varying location of users seemed not to have an impact on the price of products, with differences being close to none.<\/p>\n<\/div>\n\n\n\n
In terms of price steering (conducted by Maria), the first analysis showed that Expedia, TripAdvisor, Airbnb, Booking and Farfetch showed differences in the type of products shown for the same search \u2013 with Farfetch showing different products to phone users as opposed to computer users. Nike also revealed differences in products shown, but only to users from the Netherlands. The second analysis, however, concluded that, in terms of the ranking of the products shown within each website, the difference was close to zero for all users, with the features used not influencing the order the website choose to present them in any significant way.
Although these conclusions were a first step in proving such practice, much deeper research, with a larger data range collected regarding more variable features, is needed \u2013 an objective that is currently being developed in the project \u201cEmpowering Personalized Prices: Informing Consumers to Support a Fair and Sustainable Digital Transition\u201d.<\/p>\n\n\n\n