Tackling the problems of diversity in recommender systems

Abstract

A recommender system is a computational mechanism for information filtering, where users provide recommendations (in the form of ratings or selecting items) as inputs, which the system then aggregates and directs to appropriate recipients. With the advent of web based media and publicity methods, the age where standardized methods of publicity, sales, production and marketing strategies do not. As such, in many markets the users are given a wide range of products and information to choose which product they like, to find a way out of this recommender systems are used in a way similar to the live social scenario, that is a user tries to get reviews from friends before opting for a product in a similar way recommender system tries to be a friend who recommends the options. Most of the recommender systems currently developed solely accuracy driven, i.e., reducing the Mean Absolute Error (MAE) between the predictions of the recommender system and actual ratings of the user. This leads to various problems for recommender systems such as lack of diversity and freshness. Lack of diversity arises when the recommender system is overly focused on accuracy by recommending a set of items, in which all of the items are too similar to each other, because they are predicted to be liked by the user. Lack of freshness also arises with overly focusing on accuracy but as a limitation on the set of items recommended making it overly predictable. This thesis work is directed at addressing the issues of diversity, by developing an approach, where a threshold of accuracy (in terms of Mean Absolute Error in prediction) is maintained while trying to diversify the set of item recommendations. Here for the problem of diversity a combination of Attribute-based diversification and user preference based diversification is done. This approach is then evaluated using non-classical methods along with evaluating the base recommender algorithm to prove that diversification is indeed is possible with a mixture of collaborative and content based approach.