About People Publications Data & Code Funding Contact

DB4Pref: Managing Preference Data


The goal of this project is to streamline the management and analysis of preference data.

Preferences are orders among a collection of items attributed to a population of judges. Preference data comes in a variety of forms, such as ranked lists and pairwise comparisons, and is ubiquitous in a plethora of applications across different domains. Over the past decade, there has been a sharp increase in the volume of preference data, in the diversity of applications that use it, and in the richness of preference data analysis methods. Examples of applications include rank aggregation in genomic data analysis, management of votes in elections and recommendation systems in e-commerce.

In our work we look at two complementary aspects of preference management. In the first (funded by NSF Grant No. 1464327), we are enriching the relational database model with extensions that are specialized for handling preference data. More+

The second aspect of our work (funded by BSF Grant No. 2014391 and NSF Grant No. 1539856) focuses on developing novel analytics that are geared towards incomplete preferences. More+


Julia Stoyanovich (Drexel, USA)
Benny Kimelfeld (Technion, Israel)
Lovro Ilijasic (Drexel, USA)
Batya Kenig (Technion, Israel)
Haoyue Ping (Drexel, USA)


"Querying probabilistic preferences in databases", Batya Kenig, Benny Kimelfeld, Haoyue Ping and Julia Stoyanovich. PODS 2017. pdf

"A database framework for probabilistic preferences", Batya Kenig, Benny Kimelfeld, Haoyue Ping and Julia Stoyanovich. AMW 2017. forthcoming

"Workload-Driven Learning of Mallows Mixtures with Pairwise Preference Data", Julia Stoyanovich, Lovro Ilijasic, Haoyue Ping. WebDB 2016. pdf

"Analyzing Crowd Rankings", Julia Stoyanovich, Marie Jacob, Xuemei Gong. WebDB 2015. pdf

"Dichotomies in the Complexity of Preferred Repairs", Ronald Fagin, Benny Kimelfeld, Phokion G. Kolaitis. PODS 2015. pdf

"A System for Management and Analysis of Preference Data", Marie Jacob, Benny Kimelfeld, Julia Stoyanovich. PVLDB 7(12) 2014. pdf

"Understanding Local Structure in Ranked Datasets", Julia Stoyanovich, Sihem Amer-Yahia, Susan Davidson, Marie Jacob, Tova Milo. CIDR 2013. pdf

Data and Code

Learning Mallows Mixtures, complete code and data on project website.

The CrowdRank dataset on GitHub.


This work is generously supported by the US National Science Foundation (NSF) and by the US-Israel Binational Science Foundation (BSF).

NSF Grant No. 1464327 "Managing Preference Data", 5/1/2015 - 4/30/2017 (PI: Stoyanovich)

BSF Grant No. 2014391 "Aggregation Methods for Partial Preferences", 9/1/2015 - 8/31/2017 (US PI: Stoyanovich, Israel PI: Kimelfeld)

NSF Grant No. 1539856 "Aggregation Methods for Partial Preferences" (supplements BSF Grant No. 2014391), 9/1/2015 - 8/31/2017 (PI: Stoyanovich)