Analytica Data Science SolutionsContact
ESC

to move to open

← All work

Case study

Matching hotels to buyers, in a market with almost no ratings

A hotel goes on the market. Somewhere in a book of two hundred thousand investors are the handful who would buy it, and finding them took a broker up to three months.

Client
Jones Lang LaSalle (JLL)
Sector
Commercial real estate · Hospitality
Role
Contract engagement
Period
2016, then multi-year
Result
3 months → instant to produce a buyer shortlist
of the ratings matrix was empty
99.35%of the ratings matrix was empty
potential investors in scope
200,000potential investors in scope
increase in hotel sales, client-reported
$13.2Mincrease in hotel sales, client-reported

The problem

JLL is one of the world's largest commercial real-estate services firms. When a hotel came to market, matching it to the buyers most likely to want it was manual work done by expensive people, and it could take up to three months — during which the property sat.

The asset they had was history: tens of thousands of properties, roughly two hundred thousand potential investors, and twenty-five years of transactions. The question was whether that history could rank, for any newly listed property, the hundred buyers worth calling first.

One hundred buyers worth calling, among two hundred thousandA grid of 2000 squares, each representing 100 potential investors, for200,000 in total. Exactly one square is highlighted: the shortlist of 100 buyers the system ranks for a newly listed property. Below, the same problem in time — a broker working the book took up to three months, roughly65 working days; the ranked list is produced the moment a property is listed.THE SEARCHEvery square is 100 investors. One square is the list the broker calls.1 : 2,000100 buyersranked, on listingTHE WAITUP TO THREE MONTHS — A BROKER WORKING THE BOOK BY HAND≈65 working daysON LISTING — THE RANKED LIST IS ALREADY THERE0 daysThe shortlist is ready the day the property is listed.
A hotel comes to market and somewhere in a book of 200,000investors are the hundred who would buy it. The grid is drawn at that ratio — one square in two thousand, each square aggregating 100 investors, so the proportion on screen is the proportion in the data. Underneath is the same gap in time: up to three months of manual work against a list that exists the moment the property is listed.

The sparsity problem

Recommender systems are a solved problem when your users rate things. Commercial property buyers do not. On the modeling subset — 492 properties against 10,351 users — the ratings matrix was 99.35% empty. Sixty-five percent of users had rated one item or fewer. Ninety percent had rated six or fewer.

Almost every published collaborative-filtering result assumes a matrix an order of magnitude denser than this one, so the signal had to come from behavior instead of ratings: what buyers responded to, what they bid on, what they had said they were looking for.

Four input feeds
Property records, responses to marketing campaigns, bidding history, and each investor's stated investment preferences.
Two models
A buyer model built from investment criteria — 408 features across 10,351 users — and a property model over location, type, tenure, brand, room count and asking price.
Preprocessing that mattered
Z-score normalization to remove per-user rating bias, and binarization to stop heavily skewed behavior from dominating the similarity measures.

492 properties × 10,351 users

a rating existsnothing at all

A ratings matrix that's 99.35 percent emptyA grid of 5,280 cells drawn at the real fill rate of the engagement's ratings matrix: 99.35 percent of it is empty, so only about34 cells carry a rating. The filled cells cluster into a few columns, because sixty-five percent of users rated one item or fewer and ninety percent rated six or fewer — a small number of active buyers carry almost all of the signal. This is a sample at the true density, not the matrix itself, which has more than five million cells.
99.35% of the ratings matrix is empty.Sixty-five percent of buyers had rated a single item or fewer; ninety percent had rated six or fewer. That is why the signal had to come from behavior — what they opened, what they bid on, what they had said they were looking for — rather than from ratings. The grid above is a 120 × 44 sample drawn at the true fill rate (0.64% filled), not the full 492 × 10,351 matrix, which has more than five million cells.
How many items each buyer ever ratedA hundred squares, one percent of buyers each. 65 rated one item or fewer,25 rated between two and six, and 10 rated seven or more. Collaborative filtering needs overlap between users to work, and two thirds of this population left a single data point.WHAT EVERY BUYER EVER RATEDOne square is one percent of 10,351 buyers.65%Rated one item or fewerno basis for similarity at all25%Rated two to six itemsusable, but thin10%Rated seven or moreenough history to match ontwo thirds ofthe book isinvisible to aratings modelTwo thirds of buyers have at most one rating — too little to match on.
Collaborative filtering recommends what people with overlapping history took, and that needs history: sixty-five percent of these buyers had rated a single item or none, and ninety percent had rated six or fewer. Only those two cut-points were measured, which is why this is a hundred countable squares rather than a fitted curve. The signal for the recommender came from behavior instead — what buyers opened, what they bid on, what they had already said they wanted.

The algorithm bake-off

Several algorithm families were implemented and compared. User-based collaborative filtering outperformed everything else, and cosine distance beat the alternatives for both the user-based and item-based variants.

A plain popular-items baseline outperformed item-based collaborative filtering, which ruled that variant out.

The headline-optimal nearest-neighbor value was nn = 10. We shipped nn = 20, because nn = 10 gave a worse true-positive rate across the higher false-positive range — the range this system operates in, since a broker works down a shortlist of calls.

What was delivered

A hybrid framework that builds several candidate models — collaborative filtering, content-based, vector-space and nearest-neighbor — evaluates them against each other, and serves recommendations from whichever currently performs best, instead of hard-coding the winner of one comparison.

The output is the hundred buyers most likely to want a given property, ranked, produced the moment it's listed. The process it replaced took up to three months.

Result

The recommendation list is generated instantly once a property goes to market, and the platform was adopted across JLL globally. The client reported an increase in hotel sales of over $13.2 million.

Discuss a similar problem

If one of these engagements resembles a problem you're facing, we can walk through how it was built and what it would take in your environment.

Start a conversation