We gotta think about ways to compress the graph result information itself. Like bloom filters do. Maybe split the score in 10 ranges and create one bloom filter for each. Then add each key inside the respective score range. To get the score, the app just needs to have the filters in memory (15MB total for 10 million keys) and test against those 10 filters.
Login to reply
Replies (1)
Multiple bloom filters is an interesting idea, but still you have the problem of keeping each up to date, and I would argue that you don't need all the data all the time. You just need a bit of data, at the right moment.
View quoted note →