Multi-modal Recommendation Algorithms


Classic collaborative filtering uses a single kind of behavior recorded as a relation between users and a single class of objects. The classic examples include people buying books, people watching movies or people listening to music.

In the real world, however, real people interact in many ways with many kinds of things. People even interact (abstractly) with intangible, abstract entities such as musical styles or different food cuisines. They say things. They go places. These many kinds of behavior give strong clues about what other things these people might like to do and recommendation engines should use these multi-modal cues to make better recommendations.

I will describe how the basic mathematical structure of recommendation engines can be extended to take account of these many kinds of recommendations using a "pivot-set" representation. This leads to an extremely straightforward outline for how to design a multi-modal recommendation algorithm.

Mathematics and algorithms are not enough, however. Real-world implementation is required.

Happily, multi-model recommendation algorithms can be implemented in a remarkably simple fashion. I will provide a complete outline of how this can be done using standard tools like Pig, Mahout and SolR. I will also provide concrete examples of how this works in the real world.

About the speaker: 
Ted Dunning is the Chief Application Architect at MapR Technologies. Ted has held Chief Scientist positions at Veoh Networks, ID Analytics and at MusicMatch, (now Yahoo Music). Ted is responsible for building the most advanced identity theft detection system on the planet, as well as one of the largest peer-assisted video distribution systems and ground-breaking music and video recommendations systems. Ted has 15 issued and 15 pending patents and contributes to several Apache open source projects including Hadoop, Zookeeper and Hbase™. He is also a committer and/or PMC member for Apache Mahout, Apache Zookeeper and Apache Drill. Ted earned a BS degree in electrical engineering from the University of Colorado; a MS degree in computer science from New Mexico State University; and a Ph.D. in computing science from Sheffield University in the United Kingdom. Ted also bought the drinks at the very first Hadoop User Group meeting.

Schedule info

Time slot: 
4 June 11:30 - 12:15