ML0120EN-4.2-Review-CollaborativeFilteringwithRBM.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a href=\"https://www.bigdatauniversity.com\"><img src=\"https://ibm.box.com/shared/static/qo20b88v1hbjztubt06609ovs85q8fau.png\" width=\"400px\" align=\"center\"></a>\n",
    "\n",
    "<h1 align=\"center\"><font size=\"5\">RECOMMENDATION SYSTEM WITH A RESTRICTED BOLTZMANN MACHINE</font></h1>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Welcome to the <b>Recommendation System with a Restricted Boltzmann Machine</b> notebook. In this notebook, we study and go over the usage of a Restricted Boltzmann Machine (RBM) in a Collaborative Filtering based recommendation system. This system is an algorithm that recommends items by trying to find users that are similar to each other based on their item ratings. By the end of this notebook, you should have a deeper understanding of how Restricted Boltzmann Machines are applied, and how to build one using TensorFlow."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<h2>Table of Contents</h2>\n",
    "\n",
    "<ol>\n",
    "    <li><a href=\"#ref1\">Acquiring the Data</a></li>\n",
    "    <li><a href=\"#ref2\">Loading in the Data</a></li>\n",
    "    <li><a href=\"#ref3\">The Restricted Boltzmann Machine model</a></li>\n",
    "    <li><a href=\"#ref4\">Setting the Model's Parameters</a></li>\n",
    "    <li><a href=\"#ref5\">Recommendation</a></li>\n",
    "</ol>\n",
    "<br>\n",
    "<br>\n",
    "<hr>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a id=\"ref1\"></a>\n",
    "<h2>Acquiring the Data</h2>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "To start, we need to download the data we are going to use for our system. The datasets we are going to use were acquired by <a href=\"http://grouplens.org/datasets/movielens/\">GroupLens</a> and contain movies, users and movie ratings by these users.\n",
    "\n",
    "After downloading the data, we will extract the datasets to a directory that is easily accessible."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "--2018-11-05 09:39:36--  http://files.grouplens.org/datasets/movielens/ml-1m.zip\n",
      "Resolving files.grouplens.org (files.grouplens.org)... 128.101.34.235\n",
      "Connecting to files.grouplens.org (files.grouplens.org)|128.101.34.235|:80... connected.\n",
      "HTTP request sent, awaiting response... 200 OK\n",
      "Length: 5917549 (5.6M) [application/zip]\n",
      "Saving to: ‘./data/moviedataset.zip’\n",
      "\n",
      "./data/moviedataset 100%[=====================>]   5.64M  25.9MB/s   in 0.2s   \n",
      "\n",
      "2018-11-05 09:39:36 (25.9 MB/s) - ‘./data/moviedataset.zip’ saved [5917549/5917549]\n",
      "\n",
      "Archive:  ./data/moviedataset.zip\n",
      "   creating: ./data/ml-1m/\n",
      "  inflating: ./data/ml-1m/movies.dat  \n",
      "  inflating: ./data/ml-1m/ratings.dat  \n",
      "  inflating: ./data/ml-1m/README     \n",
      "  inflating: ./data/ml-1m/users.dat  \n"
     ]
    }
   ],
   "source": [
    "!wget -O ./data/moviedataset.zip http://files.grouplens.org/datasets/movielens/ml-1m.zip\n",
    "!unzip -o ./data/moviedataset.zip -d ./data"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "With the datasets in place, let's now import the necessary libraries. We will be using <a href=\"https://www.tensorflow.org/\">Tensorflow</a> and <a href=\"http://www.numpy.org/\">Numpy</a> together to model and initialize our Restricted Boltzmann Machine and <a href=\"http://pandas.pydata.org/pandas-docs/stable/\">Pandas</a> to manipulate our datasets. To import these libraries, run the code cell below."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "#Tensorflow library. Used to implement machine learning models\n",
    "import tensorflow as tf\n",
    "#Numpy contains helpful functions for efficient mathematical calculations\n",
    "import numpy as np\n",
    "#Dataframe manipulation library\n",
    "import pandas as pd\n",
    "#Graph plotting library\n",
    "import matplotlib.pyplot as plt\n",
    "%matplotlib inline"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<hr>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a id=\"ref2\"></a>\n",
    "<h2>Loading in the Data</h2>\n",
    "\n",
    "Let's begin by loading in our data with Pandas. The .dat files containing our data are similar to CSV files, but instead of using the ',' (comma) character to separate entries, it uses '::' (two colons) characters instead. To let Pandas know that it should separate data points at every '::', we have to specify the <code>sep='::'</code> parameter when calling the function.\n",
    "\n",
    "Additionally, we also pass it the <code>header=None</code> parameter due to the fact that our files don't contain any headers.\n",
    "\n",
    "Let's start with the movies.dat file and take a look at its structure:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>Toy Story (1995)</td>\n",
       "      <td>Animation|Children's|Comedy</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2</td>\n",
       "      <td>Jumanji (1995)</td>\n",
       "      <td>Adventure|Children's|Fantasy</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>3</td>\n",
       "      <td>Grumpier Old Men (1995)</td>\n",
       "      <td>Comedy|Romance</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>4</td>\n",
       "      <td>Waiting to Exhale (1995)</td>\n",
       "      <td>Comedy|Drama</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>5</td>\n",
       "      <td>Father of the Bride Part II (1995)</td>\n",
       "      <td>Comedy</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   0                                   1                             2\n",
       "0  1                    Toy Story (1995)   Animation|Children's|Comedy\n",
       "1  2                      Jumanji (1995)  Adventure|Children's|Fantasy\n",
       "2  3             Grumpier Old Men (1995)                Comedy|Romance\n",
       "3  4            Waiting to Exhale (1995)                  Comedy|Drama\n",
       "4  5  Father of the Bride Part II (1995)                        Comedy"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#Loading in the movies dataset\n",
    "movies_df = pd.read_csv('./data/ml-1m/movies.dat', sep='::', header=None, engine='python')\n",
    "movies_df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can do the same for the ratings.dat file:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>3</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>1193</td>\n",
       "      <td>5</td>\n",
       "      <td>978300760</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>661</td>\n",
       "      <td>3</td>\n",
       "      <td>978302109</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1</td>\n",
       "      <td>914</td>\n",
       "      <td>3</td>\n",
       "      <td>978301968</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>3408</td>\n",
       "      <td>4</td>\n",
       "      <td>978300275</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1</td>\n",
       "      <td>2355</td>\n",
       "      <td>5</td>\n",
       "      <td>978824291</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   0     1  2          3\n",
       "0  1  1193  5  978300760\n",
       "1  1   661  3  978302109\n",
       "2  1   914  3  978301968\n",
       "3  1  3408  4  978300275\n",
       "4  1  2355  5  978824291"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#Loading in the ratings dataset\n",
    "ratings_df = pd.read_csv('./data/ml-1m/ratings.dat', sep='::', header=None, engine='python')\n",
    "ratings_df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "So our <b>movies_df</b> variable contains a dataframe that stores a movie's unique ID number, title and genres, while our <b>ratings_df</b> variable stores a unique User ID number, a movie's ID that the user has watched, the user's rating to said movie and when the user rated that movie.\n",
    "\n",
    "Let's now rename the columns in these dataframes so we can better convey their data more intuitively:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "collapsed": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>MovieID</th>\n",
       "      <th>Title</th>\n",
       "      <th>Genres</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>Toy Story (1995)</td>\n",
       "      <td>Animation|Children's|Comedy</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2</td>\n",
       "      <td>Jumanji (1995)</td>\n",
       "      <td>Adventure|Children's|Fantasy</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>3</td>\n",
       "      <td>Grumpier Old Men (1995)</td>\n",
       "      <td>Comedy|Romance</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>4</td>\n",
       "      <td>Waiting to Exhale (1995)</td>\n",
       "      <td>Comedy|Drama</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>5</td>\n",
       "      <td>Father of the Bride Part II (1995)</td>\n",
       "      <td>Comedy</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   MovieID                               Title                        Genres\n",
       "0        1                    Toy Story (1995)   Animation|Children's|Comedy\n",
       "1        2                      Jumanji (1995)  Adventure|Children's|Fantasy\n",
       "2        3             Grumpier Old Men (1995)                Comedy|Romance\n",
       "3        4            Waiting to Exhale (1995)                  Comedy|Drama\n",
       "4        5  Father of the Bride Part II (1995)                        Comedy"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "movies_df.columns = ['MovieID', 'Title', 'Genres']\n",
    "movies_df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "And our final ratings_df:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>UserID</th>\n",
       "      <th>MovieID</th>\n",
       "      <th>Rating</th>\n",
       "      <th>Timestamp</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>1193</td>\n",
       "      <td>5</td>\n",
       "      <td>978300760</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>661</td>\n",
       "      <td>3</td>\n",
       "      <td>978302109</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1</td>\n",
       "      <td>914</td>\n",
       "      <td>3</td>\n",
       "      <td>978301968</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>3408</td>\n",
       "      <td>4</td>\n",
       "      <td>978300275</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1</td>\n",
       "      <td>2355</td>\n",
       "      <td>5</td>\n",
       "      <td>978824291</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   UserID  MovieID  Rating  Timestamp\n",
       "0       1     1193       5  978300760\n",
       "1       1      661       3  978302109\n",
       "2       1      914       3  978301968\n",
       "3       1     3408       4  978300275\n",
       "4       1     2355       5  978824291"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ratings_df.columns = ['UserID', 'MovieID', 'Rating', 'Timestamp']\n",
    "ratings_df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<hr>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a id=\"ref3\"></a>\n",
    "<h2>The Restricted Boltzmann Machine model</h2>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<img src=\"https://ibm.box.com/shared/static/o049tx0dsllpbj3b546vuba25qqlzelq.png\"  width=\"300\">\n",
    "<br>\n",
    "The Restricted Boltzmann Machine model has two layers of neurons, one of which is what we call a visible input layer and the other is called a hidden layer. The hidden layer is used to learn features from the information fed through the input layer. For our model, the input is going to contain X neurons, where X is the amount of movies in our dataset. Each of these neurons will possess a normalized rating value varying from 0 to 1, where 0 meaning that a user has not watched that movie and the closer the value is to 1, the more the user likes the movie that neuron's representing. These normalized values, of course, will be extracted and normalized from the ratings dataset.\n",
    "\n",
    "After passing in the input, we train the RBM on it and have the hidden layer learn its features. These features are what we use to reconstruct the input, which in our case, will predict the ratings for movies that user hasn't watched, which is exactly what we can use to recommend movies!\n",
    "\n",
    "We will now begin to format our dataset to follow the model's expected input."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<h3>Formatting the Data</h3>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "First let's see how many movies we have and see if the movie ID's correspond with that value:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "3883"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(movies_df)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now, we can start formatting the data into input for the RBM. We're going to store the normalized users ratings into as a matrix of user-rating called trX, and normalize the values."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th>MovieID</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>3</th>\n",
       "      <th>4</th>\n",
       "      <th>5</th>\n",
       "      <th>6</th>\n",
       "      <th>7</th>\n",
       "      <th>8</th>\n",
       "      <th>9</th>\n",
       "      <th>10</th>\n",
       "      <th>...</th>\n",
       "      <th>3943</th>\n",
       "      <th>3944</th>\n",
       "      <th>3945</th>\n",
       "      <th>3946</th>\n",
       "      <th>3947</th>\n",
       "      <th>3948</th>\n",
       "      <th>3949</th>\n",
       "      <th>3950</th>\n",
       "      <th>3951</th>\n",
       "      <th>3952</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>UserID</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>5.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 3706 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "MovieID  1     2     3     4     5     6     7     8     9     10    ...   \\\n",
       "UserID                                                               ...    \n",
       "1         5.0   NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN  ...    \n",
       "2         NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN  ...    \n",
       "3         NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN  ...    \n",
       "4         NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN  ...    \n",
       "5         NaN   NaN   NaN   NaN   NaN   2.0   NaN   NaN   NaN   NaN  ...    \n",
       "\n",
       "MovieID  3943  3944  3945  3946  3947  3948  3949  3950  3951  3952  \n",
       "UserID                                                               \n",
       "1         NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN  \n",
       "2         NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN  \n",
       "3         NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN  \n",
       "4         NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN  \n",
       "5         NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN   NaN  \n",
       "\n",
       "[5 rows x 3706 columns]"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "user_rating_df = ratings_df.pivot(index='UserID', columns='MovieID', values='Rating')\n",
    "user_rating_df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Lets normalize it now:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[1., 0., 0., ..., 0., 0., 0.],\n",
       "       [0., 0., 0., ..., 0., 0., 0.],\n",
       "       [0., 0., 0., ..., 0., 0., 0.],\n",
       "       [0., 0., 0., ..., 0., 0., 0.],\n",
       "       [0., 0., 0., ..., 0., 0., 0.]])"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "norm_user_rating_df = user_rating_df.fillna(0) / 5.0\n",
    "trX = norm_user_rating_df.values\n",
    "trX[0:5]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<hr>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a id=\"ref4\"></a>\n",
    "<h2>Setting the Model's Parameters</h2>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Next, let's start building our RBM with TensorFlow. We'll begin by first determining the number of neurons in the hidden layers and then creating placeholder variables for storing our visible layer biases, hidden layer biases and weights that connects the hidden layer with the visible layer. We will be arbitrarily setting the number of neurons in the hidden layers to 20. You can freely set this value to any number you want since each neuron in the hidden layer will end up learning a feature."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "hiddenUnits = 20\n",
    "visibleUnits =  len(user_rating_df.columns)\n",
    "vb = tf.placeholder(\"float\", [visibleUnits]) #Number of unique movies\n",
    "hb = tf.placeholder(\"float\", [hiddenUnits]) #Number of features we're going to learn\n",
    "W = tf.placeholder(\"float\", [visibleUnits, hiddenUnits])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We then move on to creating the visible and hidden layer units and setting their activation functions. In this case, we will be using the <code>tf.sigmoid</code> and <code>tf.relu</code> functions as nonlinear activations since it is commonly used in RBM's."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "#Phase 1: Input Processing\n",
    "v0 = tf.placeholder(\"float\", [None, visibleUnits])\n",
    "_h0 = tf.nn.sigmoid(tf.matmul(v0, W) + hb)\n",
    "h0 = tf.nn.relu(tf.sign(_h0 - tf.random_uniform(tf.shape(_h0))))\n",
    "#Phase 2: Reconstruction\n",
    "_v1 = tf.nn.sigmoid(tf.matmul(h0, tf.transpose(W)) + vb) \n",
    "v1 = tf.nn.relu(tf.sign(_v1 - tf.random_uniform(tf.shape(_v1))))\n",
    "h1 = tf.nn.sigmoid(tf.matmul(v1, W) + hb)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we set the RBM training parameters and functions."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "#Learning rate\n",
    "alpha = 1.0\n",
    "#Create the gradients\n",
    "w_pos_grad = tf.matmul(tf.transpose(v0), h0)\n",
    "w_neg_grad = tf.matmul(tf.transpose(v1), h1)\n",
    "#Calculate the Contrastive Divergence to maximize\n",
    "CD = (w_pos_grad - w_neg_grad) / tf.to_float(tf.shape(v0)[0])\n",
    "#Create methods to update the weights and biases\n",
    "update_w = W + alpha * CD\n",
    "update_vb = vb + alpha * tf.reduce_mean(v0 - v1, 0)\n",
    "update_hb = hb + alpha * tf.reduce_mean(h0 - h1, 0)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "And set the error function, which in this case will be the Mean Absolute Error Function."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "err = v0 - v1\n",
    "err_sum = tf.reduce_mean(err * err)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We also have to initialize our variables. Thankfully, NumPy has a handy ,code>zeros</code> function for this. We use it like so:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "#Current weight\n",
    "cur_w = np.zeros([visibleUnits, hiddenUnits], np.float32)\n",
    "#Current visible unit biases\n",
    "cur_vb = np.zeros([visibleUnits], np.float32)\n",
    "#Current hidden unit biases\n",
    "cur_hb = np.zeros([hiddenUnits], np.float32)\n",
    "#Previous weight\n",
    "prv_w = np.zeros([visibleUnits, hiddenUnits], np.float32)\n",
    "#Previous visible unit biases\n",
    "prv_vb = np.zeros([visibleUnits], np.float32)\n",
    "#Previous hidden unit biases\n",
    "prv_hb = np.zeros([hiddenUnits], np.float32)\n",
    "sess = tf.Session()\n",
    "sess.run(tf.global_variables_initializer())"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we train the RBM with 15 epochs with each epoch using 10 batches with size 100. After training, we print out a graph with the error by epoch."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0.05931451\n",
      "0.050760183\n",
      "0.048705507\n",
      "0.047629353\n",
      "0.046910707\n",
      "0.046327673\n",
      "0.04613088\n",
      "0.045730416\n",
      "0.045624927\n",
      "0.04541268\n",
      "0.045419753\n",
      "0.045232177\n",
      "0.045204848\n",
      "0.04514571\n",
      "0.045025617\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAZIAAAEKCAYAAAA4t9PUAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvhp/UCwAAIABJREFUeJzt3XuYXXV99/33Z+85ZZKZHCdkmMmRhDgRJIQUESWPFm3xqSVWUEJLb1rpnQcrVWttpbeXXpX26l16W1ErBaOgqCBgojUWFL1BQSHSTMIxCcFJCMnkAJPzOXP6Pn/sNWEz7DkkM3v2HD6vi33ttX7rt9f+Lq6ZfGat3zooIjAzMztdqUIXYGZmQ5uDxMzM+sRBYmZmfeIgMTOzPnGQmJlZnzhIzMysT/IaJJIuk7RRUoOkG3MsL5V0X7L8SUkzspa9RdIqSeskPSepLGm/IJlvkPQVScrnNpiZWffyFiSS0sCtwHuBecDVkuZ16nYdsC8iZgO3ADcnny0CvgtcHxFvBt4JtCSfuQ1YCsxJXpflaxvMzKxn+dwjuRBoiIjNEdEM3Ass7tRnMXBXMr0cuDTZw/g94NmIeAYgIvZERJukaqAyIlZF5krKbwPvz+M2mJlZD4ryuO4aYFvWfCPw1q76RESrpAPAROBsICQ9BFQB90bEvyb9Gzuts6anQiZNmhQzZsw4zc0wMxuZ1qxZszsiqnrql88gyTV20fl+LF31KQLeAfwOcBR4WNIa4GAv1plZsbSUzCEwpk2bRn19fS/LNjMzAEkv96ZfPg9tNQJTs+ZrgR1d9UnGRcYCe5P2RyNid0QcBR4EFiTttT2sE4CIWBYRCyNiYVVVj4FqZmanKZ9BshqYI2mmpBJgCbCyU5+VwLXJ9JXAI8nYx0PAWySVJwHz/wDrI2IncEjSRclYyv8AfpTHbTAzsx7k7dBWMuZxA5lQSAN3RsQ6STcB9RGxErgD+I6kBjJ7IkuSz+6T9EUyYRTAgxHxQLLqjwDfAkYBP0leZmZWIBoJt5FfuHBheIzEzOzUSFoTEQt76ucr283MrE8cJGZm1icOEjMz6xMHSTe+vWoLP34m59nFZmaWcJB04/76bdxfv63njmZmI5iDpBt1UyrZsDPXxfRmZtbBQdKNuupKdh9u5tVDxwtdipnZoOUg6ca8MysB2LDzUIErMTMbvBwk3aib0hEkPrxlZtYVB0k3xpYXUzNulIPEzKwbDpIe1FVXOEjMzLrhIOlBXXUlm5qOcLylrdClmJkNSg6SHtRVV9LWHjS8erjQpZiZDUoOkh7UVWcG3Nf78JaZWU4Okh5Mn1BOeUna4yRmZl1wkPQglRJzp3jA3cysKw6SXqirrmTDzkOMhIeAmZmdKgdJL9RVV3LgWAs7D/hWKWZmnTlIemFedQUA63f48JaZWWd5DRJJl0naKKlB0o05lpdKui9Z/qSkGUn7DEnHJD2dvG7P+szVkp6T9Kykn0qalM9tAJjrW6WYmXUpb0EiKQ3cCrwXmAdcLWlep27XAfsiYjZwC3Bz1rJNETE/eV2frLMI+DLwroh4C/AscEO+tqHDmNIipk8sZ8MuB4mZWWf53CO5EGiIiM0R0QzcCyzu1GcxcFcyvRy4VJK6WaeS1+ikXyUwII8wzDybxHcBNjPrLJ9BUgNkP16wMWnL2SciWoEDwMRk2UxJT0l6VNIlSZ8W4CPAc2QCZB5wR64vl7RUUr2k+qampj5vTF11JVv2HOFoc2uf12VmNpzkM0hy7Vl0Pn+2qz47gWkRcT7wSeAeSZWSiskEyfnAmWQObf19ri+PiGURsTAiFlZVVZ3uNpxUV11BBLywy3slZmbZ8hkkjcDUrPla3ngY6mSfZPxjLLA3Ik5ExB6AiFgDbALOBuYnbZsic1HH/cDFedyGkzpuleIBdzOz18tnkKwG5kiaKakEWAKs7NRnJXBtMn0l8EhEhKSqZLAeSbOAOcBmYDswT1LHLsZ7gA153IaTasePoqKsyEFiZtZJUb5WHBGtkm4AHgLSwJ0RsU7STUB9RKwkM77xHUkNwF4yYQOwCLhJUivQBlwfEXsBJH0eeExSC/Ay8Gf52oZskjzgbmaWQ96CBCAiHgQe7NT2uazp48AHc3xuBbCii3XeDtyea1m+1VVXsHxNI+3tQSrV3cllZmYjh69sPwV11ZUcaW5j276jhS7FzGzQcJCcAg+4m5m9kYPkFMydUkFKsN7jJGZmJzlITkFZcZqZk0Z7j8TMLIuD5BRlnk3iIDEz6+AgOUV11ZU07jvGweMthS7FzGxQcJCconnJgPsLHicxMwMcJKfMZ26Zmb2eg+QUnVFZyvjyYgeJmVnCQXKKJHnA3cwsi4PkNNRVV7LxlUO0tXe+K76Z2cjjIDkNddWVHG9p56XdRwpdiplZwTlITkNddQXgAXczM3CQnJbZk8dQlJKDxMwMB8lpKS1KM3vyGAeJmRkOktM2r9oPuTIzAwfJaaurrmTXwePsO9Jc6FLMzArKQXKafIW7mVmGg+Q0dZy5td5BYmYjXF6DRNJlkjZKapB0Y47lpZLuS5Y/KWlG0j5D0jFJTyev27M+UyJpmaQXJb0g6Yp8bkNXJo4pZXJFqcdJzGzEK8rXiiWlgVuB9wCNwGpJKyNifVa364B9ETFb0hLgZuCqZNmmiJifY9WfAV6NiLMlpYAJ+dqGnvhWKWZm+d0juRBoiIjNEdEM3Ass7tRnMXBXMr0cuFSSeljvh4H/DRAR7RGxux9rPiV11ZU0vHqYlrb2QpVgZlZw+QySGmBb1nxj0pazT0S0AgeAicmymZKekvSopEsAJI1Llv2jpLWSvi/pjFxfLmmppHpJ9U1NTf20Sa9XV11Bc1s7m5oO52X9ZmZDQT6DJNeeRee7HHbVZycwLSLOBz4J3COpksyhuFrg8YhYAKwCvpDryyNiWUQsjIiFVVVVp7sN3ZrnM7fMzPIaJI3A1Kz5WmBHV30kFQFjgb0RcSIi9gBExBpgE3A2sAc4Cvww+fz3gQX52oCezJw0mpKiFOt3OEjMbOTKZ5CsBuZImimpBFgCrOzUZyVwbTJ9JfBIRISkqmSwHkmzgDnA5ogI4MfAO5PPXAqsp0CK0inmnlHhM7fMbETL21lbEdEq6QbgISAN3BkR6yTdBNRHxErgDuA7khqAvWTCBmARcJOkVqANuD4i9ibLPp185ktAE/Dn+dqG3qirruDhDa8SEfR8noCZ2fCTtyABiIgHgQc7tX0ua/o48MEcn1sBrOhinS+TCZpBoa66kvvrG2k6dILJlWWFLsfMbMD5yvY+6rhViq9wN7ORykHSR3VTOs7c8jiJmY1MDpI+GlteTM24UT4F2MxGLAdJP6irrnCQmNmI5SDpB3XVlWzefYTjLW2FLsXMbMA5SPpBXXUlbe3Bb1/xrVLMbORxkPQDP+TKzEYyB0k/mD6hnPKStE8BNrMRyUHSD1IpMXeKB9zNbGRykPSTjodcZW4HZmY2cjhI+klddSUHj7ey48DxQpdiZjagHCT9ZF51BQAbfEt5MxthHCT9ZO4Un7llZiOTg6SfjCktYvrEcjbscpCY2cjiIOlHdVMqffNGMxtxHCT9qK66ki17jnC0ubXQpZiZDRgHST+qq64gAl7Y5b0SMxs5HCT9yLdKMbORKK9BIukySRslNUi6McfyUkn3JcuflDQjaZ8h6Zikp5PX7Tk+u1LS8/ms/1TVjh9FRVmRg8TMRpS8PbNdUhq4FXgP0AislrQyItZndbsO2BcRsyUtAW4GrkqWbYqI+V2s+wPAoLvVriQPuJvZiJPPPZILgYaI2BwRzcC9wOJOfRYDdyXTy4FLJam7lUoaA3wS+Kd+rrdf1FVX8MLOg7S3+1YpZjYy5DNIaoBtWfONSVvOPhHRChwAJibLZkp6StKjki7J+sw/Av8GHM1L1X1UV13JkeY2tu0blOWZmfW7fAZJrj2Lzn+md9VnJzAtIs4ns/dxj6RKSfOB2RHxwx6/XFoqqV5SfVNT06nWfto84G5mI00+g6QRmJo1Xwvs6KqPpCJgLLA3Ik5ExB6AiFgDbALOBt4GXCBpC/Br4GxJv8z15RGxLCIWRsTCqqqqftuonsydUkFKsN7jJGY2QuQzSFYDcyTNlFQCLAFWduqzErg2mb4SeCQiQlJVMliPpFnAHGBzRNwWEWdGxAzgHcCLEfHOPG7DKSsrTjOraoz3SMxsxMjbWVsR0SrpBuAhIA3cGRHrJN0E1EfESuAO4DuSGoC9ZMIGYBFwk6RWoA24PiL25qvW/lZXXclTW/cVugwzswGRtyABiIgHgQc7tX0ua/o48MEcn1sBrOhh3VuAc/ql0H5WV13Bj5/ZwcHjLVSWFRe6HDOzvPKV7XnQMeD+gsdJzGwEcJDkwTyfuWVmI4iDJA8mV5QyYXQJ6/20RDMbARwkeSCJuuoKP+TKzEYEB0me1E2pZOOuQ7S2tRe6FDOzvHKQ5ElddSUnWtvZsudIoUsxM8srB0medJy55SvczWy4c5DkyezJYyhOy2dumdmw5yDJk5KiFGf5VilmNgI4SPJoXnWlg8TMhr0eg0RSWtL/GYhihpu66kpeOXiCvUeaC12KmVne9BgkEdFG5tbt3T650N7IzyYxs5GgtzdtfAr4kaTvAyfPZ42IH+SlqmGirroCyATJ22dPKnA1Zmb50dsgmQDsAX43qy0AB0k3Jo4pZXJFKeu9R2Jmw1ivgiQi/jzfhQxXddWVbPC1JGY2jPXqrC1JtZJ+KOlVSa9IWiGpNt/FDQd11ZU0vHqI5lbfKsXMhqfenv77TTKPxT0TqAF+nLRZD+qqK2hpCzY1HS50KWZmedHbIKmKiG9GRGvy+hZQlce6hg0/m8TMhrveBsluSdck15SkJV1DZvDdejBz0mhKilIOEjMbtnobJB8GPgTsAnYCVyZt3ZJ0maSNkhok3Zhjeamk+5LlT0qakbTPkHRM0tPJ6/akvVzSA5JekLRO0r/0sv6CKUqnmHtGhQfczWzY6vGsLUlp4IqIuPxUVpx87lbgPUAjsFrSyohYn9XtOmBfRMyWtAS4GbgqWbYpIubnWPUXIuIXkkqAhyW9NyJ+ciq1DbS66goe3vAqEYGv6zSz4aa3V7YvPo11Xwg0RMTmiGgG7s2xnsXAXcn0cuDS7q6gj4ijEfGLZLoZWAsM+rPH6qor2XOkmaZDJwpdiplZv+vtoa3HJX1V0iWSFnS8evhMDbAta74xacvZJyJagQPAxGTZTElPSXpU0iWdVy5pHPCHwMO5vlzSUkn1kuqbmpp63MB8eu3ZJB4nMbPhp7dXtl+cvN+U1Ra8/kr3znLtWUQv++wEpkXEHkkXAP8p6c0RcRBAUhHwPeArEbE515dHxDJgGcDChQs7f++AqpvScebWId45d3IhSzEz63e9GSNJAbdFxP2nuO5GYGrWfC2wo4s+jUk4jAX2RkQAJwAiYo2kTcDZQH3yuWXAbyPiS6dYU0GMLS+mZtwon7llZsNSb8ZI2oEbTmPdq4E5kmYmA+NLyFzUmG0lcG0yfSXwSESEpKpksB5Js4A5wOZk/p/IBM4nTqOmgqmrrnCQmNmw1Nsxkp9L+pSkqZImdLy6+0Ay5nED8BCwAbg/ItZJuklSxxlgdwATJTUAnwQ6ThFeBDwr6Rkyg/DXR8Te5LYsnwHmAWuTU4P/4lQ2uFDqqivZvPsIx1vaCl2KmVm/6u0YScc1Ix/NagtgVncfiogHgQc7tX0ua/o48MEcn1sBrMjR3kjucZVBr666krb24LevHObc2rGFLsfMrN/09u6/M/NdyHCX/ZArB4mZDSfdHtqS9HdZ0x/stOyf81XUcDR9QjnlJWmfAmxmw05PYyRLsqb/vtOyy/q5lmEtlRJzp3jA3cyGn56CRF1M55q3HsyrrmTDzoNkzm42MxseegqS6GI617z1oK66koPHW9lx4HihSzEz6zc9DbafJ+kgmb2PUck0yXxZXisbhk4OuO84SM24UQWuxsysf3S7RxIR6YiojIiKiChKpjvmiweqyOHiTVMqkPyQKzMbXnp7QaL1g9GlRUyfUO4zt8xsWHGQDLC6ZMDdzGy4cJAMsLrqSl7ee5QjJ1oLXYqZWb9wkAywuupKIuCFXX70rpkNDw6SAfbmMzNnbj3w7M4CV2Jm1j8cJAPszHGjuOaiadz5+Ev8bN2uQpdjZtZnDpIC+Oz75nFuzVj+5vvPsHXP0UKXY2bWJw6SAigtSvMff7IAAX95zxo/o8TMhjQHSYFMnVDOFz80n+e3H+Sm/1pf6HLMzE6bg6SA3j3vDD7yzrO458mt/GBtY6HLMTM7LQ6SAvub95zNW2dO4DM/fJ6NPiXYzIYgB0mBFaVT/Psfn8+YsiI+cvcaDvtCRTMbYvIaJJIuk7RRUoOkG3MsL5V0X7L8SUkzkvYZko5Jejp53Z71mQskPZd85iuShvxzUSZXlPGVJeezZfcRblzxrJ9XYmZDSt6CRFIauBV4LzAPuFrSvE7drgP2RcRs4Bbg5qxlmyJifvK6Pqv9NmApMCd5DYsnNb7trIl86vfn8l/P7uQ7v3m50OWYmfVaPvdILgQaImJzRDQD9wKLO/VZDNyVTC8HLu1uD0NSNVAZEasi82f7t4H393/phXH9orO49E2T+cf/Ws/T2/YXuhwzs17JZ5DUANuy5huTtpx9IqIVOABMTJbNlPSUpEclXZLVP/v0plzrBEDSUkn1kuqbmpr6tiUDJJUS//ah8zijsoyP3r2WfUeaC12SmVmP8hkkufYsOh/876rPTmBaRJwPfBK4R1JlL9eZaYxYFhELI2JhVVXVKZRdWOPKS/iPP1lA06ET/PX9T9Pe7vESMxvc8hkkjcDUrPlaYEdXfSQVAWOBvRFxIiL2AETEGmATcHbSv7aHdQ55b6kdx2f/cB6/3NjEf/yyodDlmJl1K59BshqYI2mmpBJgCbCyU5+VwLXJ9JXAIxERkqqSwXokzSIzqL45InYChyRdlIyl/A/gR3nchoK55q3TWDz/TL748xd5omF3ocsxM+tS3oIkGfO4AXgI2ADcHxHrJN0k6fKk2x3AREkNZA5hdZwivAh4VtIzZAbhr4+IvcmyjwDfABrI7Kn8JF/bUEiS+Oc/OpdZVWP42L1P8crB44UuycwsJ42EaxYWLlwY9fX1hS7jtDS8eojLv/o4bz6zknv+50UUp30NqZkNDElrImJhT/38r9IgN3tyBf/7A+eyess+vvDQxkKXY2b2Bg6SIWDx/BquuWgaX3tsMw/5YVhmNsg4SIaIz75vHm+pHcun/DAsMxtkHCRDRGlRmlv/eAEpiY/c7Ydhmdng4SAZQjIPwzqPdTsO8vkf+2FYZjY4OEiGmEvrzuAv33kW3/vvraxY44dhmVnhOUiGoE92PAzrP5/jhV0HC12OmY1wDpIhqONhWBVlxfzld9f6YVhmVlAOkiFqckUZ/371+WzZc4RP+2FYZlZADpIh7KJZE/nb338TDzy7k2+v8sOwzKwwHCRD3P+3aBbvrpvMPz2wnqe27it0OWY2AjlIhrhUSvzbB+effBiWB9/NbKA5SIaBseXF3H7NBTS3tXP5vz/Obb/cRJsfiGVmA8RBMkycUzOWhz6xiN9902Ru/ukLXPW1VWzZfaTQZZnZCOAgGUYmjinltmsWcMtV57HxlUO898u/4ju/edlndJlZXjlIhhlJ/NH5tfzsrxexcMZ4Pvufz3PtN1ez64AfjGVm+eEgGaaqx47i2x++kH98/zmsfmkvv3fLo/znU9u9d2Jm/c5BMoxJ4k8vms5PPn4JsyeP4RP3Pc1H71nL3iPNhS7NzIaRvAaJpMskbZTUIOnGHMtLJd2XLH9S0oxOy6dJOizpU1ltfy1pnaTnJX1PUlk+t2E4mDFpNN+//mL+7rK5/Hz9K/zeLY/xf9e/UuiyzGyYyFuQSEoDtwLvBeYBV0ua16nbdcC+iJgN3ALc3Gn5LcBPstZZA3wMWBgR5wBpYEl+tmB4SafEX75zNitveAeTxpTwF9+u5++WP8Oh4y2FLs3Mhrh87pFcCDRExOaIaAbuBRZ36rMYuCuZXg5cKkkAkt4PbAbWdfpMETBKUhFQDuzIU/3DUl11JStveAcffddZLF/TyGVf+hWrNu0pdFlmNoTlM0hqgG1Z841JW84+EdEKHAAmShoNfBr4fHbniNgOfAHYCuwEDkTEz/JS/TBWUpTib3//TXz/+ospKUpx9dd/w00/Xu+nLprZaclnkChHW+dThrrq83nglog4/LrO0ngyezEzgTOB0ZKuyfnl0lJJ9ZLqm5qaTrn4keCC6eN54GPv4Nq3TefOx1/iD77yK57Ztr/QZZnZEJPPIGkEpmbN1/LGw1An+ySHqsYCe4G3Av8qaQvwCeB/SboBeDfwUkQ0RUQL8APg4lxfHhHLImJhRCysqqrqv60aZspLivj84nP47nVv5WhzGx+47Qm++PMXaWlrL3RpZjZE5DNIVgNzJM2UVEJmUHxlpz4rgWuT6SuBRyLjkoiYEREzgC8B/xwRXyVzSOsiSeXJWMqlwIY8bsOI8Y45k/jpJxaxeP6ZfOXh3/JH//E4L75yqNBlmdkQkLcgScY8bgAeIvOP/f0RsU7STZIuT7rdQWZMpAH4JPCGU4Q7rfNJMoPya4HnkvqX5WkTRpyxo4r54ofmc/s1F7Bz/3He9++/5uuPbfYNIM2sWxoJVzovXLgw6uvrC13GkLL78An+1w+e42frX+G8qeP46DvP4t11Z5BK5RrWMrPhSNKaiFjYUz9f2W45TRpTytf+9AK++KHz2HP4BEu/s4Z33/Io3/vvrT67y8xex3sk1qPWtnYefH4Xyx7bxPPbDzJpTCl/dvF0rrloOuPKSwpdnpnlSW/3SBwk1msRwapNe/jaY5t59MUmykvSXPU7U7nuHTOpHV9e6PLMrJ85SLI4SPrfC7sOsuyxzax8egcB/MG51SxdNItzasYWujQz6ycOkiwOkvzZeeAY33x8C/c8uZXDJ1p5++yJLF10FovmTCK5242ZDVEOkiwOkvw7eLyF7z25lTsff4lXDp7gTVMqWLpoFn943pkUp31Oh9lQ5CDJ4iAZOM2t7fzo6e18/VebefGVw1SPLePDb5/JkgunUlFWXOjyzOwUOEiyOEgGXkTwy41NfO2xTfxm814qyor447dO48Nvn8kZlX6EjNlQ4CDJ4iAprGcb9/O1xzbzk+d2kk6JxfNrWLpoFmefUVHo0sysGw6SLA6SwWHrnqPc8evN3Fe/jeMt7bx99kSuWFDLZedMobykqNDlmVknDpIsDpLBZd+RZu5+8mXur29k696jjC5J895zq7liQS1vnTnBt2ExGyQcJFkcJINTRLB6yz5WrGnkged2cvhEK7XjR/GB82v4wIJaZkwaXegSzUY0B0kWB8ngd6y5jZ+t38XyNY38umE3EbBw+niuuKCWP3hLNZU+48tswDlIsjhIhpZdB47zw6e2s2JtIw2vHqa0KMXvvXkKVyyo4ZI5VaR96MtsQDhIsjhIhqaI4NnGA6xY28jKZ3aw/2gLkytK+aPza7jiglqf9WWWZw6SLA6Soe9Eaxu/eOFVlq/Zzi83vkpre3BuzViuWFDD5fNrmDDadyE2628OkiwOkuFl9+ETrHx6ByvWNrJux0GK0+JdcydzxQW1vGvuZEqKfEsWs/7gIMniIBm+Xth1kB+s3c4Pn9pO06ETjCsvpm5KJbXjR1E7vjx5H0XthHKmVJZ5fMXsFDhIsjhIhr/WtnZ+1bCbB57dyUu7j9C47yivHDzxuj5FKVE9rozaceUng2bqhNcC5wwHjdnr9DZI8no5saTLgC8DaeAbEfEvnZaXAt8GLgD2AFdFxJas5dOA9cA/RMQXkrZxwDeAc4AAPhwRq/K5HTb4FaVTvGvuZN41d/LJthOtbezYf5zGfUdp3Hcs6/0Yj/22KWfQnDlu1Gt7MeNfC5wZE8uZ7HuEmeWUtyCRlAZuBd4DNAKrJa2MiPVZ3a4D9kXEbElLgJuBq7KW3wL8pNOqvwz8NCKulFQC+NF8llNpUZqZk0Yzs4sLG4+3tLHzQO6gefTFNwbNtAnlXHzWRN521kTeNmuig8Uskc89kguBhojYDCDpXmAxmT2MDouBf0imlwNflaSICEnvBzYDRzo6S6oEFgF/BhARzUBzHrfBhrGy4p6DZsf+TLC8+MohfrN5Lw88t5N7V28DYFbV6EywzJrERbMmMHFM6UCWbzZo5DNIaoBtWfONwFu76hMRrZIOABMlHQM+TWZv5lNZ/WcBTcA3JZ0HrAE+HhFH6ETSUmApwLRp0/plg2xkKStOM6tqDLOqxrDo7Cr+4pJZtLUH63ccZNXm3TyxaQ8/XLud7/5mKwBzz6jI7K2cNZGLZk5kbLmvxreRIZ9BkmvUsvPIfld9Pg/cEhGHOz2utQhYAPxVRDwp6cvAjcBn37CSiGXAMsgMtp96+WZvlE6Jc2vHcm7tWJYuOouWtnae236AVZv2sGrTHu5dvZVvPbEFCeZVV548FPY7Myb4wV42bOUzSBqBqVnztcCOLvo0SioCxgJ7yey5XCnpX4FxQLuk42QOfzVGxJPJ55eTCRKzgihOp1gwbTwLpo3no++azYnWNp7ZdoAnNu1m1aY93PXEy3z9Vy+RTolzasYmh8ImsnDGeN8634aNfP4krwbmSJoJbAeWAH/cqc9K4FpgFXAl8Ehkzke+pKODpH8ADkfEV5P5bZLmRsRG4FJeP+ZiVlClRWkunDmBC2dO4BPvzoyzrH15H09s2sOqzXv4+mObue2XmyhOi/Nqx3FOzVjGlRczdlTxyfeOV2XyXlqULvRmmXUrb0GSjHncADxE5vTfOyNinaSbgPqIWAncAXxHUgOZPZElvVj1XwF3J2dsbQb+PD9bYNZ3ZcVpLp49iYtnTwLgyIlW6l/exxObdvObTXtYvqaRwydau13HqOL0GwKmc+iMHVXM2Ky2KZVljC71Ho8NDF+QaFZgrW3tHDzeyoFjLRw41sL+o80cONbCwWT+tfbXpjuWHWlu63K9k8aUMG1CeeY1cTTTJpQzfWI50yeUU1VRSqfxR7M3GBQXJJpZz4rSKSaMLjl5F/osAAAJFUlEQVStG0+2tLW/LmwOHGvhwNEWdhw4xtY9R9m69yirt+xj5TM7aM/6m7GsOPVayEwYzfSJHYGTuQjTh9PsVDhIzIaw4nSKSWNKmdTDNSzNre1s33+Ml/ccYdveo7y85ygv7z3Ktr1HebxhD8daXtuzkaC6soypHXswE0czdUImYErSKSIgCCKgPYIAMgc2IlnGa8uSvnRuJ/OYgACKUymqx5Vx5thRjCpxgA1FDhKzEaCkKNXlxZcRwe7DzWzde4StSch07M38YmMTTYcaB6zOiaNLOHPcKGrGjcq8jx9FzbgyasaVUzN+FOPLi31IbhBykJiNcJKoqiilqqKUC6ZPeMPyo82tbNt7jO37j9LaFkhCQCoFQiT/vdYuoaQts+y1+VRKSd/MQimzt7TzwDG27zvG9v3H2b7/GA1Nh3n0xabX7SlB5sSDM8eVnbwn2pljM2HTET5TxpZRnPZjBAaag8TMulVeUsTcKRXMnTKwT6SMCPYdbTl5m5od+4+xff9r7xt2HmT34dffISklOKOyjJpxoxg/uoSilChKpzLvKVGUFkWpFOmUKE6LdCqVvIvidKa9o286naI49fplxWlRWpSmrDhNWXGKUSVpyorSmfekrSSdGnF7TQ4SMxuUJJ08CeGcmrE5+xxvaXstXJKwaUymt+09Slt70NoetLa309qWTLe109oemWVtmWXt/XjyakqZPaey5JUJmdTr25JXWXGKspLM9LhRxYwfXcL48sw2jysvZsLoEkYVpwd9MDlIzGzIKitOc1bVGM6qGtOn9bRnB05WwLS2ZQKnpa09eQ9OtLZxvKWd4y1tHG9p41jy6mg71vxa+8m2pO/hE600HTrBidb2TL/WTP8Tre1d1lZalGJ8eUkSMsUn3yeUlzAuCZ2Ty5J+o0sGNnwcJGY24qVSoiQlSijM+Epbe3DgWAt7jzSz/2gze480s+9oM/uOtrAvmd57pIV9R5vZsPMg+440s/9YC11dBliSTp3co1nxkYvzfnGqg8TMrMDSKZ3ytURt7cHBYy1J4LwWNJngeS2ARhXn/5RqB4mZ2RCUTilzSOs0LmTtbz5PzszM+sRBYmZmfeIgMTOzPnGQmJlZnzhIzMysTxwkZmbWJw4SMzPrEweJmZn1yYh41K6kJuDl0/z4JGB3P5aTT0OpVhha9Q6lWmFo1TuUaoWhVW9fa50eEVU9dRoRQdIXkup788ziwWAo1QpDq96hVCsMrXqHUq0wtOodqFp9aMvMzPrEQWJmZn3iIOnZskIXcAqGUq0wtOodSrXC0Kp3KNUKQ6veAanVYyRmZtYn3iMxM7M+cZB0QdJlkjZKapB0Y6Hr6Y6kqZJ+IWmDpHWSPl7omnoiKS3pKUn/VehaeiJpnKTlkl5I/h+/rdA1dUXSXyc/A89L+p6kskLXlE3SnZJelfR8VtsEST+X9NvkfXwha8zWRb3/J/lZeFbSDyWNK2SNHXLVmrXsU5JC0qR8fLeDJAdJaeBW4L3APOBqSfMKW1W3WoG/iYg64CLgo4O8XoCPAxsKXUQvfRn4aUS8CTiPQVq3pBrgY8DCiDgHSANLClvVG3wLuKxT243AwxExB3g4mR8svsUb6/05cE5EvAV4Efj7gS6qC9/ijbUiaSrwHmBrvr7YQZLbhUBDRGyOiGbgXmBxgWvqUkTsjIi1yfQhMv/Q1RS2qq5JqgX+APhGoWvpiaRKYBFwB0BENEfE/sJW1a0iYJSkIqAc2FHgel4nIh4D9nZqXgzclUzfBbx/QIvqRq56I+JnEdGazP4GqB3wwnLo4v8twC3A3wF5GxB3kORWA2zLmm9kEP/DnE3SDOB84MnCVtKtL5H5wW4vdCG9MAtoAr6ZHIr7hqTRhS4ql4jYDnyBzF+eO4EDEfGzwlbVK2dExE7I/FEETC5wPafiw8BPCl1EVyRdDmyPiGfy+T0OktyUo23Qn94maQywAvhERBwsdD25SHof8GpErCl0Lb1UBCwAbouI84EjDK5DLyclYwuLgZnAmcBoSdcUtqrhS9JnyBxWvrvQteQiqRz4DPC5fH+XgyS3RmBq1nwtg+wQQWeSismEyN0R8YNC19ONtwOXS9pC5pDh70r6bmFL6lYj0BgRHXt4y8kEy2D0buCliGiKiBbgB8DFBa6pN16RVA2QvL9a4Hp6JOla4H3An8TgvYbiLDJ/VDyT/L7VAmslTenvL3KQ5LYamCNppqQSMgOWKwtcU5ckicwx/A0R8cVC19OdiPj7iKiNiBlk/r8+EhGD9q/miNgFbJM0N2m6FFhfwJK6sxW4SFJ58jNxKYP0xIBOVgLXJtPXAj8qYC09knQZ8Gng8og4Wuh6uhIRz0XE5IiYkfy+NQILkp/pfuUgySEZSLsBeIjML+L9EbGusFV16+3An5L56/7p5PX/FrqoYeSvgLslPQvMB/65wPXklOw1LQfWAs+R+f0eVFdhS/oesAqYK6lR0nXAvwDvkfRbMmcX/Usha8zWRb1fBSqAnye/a7cXtMhEF7UOzHcP3r0yMzMbCrxHYmZmfeIgMTOzPnGQmJlZnzhIzMysTxwkZmbWJw4Ss34gqS3r1Oun+/OO0ZJm5Lqjq9lgUVToAsyGiWMRMb/QRZgVgvdIzPJI0hZJN0v67+Q1O2mfLunh5JkWD0ualrSfkTzj4pnk1XGLk7SkryfPGvmZpFEF2yizThwkZv1jVKdDW1dlLTsYEReSuSL6S0nbV4FvJ8+0uBv4StL+FeDRiDiPzD29Ou6oMAe4NSLeDOwHrsjz9pj1mq9sN+sHkg5HxJgc7VuA342IzcmNNXdFxERJu4HqiGhJ2ndGxCRJTUBtRJzIWscM4OfJg5+Q9GmgOCL+Kf9bZtYz75GY5V90Md1Vn1xOZE234fFNG0QcJGb5d1XW+6pk+gleewzunwC/TqYfBj4CJ59rXzlQRZqdLv9VY9Y/Rkl6Omv+pxHRcQpwqaQnyfzhdnXS9jHgTkl/S+YJjH+etH8cWJbcubWNTKjszHv1Zn3gMRKzPErGSBZGxO5C12KWLz60ZWZmfeI9EjMz6xPvkZiZWZ84SMzMrE8cJGZm1icOEjMz6xMHiZmZ9YmDxMzM+uT/BxSS6w6Z6CDDAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "epochs = 15\n",
    "batchsize = 100\n",
    "errors = []\n",
    "for i in range(epochs):\n",
    "    for start, end in zip( range(0, len(trX), batchsize), range(batchsize, len(trX), batchsize)):\n",
    "        batch = trX[start:end]\n",
    "        cur_w = sess.run(update_w, feed_dict={v0: batch, W: prv_w, vb: prv_vb, hb: prv_hb})\n",
    "        cur_vb = sess.run(update_vb, feed_dict={v0: batch, W: prv_w, vb: prv_vb, hb: prv_hb})\n",
    "        cur_nb = sess.run(update_hb, feed_dict={v0: batch, W: prv_w, vb: prv_vb, hb: prv_hb})\n",
    "        prv_w = cur_w\n",
    "        prv_vb = cur_vb\n",
    "        prv_hb = cur_hb\n",
    "    errors.append(sess.run(err_sum, feed_dict={v0: trX, W: cur_w, vb: cur_vb, hb: cur_hb}))\n",
    "    print (errors[-1])\n",
    "plt.plot(errors)\n",
    "plt.ylabel('Error')\n",
    "plt.xlabel('Epoch')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<hr>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a id=\"ref5\"></a>\n",
    "<h2>Recommendation</h2>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can now predict movies that an arbitrarily selected user might like. This can be accomplished by feeding in the user's watched movie preferences into the RBM and then reconstructing the input. The values that the RBM gives us will attempt to estimate the user's preferences for movies that he hasn't watched based on the preferences of the users that the RBM was trained on."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Lets first select a <b>User ID</b> of our mock user:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [],
   "source": [
    "mock_user_id = 215"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {
    "collapsed": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[0.8, 0. , 0. , ..., 0. , 0. , 0. ]])"
      ]
     },
     "execution_count": 17,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#Selecting the input user\n",
    "inputUser = trX[mock_user_id-1].reshape(1, -1)\n",
    "inputUser[0:5]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "collapsed": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[0.22817394 0.16532987 0.04084043 ... 0.0019875  0.00165076 0.00574424]]\n"
     ]
    }
   ],
   "source": [
    "#Feeding in the user and reconstructing the input\n",
    "hh0 = tf.nn.sigmoid(tf.matmul(v0, W) + hb)\n",
    "vv1 = tf.nn.sigmoid(tf.matmul(hh0, tf.transpose(W)) + vb)\n",
    "feed = sess.run(hh0, feed_dict={ v0: inputUser, W: prv_w, hb: prv_hb})\n",
    "rec = sess.run(vv1, feed_dict={ hh0: feed, W: prv_w, vb: prv_vb})\n",
    "print(rec)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can then list the 20 most recommended movies for our mock user by sorting it by their scores given by our model."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>MovieID</th>\n",
       "      <th>Title</th>\n",
       "      <th>Genres</th>\n",
       "      <th>RecommendationScore</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>257</th>\n",
       "      <td>260</td>\n",
       "      <td>Star Wars: Episode IV - A New Hope (1977)</td>\n",
       "      <td>Action|Adventure|Fantasy|Sci-Fi</td>\n",
       "      <td>0.995710</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1178</th>\n",
       "      <td>1196</td>\n",
       "      <td>Star Wars: Episode V - The Empire Strikes Back...</td>\n",
       "      <td>Action|Adventure|Drama|Sci-Fi|War</td>\n",
       "      <td>0.945066</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1192</th>\n",
       "      <td>1210</td>\n",
       "      <td>Star Wars: Episode VI - Return of the Jedi (1983)</td>\n",
       "      <td>Action|Adventure|Romance|Sci-Fi|War</td>\n",
       "      <td>0.884173</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2559</th>\n",
       "      <td>2628</td>\n",
       "      <td>Star Wars: Episode I - The Phantom Menace (1999)</td>\n",
       "      <td>Action|Adventure|Fantasy|Sci-Fi</td>\n",
       "      <td>0.861583</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2502</th>\n",
       "      <td>2571</td>\n",
       "      <td>Matrix, The (1999)</td>\n",
       "      <td>Action|Sci-Fi|Thriller</td>\n",
       "      <td>0.828158</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>476</th>\n",
       "      <td>480</td>\n",
       "      <td>Jurassic Park (1993)</td>\n",
       "      <td>Action|Adventure|Sci-Fi</td>\n",
       "      <td>0.767944</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1539</th>\n",
       "      <td>1580</td>\n",
       "      <td>Men in Black (1997)</td>\n",
       "      <td>Action|Adventure|Comedy|Sci-Fi</td>\n",
       "      <td>0.760474</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1250</th>\n",
       "      <td>1270</td>\n",
       "      <td>Back to the Future (1985)</td>\n",
       "      <td>Comedy|Sci-Fi</td>\n",
       "      <td>0.751571</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1180</th>\n",
       "      <td>1198</td>\n",
       "      <td>Raiders of the Lost Ark (1981)</td>\n",
       "      <td>Action|Adventure</td>\n",
       "      <td>0.746259</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1335</th>\n",
       "      <td>1356</td>\n",
       "      <td>Star Trek: First Contact (1996)</td>\n",
       "      <td>Action|Adventure|Sci-Fi</td>\n",
       "      <td>0.743140</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>585</th>\n",
       "      <td>589</td>\n",
       "      <td>Terminator 2: Judgment Day (1991)</td>\n",
       "      <td>Action|Sci-Fi|Thriller</td>\n",
       "      <td>0.738508</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1220</th>\n",
       "      <td>1240</td>\n",
       "      <td>Terminator, The (1984)</td>\n",
       "      <td>Action|Sci-Fi|Thriller</td>\n",
       "      <td>0.724062</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2847</th>\n",
       "      <td>2916</td>\n",
       "      <td>Total Recall (1990)</td>\n",
       "      <td>Action|Adventure|Sci-Fi|Thriller</td>\n",
       "      <td>0.656895</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1353</th>\n",
       "      <td>1374</td>\n",
       "      <td>Star Trek: The Wrath of Khan (1982)</td>\n",
       "      <td>Action|Adventure|Sci-Fi</td>\n",
       "      <td>0.639605</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>313</th>\n",
       "      <td>316</td>\n",
       "      <td>Stargate (1994)</td>\n",
       "      <td>Action|Adventure|Sci-Fi</td>\n",
       "      <td>0.606207</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1081</th>\n",
       "      <td>1097</td>\n",
       "      <td>E.T. the Extra-Terrestrial (1982)</td>\n",
       "      <td>Children's|Drama|Fantasy|Sci-Fi</td>\n",
       "      <td>0.604359</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>325</th>\n",
       "      <td>329</td>\n",
       "      <td>Star Trek: Generations (1994)</td>\n",
       "      <td>Action|Adventure|Sci-Fi</td>\n",
       "      <td>0.600770</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1179</th>\n",
       "      <td>1197</td>\n",
       "      <td>Princess Bride, The (1987)</td>\n",
       "      <td>Action|Adventure|Comedy|Romance</td>\n",
       "      <td>0.592652</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2789</th>\n",
       "      <td>2858</td>\n",
       "      <td>American Beauty (1999)</td>\n",
       "      <td>Comedy|Drama</td>\n",
       "      <td>0.589972</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1271</th>\n",
       "      <td>1291</td>\n",
       "      <td>Indiana Jones and the Last Crusade (1989)</td>\n",
       "      <td>Action|Adventure</td>\n",
       "      <td>0.582525</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "      MovieID                                              Title  \\\n",
       "257       260          Star Wars: Episode IV - A New Hope (1977)   \n",
       "1178     1196  Star Wars: Episode V - The Empire Strikes Back...   \n",
       "1192     1210  Star Wars: Episode VI - Return of the Jedi (1983)   \n",
       "2559     2628   Star Wars: Episode I - The Phantom Menace (1999)   \n",
       "2502     2571                                 Matrix, The (1999)   \n",
       "476       480                               Jurassic Park (1993)   \n",
       "1539     1580                                Men in Black (1997)   \n",
       "1250     1270                          Back to the Future (1985)   \n",
       "1180     1198                     Raiders of the Lost Ark (1981)   \n",
       "1335     1356                    Star Trek: First Contact (1996)   \n",
       "585       589                  Terminator 2: Judgment Day (1991)   \n",
       "1220     1240                             Terminator, The (1984)   \n",
       "2847     2916                                Total Recall (1990)   \n",
       "1353     1374                Star Trek: The Wrath of Khan (1982)   \n",
       "313       316                                    Stargate (1994)   \n",
       "1081     1097                  E.T. the Extra-Terrestrial (1982)   \n",
       "325       329                      Star Trek: Generations (1994)   \n",
       "1179     1197                         Princess Bride, The (1987)   \n",
       "2789     2858                             American Beauty (1999)   \n",
       "1271     1291          Indiana Jones and the Last Crusade (1989)   \n",
       "\n",
       "                                   Genres  RecommendationScore  \n",
       "257       Action|Adventure|Fantasy|Sci-Fi             0.995710  \n",
       "1178    Action|Adventure|Drama|Sci-Fi|War             0.945066  \n",
       "1192  Action|Adventure|Romance|Sci-Fi|War             0.884173  \n",
       "2559      Action|Adventure|Fantasy|Sci-Fi             0.861583  \n",
       "2502               Action|Sci-Fi|Thriller             0.828158  \n",
       "476               Action|Adventure|Sci-Fi             0.767944  \n",
       "1539       Action|Adventure|Comedy|Sci-Fi             0.760474  \n",
       "1250                        Comedy|Sci-Fi             0.751571  \n",
       "1180                     Action|Adventure             0.746259  \n",
       "1335              Action|Adventure|Sci-Fi             0.743140  \n",
       "585                Action|Sci-Fi|Thriller             0.738508  \n",
       "1220               Action|Sci-Fi|Thriller             0.724062  \n",
       "2847     Action|Adventure|Sci-Fi|Thriller             0.656895  \n",
       "1353              Action|Adventure|Sci-Fi             0.639605  \n",
       "313               Action|Adventure|Sci-Fi             0.606207  \n",
       "1081      Children's|Drama|Fantasy|Sci-Fi             0.604359  \n",
       "325               Action|Adventure|Sci-Fi             0.600770  \n",
       "1179      Action|Adventure|Comedy|Romance             0.592652  \n",
       "2789                         Comedy|Drama             0.589972  \n",
       "1271                     Action|Adventure             0.582525  "
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scored_movies_df_mock = movies_df[movies_df['MovieID'].isin(user_rating_df.columns)]\n",
    "scored_movies_df_mock = scored_movies_df_mock.assign(RecommendationScore = rec[0])\n",
    "scored_movies_df_mock.sort_values([\"RecommendationScore\"], ascending=False).head(20)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "So, how to recommend the movies that the user has not watched yet? "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now, we can find all the movies that our mock user has watched before:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>UserID</th>\n",
       "      <th>MovieID</th>\n",
       "      <th>Rating</th>\n",
       "      <th>Timestamp</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>31603</th>\n",
       "      <td>215</td>\n",
       "      <td>3793</td>\n",
       "      <td>5</td>\n",
       "      <td>977099259</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31604</th>\n",
       "      <td>215</td>\n",
       "      <td>1</td>\n",
       "      <td>4</td>\n",
       "      <td>979174987</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31605</th>\n",
       "      <td>215</td>\n",
       "      <td>1197</td>\n",
       "      <td>5</td>\n",
       "      <td>976899663</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31606</th>\n",
       "      <td>215</td>\n",
       "      <td>2302</td>\n",
       "      <td>5</td>\n",
       "      <td>976899718</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31607</th>\n",
       "      <td>215</td>\n",
       "      <td>2167</td>\n",
       "      <td>5</td>\n",
       "      <td>976899770</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "       UserID  MovieID  Rating  Timestamp\n",
       "31603     215     3793       5  977099259\n",
       "31604     215        1       4  979174987\n",
       "31605     215     1197       5  976899663\n",
       "31606     215     2302       5  976899718\n",
       "31607     215     2167       5  976899770"
      ]
     },
     "execution_count": 20,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "movies_df_mock = ratings_df[ratings_df['UserID'] == mock_user_id]\n",
    "movies_df_mock.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the next cell, we merge all the movies that our mock users has watched with the predicted scores based on his historical data:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "#Merging movies_df with ratings_df by MovieID\n",
    "merged_df_mock = scored_movies_df_mock.merge(movies_df_mock, on='MovieID', how='outer')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "lets sort it and take a look at the first 20 rows:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>MovieID</th>\n",
       "      <th>Title</th>\n",
       "      <th>Genres</th>\n",
       "      <th>RecommendationScore</th>\n",
       "      <th>UserID</th>\n",
       "      <th>Rating</th>\n",
       "      <th>Timestamp</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>253</th>\n",
       "      <td>260</td>\n",
       "      <td>Star Wars: Episode IV - A New Hope (1977)</td>\n",
       "      <td>Action|Adventure|Fantasy|Sci-Fi</td>\n",
       "      <td>0.995710</td>\n",
       "      <td>215.0</td>\n",
       "      <td>5.0</td>\n",
       "      <td>976899190.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1106</th>\n",
       "      <td>1196</td>\n",
       "      <td>Star Wars: Episode V - The Empire Strikes Back...</td>\n",
       "      <td>Action|Adventure|Drama|Sci-Fi|War</td>\n",
       "      <td>0.945066</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1120</th>\n",
       "      <td>1210</td>\n",
       "      <td>Star Wars: Episode VI - Return of the Jedi (1983)</td>\n",
       "      <td>Action|Adventure|Romance|Sci-Fi|War</td>\n",
       "      <td>0.884173</td>\n",
       "      <td>215.0</td>\n",
       "      <td>5.0</td>\n",
       "      <td>976899689.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2426</th>\n",
       "      <td>2628</td>\n",
       "      <td>Star Wars: Episode I - The Phantom Menace (1999)</td>\n",
       "      <td>Action|Adventure|Fantasy|Sci-Fi</td>\n",
       "      <td>0.861583</td>\n",
       "      <td>215.0</td>\n",
       "      <td>5.0</td>\n",
       "      <td>976908635.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2374</th>\n",
       "      <td>2571</td>\n",
       "      <td>Matrix, The (1999)</td>\n",
       "      <td>Action|Sci-Fi|Thriller</td>\n",
       "      <td>0.828158</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>466</th>\n",
       "      <td>480</td>\n",
       "      <td>Jurassic Park (1993)</td>\n",
       "      <td>Action|Adventure|Sci-Fi</td>\n",
       "      <td>0.767944</td>\n",
       "      <td>215.0</td>\n",
       "      <td>5.0</td>\n",
       "      <td>976899784.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1449</th>\n",
       "      <td>1580</td>\n",
       "      <td>Men in Black (1997)</td>\n",
       "      <td>Action|Adventure|Comedy|Sci-Fi</td>\n",
       "      <td>0.760474</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1178</th>\n",
       "      <td>1270</td>\n",
       "      <td>Back to the Future (1985)</td>\n",
       "      <td>Comedy|Sci-Fi</td>\n",
       "      <td>0.751571</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1108</th>\n",
       "      <td>1198</td>\n",
       "      <td>Raiders of the Lost Ark (1981)</td>\n",
       "      <td>Action|Adventure</td>\n",
       "      <td>0.746259</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1258</th>\n",
       "      <td>1356</td>\n",
       "      <td>Star Trek: First Contact (1996)</td>\n",
       "      <td>Action|Adventure|Sci-Fi</td>\n",
       "      <td>0.743140</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>575</th>\n",
       "      <td>589</td>\n",
       "      <td>Terminator 2: Judgment Day (1991)</td>\n",
       "      <td>Action|Sci-Fi|Thriller</td>\n",
       "      <td>0.738508</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1148</th>\n",
       "      <td>1240</td>\n",
       "      <td>Terminator, The (1984)</td>\n",
       "      <td>Action|Sci-Fi|Thriller</td>\n",
       "      <td>0.724062</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2708</th>\n",
       "      <td>2916</td>\n",
       "      <td>Total Recall (1990)</td>\n",
       "      <td>Action|Adventure|Sci-Fi|Thriller</td>\n",
       "      <td>0.656895</td>\n",
       "      <td>215.0</td>\n",
       "      <td>4.0</td>\n",
       "      <td>976908547.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1275</th>\n",
       "      <td>1374</td>\n",
       "      <td>Star Trek: The Wrath of Khan (1982)</td>\n",
       "      <td>Action|Adventure|Sci-Fi</td>\n",
       "      <td>0.639605</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>307</th>\n",
       "      <td>316</td>\n",
       "      <td>Stargate (1994)</td>\n",
       "      <td>Action|Adventure|Sci-Fi</td>\n",
       "      <td>0.606207</td>\n",
       "      <td>215.0</td>\n",
       "      <td>4.0</td>\n",
       "      <td>976908635.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1025</th>\n",
       "      <td>1097</td>\n",
       "      <td>E.T. the Extra-Terrestrial (1982)</td>\n",
       "      <td>Children's|Drama|Fantasy|Sci-Fi</td>\n",
       "      <td>0.604359</td>\n",
       "      <td>215.0</td>\n",
       "      <td>5.0</td>\n",
       "      <td>976908468.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>319</th>\n",
       "      <td>329</td>\n",
       "      <td>Star Trek: Generations (1994)</td>\n",
       "      <td>Action|Adventure|Sci-Fi</td>\n",
       "      <td>0.600770</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1107</th>\n",
       "      <td>1197</td>\n",
       "      <td>Princess Bride, The (1987)</td>\n",
       "      <td>Action|Adventure|Comedy|Romance</td>\n",
       "      <td>0.592652</td>\n",
       "      <td>215.0</td>\n",
       "      <td>5.0</td>\n",
       "      <td>976899663.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2651</th>\n",
       "      <td>2858</td>\n",
       "      <td>American Beauty (1999)</td>\n",
       "      <td>Comedy|Drama</td>\n",
       "      <td>0.589972</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1199</th>\n",
       "      <td>1291</td>\n",
       "      <td>Indiana Jones and the Last Crusade (1989)</td>\n",
       "      <td>Action|Adventure</td>\n",
       "      <td>0.582525</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "      MovieID                                              Title  \\\n",
       "253       260          Star Wars: Episode IV - A New Hope (1977)   \n",
       "1106     1196  Star Wars: Episode V - The Empire Strikes Back...   \n",
       "1120     1210  Star Wars: Episode VI - Return of the Jedi (1983)   \n",
       "2426     2628   Star Wars: Episode I - The Phantom Menace (1999)   \n",
       "2374     2571                                 Matrix, The (1999)   \n",
       "466       480                               Jurassic Park (1993)   \n",
       "1449     1580                                Men in Black (1997)   \n",
       "1178     1270                          Back to the Future (1985)   \n",
       "1108     1198                     Raiders of the Lost Ark (1981)   \n",
       "1258     1356                    Star Trek: First Contact (1996)   \n",
       "575       589                  Terminator 2: Judgment Day (1991)   \n",
       "1148     1240                             Terminator, The (1984)   \n",
       "2708     2916                                Total Recall (1990)   \n",
       "1275     1374                Star Trek: The Wrath of Khan (1982)   \n",
       "307       316                                    Stargate (1994)   \n",
       "1025     1097                  E.T. the Extra-Terrestrial (1982)   \n",
       "319       329                      Star Trek: Generations (1994)   \n",
       "1107     1197                         Princess Bride, The (1987)   \n",
       "2651     2858                             American Beauty (1999)   \n",
       "1199     1291          Indiana Jones and the Last Crusade (1989)   \n",
       "\n",
       "                                   Genres  RecommendationScore  UserID  \\\n",
       "253       Action|Adventure|Fantasy|Sci-Fi             0.995710   215.0   \n",
       "1106    Action|Adventure|Drama|Sci-Fi|War             0.945066     NaN   \n",
       "1120  Action|Adventure|Romance|Sci-Fi|War             0.884173   215.0   \n",
       "2426      Action|Adventure|Fantasy|Sci-Fi             0.861583   215.0   \n",
       "2374               Action|Sci-Fi|Thriller             0.828158     NaN   \n",
       "466               Action|Adventure|Sci-Fi             0.767944   215.0   \n",
       "1449       Action|Adventure|Comedy|Sci-Fi             0.760474     NaN   \n",
       "1178                        Comedy|Sci-Fi             0.751571     NaN   \n",
       "1108                     Action|Adventure             0.746259     NaN   \n",
       "1258              Action|Adventure|Sci-Fi             0.743140     NaN   \n",
       "575                Action|Sci-Fi|Thriller             0.738508     NaN   \n",
       "1148               Action|Sci-Fi|Thriller             0.724062     NaN   \n",
       "2708     Action|Adventure|Sci-Fi|Thriller             0.656895   215.0   \n",
       "1275              Action|Adventure|Sci-Fi             0.639605     NaN   \n",
       "307               Action|Adventure|Sci-Fi             0.606207   215.0   \n",
       "1025      Children's|Drama|Fantasy|Sci-Fi             0.604359   215.0   \n",
       "319               Action|Adventure|Sci-Fi             0.600770     NaN   \n",
       "1107      Action|Adventure|Comedy|Romance             0.592652   215.0   \n",
       "2651                         Comedy|Drama             0.589972     NaN   \n",
       "1199                     Action|Adventure             0.582525     NaN   \n",
       "\n",
       "      Rating    Timestamp  \n",
       "253      5.0  976899190.0  \n",
       "1106     NaN          NaN  \n",
       "1120     5.0  976899689.0  \n",
       "2426     5.0  976908635.0  \n",
       "2374     NaN          NaN  \n",
       "466      5.0  976899784.0  \n",
       "1449     NaN          NaN  \n",
       "1178     NaN          NaN  \n",
       "1108     NaN          NaN  \n",
       "1258     NaN          NaN  \n",
       "575      NaN          NaN  \n",
       "1148     NaN          NaN  \n",
       "2708     4.0  976908547.0  \n",
       "1275     NaN          NaN  \n",
       "307      4.0  976908635.0  \n",
       "1025     5.0  976908468.0  \n",
       "319      NaN          NaN  \n",
       "1107     5.0  976899663.0  \n",
       "2651     NaN          NaN  \n",
       "1199     NaN          NaN  "
      ]
     },
     "execution_count": 22,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "merged_df_mock.sort_values([\"RecommendationScore\"], ascending=False).head(20)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As you can see, there are some movies that user has not watched yet and has high score based on our model. So, we can recommend them to the user."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This is the end of the module. If you want, you can try to change the parameters in the code -- adding more units to the hidden layer, changing the loss functions or maybe something else to see if it changes anything. Does the model perform better? Does it take longer to compute?\n",
    "\n",
    "Thank you for reading this notebook. Hopefully, you now have a little more understanding of the RBM model, its applications and how it works with TensorFlow."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<hr>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Want to learn more?\n",
    "\n",
    "Running deep learning programs usually needs a high performance platform. __PowerAI__ speeds up deep learning and AI. Built on IBM’s Power Systems, __PowerAI__ is a scalable software platform that accelerates deep learning and AI with blazing performance for individual users or enterprises. The __PowerAI__ platform supports popular machine learning libraries and dependencies including TensorFlow, Caffe, Torch, and Theano. You can use [PowerAI on IMB Cloud](https://cocl.us/ML0120EN_PAI).\n",
    "\n",
    "Also, you can use __Watson Studio__ to run these notebooks faster with bigger datasets.__Watson Studio__ is IBM’s leading cloud solution for data scientists, built by data scientists. With Jupyter notebooks, RStudio, Apache Spark and popular libraries pre-packaged in the cloud, __Watson Studio__ enables data scientists to collaborate on their projects without having to install anything. Join the fast-growing community of __Watson Studio__ users today with a free account at [Watson Studio](https://cocl.us/ML0120EN_DSX).This is the end of this lesson. Thank you for reading this notebook, and good luck on your studies."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Thank you for completing this exercise!\n",
    "\n",
    "Notebook created by: <a href = \"https://ca.linkedin.com/in/saeedaghabozorgi\">Saeed Aghabozorgi</a>, Gabriel Garcez Barros Sousa"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<hr>\n",
    "\n",
    "Copyright &copy; 2018 [Cognitive Class](https://cocl.us/DX0108EN_CC). This notebook and its source code are released under the terms of the [MIT License](https://bigdatauniversity.com/mit-license/)."
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.5"
  },
  "widgets": {
   "state": {},
   "version": "1.1.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}