├── README.md
└── Recommender System With Matrix Factorization .ipynb


/README.md:
--------------------------------------------------------------------------------
 1 | <h1>Recommendation System Using Matrix Factorization</h1>
 2 | <p>In this project we make a movie recommender using matrix factorization in python.The tools that are used in this project are as 
 3 | follows.</p>
 4 | <ol>
 5 | <li>Numpy</li>
 6 | <li>Pandas</li>
 7 | </ol>
 8 | <p>The dataset i have used is MovieLens dataset which is one of the most common datasets used when implementing and testing recommender engines.I have used the small dataset for this program you can check the website for the larger dataset <a target="_blank" href="https://grouplens.org/datasets/movielens/">here</a>.To downlaod the exact dataset i have used then just click <a target="_blank" href="http://files.grouplens.org/datasets/movielens/ml-latest-small.zip">here</a></p>
 9 | <h2>Matrix Factorization</h2>
10 | <p>A matrix factorization is simply a mathematical tool for playing around with matrices and is therefore applicable in many scenarios where one would like to find out something hidden under the data.</p>
11 | 
12 | <p align="center">
13 |   <img src="http://katbailey.github.io/images/matrix_factorization.png" height="340px">
14 | </p>
15 | <p>In order to understand matrix factorization here is an artical with the complete implementaion on python just click <a target="_blank" href="http://www.quuxlabs.com/blog/2010/09/matrix-factorization-a-simple-tutorial-and-implementation-in-python/">here</a>. </p>
16 | 


--------------------------------------------------------------------------------
/Recommender System With Matrix Factorization .ipynb:
--------------------------------------------------------------------------------
   1 | {
   2 |  "cells": [
   3 |   {
   4 |    "cell_type": "markdown",
   5 |    "metadata": {},
   6 |    "source": [
   7 |     "### Import Libraries "
   8 |    ]
   9 |   },
  10 |   {
  11 |    "cell_type": "code",
  12 |    "execution_count": 1,
  13 |    "metadata": {},
  14 |    "outputs": [],
  15 |    "source": [
  16 |     "import pandas as pd\n",
  17 |     "import numpy as np"
  18 |    ]
  19 |   },
  20 |   {
  21 |    "cell_type": "markdown",
  22 |    "metadata": {},
  23 |    "source": [
  24 |     "### Import the movies dataset"
  25 |    ]
  26 |   },
  27 |   {
  28 |    "cell_type": "code",
  29 |    "execution_count": 2,
  30 |    "metadata": {},
  31 |    "outputs": [],
  32 |    "source": [
  33 |     "movie_df = pd.read_csv('movies.csv')"
  34 |    ]
  35 |   },
  36 |   {
  37 |    "cell_type": "code",
  38 |    "execution_count": 3,
  39 |    "metadata": {},
  40 |    "outputs": [],
  41 |    "source": [
  42 |     "rating_df = pd.read_csv('ratings.csv')"
  43 |    ]
  44 |   },
  45 |   {
  46 |    "cell_type": "markdown",
  47 |    "metadata": {},
  48 |    "source": [
  49 |     "### Checking the tables "
  50 |    ]
  51 |   },
  52 |   {
  53 |    "cell_type": "code",
  54 |    "execution_count": 29,
  55 |    "metadata": {},
  56 |    "outputs": [
  57 |     {
  58 |      "data": {
  59 |       "text/html": [
  60 |        "<div>\n",
  61 |        "<style scoped>\n",
  62 |        "    .dataframe tbody tr th:only-of-type {\n",
  63 |        "        vertical-align: middle;\n",
  64 |        "    }\n",
  65 |        "\n",
  66 |        "    .dataframe tbody tr th {\n",
  67 |        "        vertical-align: top;\n",
  68 |        "    }\n",
  69 |        "\n",
  70 |        "    .dataframe thead th {\n",
  71 |        "        text-align: right;\n",
  72 |        "    }\n",
  73 |        "</style>\n",
  74 |        "<table border=\"1\" class=\"dataframe\">\n",
  75 |        "  <thead>\n",
  76 |        "    <tr style=\"text-align: right;\">\n",
  77 |        "      <th></th>\n",
  78 |        "      <th>movieId</th>\n",
  79 |        "      <th>title</th>\n",
  80 |        "      <th>genres</th>\n",
  81 |        "    </tr>\n",
  82 |        "  </thead>\n",
  83 |        "  <tbody>\n",
  84 |        "    <tr>\n",
  85 |        "      <th>0</th>\n",
  86 |        "      <td>1</td>\n",
  87 |        "      <td>Toy Story (1995)</td>\n",
  88 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
  89 |        "    </tr>\n",
  90 |        "    <tr>\n",
  91 |        "      <th>1</th>\n",
  92 |        "      <td>2</td>\n",
  93 |        "      <td>Jumanji (1995)</td>\n",
  94 |        "      <td>Adventure|Children|Fantasy</td>\n",
  95 |        "    </tr>\n",
  96 |        "    <tr>\n",
  97 |        "      <th>2</th>\n",
  98 |        "      <td>3</td>\n",
  99 |        "      <td>Grumpier Old Men (1995)</td>\n",
 100 |        "      <td>Comedy|Romance</td>\n",
 101 |        "    </tr>\n",
 102 |        "    <tr>\n",
 103 |        "      <th>3</th>\n",
 104 |        "      <td>4</td>\n",
 105 |        "      <td>Waiting to Exhale (1995)</td>\n",
 106 |        "      <td>Comedy|Drama|Romance</td>\n",
 107 |        "    </tr>\n",
 108 |        "    <tr>\n",
 109 |        "      <th>4</th>\n",
 110 |        "      <td>5</td>\n",
 111 |        "      <td>Father of the Bride Part II (1995)</td>\n",
 112 |        "      <td>Comedy</td>\n",
 113 |        "    </tr>\n",
 114 |        "    <tr>\n",
 115 |        "      <th>5</th>\n",
 116 |        "      <td>6</td>\n",
 117 |        "      <td>Heat (1995)</td>\n",
 118 |        "      <td>Action|Crime|Thriller</td>\n",
 119 |        "    </tr>\n",
 120 |        "    <tr>\n",
 121 |        "      <th>6</th>\n",
 122 |        "      <td>7</td>\n",
 123 |        "      <td>Sabrina (1995)</td>\n",
 124 |        "      <td>Comedy|Romance</td>\n",
 125 |        "    </tr>\n",
 126 |        "    <tr>\n",
 127 |        "      <th>7</th>\n",
 128 |        "      <td>8</td>\n",
 129 |        "      <td>Tom and Huck (1995)</td>\n",
 130 |        "      <td>Adventure|Children</td>\n",
 131 |        "    </tr>\n",
 132 |        "    <tr>\n",
 133 |        "      <th>8</th>\n",
 134 |        "      <td>9</td>\n",
 135 |        "      <td>Sudden Death (1995)</td>\n",
 136 |        "      <td>Action</td>\n",
 137 |        "    </tr>\n",
 138 |        "    <tr>\n",
 139 |        "      <th>9</th>\n",
 140 |        "      <td>10</td>\n",
 141 |        "      <td>GoldenEye (1995)</td>\n",
 142 |        "      <td>Action|Adventure|Thriller</td>\n",
 143 |        "    </tr>\n",
 144 |        "  </tbody>\n",
 145 |        "</table>\n",
 146 |        "</div>"
 147 |       ],
 148 |       "text/plain": [
 149 |        "   movieId                               title  \\\n",
 150 |        "0        1                    Toy Story (1995)   \n",
 151 |        "1        2                      Jumanji (1995)   \n",
 152 |        "2        3             Grumpier Old Men (1995)   \n",
 153 |        "3        4            Waiting to Exhale (1995)   \n",
 154 |        "4        5  Father of the Bride Part II (1995)   \n",
 155 |        "5        6                         Heat (1995)   \n",
 156 |        "6        7                      Sabrina (1995)   \n",
 157 |        "7        8                 Tom and Huck (1995)   \n",
 158 |        "8        9                 Sudden Death (1995)   \n",
 159 |        "9       10                    GoldenEye (1995)   \n",
 160 |        "\n",
 161 |        "                                        genres  \n",
 162 |        "0  Adventure|Animation|Children|Comedy|Fantasy  \n",
 163 |        "1                   Adventure|Children|Fantasy  \n",
 164 |        "2                               Comedy|Romance  \n",
 165 |        "3                         Comedy|Drama|Romance  \n",
 166 |        "4                                       Comedy  \n",
 167 |        "5                        Action|Crime|Thriller  \n",
 168 |        "6                               Comedy|Romance  \n",
 169 |        "7                           Adventure|Children  \n",
 170 |        "8                                       Action  \n",
 171 |        "9                    Action|Adventure|Thriller  "
 172 |       ]
 173 |      },
 174 |      "execution_count": 29,
 175 |      "metadata": {},
 176 |      "output_type": "execute_result"
 177 |     }
 178 |    ],
 179 |    "source": [
 180 |     "movie_df.head(10)"
 181 |    ]
 182 |   },
 183 |   {
 184 |    "cell_type": "code",
 185 |    "execution_count": 30,
 186 |    "metadata": {},
 187 |    "outputs": [
 188 |     {
 189 |      "data": {
 190 |       "text/html": [
 191 |        "<div>\n",
 192 |        "<style scoped>\n",
 193 |        "    .dataframe tbody tr th:only-of-type {\n",
 194 |        "        vertical-align: middle;\n",
 195 |        "    }\n",
 196 |        "\n",
 197 |        "    .dataframe tbody tr th {\n",
 198 |        "        vertical-align: top;\n",
 199 |        "    }\n",
 200 |        "\n",
 201 |        "    .dataframe thead th {\n",
 202 |        "        text-align: right;\n",
 203 |        "    }\n",
 204 |        "</style>\n",
 205 |        "<table border=\"1\" class=\"dataframe\">\n",
 206 |        "  <thead>\n",
 207 |        "    <tr style=\"text-align: right;\">\n",
 208 |        "      <th></th>\n",
 209 |        "      <th>userId</th>\n",
 210 |        "      <th>movieId</th>\n",
 211 |        "      <th>rating</th>\n",
 212 |        "      <th>timestamp</th>\n",
 213 |        "    </tr>\n",
 214 |        "  </thead>\n",
 215 |        "  <tbody>\n",
 216 |        "    <tr>\n",
 217 |        "      <th>0</th>\n",
 218 |        "      <td>1</td>\n",
 219 |        "      <td>1</td>\n",
 220 |        "      <td>4.0</td>\n",
 221 |        "      <td>964982703</td>\n",
 222 |        "    </tr>\n",
 223 |        "    <tr>\n",
 224 |        "      <th>1</th>\n",
 225 |        "      <td>1</td>\n",
 226 |        "      <td>3</td>\n",
 227 |        "      <td>4.0</td>\n",
 228 |        "      <td>964981247</td>\n",
 229 |        "    </tr>\n",
 230 |        "    <tr>\n",
 231 |        "      <th>2</th>\n",
 232 |        "      <td>1</td>\n",
 233 |        "      <td>6</td>\n",
 234 |        "      <td>4.0</td>\n",
 235 |        "      <td>964982224</td>\n",
 236 |        "    </tr>\n",
 237 |        "    <tr>\n",
 238 |        "      <th>3</th>\n",
 239 |        "      <td>1</td>\n",
 240 |        "      <td>47</td>\n",
 241 |        "      <td>5.0</td>\n",
 242 |        "      <td>964983815</td>\n",
 243 |        "    </tr>\n",
 244 |        "    <tr>\n",
 245 |        "      <th>4</th>\n",
 246 |        "      <td>1</td>\n",
 247 |        "      <td>50</td>\n",
 248 |        "      <td>5.0</td>\n",
 249 |        "      <td>964982931</td>\n",
 250 |        "    </tr>\n",
 251 |        "    <tr>\n",
 252 |        "      <th>5</th>\n",
 253 |        "      <td>1</td>\n",
 254 |        "      <td>70</td>\n",
 255 |        "      <td>3.0</td>\n",
 256 |        "      <td>964982400</td>\n",
 257 |        "    </tr>\n",
 258 |        "    <tr>\n",
 259 |        "      <th>6</th>\n",
 260 |        "      <td>1</td>\n",
 261 |        "      <td>101</td>\n",
 262 |        "      <td>5.0</td>\n",
 263 |        "      <td>964980868</td>\n",
 264 |        "    </tr>\n",
 265 |        "    <tr>\n",
 266 |        "      <th>7</th>\n",
 267 |        "      <td>1</td>\n",
 268 |        "      <td>110</td>\n",
 269 |        "      <td>4.0</td>\n",
 270 |        "      <td>964982176</td>\n",
 271 |        "    </tr>\n",
 272 |        "    <tr>\n",
 273 |        "      <th>8</th>\n",
 274 |        "      <td>1</td>\n",
 275 |        "      <td>151</td>\n",
 276 |        "      <td>5.0</td>\n",
 277 |        "      <td>964984041</td>\n",
 278 |        "    </tr>\n",
 279 |        "    <tr>\n",
 280 |        "      <th>9</th>\n",
 281 |        "      <td>1</td>\n",
 282 |        "      <td>157</td>\n",
 283 |        "      <td>5.0</td>\n",
 284 |        "      <td>964984100</td>\n",
 285 |        "    </tr>\n",
 286 |        "  </tbody>\n",
 287 |        "</table>\n",
 288 |        "</div>"
 289 |       ],
 290 |       "text/plain": [
 291 |        "   userId  movieId  rating  timestamp\n",
 292 |        "0       1        1     4.0  964982703\n",
 293 |        "1       1        3     4.0  964981247\n",
 294 |        "2       1        6     4.0  964982224\n",
 295 |        "3       1       47     5.0  964983815\n",
 296 |        "4       1       50     5.0  964982931\n",
 297 |        "5       1       70     3.0  964982400\n",
 298 |        "6       1      101     5.0  964980868\n",
 299 |        "7       1      110     4.0  964982176\n",
 300 |        "8       1      151     5.0  964984041\n",
 301 |        "9       1      157     5.0  964984100"
 302 |       ]
 303 |      },
 304 |      "execution_count": 30,
 305 |      "metadata": {},
 306 |      "output_type": "execute_result"
 307 |     }
 308 |    ],
 309 |    "source": [
 310 |     "rating_df.head(10)"
 311 |    ]
 312 |   },
 313 |   {
 314 |    "cell_type": "markdown",
 315 |    "metadata": {},
 316 |    "source": [
 317 |     "### Now combine the two tables and drop things we dont have to use"
 318 |    ]
 319 |   },
 320 |   {
 321 |    "cell_type": "code",
 322 |    "execution_count": 9,
 323 |    "metadata": {},
 324 |    "outputs": [
 325 |     {
 326 |      "data": {
 327 |       "text/html": [
 328 |        "<div>\n",
 329 |        "<style scoped>\n",
 330 |        "    .dataframe tbody tr th:only-of-type {\n",
 331 |        "        vertical-align: middle;\n",
 332 |        "    }\n",
 333 |        "\n",
 334 |        "    .dataframe tbody tr th {\n",
 335 |        "        vertical-align: top;\n",
 336 |        "    }\n",
 337 |        "\n",
 338 |        "    .dataframe thead th {\n",
 339 |        "        text-align: right;\n",
 340 |        "    }\n",
 341 |        "</style>\n",
 342 |        "<table border=\"1\" class=\"dataframe\">\n",
 343 |        "  <thead>\n",
 344 |        "    <tr style=\"text-align: right;\">\n",
 345 |        "      <th></th>\n",
 346 |        "      <th>userId</th>\n",
 347 |        "      <th>movieId</th>\n",
 348 |        "      <th>rating</th>\n",
 349 |        "      <th>timestamp</th>\n",
 350 |        "      <th>title</th>\n",
 351 |        "      <th>genres</th>\n",
 352 |        "    </tr>\n",
 353 |        "  </thead>\n",
 354 |        "  <tbody>\n",
 355 |        "    <tr>\n",
 356 |        "      <th>0</th>\n",
 357 |        "      <td>1</td>\n",
 358 |        "      <td>1</td>\n",
 359 |        "      <td>4.0</td>\n",
 360 |        "      <td>964982703</td>\n",
 361 |        "      <td>Toy Story (1995)</td>\n",
 362 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 363 |        "    </tr>\n",
 364 |        "    <tr>\n",
 365 |        "      <th>1</th>\n",
 366 |        "      <td>5</td>\n",
 367 |        "      <td>1</td>\n",
 368 |        "      <td>4.0</td>\n",
 369 |        "      <td>847434962</td>\n",
 370 |        "      <td>Toy Story (1995)</td>\n",
 371 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 372 |        "    </tr>\n",
 373 |        "    <tr>\n",
 374 |        "      <th>2</th>\n",
 375 |        "      <td>7</td>\n",
 376 |        "      <td>1</td>\n",
 377 |        "      <td>4.5</td>\n",
 378 |        "      <td>1106635946</td>\n",
 379 |        "      <td>Toy Story (1995)</td>\n",
 380 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 381 |        "    </tr>\n",
 382 |        "    <tr>\n",
 383 |        "      <th>3</th>\n",
 384 |        "      <td>15</td>\n",
 385 |        "      <td>1</td>\n",
 386 |        "      <td>2.5</td>\n",
 387 |        "      <td>1510577970</td>\n",
 388 |        "      <td>Toy Story (1995)</td>\n",
 389 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 390 |        "    </tr>\n",
 391 |        "    <tr>\n",
 392 |        "      <th>4</th>\n",
 393 |        "      <td>17</td>\n",
 394 |        "      <td>1</td>\n",
 395 |        "      <td>4.5</td>\n",
 396 |        "      <td>1305696483</td>\n",
 397 |        "      <td>Toy Story (1995)</td>\n",
 398 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 399 |        "    </tr>\n",
 400 |        "    <tr>\n",
 401 |        "      <th>5</th>\n",
 402 |        "      <td>18</td>\n",
 403 |        "      <td>1</td>\n",
 404 |        "      <td>3.5</td>\n",
 405 |        "      <td>1455209816</td>\n",
 406 |        "      <td>Toy Story (1995)</td>\n",
 407 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 408 |        "    </tr>\n",
 409 |        "    <tr>\n",
 410 |        "      <th>6</th>\n",
 411 |        "      <td>19</td>\n",
 412 |        "      <td>1</td>\n",
 413 |        "      <td>4.0</td>\n",
 414 |        "      <td>965705637</td>\n",
 415 |        "      <td>Toy Story (1995)</td>\n",
 416 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 417 |        "    </tr>\n",
 418 |        "    <tr>\n",
 419 |        "      <th>7</th>\n",
 420 |        "      <td>21</td>\n",
 421 |        "      <td>1</td>\n",
 422 |        "      <td>3.5</td>\n",
 423 |        "      <td>1407618878</td>\n",
 424 |        "      <td>Toy Story (1995)</td>\n",
 425 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 426 |        "    </tr>\n",
 427 |        "    <tr>\n",
 428 |        "      <th>8</th>\n",
 429 |        "      <td>27</td>\n",
 430 |        "      <td>1</td>\n",
 431 |        "      <td>3.0</td>\n",
 432 |        "      <td>962685262</td>\n",
 433 |        "      <td>Toy Story (1995)</td>\n",
 434 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 435 |        "    </tr>\n",
 436 |        "    <tr>\n",
 437 |        "      <th>9</th>\n",
 438 |        "      <td>31</td>\n",
 439 |        "      <td>1</td>\n",
 440 |        "      <td>5.0</td>\n",
 441 |        "      <td>850466616</td>\n",
 442 |        "      <td>Toy Story (1995)</td>\n",
 443 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 444 |        "    </tr>\n",
 445 |        "  </tbody>\n",
 446 |        "</table>\n",
 447 |        "</div>"
 448 |       ],
 449 |       "text/plain": [
 450 |        "   userId  movieId  rating   timestamp             title  \\\n",
 451 |        "0       1        1     4.0   964982703  Toy Story (1995)   \n",
 452 |        "1       5        1     4.0   847434962  Toy Story (1995)   \n",
 453 |        "2       7        1     4.5  1106635946  Toy Story (1995)   \n",
 454 |        "3      15        1     2.5  1510577970  Toy Story (1995)   \n",
 455 |        "4      17        1     4.5  1305696483  Toy Story (1995)   \n",
 456 |        "5      18        1     3.5  1455209816  Toy Story (1995)   \n",
 457 |        "6      19        1     4.0   965705637  Toy Story (1995)   \n",
 458 |        "7      21        1     3.5  1407618878  Toy Story (1995)   \n",
 459 |        "8      27        1     3.0   962685262  Toy Story (1995)   \n",
 460 |        "9      31        1     5.0   850466616  Toy Story (1995)   \n",
 461 |        "\n",
 462 |        "                                        genres  \n",
 463 |        "0  Adventure|Animation|Children|Comedy|Fantasy  \n",
 464 |        "1  Adventure|Animation|Children|Comedy|Fantasy  \n",
 465 |        "2  Adventure|Animation|Children|Comedy|Fantasy  \n",
 466 |        "3  Adventure|Animation|Children|Comedy|Fantasy  \n",
 467 |        "4  Adventure|Animation|Children|Comedy|Fantasy  \n",
 468 |        "5  Adventure|Animation|Children|Comedy|Fantasy  \n",
 469 |        "6  Adventure|Animation|Children|Comedy|Fantasy  \n",
 470 |        "7  Adventure|Animation|Children|Comedy|Fantasy  \n",
 471 |        "8  Adventure|Animation|Children|Comedy|Fantasy  \n",
 472 |        "9  Adventure|Animation|Children|Comedy|Fantasy  "
 473 |       ]
 474 |      },
 475 |      "execution_count": 9,
 476 |      "metadata": {},
 477 |      "output_type": "execute_result"
 478 |     }
 479 |    ],
 480 |    "source": [
 481 |     "combine_movie_rating = pd.merge(rating_df, movie_df, on='movieId')\n",
 482 |     "combine_movie_rating.head(10)"
 483 |    ]
 484 |   },
 485 |   {
 486 |    "cell_type": "code",
 487 |    "execution_count": 31,
 488 |    "metadata": {},
 489 |    "outputs": [
 490 |     {
 491 |      "data": {
 492 |       "text/html": [
 493 |        "<div>\n",
 494 |        "<style scoped>\n",
 495 |        "    .dataframe tbody tr th:only-of-type {\n",
 496 |        "        vertical-align: middle;\n",
 497 |        "    }\n",
 498 |        "\n",
 499 |        "    .dataframe tbody tr th {\n",
 500 |        "        vertical-align: top;\n",
 501 |        "    }\n",
 502 |        "\n",
 503 |        "    .dataframe thead th {\n",
 504 |        "        text-align: right;\n",
 505 |        "    }\n",
 506 |        "</style>\n",
 507 |        "<table border=\"1\" class=\"dataframe\">\n",
 508 |        "  <thead>\n",
 509 |        "    <tr style=\"text-align: right;\">\n",
 510 |        "      <th></th>\n",
 511 |        "      <th>userId</th>\n",
 512 |        "      <th>movieId</th>\n",
 513 |        "      <th>rating</th>\n",
 514 |        "      <th>title</th>\n",
 515 |        "    </tr>\n",
 516 |        "  </thead>\n",
 517 |        "  <tbody>\n",
 518 |        "    <tr>\n",
 519 |        "      <th>0</th>\n",
 520 |        "      <td>1</td>\n",
 521 |        "      <td>1</td>\n",
 522 |        "      <td>4.0</td>\n",
 523 |        "      <td>Toy Story (1995)</td>\n",
 524 |        "    </tr>\n",
 525 |        "    <tr>\n",
 526 |        "      <th>1</th>\n",
 527 |        "      <td>5</td>\n",
 528 |        "      <td>1</td>\n",
 529 |        "      <td>4.0</td>\n",
 530 |        "      <td>Toy Story (1995)</td>\n",
 531 |        "    </tr>\n",
 532 |        "    <tr>\n",
 533 |        "      <th>2</th>\n",
 534 |        "      <td>7</td>\n",
 535 |        "      <td>1</td>\n",
 536 |        "      <td>4.5</td>\n",
 537 |        "      <td>Toy Story (1995)</td>\n",
 538 |        "    </tr>\n",
 539 |        "    <tr>\n",
 540 |        "      <th>3</th>\n",
 541 |        "      <td>15</td>\n",
 542 |        "      <td>1</td>\n",
 543 |        "      <td>2.5</td>\n",
 544 |        "      <td>Toy Story (1995)</td>\n",
 545 |        "    </tr>\n",
 546 |        "    <tr>\n",
 547 |        "      <th>4</th>\n",
 548 |        "      <td>17</td>\n",
 549 |        "      <td>1</td>\n",
 550 |        "      <td>4.5</td>\n",
 551 |        "      <td>Toy Story (1995)</td>\n",
 552 |        "    </tr>\n",
 553 |        "    <tr>\n",
 554 |        "      <th>5</th>\n",
 555 |        "      <td>18</td>\n",
 556 |        "      <td>1</td>\n",
 557 |        "      <td>3.5</td>\n",
 558 |        "      <td>Toy Story (1995)</td>\n",
 559 |        "    </tr>\n",
 560 |        "    <tr>\n",
 561 |        "      <th>6</th>\n",
 562 |        "      <td>19</td>\n",
 563 |        "      <td>1</td>\n",
 564 |        "      <td>4.0</td>\n",
 565 |        "      <td>Toy Story (1995)</td>\n",
 566 |        "    </tr>\n",
 567 |        "    <tr>\n",
 568 |        "      <th>7</th>\n",
 569 |        "      <td>21</td>\n",
 570 |        "      <td>1</td>\n",
 571 |        "      <td>3.5</td>\n",
 572 |        "      <td>Toy Story (1995)</td>\n",
 573 |        "    </tr>\n",
 574 |        "    <tr>\n",
 575 |        "      <th>8</th>\n",
 576 |        "      <td>27</td>\n",
 577 |        "      <td>1</td>\n",
 578 |        "      <td>3.0</td>\n",
 579 |        "      <td>Toy Story (1995)</td>\n",
 580 |        "    </tr>\n",
 581 |        "    <tr>\n",
 582 |        "      <th>9</th>\n",
 583 |        "      <td>31</td>\n",
 584 |        "      <td>1</td>\n",
 585 |        "      <td>5.0</td>\n",
 586 |        "      <td>Toy Story (1995)</td>\n",
 587 |        "    </tr>\n",
 588 |        "  </tbody>\n",
 589 |        "</table>\n",
 590 |        "</div>"
 591 |       ],
 592 |       "text/plain": [
 593 |        "   userId  movieId  rating             title\n",
 594 |        "0       1        1     4.0  Toy Story (1995)\n",
 595 |        "1       5        1     4.0  Toy Story (1995)\n",
 596 |        "2       7        1     4.5  Toy Story (1995)\n",
 597 |        "3      15        1     2.5  Toy Story (1995)\n",
 598 |        "4      17        1     4.5  Toy Story (1995)\n",
 599 |        "5      18        1     3.5  Toy Story (1995)\n",
 600 |        "6      19        1     4.0  Toy Story (1995)\n",
 601 |        "7      21        1     3.5  Toy Story (1995)\n",
 602 |        "8      27        1     3.0  Toy Story (1995)\n",
 603 |        "9      31        1     5.0  Toy Story (1995)"
 604 |       ]
 605 |      },
 606 |      "execution_count": 31,
 607 |      "metadata": {},
 608 |      "output_type": "execute_result"
 609 |     }
 610 |    ],
 611 |    "source": [
 612 |     "columns = ['timestamp', 'genres']\n",
 613 |     "combine_movie_rating = combine_movie_rating.drop(columns, axis=1)\n",
 614 |     "combine_movie_rating.head(10)"
 615 |    ]
 616 |   },
 617 |   {
 618 |    "cell_type": "code",
 619 |    "execution_count": 32,
 620 |    "metadata": {},
 621 |    "outputs": [
 622 |     {
 623 |      "data": {
 624 |       "text/html": [
 625 |        "<div>\n",
 626 |        "<style scoped>\n",
 627 |        "    .dataframe tbody tr th:only-of-type {\n",
 628 |        "        vertical-align: middle;\n",
 629 |        "    }\n",
 630 |        "\n",
 631 |        "    .dataframe tbody tr th {\n",
 632 |        "        vertical-align: top;\n",
 633 |        "    }\n",
 634 |        "\n",
 635 |        "    .dataframe thead th {\n",
 636 |        "        text-align: right;\n",
 637 |        "    }\n",
 638 |        "</style>\n",
 639 |        "<table border=\"1\" class=\"dataframe\">\n",
 640 |        "  <thead>\n",
 641 |        "    <tr style=\"text-align: right;\">\n",
 642 |        "      <th></th>\n",
 643 |        "      <th>title</th>\n",
 644 |        "      <th>totalRatingCount</th>\n",
 645 |        "    </tr>\n",
 646 |        "  </thead>\n",
 647 |        "  <tbody>\n",
 648 |        "    <tr>\n",
 649 |        "      <th>0</th>\n",
 650 |        "      <td>'71 (2014)</td>\n",
 651 |        "      <td>1</td>\n",
 652 |        "    </tr>\n",
 653 |        "    <tr>\n",
 654 |        "      <th>1</th>\n",
 655 |        "      <td>'Hellboy': The Seeds of Creation (2004)</td>\n",
 656 |        "      <td>1</td>\n",
 657 |        "    </tr>\n",
 658 |        "    <tr>\n",
 659 |        "      <th>2</th>\n",
 660 |        "      <td>'Round Midnight (1986)</td>\n",
 661 |        "      <td>2</td>\n",
 662 |        "    </tr>\n",
 663 |        "    <tr>\n",
 664 |        "      <th>3</th>\n",
 665 |        "      <td>'Salem's Lot (2004)</td>\n",
 666 |        "      <td>1</td>\n",
 667 |        "    </tr>\n",
 668 |        "    <tr>\n",
 669 |        "      <th>4</th>\n",
 670 |        "      <td>'Til There Was You (1997)</td>\n",
 671 |        "      <td>2</td>\n",
 672 |        "    </tr>\n",
 673 |        "    <tr>\n",
 674 |        "      <th>5</th>\n",
 675 |        "      <td>'Tis the Season for Love (2015)</td>\n",
 676 |        "      <td>1</td>\n",
 677 |        "    </tr>\n",
 678 |        "    <tr>\n",
 679 |        "      <th>6</th>\n",
 680 |        "      <td>'burbs, The (1989)</td>\n",
 681 |        "      <td>17</td>\n",
 682 |        "    </tr>\n",
 683 |        "    <tr>\n",
 684 |        "      <th>7</th>\n",
 685 |        "      <td>'night Mother (1986)</td>\n",
 686 |        "      <td>1</td>\n",
 687 |        "    </tr>\n",
 688 |        "    <tr>\n",
 689 |        "      <th>8</th>\n",
 690 |        "      <td>(500) Days of Summer (2009)</td>\n",
 691 |        "      <td>42</td>\n",
 692 |        "    </tr>\n",
 693 |        "    <tr>\n",
 694 |        "      <th>9</th>\n",
 695 |        "      <td>*batteries not included (1987)</td>\n",
 696 |        "      <td>7</td>\n",
 697 |        "    </tr>\n",
 698 |        "  </tbody>\n",
 699 |        "</table>\n",
 700 |        "</div>"
 701 |       ],
 702 |       "text/plain": [
 703 |        "                                     title  totalRatingCount\n",
 704 |        "0                               '71 (2014)                 1\n",
 705 |        "1  'Hellboy': The Seeds of Creation (2004)                 1\n",
 706 |        "2                   'Round Midnight (1986)                 2\n",
 707 |        "3                      'Salem's Lot (2004)                 1\n",
 708 |        "4                'Til There Was You (1997)                 2\n",
 709 |        "5          'Tis the Season for Love (2015)                 1\n",
 710 |        "6                       'burbs, The (1989)                17\n",
 711 |        "7                     'night Mother (1986)                 1\n",
 712 |        "8              (500) Days of Summer (2009)                42\n",
 713 |        "9           *batteries not included (1987)                 7"
 714 |       ]
 715 |      },
 716 |      "execution_count": 32,
 717 |      "metadata": {},
 718 |      "output_type": "execute_result"
 719 |     }
 720 |    ],
 721 |    "source": [
 722 |     "combine_movie_rating = combine_movie_rating.dropna(axis = 0, subset = ['title'])\n",
 723 |     "\n",
 724 |     "movie_ratingCount = (combine_movie_rating.\n",
 725 |     "     groupby(by = ['title'])['rating'].\n",
 726 |     "     count().\n",
 727 |     "     reset_index().\n",
 728 |     "     rename(columns = {'rating': 'totalRatingCount'})\n",
 729 |     "     [['title', 'totalRatingCount']]\n",
 730 |     "    )\n",
 731 |     "movie_ratingCount.head(10)"
 732 |    ]
 733 |   },
 734 |   {
 735 |    "cell_type": "code",
 736 |    "execution_count": 14,
 737 |    "metadata": {},
 738 |    "outputs": [
 739 |     {
 740 |      "data": {
 741 |       "text/html": [
 742 |        "<div>\n",
 743 |        "<style scoped>\n",
 744 |        "    .dataframe tbody tr th:only-of-type {\n",
 745 |        "        vertical-align: middle;\n",
 746 |        "    }\n",
 747 |        "\n",
 748 |        "    .dataframe tbody tr th {\n",
 749 |        "        vertical-align: top;\n",
 750 |        "    }\n",
 751 |        "\n",
 752 |        "    .dataframe thead th {\n",
 753 |        "        text-align: right;\n",
 754 |        "    }\n",
 755 |        "</style>\n",
 756 |        "<table border=\"1\" class=\"dataframe\">\n",
 757 |        "  <thead>\n",
 758 |        "    <tr style=\"text-align: right;\">\n",
 759 |        "      <th></th>\n",
 760 |        "      <th>userId</th>\n",
 761 |        "      <th>movieId</th>\n",
 762 |        "      <th>rating</th>\n",
 763 |        "      <th>timestamp</th>\n",
 764 |        "      <th>title</th>\n",
 765 |        "      <th>genres</th>\n",
 766 |        "      <th>totalRatingCount</th>\n",
 767 |        "    </tr>\n",
 768 |        "  </thead>\n",
 769 |        "  <tbody>\n",
 770 |        "    <tr>\n",
 771 |        "      <th>0</th>\n",
 772 |        "      <td>1</td>\n",
 773 |        "      <td>1</td>\n",
 774 |        "      <td>4.0</td>\n",
 775 |        "      <td>964982703</td>\n",
 776 |        "      <td>Toy Story (1995)</td>\n",
 777 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 778 |        "      <td>215</td>\n",
 779 |        "    </tr>\n",
 780 |        "    <tr>\n",
 781 |        "      <th>1</th>\n",
 782 |        "      <td>5</td>\n",
 783 |        "      <td>1</td>\n",
 784 |        "      <td>4.0</td>\n",
 785 |        "      <td>847434962</td>\n",
 786 |        "      <td>Toy Story (1995)</td>\n",
 787 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 788 |        "      <td>215</td>\n",
 789 |        "    </tr>\n",
 790 |        "    <tr>\n",
 791 |        "      <th>2</th>\n",
 792 |        "      <td>7</td>\n",
 793 |        "      <td>1</td>\n",
 794 |        "      <td>4.5</td>\n",
 795 |        "      <td>1106635946</td>\n",
 796 |        "      <td>Toy Story (1995)</td>\n",
 797 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 798 |        "      <td>215</td>\n",
 799 |        "    </tr>\n",
 800 |        "    <tr>\n",
 801 |        "      <th>3</th>\n",
 802 |        "      <td>15</td>\n",
 803 |        "      <td>1</td>\n",
 804 |        "      <td>2.5</td>\n",
 805 |        "      <td>1510577970</td>\n",
 806 |        "      <td>Toy Story (1995)</td>\n",
 807 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 808 |        "      <td>215</td>\n",
 809 |        "    </tr>\n",
 810 |        "    <tr>\n",
 811 |        "      <th>4</th>\n",
 812 |        "      <td>17</td>\n",
 813 |        "      <td>1</td>\n",
 814 |        "      <td>4.5</td>\n",
 815 |        "      <td>1305696483</td>\n",
 816 |        "      <td>Toy Story (1995)</td>\n",
 817 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 818 |        "      <td>215</td>\n",
 819 |        "    </tr>\n",
 820 |        "    <tr>\n",
 821 |        "      <th>5</th>\n",
 822 |        "      <td>18</td>\n",
 823 |        "      <td>1</td>\n",
 824 |        "      <td>3.5</td>\n",
 825 |        "      <td>1455209816</td>\n",
 826 |        "      <td>Toy Story (1995)</td>\n",
 827 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 828 |        "      <td>215</td>\n",
 829 |        "    </tr>\n",
 830 |        "    <tr>\n",
 831 |        "      <th>6</th>\n",
 832 |        "      <td>19</td>\n",
 833 |        "      <td>1</td>\n",
 834 |        "      <td>4.0</td>\n",
 835 |        "      <td>965705637</td>\n",
 836 |        "      <td>Toy Story (1995)</td>\n",
 837 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 838 |        "      <td>215</td>\n",
 839 |        "    </tr>\n",
 840 |        "    <tr>\n",
 841 |        "      <th>7</th>\n",
 842 |        "      <td>21</td>\n",
 843 |        "      <td>1</td>\n",
 844 |        "      <td>3.5</td>\n",
 845 |        "      <td>1407618878</td>\n",
 846 |        "      <td>Toy Story (1995)</td>\n",
 847 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 848 |        "      <td>215</td>\n",
 849 |        "    </tr>\n",
 850 |        "    <tr>\n",
 851 |        "      <th>8</th>\n",
 852 |        "      <td>27</td>\n",
 853 |        "      <td>1</td>\n",
 854 |        "      <td>3.0</td>\n",
 855 |        "      <td>962685262</td>\n",
 856 |        "      <td>Toy Story (1995)</td>\n",
 857 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 858 |        "      <td>215</td>\n",
 859 |        "    </tr>\n",
 860 |        "    <tr>\n",
 861 |        "      <th>9</th>\n",
 862 |        "      <td>31</td>\n",
 863 |        "      <td>1</td>\n",
 864 |        "      <td>5.0</td>\n",
 865 |        "      <td>850466616</td>\n",
 866 |        "      <td>Toy Story (1995)</td>\n",
 867 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 868 |        "      <td>215</td>\n",
 869 |        "    </tr>\n",
 870 |        "  </tbody>\n",
 871 |        "</table>\n",
 872 |        "</div>"
 873 |       ],
 874 |       "text/plain": [
 875 |        "   userId  movieId  rating   timestamp             title  \\\n",
 876 |        "0       1        1     4.0   964982703  Toy Story (1995)   \n",
 877 |        "1       5        1     4.0   847434962  Toy Story (1995)   \n",
 878 |        "2       7        1     4.5  1106635946  Toy Story (1995)   \n",
 879 |        "3      15        1     2.5  1510577970  Toy Story (1995)   \n",
 880 |        "4      17        1     4.5  1305696483  Toy Story (1995)   \n",
 881 |        "5      18        1     3.5  1455209816  Toy Story (1995)   \n",
 882 |        "6      19        1     4.0   965705637  Toy Story (1995)   \n",
 883 |        "7      21        1     3.5  1407618878  Toy Story (1995)   \n",
 884 |        "8      27        1     3.0   962685262  Toy Story (1995)   \n",
 885 |        "9      31        1     5.0   850466616  Toy Story (1995)   \n",
 886 |        "\n",
 887 |        "                                        genres  totalRatingCount  \n",
 888 |        "0  Adventure|Animation|Children|Comedy|Fantasy               215  \n",
 889 |        "1  Adventure|Animation|Children|Comedy|Fantasy               215  \n",
 890 |        "2  Adventure|Animation|Children|Comedy|Fantasy               215  \n",
 891 |        "3  Adventure|Animation|Children|Comedy|Fantasy               215  \n",
 892 |        "4  Adventure|Animation|Children|Comedy|Fantasy               215  \n",
 893 |        "5  Adventure|Animation|Children|Comedy|Fantasy               215  \n",
 894 |        "6  Adventure|Animation|Children|Comedy|Fantasy               215  \n",
 895 |        "7  Adventure|Animation|Children|Comedy|Fantasy               215  \n",
 896 |        "8  Adventure|Animation|Children|Comedy|Fantasy               215  \n",
 897 |        "9  Adventure|Animation|Children|Comedy|Fantasy               215  "
 898 |       ]
 899 |      },
 900 |      "execution_count": 14,
 901 |      "metadata": {},
 902 |      "output_type": "execute_result"
 903 |     }
 904 |    ],
 905 |    "source": [
 906 |     "rating_with_totalRatingCount = combine_movie_rating.merge(movie_ratingCount, left_on = 'title', right_on = 'title', how = 'left')\n",
 907 |     "rating_with_totalRatingCount.head(10)"
 908 |    ]
 909 |   },
 910 |   {
 911 |    "cell_type": "markdown",
 912 |    "metadata": {},
 913 |    "source": [
 914 |     "### Now drop the duplicate data"
 915 |    ]
 916 |   },
 917 |   {
 918 |    "cell_type": "code",
 919 |    "execution_count": 20,
 920 |    "metadata": {},
 921 |    "outputs": [
 922 |     {
 923 |      "data": {
 924 |       "text/html": [
 925 |        "<div>\n",
 926 |        "<style scoped>\n",
 927 |        "    .dataframe tbody tr th:only-of-type {\n",
 928 |        "        vertical-align: middle;\n",
 929 |        "    }\n",
 930 |        "\n",
 931 |        "    .dataframe tbody tr th {\n",
 932 |        "        vertical-align: top;\n",
 933 |        "    }\n",
 934 |        "\n",
 935 |        "    .dataframe thead th {\n",
 936 |        "        text-align: right;\n",
 937 |        "    }\n",
 938 |        "</style>\n",
 939 |        "<table border=\"1\" class=\"dataframe\">\n",
 940 |        "  <thead>\n",
 941 |        "    <tr style=\"text-align: right;\">\n",
 942 |        "      <th></th>\n",
 943 |        "      <th>userId</th>\n",
 944 |        "      <th>movieId</th>\n",
 945 |        "      <th>rating</th>\n",
 946 |        "      <th>timestamp</th>\n",
 947 |        "      <th>title</th>\n",
 948 |        "      <th>genres</th>\n",
 949 |        "      <th>totalRatingCount</th>\n",
 950 |        "    </tr>\n",
 951 |        "  </thead>\n",
 952 |        "  <tbody>\n",
 953 |        "    <tr>\n",
 954 |        "      <th>0</th>\n",
 955 |        "      <td>1</td>\n",
 956 |        "      <td>1</td>\n",
 957 |        "      <td>4.0</td>\n",
 958 |        "      <td>964982703</td>\n",
 959 |        "      <td>Toy Story (1995)</td>\n",
 960 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 961 |        "      <td>215</td>\n",
 962 |        "    </tr>\n",
 963 |        "    <tr>\n",
 964 |        "      <th>1</th>\n",
 965 |        "      <td>5</td>\n",
 966 |        "      <td>1</td>\n",
 967 |        "      <td>4.0</td>\n",
 968 |        "      <td>847434962</td>\n",
 969 |        "      <td>Toy Story (1995)</td>\n",
 970 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 971 |        "      <td>215</td>\n",
 972 |        "    </tr>\n",
 973 |        "    <tr>\n",
 974 |        "      <th>2</th>\n",
 975 |        "      <td>7</td>\n",
 976 |        "      <td>1</td>\n",
 977 |        "      <td>4.5</td>\n",
 978 |        "      <td>1106635946</td>\n",
 979 |        "      <td>Toy Story (1995)</td>\n",
 980 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 981 |        "      <td>215</td>\n",
 982 |        "    </tr>\n",
 983 |        "    <tr>\n",
 984 |        "      <th>3</th>\n",
 985 |        "      <td>15</td>\n",
 986 |        "      <td>1</td>\n",
 987 |        "      <td>2.5</td>\n",
 988 |        "      <td>1510577970</td>\n",
 989 |        "      <td>Toy Story (1995)</td>\n",
 990 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
 991 |        "      <td>215</td>\n",
 992 |        "    </tr>\n",
 993 |        "    <tr>\n",
 994 |        "      <th>4</th>\n",
 995 |        "      <td>17</td>\n",
 996 |        "      <td>1</td>\n",
 997 |        "      <td>4.5</td>\n",
 998 |        "      <td>1305696483</td>\n",
 999 |        "      <td>Toy Story (1995)</td>\n",
1000 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
1001 |        "      <td>215</td>\n",
1002 |        "    </tr>\n",
1003 |        "    <tr>\n",
1004 |        "      <th>5</th>\n",
1005 |        "      <td>18</td>\n",
1006 |        "      <td>1</td>\n",
1007 |        "      <td>3.5</td>\n",
1008 |        "      <td>1455209816</td>\n",
1009 |        "      <td>Toy Story (1995)</td>\n",
1010 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
1011 |        "      <td>215</td>\n",
1012 |        "    </tr>\n",
1013 |        "    <tr>\n",
1014 |        "      <th>6</th>\n",
1015 |        "      <td>19</td>\n",
1016 |        "      <td>1</td>\n",
1017 |        "      <td>4.0</td>\n",
1018 |        "      <td>965705637</td>\n",
1019 |        "      <td>Toy Story (1995)</td>\n",
1020 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
1021 |        "      <td>215</td>\n",
1022 |        "    </tr>\n",
1023 |        "    <tr>\n",
1024 |        "      <th>7</th>\n",
1025 |        "      <td>21</td>\n",
1026 |        "      <td>1</td>\n",
1027 |        "      <td>3.5</td>\n",
1028 |        "      <td>1407618878</td>\n",
1029 |        "      <td>Toy Story (1995)</td>\n",
1030 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
1031 |        "      <td>215</td>\n",
1032 |        "    </tr>\n",
1033 |        "    <tr>\n",
1034 |        "      <th>8</th>\n",
1035 |        "      <td>27</td>\n",
1036 |        "      <td>1</td>\n",
1037 |        "      <td>3.0</td>\n",
1038 |        "      <td>962685262</td>\n",
1039 |        "      <td>Toy Story (1995)</td>\n",
1040 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
1041 |        "      <td>215</td>\n",
1042 |        "    </tr>\n",
1043 |        "    <tr>\n",
1044 |        "      <th>9</th>\n",
1045 |        "      <td>31</td>\n",
1046 |        "      <td>1</td>\n",
1047 |        "      <td>5.0</td>\n",
1048 |        "      <td>850466616</td>\n",
1049 |        "      <td>Toy Story (1995)</td>\n",
1050 |        "      <td>Adventure|Animation|Children|Comedy|Fantasy</td>\n",
1051 |        "      <td>215</td>\n",
1052 |        "    </tr>\n",
1053 |        "  </tbody>\n",
1054 |        "</table>\n",
1055 |        "</div>"
1056 |       ],
1057 |       "text/plain": [
1058 |        "   userId  movieId  rating   timestamp             title  \\\n",
1059 |        "0       1        1     4.0   964982703  Toy Story (1995)   \n",
1060 |        "1       5        1     4.0   847434962  Toy Story (1995)   \n",
1061 |        "2       7        1     4.5  1106635946  Toy Story (1995)   \n",
1062 |        "3      15        1     2.5  1510577970  Toy Story (1995)   \n",
1063 |        "4      17        1     4.5  1305696483  Toy Story (1995)   \n",
1064 |        "5      18        1     3.5  1455209816  Toy Story (1995)   \n",
1065 |        "6      19        1     4.0   965705637  Toy Story (1995)   \n",
1066 |        "7      21        1     3.5  1407618878  Toy Story (1995)   \n",
1067 |        "8      27        1     3.0   962685262  Toy Story (1995)   \n",
1068 |        "9      31        1     5.0   850466616  Toy Story (1995)   \n",
1069 |        "\n",
1070 |        "                                        genres  totalRatingCount  \n",
1071 |        "0  Adventure|Animation|Children|Comedy|Fantasy               215  \n",
1072 |        "1  Adventure|Animation|Children|Comedy|Fantasy               215  \n",
1073 |        "2  Adventure|Animation|Children|Comedy|Fantasy               215  \n",
1074 |        "3  Adventure|Animation|Children|Comedy|Fantasy               215  \n",
1075 |        "4  Adventure|Animation|Children|Comedy|Fantasy               215  \n",
1076 |        "5  Adventure|Animation|Children|Comedy|Fantasy               215  \n",
1077 |        "6  Adventure|Animation|Children|Comedy|Fantasy               215  \n",
1078 |        "7  Adventure|Animation|Children|Comedy|Fantasy               215  \n",
1079 |        "8  Adventure|Animation|Children|Comedy|Fantasy               215  \n",
1080 |        "9  Adventure|Animation|Children|Comedy|Fantasy               215  "
1081 |       ]
1082 |      },
1083 |      "execution_count": 20,
1084 |      "metadata": {},
1085 |      "output_type": "execute_result"
1086 |     }
1087 |    ],
1088 |    "source": [
1089 |     "user_rating = rating_with_totalRatingCount.drop_duplicates(['userId','title'])\n",
1090 |     "user_rating.head(10)"
1091 |    ]
1092 |   },
1093 |   {
1094 |    "cell_type": "markdown",
1095 |    "metadata": {},
1096 |    "source": [
1097 |     "## Matrix Factorization"
1098 |    ]
1099 |   },
1100 |   {
1101 |    "cell_type": "markdown",
1102 |    "metadata": {},
1103 |    "source": [
1104 |     "### Now create a matrix and fill 0 values  "
1105 |    ]
1106 |   },
1107 |   {
1108 |    "cell_type": "code",
1109 |    "execution_count": 21,
1110 |    "metadata": {},
1111 |    "outputs": [
1112 |     {
1113 |      "data": {
1114 |       "text/html": [
1115 |        "<div>\n",
1116 |        "<style scoped>\n",
1117 |        "    .dataframe tbody tr th:only-of-type {\n",
1118 |        "        vertical-align: middle;\n",
1119 |        "    }\n",
1120 |        "\n",
1121 |        "    .dataframe tbody tr th {\n",
1122 |        "        vertical-align: top;\n",
1123 |        "    }\n",
1124 |        "\n",
1125 |        "    .dataframe thead th {\n",
1126 |        "        text-align: right;\n",
1127 |        "    }\n",
1128 |        "</style>\n",
1129 |        "<table border=\"1\" class=\"dataframe\">\n",
1130 |        "  <thead>\n",
1131 |        "    <tr style=\"text-align: right;\">\n",
1132 |        "      <th>title</th>\n",
1133 |        "      <th>'71 (2014)</th>\n",
1134 |        "      <th>'Hellboy': The Seeds of Creation (2004)</th>\n",
1135 |        "      <th>'Round Midnight (1986)</th>\n",
1136 |        "      <th>'Salem's Lot (2004)</th>\n",
1137 |        "      <th>'Til There Was You (1997)</th>\n",
1138 |        "      <th>'Tis the Season for Love (2015)</th>\n",
1139 |        "      <th>'burbs, The (1989)</th>\n",
1140 |        "      <th>'night Mother (1986)</th>\n",
1141 |        "      <th>(500) Days of Summer (2009)</th>\n",
1142 |        "      <th>*batteries not included (1987)</th>\n",
1143 |        "      <th>...</th>\n",
1144 |        "      <th>Zulu (2013)</th>\n",
1145 |        "      <th>[REC] (2007)</th>\n",
1146 |        "      <th>[REC]² (2009)</th>\n",
1147 |        "      <th>[REC]³ 3 Génesis (2012)</th>\n",
1148 |        "      <th>anohana: The Flower We Saw That Day - The Movie (2013)</th>\n",
1149 |        "      <th>eXistenZ (1999)</th>\n",
1150 |        "      <th>xXx (2002)</th>\n",
1151 |        "      <th>xXx: State of the Union (2005)</th>\n",
1152 |        "      <th>¡Three Amigos! (1986)</th>\n",
1153 |        "      <th>À nous la liberté (Freedom for Us) (1931)</th>\n",
1154 |        "    </tr>\n",
1155 |        "    <tr>\n",
1156 |        "      <th>userId</th>\n",
1157 |        "      <th></th>\n",
1158 |        "      <th></th>\n",
1159 |        "      <th></th>\n",
1160 |        "      <th></th>\n",
1161 |        "      <th></th>\n",
1162 |        "      <th></th>\n",
1163 |        "      <th></th>\n",
1164 |        "      <th></th>\n",
1165 |        "      <th></th>\n",
1166 |        "      <th></th>\n",
1167 |        "      <th></th>\n",
1168 |        "      <th></th>\n",
1169 |        "      <th></th>\n",
1170 |        "      <th></th>\n",
1171 |        "      <th></th>\n",
1172 |        "      <th></th>\n",
1173 |        "      <th></th>\n",
1174 |        "      <th></th>\n",
1175 |        "      <th></th>\n",
1176 |        "      <th></th>\n",
1177 |        "      <th></th>\n",
1178 |        "    </tr>\n",
1179 |        "  </thead>\n",
1180 |        "  <tbody>\n",
1181 |        "    <tr>\n",
1182 |        "      <th>1</th>\n",
1183 |        "      <td>0.0</td>\n",
1184 |        "      <td>0.0</td>\n",
1185 |        "      <td>0.0</td>\n",
1186 |        "      <td>0.0</td>\n",
1187 |        "      <td>0.0</td>\n",
1188 |        "      <td>0.0</td>\n",
1189 |        "      <td>0.0</td>\n",
1190 |        "      <td>0.0</td>\n",
1191 |        "      <td>0.0</td>\n",
1192 |        "      <td>0.0</td>\n",
1193 |        "      <td>...</td>\n",
1194 |        "      <td>0.0</td>\n",
1195 |        "      <td>0.0</td>\n",
1196 |        "      <td>0.0</td>\n",
1197 |        "      <td>0.0</td>\n",
1198 |        "      <td>0.0</td>\n",
1199 |        "      <td>0.0</td>\n",
1200 |        "      <td>0.0</td>\n",
1201 |        "      <td>0.0</td>\n",
1202 |        "      <td>4.0</td>\n",
1203 |        "      <td>0.0</td>\n",
1204 |        "    </tr>\n",
1205 |        "    <tr>\n",
1206 |        "      <th>2</th>\n",
1207 |        "      <td>0.0</td>\n",
1208 |        "      <td>0.0</td>\n",
1209 |        "      <td>0.0</td>\n",
1210 |        "      <td>0.0</td>\n",
1211 |        "      <td>0.0</td>\n",
1212 |        "      <td>0.0</td>\n",
1213 |        "      <td>0.0</td>\n",
1214 |        "      <td>0.0</td>\n",
1215 |        "      <td>0.0</td>\n",
1216 |        "      <td>0.0</td>\n",
1217 |        "      <td>...</td>\n",
1218 |        "      <td>0.0</td>\n",
1219 |        "      <td>0.0</td>\n",
1220 |        "      <td>0.0</td>\n",
1221 |        "      <td>0.0</td>\n",
1222 |        "      <td>0.0</td>\n",
1223 |        "      <td>0.0</td>\n",
1224 |        "      <td>0.0</td>\n",
1225 |        "      <td>0.0</td>\n",
1226 |        "      <td>0.0</td>\n",
1227 |        "      <td>0.0</td>\n",
1228 |        "    </tr>\n",
1229 |        "    <tr>\n",
1230 |        "      <th>3</th>\n",
1231 |        "      <td>0.0</td>\n",
1232 |        "      <td>0.0</td>\n",
1233 |        "      <td>0.0</td>\n",
1234 |        "      <td>0.0</td>\n",
1235 |        "      <td>0.0</td>\n",
1236 |        "      <td>0.0</td>\n",
1237 |        "      <td>0.0</td>\n",
1238 |        "      <td>0.0</td>\n",
1239 |        "      <td>0.0</td>\n",
1240 |        "      <td>0.0</td>\n",
1241 |        "      <td>...</td>\n",
1242 |        "      <td>0.0</td>\n",
1243 |        "      <td>0.0</td>\n",
1244 |        "      <td>0.0</td>\n",
1245 |        "      <td>0.0</td>\n",
1246 |        "      <td>0.0</td>\n",
1247 |        "      <td>0.0</td>\n",
1248 |        "      <td>0.0</td>\n",
1249 |        "      <td>0.0</td>\n",
1250 |        "      <td>0.0</td>\n",
1251 |        "      <td>0.0</td>\n",
1252 |        "    </tr>\n",
1253 |        "    <tr>\n",
1254 |        "      <th>4</th>\n",
1255 |        "      <td>0.0</td>\n",
1256 |        "      <td>0.0</td>\n",
1257 |        "      <td>0.0</td>\n",
1258 |        "      <td>0.0</td>\n",
1259 |        "      <td>0.0</td>\n",
1260 |        "      <td>0.0</td>\n",
1261 |        "      <td>0.0</td>\n",
1262 |        "      <td>0.0</td>\n",
1263 |        "      <td>0.0</td>\n",
1264 |        "      <td>0.0</td>\n",
1265 |        "      <td>...</td>\n",
1266 |        "      <td>0.0</td>\n",
1267 |        "      <td>0.0</td>\n",
1268 |        "      <td>0.0</td>\n",
1269 |        "      <td>0.0</td>\n",
1270 |        "      <td>0.0</td>\n",
1271 |        "      <td>0.0</td>\n",
1272 |        "      <td>0.0</td>\n",
1273 |        "      <td>0.0</td>\n",
1274 |        "      <td>0.0</td>\n",
1275 |        "      <td>0.0</td>\n",
1276 |        "    </tr>\n",
1277 |        "    <tr>\n",
1278 |        "      <th>5</th>\n",
1279 |        "      <td>0.0</td>\n",
1280 |        "      <td>0.0</td>\n",
1281 |        "      <td>0.0</td>\n",
1282 |        "      <td>0.0</td>\n",
1283 |        "      <td>0.0</td>\n",
1284 |        "      <td>0.0</td>\n",
1285 |        "      <td>0.0</td>\n",
1286 |        "      <td>0.0</td>\n",
1287 |        "      <td>0.0</td>\n",
1288 |        "      <td>0.0</td>\n",
1289 |        "      <td>...</td>\n",
1290 |        "      <td>0.0</td>\n",
1291 |        "      <td>0.0</td>\n",
1292 |        "      <td>0.0</td>\n",
1293 |        "      <td>0.0</td>\n",
1294 |        "      <td>0.0</td>\n",
1295 |        "      <td>0.0</td>\n",
1296 |        "      <td>0.0</td>\n",
1297 |        "      <td>0.0</td>\n",
1298 |        "      <td>0.0</td>\n",
1299 |        "      <td>0.0</td>\n",
1300 |        "    </tr>\n",
1301 |        "    <tr>\n",
1302 |        "      <th>6</th>\n",
1303 |        "      <td>0.0</td>\n",
1304 |        "      <td>0.0</td>\n",
1305 |        "      <td>0.0</td>\n",
1306 |        "      <td>0.0</td>\n",
1307 |        "      <td>0.0</td>\n",
1308 |        "      <td>0.0</td>\n",
1309 |        "      <td>0.0</td>\n",
1310 |        "      <td>0.0</td>\n",
1311 |        "      <td>0.0</td>\n",
1312 |        "      <td>0.0</td>\n",
1313 |        "      <td>...</td>\n",
1314 |        "      <td>0.0</td>\n",
1315 |        "      <td>0.0</td>\n",
1316 |        "      <td>0.0</td>\n",
1317 |        "      <td>0.0</td>\n",
1318 |        "      <td>0.0</td>\n",
1319 |        "      <td>0.0</td>\n",
1320 |        "      <td>0.0</td>\n",
1321 |        "      <td>0.0</td>\n",
1322 |        "      <td>0.0</td>\n",
1323 |        "      <td>0.0</td>\n",
1324 |        "    </tr>\n",
1325 |        "    <tr>\n",
1326 |        "      <th>7</th>\n",
1327 |        "      <td>0.0</td>\n",
1328 |        "      <td>0.0</td>\n",
1329 |        "      <td>0.0</td>\n",
1330 |        "      <td>0.0</td>\n",
1331 |        "      <td>0.0</td>\n",
1332 |        "      <td>0.0</td>\n",
1333 |        "      <td>0.0</td>\n",
1334 |        "      <td>0.0</td>\n",
1335 |        "      <td>0.0</td>\n",
1336 |        "      <td>0.0</td>\n",
1337 |        "      <td>...</td>\n",
1338 |        "      <td>0.0</td>\n",
1339 |        "      <td>0.0</td>\n",
1340 |        "      <td>0.0</td>\n",
1341 |        "      <td>0.0</td>\n",
1342 |        "      <td>0.0</td>\n",
1343 |        "      <td>0.0</td>\n",
1344 |        "      <td>0.0</td>\n",
1345 |        "      <td>0.0</td>\n",
1346 |        "      <td>0.0</td>\n",
1347 |        "      <td>0.0</td>\n",
1348 |        "    </tr>\n",
1349 |        "    <tr>\n",
1350 |        "      <th>8</th>\n",
1351 |        "      <td>0.0</td>\n",
1352 |        "      <td>0.0</td>\n",
1353 |        "      <td>0.0</td>\n",
1354 |        "      <td>0.0</td>\n",
1355 |        "      <td>0.0</td>\n",
1356 |        "      <td>0.0</td>\n",
1357 |        "      <td>0.0</td>\n",
1358 |        "      <td>0.0</td>\n",
1359 |        "      <td>0.0</td>\n",
1360 |        "      <td>0.0</td>\n",
1361 |        "      <td>...</td>\n",
1362 |        "      <td>0.0</td>\n",
1363 |        "      <td>0.0</td>\n",
1364 |        "      <td>0.0</td>\n",
1365 |        "      <td>0.0</td>\n",
1366 |        "      <td>0.0</td>\n",
1367 |        "      <td>0.0</td>\n",
1368 |        "      <td>0.0</td>\n",
1369 |        "      <td>0.0</td>\n",
1370 |        "      <td>0.0</td>\n",
1371 |        "      <td>0.0</td>\n",
1372 |        "    </tr>\n",
1373 |        "    <tr>\n",
1374 |        "      <th>9</th>\n",
1375 |        "      <td>0.0</td>\n",
1376 |        "      <td>0.0</td>\n",
1377 |        "      <td>0.0</td>\n",
1378 |        "      <td>0.0</td>\n",
1379 |        "      <td>0.0</td>\n",
1380 |        "      <td>0.0</td>\n",
1381 |        "      <td>0.0</td>\n",
1382 |        "      <td>0.0</td>\n",
1383 |        "      <td>0.0</td>\n",
1384 |        "      <td>0.0</td>\n",
1385 |        "      <td>...</td>\n",
1386 |        "      <td>0.0</td>\n",
1387 |        "      <td>0.0</td>\n",
1388 |        "      <td>0.0</td>\n",
1389 |        "      <td>0.0</td>\n",
1390 |        "      <td>0.0</td>\n",
1391 |        "      <td>0.0</td>\n",
1392 |        "      <td>1.0</td>\n",
1393 |        "      <td>0.0</td>\n",
1394 |        "      <td>0.0</td>\n",
1395 |        "      <td>0.0</td>\n",
1396 |        "    </tr>\n",
1397 |        "    <tr>\n",
1398 |        "      <th>10</th>\n",
1399 |        "      <td>0.0</td>\n",
1400 |        "      <td>0.0</td>\n",
1401 |        "      <td>0.0</td>\n",
1402 |        "      <td>0.0</td>\n",
1403 |        "      <td>0.0</td>\n",
1404 |        "      <td>0.0</td>\n",
1405 |        "      <td>0.0</td>\n",
1406 |        "      <td>0.0</td>\n",
1407 |        "      <td>0.0</td>\n",
1408 |        "      <td>0.0</td>\n",
1409 |        "      <td>...</td>\n",
1410 |        "      <td>0.0</td>\n",
1411 |        "      <td>0.0</td>\n",
1412 |        "      <td>0.0</td>\n",
1413 |        "      <td>0.0</td>\n",
1414 |        "      <td>0.0</td>\n",
1415 |        "      <td>0.0</td>\n",
1416 |        "      <td>0.0</td>\n",
1417 |        "      <td>0.0</td>\n",
1418 |        "      <td>0.0</td>\n",
1419 |        "      <td>0.0</td>\n",
1420 |        "    </tr>\n",
1421 |        "  </tbody>\n",
1422 |        "</table>\n",
1423 |        "<p>10 rows × 9719 columns</p>\n",
1424 |        "</div>"
1425 |       ],
1426 |       "text/plain": [
1427 |        "title   '71 (2014)  'Hellboy': The Seeds of Creation (2004)  \\\n",
1428 |        "userId                                                        \n",
1429 |        "1              0.0                                      0.0   \n",
1430 |        "2              0.0                                      0.0   \n",
1431 |        "3              0.0                                      0.0   \n",
1432 |        "4              0.0                                      0.0   \n",
1433 |        "5              0.0                                      0.0   \n",
1434 |        "6              0.0                                      0.0   \n",
1435 |        "7              0.0                                      0.0   \n",
1436 |        "8              0.0                                      0.0   \n",
1437 |        "9              0.0                                      0.0   \n",
1438 |        "10             0.0                                      0.0   \n",
1439 |        "\n",
1440 |        "title   'Round Midnight (1986)  'Salem's Lot (2004)  \\\n",
1441 |        "userId                                                \n",
1442 |        "1                          0.0                  0.0   \n",
1443 |        "2                          0.0                  0.0   \n",
1444 |        "3                          0.0                  0.0   \n",
1445 |        "4                          0.0                  0.0   \n",
1446 |        "5                          0.0                  0.0   \n",
1447 |        "6                          0.0                  0.0   \n",
1448 |        "7                          0.0                  0.0   \n",
1449 |        "8                          0.0                  0.0   \n",
1450 |        "9                          0.0                  0.0   \n",
1451 |        "10                         0.0                  0.0   \n",
1452 |        "\n",
1453 |        "title   'Til There Was You (1997)  'Tis the Season for Love (2015)  \\\n",
1454 |        "userId                                                               \n",
1455 |        "1                             0.0                              0.0   \n",
1456 |        "2                             0.0                              0.0   \n",
1457 |        "3                             0.0                              0.0   \n",
1458 |        "4                             0.0                              0.0   \n",
1459 |        "5                             0.0                              0.0   \n",
1460 |        "6                             0.0                              0.0   \n",
1461 |        "7                             0.0                              0.0   \n",
1462 |        "8                             0.0                              0.0   \n",
1463 |        "9                             0.0                              0.0   \n",
1464 |        "10                            0.0                              0.0   \n",
1465 |        "\n",
1466 |        "title   'burbs, The (1989)  'night Mother (1986)  (500) Days of Summer (2009)  \\\n",
1467 |        "userId                                                                          \n",
1468 |        "1                      0.0                   0.0                          0.0   \n",
1469 |        "2                      0.0                   0.0                          0.0   \n",
1470 |        "3                      0.0                   0.0                          0.0   \n",
1471 |        "4                      0.0                   0.0                          0.0   \n",
1472 |        "5                      0.0                   0.0                          0.0   \n",
1473 |        "6                      0.0                   0.0                          0.0   \n",
1474 |        "7                      0.0                   0.0                          0.0   \n",
1475 |        "8                      0.0                   0.0                          0.0   \n",
1476 |        "9                      0.0                   0.0                          0.0   \n",
1477 |        "10                     0.0                   0.0                          0.0   \n",
1478 |        "\n",
1479 |        "title   *batteries not included (1987)  \\\n",
1480 |        "userId                                   \n",
1481 |        "1                                  0.0   \n",
1482 |        "2                                  0.0   \n",
1483 |        "3                                  0.0   \n",
1484 |        "4                                  0.0   \n",
1485 |        "5                                  0.0   \n",
1486 |        "6                                  0.0   \n",
1487 |        "7                                  0.0   \n",
1488 |        "8                                  0.0   \n",
1489 |        "9                                  0.0   \n",
1490 |        "10                                 0.0   \n",
1491 |        "\n",
1492 |        "title                     ...                      Zulu (2013)  [REC] (2007)  \\\n",
1493 |        "userId                    ...                                                  \n",
1494 |        "1                         ...                              0.0           0.0   \n",
1495 |        "2                         ...                              0.0           0.0   \n",
1496 |        "3                         ...                              0.0           0.0   \n",
1497 |        "4                         ...                              0.0           0.0   \n",
1498 |        "5                         ...                              0.0           0.0   \n",
1499 |        "6                         ...                              0.0           0.0   \n",
1500 |        "7                         ...                              0.0           0.0   \n",
1501 |        "8                         ...                              0.0           0.0   \n",
1502 |        "9                         ...                              0.0           0.0   \n",
1503 |        "10                        ...                              0.0           0.0   \n",
1504 |        "\n",
1505 |        "title   [REC]² (2009)  [REC]³ 3 Génesis (2012)  \\\n",
1506 |        "userId                                           \n",
1507 |        "1                 0.0                      0.0   \n",
1508 |        "2                 0.0                      0.0   \n",
1509 |        "3                 0.0                      0.0   \n",
1510 |        "4                 0.0                      0.0   \n",
1511 |        "5                 0.0                      0.0   \n",
1512 |        "6                 0.0                      0.0   \n",
1513 |        "7                 0.0                      0.0   \n",
1514 |        "8                 0.0                      0.0   \n",
1515 |        "9                 0.0                      0.0   \n",
1516 |        "10                0.0                      0.0   \n",
1517 |        "\n",
1518 |        "title   anohana: The Flower We Saw That Day - The Movie (2013)  \\\n",
1519 |        "userId                                                           \n",
1520 |        "1                                                     0.0        \n",
1521 |        "2                                                     0.0        \n",
1522 |        "3                                                     0.0        \n",
1523 |        "4                                                     0.0        \n",
1524 |        "5                                                     0.0        \n",
1525 |        "6                                                     0.0        \n",
1526 |        "7                                                     0.0        \n",
1527 |        "8                                                     0.0        \n",
1528 |        "9                                                     0.0        \n",
1529 |        "10                                                    0.0        \n",
1530 |        "\n",
1531 |        "title   eXistenZ (1999)  xXx (2002)  xXx: State of the Union (2005)  \\\n",
1532 |        "userId                                                                \n",
1533 |        "1                   0.0         0.0                             0.0   \n",
1534 |        "2                   0.0         0.0                             0.0   \n",
1535 |        "3                   0.0         0.0                             0.0   \n",
1536 |        "4                   0.0         0.0                             0.0   \n",
1537 |        "5                   0.0         0.0                             0.0   \n",
1538 |        "6                   0.0         0.0                             0.0   \n",
1539 |        "7                   0.0         0.0                             0.0   \n",
1540 |        "8                   0.0         0.0                             0.0   \n",
1541 |        "9                   0.0         1.0                             0.0   \n",
1542 |        "10                  0.0         0.0                             0.0   \n",
1543 |        "\n",
1544 |        "title   ¡Three Amigos! (1986)  À nous la liberté (Freedom for Us) (1931)  \n",
1545 |        "userId                                                                    \n",
1546 |        "1                         4.0                                        0.0  \n",
1547 |        "2                         0.0                                        0.0  \n",
1548 |        "3                         0.0                                        0.0  \n",
1549 |        "4                         0.0                                        0.0  \n",
1550 |        "5                         0.0                                        0.0  \n",
1551 |        "6                         0.0                                        0.0  \n",
1552 |        "7                         0.0                                        0.0  \n",
1553 |        "8                         0.0                                        0.0  \n",
1554 |        "9                         0.0                                        0.0  \n",
1555 |        "10                        0.0                                        0.0  \n",
1556 |        "\n",
1557 |        "[10 rows x 9719 columns]"
1558 |       ]
1559 |      },
1560 |      "execution_count": 21,
1561 |      "metadata": {},
1562 |      "output_type": "execute_result"
1563 |     }
1564 |    ],
1565 |    "source": [
1566 |     "movie_user_rating_pivot = user_rating.pivot(index = 'userId', columns = 'title', values = 'rating').fillna(0)\n",
1567 |     "movie_user_rating_pivot.head(10)"
1568 |    ]
1569 |   },
1570 |   {
1571 |    "cell_type": "code",
1572 |    "execution_count": 22,
1573 |    "metadata": {},
1574 |    "outputs": [
1575 |     {
1576 |      "data": {
1577 |       "text/plain": [
1578 |        "(9719, 610)"
1579 |       ]
1580 |      },
1581 |      "execution_count": 22,
1582 |      "metadata": {},
1583 |      "output_type": "execute_result"
1584 |     }
1585 |    ],
1586 |    "source": [
1587 |     "X = movie_user_rating_pivot.values.T\n",
1588 |     "X.shape"
1589 |    ]
1590 |   },
1591 |   {
1592 |    "cell_type": "markdown",
1593 |    "metadata": {},
1594 |    "source": [
1595 |     "### Now lets fit the model"
1596 |    ]
1597 |   },
1598 |   {
1599 |    "cell_type": "code",
1600 |    "execution_count": 35,
1601 |    "metadata": {},
1602 |    "outputs": [
1603 |     {
1604 |      "data": {
1605 |       "text/plain": [
1606 |        "(9719, 12)"
1607 |       ]
1608 |      },
1609 |      "execution_count": 35,
1610 |      "metadata": {},
1611 |      "output_type": "execute_result"
1612 |     }
1613 |    ],
1614 |    "source": [
1615 |     "import sklearn\n",
1616 |     "from sklearn.decomposition import TruncatedSVD\n",
1617 |     "\n",
1618 |     "SVD = TruncatedSVD(n_components=12, random_state=17)\n",
1619 |     "matrix = SVD.fit_transform(X)\n",
1620 |     "matrix.shape"
1621 |    ]
1622 |   },
1623 |   {
1624 |    "cell_type": "code",
1625 |    "execution_count": 24,
1626 |    "metadata": {},
1627 |    "outputs": [
1628 |     {
1629 |      "data": {
1630 |       "text/plain": [
1631 |        "(9719, 9719)"
1632 |       ]
1633 |      },
1634 |      "execution_count": 24,
1635 |      "metadata": {},
1636 |      "output_type": "execute_result"
1637 |     }
1638 |    ],
1639 |    "source": [
1640 |     "import warnings\n",
1641 |     "warnings.filterwarnings(\"ignore\",category =RuntimeWarning)\n",
1642 |     "corr = np.corrcoef(matrix)\n",
1643 |     "corr.shape"
1644 |    ]
1645 |   },
1646 |   {
1647 |    "cell_type": "markdown",
1648 |    "metadata": {},
1649 |    "source": [
1650 |     "### Now lets check the results"
1651 |    ]
1652 |   },
1653 |   {
1654 |    "cell_type": "code",
1655 |    "execution_count": 27,
1656 |    "metadata": {},
1657 |    "outputs": [],
1658 |    "source": [
1659 |     "movie_title = movie_user_rating_pivot.columns\n",
1660 |     "movie_title_list = list(movie_title)\n",
1661 |     "coffey_hands = movie_title_list.index(\"Guardians of the Galaxy (2014)\")"
1662 |    ]
1663 |   },
1664 |   {
1665 |    "cell_type": "code",
1666 |    "execution_count": 28,
1667 |    "metadata": {},
1668 |    "outputs": [
1669 |     {
1670 |      "data": {
1671 |       "text/plain": [
1672 |        "['Adjustment Bureau, The (2011)',\n",
1673 |        " 'Amazing Spider-Man, The (2012)',\n",
1674 |        " 'Ant-Man (2015)',\n",
1675 |        " 'Avatar (2009)',\n",
1676 |        " 'Avengers, The (2012)',\n",
1677 |        " 'Avengers: Age of Ultron (2015)',\n",
1678 |        " 'Big Hero 6 (2014)',\n",
1679 |        " 'Brave (2012)',\n",
1680 |        " 'Captain America: Civil War (2016)',\n",
1681 |        " 'Captain America: The First Avenger (2011)',\n",
1682 |        " 'Captain America: The Winter Soldier (2014)',\n",
1683 |        " 'Cloud Atlas (2012)',\n",
1684 |        " 'Cloudy with a Chance of Meatballs (2009)',\n",
1685 |        " 'Dark Knight Rises, The (2012)',\n",
1686 |        " 'Deadpool (2016)',\n",
1687 |        " 'Despicable Me (2010)',\n",
1688 |        " 'District 9 (2009)',\n",
1689 |        " 'Django Unchained (2012)',\n",
1690 |        " 'Doctor Strange (2016)',\n",
1691 |        " 'Edge of Tomorrow (2014)',\n",
1692 |        " \"Ender's Game (2013)\",\n",
1693 |        " 'Grand Budapest Hotel, The (2014)',\n",
1694 |        " 'Gravity (2013)',\n",
1695 |        " 'Guardians of the Galaxy (2014)',\n",
1696 |        " 'Guardians of the Galaxy 2 (2017)',\n",
1697 |        " 'Harry Potter and the Deathly Hallows: Part 1 (2010)',\n",
1698 |        " 'Harry Potter and the Deathly Hallows: Part 2 (2011)',\n",
1699 |        " 'Hobbit: An Unexpected Journey, The (2012)',\n",
1700 |        " 'Hobbit: The Desolation of Smaug, The (2013)',\n",
1701 |        " 'How to Train Your Dragon (2010)',\n",
1702 |        " 'Hugo (2011)',\n",
1703 |        " 'Inside Out (2015)',\n",
1704 |        " 'Iron Man (2008)',\n",
1705 |        " 'Iron Man 2 (2010)',\n",
1706 |        " 'Iron Man 3 (2013)',\n",
1707 |        " 'John Wick (2014)',\n",
1708 |        " 'Jurassic World (2015)',\n",
1709 |        " 'Kingsman: The Golden Circle (2017)',\n",
1710 |        " 'Kingsman: The Secret Service (2015)',\n",
1711 |        " 'Kung Fu Panda (2008)',\n",
1712 |        " 'Kung Fu Panda 2 (2011)',\n",
1713 |        " 'Life of Pi (2012)',\n",
1714 |        " 'Logan (2017)',\n",
1715 |        " 'Lone Ranger, The (2013)',\n",
1716 |        " 'Looper (2012)',\n",
1717 |        " 'Mad Max: Fury Road (2015)',\n",
1718 |        " 'Man of Steel (2013)',\n",
1719 |        " 'Maze Runner, The (2014)',\n",
1720 |        " 'Men in Black III (M.III.B.) (M.I.B.³) (2012)',\n",
1721 |        " 'Mission: Impossible - Ghost Protocol (2011)',\n",
1722 |        " 'Now You See Me (2013)',\n",
1723 |        " 'Oblivion (2013)',\n",
1724 |        " 'Pirates of the Caribbean: On Stranger Tides (2011)',\n",
1725 |        " 'Prometheus (2012)',\n",
1726 |        " 'Quantum of Solace (2008)',\n",
1727 |        " 'Rango (2011)',\n",
1728 |        " 'Red (2010)',\n",
1729 |        " 'Rise of the Planet of the Apes (2011)',\n",
1730 |        " 'Rogue One: A Star Wars Story (2016)',\n",
1731 |        " 'Scott Pilgrim vs. the World (2010)',\n",
1732 |        " 'Secret Life of Walter Mitty, The (2013)',\n",
1733 |        " 'Sherlock Holmes (2009)',\n",
1734 |        " 'Sherlock Holmes: A Game of Shadows (2011)',\n",
1735 |        " 'Skyfall (2012)',\n",
1736 |        " 'Star Trek (2009)',\n",
1737 |        " 'Star Trek Into Darkness (2013)',\n",
1738 |        " 'Star Wars: Episode VII - The Force Awakens (2015)',\n",
1739 |        " 'Suicide Squad (2016)',\n",
1740 |        " 'The Expendables 3 (2014)',\n",
1741 |        " 'The Hobbit: The Battle of the Five Armies (2014)',\n",
1742 |        " 'The Hunger Games (2012)',\n",
1743 |        " 'The Hunger Games: Catching Fire (2013)',\n",
1744 |        " 'The Hunger Games: Mockingjay - Part 1 (2014)',\n",
1745 |        " 'The Lego Movie (2014)',\n",
1746 |        " 'The Man from U.N.C.L.E. (2015)',\n",
1747 |        " 'The Martian (2015)',\n",
1748 |        " 'Thor (2011)',\n",
1749 |        " 'Thor: The Dark World (2013)',\n",
1750 |        " 'Toy Story 3 (2010)',\n",
1751 |        " 'Up (2009)',\n",
1752 |        " 'Wolverine, The (2013)',\n",
1753 |        " 'World War Z (2013)',\n",
1754 |        " \"World's End, The (2013)\",\n",
1755 |        " 'Wreck-It Ralph (2012)',\n",
1756 |        " 'X-Men Origins: Wolverine (2009)',\n",
1757 |        " 'X-Men: Days of Future Past (2014)',\n",
1758 |        " 'X-Men: First Class (2011)',\n",
1759 |        " 'Zombieland (2009)',\n",
1760 |        " 'Zootopia (2016)']"
1761 |       ]
1762 |      },
1763 |      "execution_count": 28,
1764 |      "metadata": {},
1765 |      "output_type": "execute_result"
1766 |     }
1767 |    ],
1768 |    "source": [
1769 |     "corr_coffey_hands  = corr[coffey_hands]\n",
1770 |     "list(movie_title[(corr_coffey_hands >= 0.9)])"
1771 |    ]
1772 |   }
1773 |  ],
1774 |  "metadata": {
1775 |   "kernelspec": {
1776 |    "display_name": "Python 3",
1777 |    "language": "python",
1778 |    "name": "python3"
1779 |   },
1780 |   "language_info": {
1781 |    "codemirror_mode": {
1782 |     "name": "ipython",
1783 |     "version": 3
1784 |    },
1785 |    "file_extension": ".py",
1786 |    "mimetype": "text/x-python",
1787 |    "name": "python",
1788 |    "nbconvert_exporter": "python",
1789 |    "pygments_lexer": "ipython3",
1790 |    "version": "3.6.1"
1791 |   }
1792 |  },
1793 |  "nbformat": 4,
1794 |  "nbformat_minor": 2
1795 | }
1796 | 


--------------------------------------------------------------------------------