Starbucks_Capstone_notebook.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Starbucks Capstone Challenge\n",
    "\n",
    "### Introduction\n",
    "\n",
    "This data set contains simulated data that mimics customer behavior on the Starbucks rewards mobile app. Once every few days, Starbucks sends out an offer to users of the mobile app. An offer can be merely an advertisement for a drink or an actual offer such as a discount or BOGO (buy one get one free). Some users might not receive any offer during certain weeks. \n",
    "\n",
    "Not all users receive the same offer, and that is the challenge to solve with this data set.\n",
    "\n",
    "Your task is to combine transaction, demographic and offer data to determine which demographic groups respond best to which offer type. This data set is a simplified version of the real Starbucks app because the underlying simulator only has one product whereas Starbucks actually sells dozens of products.\n",
    "\n",
    "Every offer has a validity period before the offer expires. As an example, a BOGO offer might be valid for only 5 days. You'll see in the data set that informational offers have a validity period even though these ads are merely providing information about a product; for example, if an informational offer has 7 days of validity, you can assume the customer is feeling the influence of the offer for 7 days after receiving the advertisement.\n",
    "\n",
    "You'll be given transactional data showing user purchases made on the app including the timestamp of purchase and the amount of money spent on a purchase. This transactional data also has a record for each offer that a user receives as well as a record for when a user actually views the offer. There are also records for when a user completes an offer. \n",
    "\n",
    "Keep in mind as well that someone using the app might make a purchase through the app without having received an offer or seen an offer.\n",
    "\n",
    "### Example\n",
    "\n",
    "To give an example, a user could receive a discount offer buy 10 dollars get 2 off on Monday. The offer is valid for 10 days from receipt. If the customer accumulates at least 10 dollars in purchases during the validity period, the customer completes the offer.\n",
    "\n",
    "However, there are a few things to watch out for in this data set. Customers do not opt into the offers that they receive; in other words, a user can receive an offer, never actually view the offer, and still complete the offer. For example, a user might receive the \"buy 10 dollars get 2 dollars off offer\", but the user never opens the offer during the 10 day validity period. The customer spends 15 dollars during those ten days. There will be an offer completion record in the data set; however, the customer was not influenced by the offer because the customer never viewed the offer.\n",
    "\n",
    "### Cleaning\n",
    "\n",
    "This makes data cleaning especially important and tricky.\n",
    "\n",
    "You'll also want to take into account that some demographic groups will make purchases even if they don't receive an offer. From a business perspective, if a customer is going to make a 10 dollar purchase without an offer anyway, you wouldn't want to send a buy 10 dollars get 2 dollars off offer. You'll want to try to assess what a certain demographic group will buy when not receiving any offers.\n",
    "\n",
    "### Final Advice\n",
    "\n",
    "Because this is a capstone project, you are free to analyze the data any way you see fit. For example, you could build a machine learning model that predicts how much someone will spend based on demographics and offer type. Or you could build a model that predicts whether or not someone will respond to an offer. Or, you don't need to build a machine learning model at all. You could develop a set of heuristics that determine what offer you should send to each customer (i.e., 75 percent of women customers who were 35 years old responded to offer A vs 40 percent from the same demographic to offer B, so send offer A)."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Data Sets\n",
    "\n",
    "The data is contained in three files:\n",
    "\n",
    "* portfolio.json - containing offer ids and meta data about each offer (duration, type, etc.)\n",
    "* profile.json - demographic data for each customer\n",
    "* transcript.json - records for transactions, offers received, offers viewed, and offers completed\n",
    "\n",
    "Here is the schema and explanation of each variable in the files:\n",
    "\n",
    "**portfolio.json**\n",
    "* id (string) - offer id\n",
    "* offer_type (string) - type of offer ie BOGO, discount, informational\n",
    "* difficulty (int) - minimum required spend to complete an offer\n",
    "* reward (int) - reward given for completing an offer\n",
    "* duration (int) - time for offer to be open, in days\n",
    "* channels (list of strings)\n",
    "\n",
    "**profile.json**\n",
    "* age (int) - age of the customer \n",
    "* became_member_on (int) - date when customer created an app account\n",
    "* gender (str) - gender of the customer (note some entries contain 'O' for other rather than M or F)\n",
    "* id (str) - customer id\n",
    "* income (float) - customer's income\n",
    "\n",
    "**transcript.json**\n",
    "* event (str) - record description (ie transaction, offer received, offer viewed, etc.)\n",
    "* person (str) - customer id\n",
    "* time (int) - time in hours since start of test. The data begins at time t=0\n",
    "* value - (dict of strings) - either an offer id or transaction amount depending on the record\n",
    "\n",
    "**Note:** If you are using the workspace, you will need to go to the terminal and run the command `conda update pandas` before reading in the files. This is because the version of pandas in the workspace cannot read in the transcript.json file correctly, but the newest version of pandas can. You can access the termnal from the orange icon in the top left of this notebook.  \n",
    "\n",
    "You can see how to access the terminal and how the install works using the two images below.  First you need to access the terminal:\n",
    "\n",
    "<img src=\"pic1.png\"/>\n",
    "\n",
    "Then you will want to run the above command:\n",
    "\n",
    "<img src=\"pic2.png\"/>\n",
    "\n",
    "Finally, when you enter back into the notebook (use the jupyter icon again), you should be able to run the below cell without any errors."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import datetime\n",
    "import pickle\n",
    "import matplotlib.pyplot as plt"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "import numpy as np\n",
    "import math\n",
    "import json\n",
    "% matplotlib inline\n",
    "\n",
    "# read in the json files\n",
    "portfolio = pd.read_json('data/portfolio.json', orient='records', lines=True)\n",
    "profile = pd.read_json('data/profile.json', orient='records', lines=True)\n",
    "transcript = pd.read_json('data/transcript.json', orient='records', lines=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 244,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>channels</th>\n",
       "      <th>difficulty</th>\n",
       "      <th>duration</th>\n",
       "      <th>id</th>\n",
       "      <th>offer_type</th>\n",
       "      <th>reward</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>[email, mobile, social]</td>\n",
       "      <td>10</td>\n",
       "      <td>7</td>\n",
       "      <td>ae264e3637204a6fb9bb56bc8210ddfd</td>\n",
       "      <td>bogo</td>\n",
       "      <td>10</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>[web, email, mobile, social]</td>\n",
       "      <td>10</td>\n",
       "      <td>5</td>\n",
       "      <td>4d5c57ea9a6940dd891ad53e9dbe8da0</td>\n",
       "      <td>bogo</td>\n",
       "      <td>10</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>[web, email, mobile]</td>\n",
       "      <td>0</td>\n",
       "      <td>4</td>\n",
       "      <td>3f207df678b143eea3cee63160fa8bed</td>\n",
       "      <td>informational</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>[web, email, mobile]</td>\n",
       "      <td>5</td>\n",
       "      <td>7</td>\n",
       "      <td>9b98b8c7a33c4b65b9aebfe6a799e6d9</td>\n",
       "      <td>bogo</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>[web, email]</td>\n",
       "      <td>20</td>\n",
       "      <td>10</td>\n",
       "      <td>0b1e1539f2cc45b7b9fa7c272da2e1d7</td>\n",
       "      <td>discount</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>[web, email, mobile, social]</td>\n",
       "      <td>7</td>\n",
       "      <td>7</td>\n",
       "      <td>2298d6c36e964ae4a3e7e9706d1fb8c2</td>\n",
       "      <td>discount</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>[web, email, mobile, social]</td>\n",
       "      <td>10</td>\n",
       "      <td>10</td>\n",
       "      <td>fafdcd668e3743c1bb461111dcafc2a4</td>\n",
       "      <td>discount</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>[email, mobile, social]</td>\n",
       "      <td>0</td>\n",
       "      <td>3</td>\n",
       "      <td>5a8bc65990b245e5a138643cd4eb9837</td>\n",
       "      <td>informational</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>[web, email, mobile, social]</td>\n",
       "      <td>5</td>\n",
       "      <td>5</td>\n",
       "      <td>f19421c1d4aa40978ebb69ca19b0e20d</td>\n",
       "      <td>bogo</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>[web, email, mobile]</td>\n",
       "      <td>10</td>\n",
       "      <td>7</td>\n",
       "      <td>2906b810c7d4411798c6938adc9daaa5</td>\n",
       "      <td>discount</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                       channels  difficulty  duration  \\\n",
       "0       [email, mobile, social]          10         7   \n",
       "1  [web, email, mobile, social]          10         5   \n",
       "2          [web, email, mobile]           0         4   \n",
       "3          [web, email, mobile]           5         7   \n",
       "4                  [web, email]          20        10   \n",
       "5  [web, email, mobile, social]           7         7   \n",
       "6  [web, email, mobile, social]          10        10   \n",
       "7       [email, mobile, social]           0         3   \n",
       "8  [web, email, mobile, social]           5         5   \n",
       "9          [web, email, mobile]          10         7   \n",
       "\n",
       "                                 id     offer_type  reward  \n",
       "0  ae264e3637204a6fb9bb56bc8210ddfd           bogo      10  \n",
       "1  4d5c57ea9a6940dd891ad53e9dbe8da0           bogo      10  \n",
       "2  3f207df678b143eea3cee63160fa8bed  informational       0  \n",
       "3  9b98b8c7a33c4b65b9aebfe6a799e6d9           bogo       5  \n",
       "4  0b1e1539f2cc45b7b9fa7c272da2e1d7       discount       5  \n",
       "5  2298d6c36e964ae4a3e7e9706d1fb8c2       discount       3  \n",
       "6  fafdcd668e3743c1bb461111dcafc2a4       discount       2  \n",
       "7  5a8bc65990b245e5a138643cd4eb9837  informational       0  \n",
       "8  f19421c1d4aa40978ebb69ca19b0e20d           bogo       5  \n",
       "9  2906b810c7d4411798c6938adc9daaa5       discount       2  "
      ]
     },
     "execution_count": 244,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# explore the portfolio\n",
    "portfolio"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "def clean_portfolio(portfolio):\n",
    "    '''\n",
    "    data cleaning the portfolio dataframe\n",
    "    \n",
    "    INPUT:\n",
    "    portfolio - the portfolio dataframe to be cleaned\n",
    "    \n",
    "    OUTPUT:\n",
    "    portfolio - the cleaned portfolio dataframe\n",
    "    \n",
    "    '''\n",
    "    # change the duration from day to hour\n",
    "    cleaned_portfolio = portfolio.copy()\n",
    "    cleaned_portfolio['duration'] = cleaned_portfolio['duration'] * 24\n",
    "    \n",
    "    # apply one hot encoding to channels column\n",
    "    cleaned_portfolio['web'] = cleaned_portfolio['channels'].apply(lambda x: 1 if 'web' in x else 0)\n",
    "    cleaned_portfolio['email'] = cleaned_portfolio['channels'].apply(lambda x: 1 if 'email' in x else 0)\n",
    "    cleaned_portfolio['mobile'] = cleaned_portfolio['channels'].apply(lambda x: 1 if 'mobile' in x else 0)\n",
    "    cleaned_portfolio['social'] = cleaned_portfolio['channels'].apply(lambda x: 1 if 'social' in x else 0)\n",
    "    \n",
    "    # apply one hot encoding to offer_type column\n",
    "    offer_type = pd.get_dummies(cleaned_portfolio['offer_type'])\n",
    "    \n",
    "    # drop the channels and offer_type column\n",
    "    cleaned_portfolio.drop(['channels', 'offer_type'], axis=1, inplace=True)\n",
    "    \n",
    "    # combine the portfolio and offer_type dataframe to form a cleaned dataframe\n",
    "    cleaned_portfolio = pd.concat([cleaned_portfolio, offer_type], axis=1, sort=False)\n",
    "    \n",
    "    return cleaned_portfolio"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "cleaned_portfolio = clean_portfolio(portfolio)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 316,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>difficulty</th>\n",
       "      <th>duration</th>\n",
       "      <th>id</th>\n",
       "      <th>reward</th>\n",
       "      <th>web</th>\n",
       "      <th>email</th>\n",
       "      <th>mobile</th>\n",
       "      <th>social</th>\n",
       "      <th>bogo</th>\n",
       "      <th>discount</th>\n",
       "      <th>informational</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>10</td>\n",
       "      <td>168</td>\n",
       "      <td>ae264e3637204a6fb9bb56bc8210ddfd</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>10</td>\n",
       "      <td>120</td>\n",
       "      <td>4d5c57ea9a6940dd891ad53e9dbe8da0</td>\n",
       "      <td>10</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0</td>\n",
       "      <td>96</td>\n",
       "      <td>3f207df678b143eea3cee63160fa8bed</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>5</td>\n",
       "      <td>168</td>\n",
       "      <td>9b98b8c7a33c4b65b9aebfe6a799e6d9</td>\n",
       "      <td>5</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>20</td>\n",
       "      <td>240</td>\n",
       "      <td>0b1e1539f2cc45b7b9fa7c272da2e1d7</td>\n",
       "      <td>5</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>7</td>\n",
       "      <td>168</td>\n",
       "      <td>2298d6c36e964ae4a3e7e9706d1fb8c2</td>\n",
       "      <td>3</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>10</td>\n",
       "      <td>240</td>\n",
       "      <td>fafdcd668e3743c1bb461111dcafc2a4</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>0</td>\n",
       "      <td>72</td>\n",
       "      <td>5a8bc65990b245e5a138643cd4eb9837</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>5</td>\n",
       "      <td>120</td>\n",
       "      <td>f19421c1d4aa40978ebb69ca19b0e20d</td>\n",
       "      <td>5</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>10</td>\n",
       "      <td>168</td>\n",
       "      <td>2906b810c7d4411798c6938adc9daaa5</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   difficulty  duration                                id  reward  web  email  \\\n",
       "0          10       168  ae264e3637204a6fb9bb56bc8210ddfd      10    0      1   \n",
       "1          10       120  4d5c57ea9a6940dd891ad53e9dbe8da0      10    1      1   \n",
       "2           0        96  3f207df678b143eea3cee63160fa8bed       0    1      1   \n",
       "3           5       168  9b98b8c7a33c4b65b9aebfe6a799e6d9       5    1      1   \n",
       "4          20       240  0b1e1539f2cc45b7b9fa7c272da2e1d7       5    1      1   \n",
       "5           7       168  2298d6c36e964ae4a3e7e9706d1fb8c2       3    1      1   \n",
       "6          10       240  fafdcd668e3743c1bb461111dcafc2a4       2    1      1   \n",
       "7           0        72  5a8bc65990b245e5a138643cd4eb9837       0    0      1   \n",
       "8           5       120  f19421c1d4aa40978ebb69ca19b0e20d       5    1      1   \n",
       "9          10       168  2906b810c7d4411798c6938adc9daaa5       2    1      1   \n",
       "\n",
       "   mobile  social  bogo  discount  informational  \n",
       "0       1       1     1         0              0  \n",
       "1       1       1     1         0              0  \n",
       "2       1       0     0         0              1  \n",
       "3       1       0     1         0              0  \n",
       "4       0       0     0         1              0  \n",
       "5       1       1     0         1              0  \n",
       "6       1       1     0         1              0  \n",
       "7       1       1     0         0              1  \n",
       "8       1       1     1         0              0  \n",
       "9       1       0     0         1              0  "
      ]
     },
     "execution_count": 316,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cleaned_portfolio"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 248,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>age</th>\n",
       "      <th>became_member_on</th>\n",
       "      <th>gender</th>\n",
       "      <th>id</th>\n",
       "      <th>income</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>118</td>\n",
       "      <td>20170212</td>\n",
       "      <td>None</td>\n",
       "      <td>68be06ca386d4c31939f3a4f0e3dd783</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>55</td>\n",
       "      <td>20170715</td>\n",
       "      <td>F</td>\n",
       "      <td>0610b486422d4921ae7d2bf64640c50b</td>\n",
       "      <td>112000.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>118</td>\n",
       "      <td>20180712</td>\n",
       "      <td>None</td>\n",
       "      <td>38fe809add3b4fcf9315a9694bb96ff5</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>75</td>\n",
       "      <td>20170509</td>\n",
       "      <td>F</td>\n",
       "      <td>78afa995795e4d85b5d9ceeca43f5fef</td>\n",
       "      <td>100000.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>118</td>\n",
       "      <td>20170804</td>\n",
       "      <td>None</td>\n",
       "      <td>a03223e636434f42ac4c3df47e8bac43</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   age  became_member_on gender                                id    income\n",
       "0  118          20170212   None  68be06ca386d4c31939f3a4f0e3dd783       NaN\n",
       "1   55          20170715      F  0610b486422d4921ae7d2bf64640c50b  112000.0\n",
       "2  118          20180712   None  38fe809add3b4fcf9315a9694bb96ff5       NaN\n",
       "3   75          20170509      F  78afa995795e4d85b5d9ceeca43f5fef  100000.0\n",
       "4  118          20170804   None  a03223e636434f42ac4c3df47e8bac43       NaN"
      ]
     },
     "execution_count": 248,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# explore the profile \n",
    "profile.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 249,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(17000, 5)"
      ]
     },
     "execution_count": 249,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "profile.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "def clean_profile(profile):\n",
    "    '''\n",
    "    data cleaning the profile dataframe\n",
    "    \n",
    "    INPUT:\n",
    "    profile - the profile dataframe to be cleaned\n",
    "    \n",
    "    OUTPUT:\n",
    "    profile - the cleaned profile dataframe\n",
    "    \n",
    "    '''\n",
    "    # age: (numeric) missing value encoded as 118\n",
    "    profile['age'] = profile['age'].apply(lambda x: np.nan if x == 118 else x)\n",
    "    \n",
    "    # drop all missing values\n",
    "    profile.dropna(inplace=True)\n",
    "    \n",
    "    # the number of days since the user is a memeber of starbucks\n",
    "    profile['memberdays'] = datetime.datetime.today().date() - pd.to_datetime(profile['became_member_on'], format='%Y%m%d').dt.date\n",
    "    profile['memberdays'] = profile['memberdays'].dt.days\n",
    "    \n",
    "    \n",
    "    return profile\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "cleaned_profile = clean_profile(profile)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 252,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>age</th>\n",
       "      <th>became_member_on</th>\n",
       "      <th>gender</th>\n",
       "      <th>id</th>\n",
       "      <th>income</th>\n",
       "      <th>memberdays</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>55.0</td>\n",
       "      <td>20170715</td>\n",
       "      <td>F</td>\n",
       "      <td>0610b486422d4921ae7d2bf64640c50b</td>\n",
       "      <td>112000.0</td>\n",
       "      <td>683</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>75.0</td>\n",
       "      <td>20170509</td>\n",
       "      <td>F</td>\n",
       "      <td>78afa995795e4d85b5d9ceeca43f5fef</td>\n",
       "      <td>100000.0</td>\n",
       "      <td>750</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>68.0</td>\n",
       "      <td>20180426</td>\n",
       "      <td>M</td>\n",
       "      <td>e2127556f4f64592b11af22de27a7932</td>\n",
       "      <td>70000.0</td>\n",
       "      <td>398</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>65.0</td>\n",
       "      <td>20180209</td>\n",
       "      <td>M</td>\n",
       "      <td>389bc3fa690240e798340f5a15918d5c</td>\n",
       "      <td>53000.0</td>\n",
       "      <td>474</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>58.0</td>\n",
       "      <td>20171111</td>\n",
       "      <td>M</td>\n",
       "      <td>2eeac8d8feae4a8cad5a6af0499a211d</td>\n",
       "      <td>51000.0</td>\n",
       "      <td>564</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "     age  became_member_on gender                                id    income  \\\n",
       "1   55.0          20170715      F  0610b486422d4921ae7d2bf64640c50b  112000.0   \n",
       "3   75.0          20170509      F  78afa995795e4d85b5d9ceeca43f5fef  100000.0   \n",
       "5   68.0          20180426      M  e2127556f4f64592b11af22de27a7932   70000.0   \n",
       "8   65.0          20180209      M  389bc3fa690240e798340f5a15918d5c   53000.0   \n",
       "12  58.0          20171111      M  2eeac8d8feae4a8cad5a6af0499a211d   51000.0   \n",
       "\n",
       "    memberdays  \n",
       "1          683  \n",
       "3          750  \n",
       "5          398  \n",
       "8          474  \n",
       "12         564  "
      ]
     },
     "execution_count": 252,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cleaned_profile.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 253,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>age</th>\n",
       "      <th>became_member_on</th>\n",
       "      <th>income</th>\n",
       "      <th>memberdays</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>count</th>\n",
       "      <td>14825.000000</td>\n",
       "      <td>1.482500e+04</td>\n",
       "      <td>14825.000000</td>\n",
       "      <td>14825.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>mean</th>\n",
       "      <td>54.393524</td>\n",
       "      <td>2.016689e+07</td>\n",
       "      <td>65404.991568</td>\n",
       "      <td>829.478988</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>std</th>\n",
       "      <td>17.383705</td>\n",
       "      <td>1.188565e+04</td>\n",
       "      <td>21598.299410</td>\n",
       "      <td>419.205158</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>min</th>\n",
       "      <td>18.000000</td>\n",
       "      <td>2.013073e+07</td>\n",
       "      <td>30000.000000</td>\n",
       "      <td>307.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25%</th>\n",
       "      <td>42.000000</td>\n",
       "      <td>2.016052e+07</td>\n",
       "      <td>49000.000000</td>\n",
       "      <td>515.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>50%</th>\n",
       "      <td>55.000000</td>\n",
       "      <td>2.017080e+07</td>\n",
       "      <td>64000.000000</td>\n",
       "      <td>665.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>75%</th>\n",
       "      <td>66.000000</td>\n",
       "      <td>2.017123e+07</td>\n",
       "      <td>80000.000000</td>\n",
       "      <td>1104.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>max</th>\n",
       "      <td>101.000000</td>\n",
       "      <td>2.018073e+07</td>\n",
       "      <td>120000.000000</td>\n",
       "      <td>2130.000000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                age  became_member_on         income    memberdays\n",
       "count  14825.000000      1.482500e+04   14825.000000  14825.000000\n",
       "mean      54.393524      2.016689e+07   65404.991568    829.478988\n",
       "std       17.383705      1.188565e+04   21598.299410    419.205158\n",
       "min       18.000000      2.013073e+07   30000.000000    307.000000\n",
       "25%       42.000000      2.016052e+07   49000.000000    515.000000\n",
       "50%       55.000000      2.017080e+07   64000.000000    665.000000\n",
       "75%       66.000000      2.017123e+07   80000.000000   1104.000000\n",
       "max      101.000000      2.018073e+07  120000.000000   2130.000000"
      ]
     },
     "execution_count": 253,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cleaned_profile.describe()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 254,
   "metadata": {},
   "outputs": [],
   "source": [
    "def display_customer_profile():\n",
    "    '''Display customer profile with histograms'''\n",
    "    \n",
    "    # Display Histogram of Customer Age\n",
    "    user_age = cleaned_profile['age'].plot(kind='hist', bins=20, title='Distribution of Customer Age')\n",
    "    user_age.set_xlabel(\"Customer Age\")\n",
    "       \n",
    "    # Display Histogram of the days being member\n",
    "    plt.figure()\n",
    "    memberdays = cleaned_profile['memberdays'].plot(kind='hist', bins=50, title='How long did the users become our members?')\n",
    "    memberdays.set_xlabel(\"Days\")\n",
    "    \n",
    "    # Display Histogram of User Income\n",
    "    plt.figure()\n",
    "    user_income = cleaned_profile['income'].plot(kind='hist', bins=20, title='Distribution of Customer Income')\n",
    "    user_income.set_xlabel(\"Income\")\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 255,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAY4AAAEWCAYAAABxMXBSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvhp/UCwAAH0tJREFUeJzt3XuYHFW57/HvjwQINwkhATEJDGAUIkchhssWVDSA3INuQBAlIpjjEa94C8gWtsI2PF5Qt24wQiSAgoggEaMYgYgc5RIuAuEiMcRkSCADgSQQIATe/cdaLZ1Jz0zXTPd0z8zv8zz9dNWqVVXvVDr99qpatUoRgZmZWbU2aHQAZmbWtzhxmJlZIU4cZmZWiBOHmZkV4sRhZmaFOHGYmVkhThzWbZIulPQfNdrW9pKekzQoz8+RdEottp239ztJk2q1vQL7PUfSU5Ke6O19m9WLE4dVJGmhpBckrZL0rKS/SPqEpH99ZiLiExHxjSq3dUBndSJiUURsHhGv1CD2syVd3m77h0TEjJ5uu2Aco4EvAGMj4vUd1HmdpO9JWpQT5/w8P7yH++7ymDeD/APhGUkbNzoWq54Th3XmiIjYAtgBmAp8Bbi41juRNLjW22wSOwBPR8SySgslbQTcCLwFOBh4HfAO4Glgr94Ksp6UVPyekdQCvBMI4MheDMt6KiL88mu9F7AQOKBd2V7Aq8Buef4S4Jw8PRy4HngWWA78mfTD5LK8zgvAc8CXgRbSl8XJwCLglrKywXl7c4BvAncAK4DrgGF52f5Aa6V4SV/Aa4CX8/7+Vra9U/L0BsCZwD+BZcClwJZ5WSmOSTm2p4CvdnKctszrt+XtnZm3f0D+m1/NcVxSYd1TgCeBzTvZfgBvLJvv1jHP9Y8E5uX6c4Bd2x2/LwH3Ac+TfiBsC/wOWAX8EdiqrP4+wF/ytv4G7F+2bA5wLvD/cwxv7OBv+1qu813g+nbLtgZ+A6wE7gTOAW4tW74LMDv/3Y8Axzb6/8xAejU8AL+a80WFxJHLFwH/L0+Xf4l9E7gQ2DC/3gmo0rbKvpwvBTYDNqFy4ngc2C3X+RVweV62Px0kjjx9dqlu2fI5vJY4PgbMB3YCNgeuAS5rF9tPclxvA14q/5Jtt91LSUlti7zu34GTO4qz3bpXAjO6+HfoLHEUOeZvIiWEA3PdL+djsFFZ/dtIyWIkKaHeDewBbAzcBJyV644ktYoOJSWqA/P8iLJjvYjUkhoMbNjB3zYf+CTwdlKi37bdsbkS2BQYCywmJ478eVgMnJS3P46U4N/S6P83A+XlU1VW1BJgWIXyl4HtgB0i4uWI+HPk/+WdODsino+IFzpYfllEPBARzwP/ARxbunjeQycA342IBRHxHHA6cFy7U2b/GREvRMTfSL+o39Z+IzmWDwKnR8SqiFgIfAf4SJVxbA0s7cHfUeSYfxD4bUTMjoiXgW+TEuM7yur8d0Q8GRGPk1ovt0fEPRHxEnAtKYkAfBiYFRGzIuLViJgNzCUlkpJLImJeRKzN+1uHpP1Ip/Kuioi7gH8AH8rLBgH/TkpUqyPiQaD8+tThwMKI+Gne/t2kHxZHV3fYrKecOKyokaTTA+19i/QL8g+SFkiaUsW2FhdY/k/SL+UeXTTO3pC3V77twaRf2yXlvaBWk1om7Q0HNqqwrZFVxvE06Yu/u4oc83X+5oh4lXR8y2N9smz6hQrzpWOwA3BM7jTxrKRngf1Y92/p6t92EvCHiHgqz/88lwGMIP17lG+jfHoHYO92+z8BqNgBwWqvv16UtDqQtCfpi+bW9ssiYhWpB9EXJL0FuFnSnRFxI+l0SyVdtUhGl01vT/qF/RTplMumZXENIn3ZVLvdJaQvn/JtryV9UY7qYt1yT+WYdgAeLNvW41Wu/0fgHEmb5VZVJasp+1tJX46tUPiYLwH+T2lGkkjHt9pYyy0mtQY/3kmdDv8NJG0CHAsMKuumvDEwVNLbgAdI/x6jSKf+YN3PwmLgTxFxYDditxpwi8O6lLuMHk4653x5RNxfoc7hkt6Yv5BWAq/kF6Qv5J26sesPSxoraVPg68DVkbrr/h0YIukwSRuSLkiXd+d8EmjpqDcPcAXweUk7Stoc+C/gFxGxtkhwOZargHMlbSFpB+A04PLO1/yXy0hfgr+StIukDSRtLekMSaXTPvcCH5I0SNLBwLtLKxc85lcBh0makI/ZF0jXbv5S5G/OLgeOkPS+HNcQSftLqjbpHpXjHAvsnl+7kk6PnZiP6zXA2ZI2lbQLcGLZ+tcDb5L0EUkb5teeknbtxt9i3eDEYZ35jaRVpC+3r5J6v5zUQd0xpF/QzwF/Bf4nIubkZd8EzsynFb5YYP+XkS4GPwEMAT4DEBErSBdVLyL9Yn6e/Cs8+2V+f1rS3RW2Oz1v+xbgMeBF4NMF4ir36bz/BaSW2M/z9ruUrx0cADxM6iG0ktSLbDhwe672WeAIUu+lE4Bfl22i6mMeEY+Qrk38N6mldASpu/Waon9wRCwGJgJnkHqTLSb1yKr2+2QS8NNI9+48UXoBPwROyNeaPkXqsfYE6d/qClKiK7W0DgKOI7WkngDOY90fD1ZHpR4YZmZNS9J5wOsjotfv/rf1ucVhZk0nn7p7a76BcC/SPT/XNjouS3xx3Mya0Rak01NvIN1T8h3S/TLWBHyqyszMCvGpKjMzK6RfnqoaPnx4tLS0NDoMM7M+5a677noqIkZ0Va9fJo6Wlhbmzp3b6DDMzPoUSf/supZPVZmZWUFOHGZmVogTh5mZFeLEYWZmhThxmJlZIU4cZmZWiBOHmZkV4sRhZmaFOHGYmVkh/fLOcbN6a5ny226vu3DqYTWMxKz3ucVhZmaFOHGYmVkhThxmZlaIr3HYgNSTaxRmA13dWhySpktaJumBCsu+KCkkDc/zkvQDSfMl3SdpXFndSZIezS8/qN7MrMHqearqEuDg9oWSRgMHAovKig8BxuTXZOCCXHcYcBawN7AXcJakreoYs5mZdaFuiSMibgGWV1h0PvBloPxh5xOBSyO5DRgqaTvgfcDsiFgeEc8As6mQjMzMrPf06sVxSUcCj0fE39otGgksLptvzWUdlVfa9mRJcyXNbWtrq2HUZmZWrtcSh6RNga8CX6u0uEJZdFK+fmHEtIgYHxHjR4zo8pG5ZmbWTb3Z4tgZ2BH4m6SFwCjgbkmvJ7UkRpfVHQUs6aTczMwapNcSR0TcHxHbRERLRLSQksK4iHgCmAmcmHtX7QOsiIilwA3AQZK2yhfFD8plZmbWIPXsjnsF8FfgzZJaJZ3cSfVZwAJgPvAT4JMAEbEc+AZwZ359PZeZmVmD1O0GwIg4vovlLWXTAZzaQb3pwPSaBmdmZt3mIUfMzKwQJw4zMyvEicPMzApx4jAzs0KcOMzMrBAnDjMzK8SJw8zMCnHiMDOzQpw4zMysED861qyX9eSxtQunHlbDSMy6xy0OMzMrxInDzMwKceIwM7NCnDjMzKwQJw4zMyvEvaqsz+pJ7yQz6z63OMzMrBAnDjMzK8SJw8zMCnHiMDOzQuqWOCRNl7RM0gNlZd+S9LCk+yRdK2lo2bLTJc2X9Iik95WVH5zL5kuaUq94zcysOvVscVwCHNyubDawW0S8Ffg7cDqApLHAccBb8jr/I2mQpEHAj4BDgLHA8bmumZk1SN0SR0TcAixvV/aHiFibZ28DRuXpicCVEfFSRDwGzAf2yq/5EbEgItYAV+a6ZmbWII28xvEx4Hd5eiSwuGxZay7rqHw9kiZLmitpbltbWx3CNTMzaNANgJK+CqwFflYqqlAtqJzYotI2I2IaMA1g/PjxFeuY9XUekt2aQa8nDkmTgMOBCRFR+oJvBUaXVRsFLMnTHZWbmVkD9OqpKkkHA18BjoyI1WWLZgLHSdpY0o7AGOAO4E5gjKQdJW1EuoA+szdjNjOzddWtxSHpCmB/YLikVuAsUi+qjYHZkgBui4hPRMQ8SVcBD5JOYZ0aEa/k7XwKuAEYBEyPiHn1itnMzLpWt8QREcdXKL64k/rnAudWKJ8FzKphaGZm1gO+c9zMzApx4jAzs0KcOMzMrBAnDjMzK8SJw8zMCnHiMDOzQpw4zMysECcOMzMrxInDzMwKceIwM7NCnDjMzKyQhjyPw6ykJ8+XMLPGcIvDzMwKceIwM7NCnDjMzKwQJw4zMyvEicPMzApx4jAzs0KcOMzMrJC6JQ5J0yUtk/RAWdkwSbMlPZrft8rlkvQDSfMl3SdpXNk6k3L9RyVNqle8ZmZWnXq2OC4BDm5XNgW4MSLGADfmeYBDgDH5NRm4AFKiAc4C9gb2As4qJRszM2uMuiWOiLgFWN6ueCIwI0/PAI4qK780ktuAoZK2A94HzI6I5RHxDDCb9ZORmZn1ot6+xrFtRCwFyO/b5PKRwOKyeq25rKPy9UiaLGmupLltbW01D9zMzJJmuTiuCmXRSfn6hRHTImJ8RIwfMWJETYMzM7PX9HbieDKfgiK/L8vlrcDosnqjgCWdlJuZWYP09ui4M4FJwNT8fl1Z+ackXUm6EL4iIpZKugH4r7IL4gcBp/dyzGb9Qk9HIl449bAaRWJ9Xd0Sh6QrgP2B4ZJaSb2jpgJXSToZWAQck6vPAg4F5gOrgZMAImK5pG8Ad+Z6X4+I9hfczcysF9UtcUTE8R0smlChbgCndrCd6cD0GoZmZmY90CwXx83MrI9w4jAzs0KcOMzMrJCqEoek3eodiJmZ9Q3VtjgulHSHpE9KGlrXiMzMrKlVlTgiYj/gBNLNeHMl/VzSgXWNzMzMmlLV1zgi4lHgTOArwLuBH0h6WNIH6hWcmZk1n6ru45D0VtJNeYeRRqg9IiLulvQG4K/ANfUL0cyaQU/uPPdd5/1LtTcA/hD4CXBGRLxQKoyIJZLOrEtkZmbWlKpNHIcCL0TEKwCSNgCGRMTqiLisbtGZmVnTqfYaxx+BTcrmN81lZmY2wFSbOIZExHOlmTy9aX1CMjOzZlZt4nhe0rjSjKS3Ay90Ut/MzPqpaq9xfA74paTSQ5S2Az5Yn5DMzKyZVZU4IuJOSbsAbyY9zvXhiHi5rpGZmVlTKvI8jj2BlrzOHpKIiEvrEpWZmTWtam8AvAzYGbgXeCUXB+DEYWY2wFTb4hgPjM1P6jMzswGs2l5VDwCvr2cgZmbWN1Tb4hgOPCjpDuClUmFEHNmdnUr6PHAK6XTX/aRxsLYDrgSGAXcDH4mINZI2Jp0SezvwNPDBiFjYnf2amVnPVZs4zq7VDiWNBD5DOvX1gqSrgONIw5qcHxFXSroQOBm4IL8/ExFvlHQccB7uCmxm1jDVPo/jT8BCYMM8fSepVdBdg4FNJA0m3YG+FHgvcHVePgM4Kk9PzPPk5RMkqQf7NjOzHqi2V9XHgcmk00g7AyOBC4EJRXcYEY9L+jawiHT3+R+Au4BnI2Jtrtaa90F+X5zXXStpBbA18FS7GCfnGNl+++2LhmU90JPhts2s76n24vipwL7ASvjXQ5226c4OJW1FakXsCLwB2Aw4pELVUg+uSq2L9Xp3RcS0iBgfEeNHjBjRndDMzKwK1SaOlyJiTWkmn2LqbtfcA4DHIqIt331+DfAOYGjeLsAooDS8SSvpkbWl/W4JLO/mvs3MrIeqTRx/knQG6brEgcAvgd90c5+LgH0kbZqvVUwAHgRuBo7OdSYB1+XpmXmevPwm309iZtY41SaOKUAbqevs/wVmkZ4/XlhE3E66yH133t4GwDTSs8xPkzSfdA3j4rzKxcDWufy0HIuZmTVItYMcvkp6dOxParHTiDgLOKtd8QJgrwp1XwSOqcV+zcys56rtVfUYlS9I71TziMzMrKkVGauqZAipBTCs9uGYmVmzq/YGwKfLXo9HxPdIN+yZmdkAU+2pqnFlsxuQWiBb1CUiMzNratWeqvpO2fRa0vAjx9Y8GjMza3rV9qp6T70DMTOzvqHaU1WndbY8Ir5bm3DMzKzZFelVtSfpLm6AI4BbyIMPmpnZwFHkQU7jImIVgKSzgV9GxCn1CszMzJpTtUOObA+sKZtfA7TUPBozM2t61bY4LgPukHQt6Q7y95Me52pmZgNMtb2qzpX0O+CdueikiLinfmGZmVmzqvZUFaRHvK6MiO8DrZJ2rFNMZmbWxKpKHJLOIg17fnou2hC4vF5BmZlZ86r2Gsf7gT1Iz9AgIpZI8pAj/YifG25m1ar2VNWa/NS9AJC0Wf1CMjOzZlZt4rhK0o9JzwX/OPBHavRQJzMz61uq7VX17fys8ZXAm4GvRcTsukZmZmZNqcvEIWkQcENEHAA4WZiZDXBdnqqKiFeA1ZK27IV4zMysyVXbq+pF4H5Js4HnS4UR8Znu7FTSUOAiYDfSBfePAY8AvyANZbIQODYinpEk4PvAocBq4KMRcXd39mtmZj1XbeL4bX7VyveB30fE0ZI2It1ceAZwY0RMlTQFmEK6d+QQYEx+7Q1ckN/rpiddUxdOPayGkZiZNZ9OE4ek7SNiUUTMqNUOJb0OeBfwUYCIWAOskTQR2D9XmwHMISWOicCluTvwbZKGStouIpbWKiYzM6teV9c4fl2akPSrGu1zJ6AN+KmkeyRdlO8L2baUDPL7Nrn+SNZ97kdrLluHpMmS5kqa29bWVqNQzcysva4Sh8qmd6rRPgcD44ALImIP0jWTKVXGUBLrFURMi4jxETF+xIgRtYnUzMzW01XiiA6me6IVaI2I2/P81aRE8qSk7QDy+7Ky+qPL1h8FLKlRLGZmVlBXieNtklZKWgW8NU+vlLRK0sru7DAingAWS3pzLpoAPEh6LO2kXDYJuC5PzwROVLIPsMLXN8zMGqfTi+MRMahO+/008LPco2oBcBIpiV0l6WRgEXBMrjuL1BV3Pqk77kl1isnMzKpQbXfcmoqIe4HxFRZNqFA3gFPrHpSZmVWlIYmjP/M9IGbW3zlx9BN+noaZ9ZYij441MzNzi6OZuNVgZn2BWxxmZlaIE4eZmRXixGFmZoX4GoeZ1Z27qfcvbnGYmVkhThxmZlaIE4eZmRXixGFmZoU4cZiZWSFOHGZmVogTh5mZFeLEYWZmhThxmJlZIU4cZmZWiBOHmZkV0rDEIWmQpHskXZ/nd5R0u6RHJf1C0ka5fOM8Pz8vb2lUzGZm1tgWx2eBh8rmzwPOj4gxwDPAybn8ZOCZiHgjcH6uZ2ZmDdKQ0XEljQIOA84FTpMk4L3Ah3KVGcDZwAXAxDwNcDXwQ0mKiOjNmM2sMTyybvNpVIvje8CXgVfz/NbAsxGxNs+3AiPz9EhgMUBeviLXX4ekyZLmSprb1tZWz9jNzAa0Xk8ckg4HlkXEXeXFFapGFcteK4iYFhHjI2L8iBEjahCpmZlV0ohTVfsCR0o6FBgCvI7UAhkqaXBuVYwCluT6rcBooFXSYGBLYHnvh21mZtCAFkdEnB4RoyKiBTgOuCkiTgBuBo7O1SYB1+XpmXmevPwmX98wM2ucZrqP4yukC+XzSdcwLs7lFwNb5/LTgCkNis/MzGjwM8cjYg4wJ08vAPaqUOdF4JheDczMzDrUTC0OMzPrA5w4zMysECcOMzMrxInDzMwKceIwM7NCnDjMzKwQJw4zMyvEicPMzApx4jAzs0KcOMzMrBAnDjMzK8SJw8zMCnHiMDOzQpw4zMysECcOMzMrpKHP4zAzq6eWKb/t9roLpx5Ww0j6F7c4zMysECcOMzMrxInDzMwK6fXEIWm0pJslPSRpnqTP5vJhkmZLejS/b5XLJekHkuZLuk/SuN6O2czMXtOIFsda4AsRsSuwD3CqpLHAFODGiBgD3JjnAQ4BxuTXZOCC3g/ZzMxKej1xRMTSiLg7T68CHgJGAhOBGbnaDOCoPD0RuDSS24Chkrbr5bDNzCxr6DUOSS3AHsDtwLYRsRRScgG2ydVGAovLVmvNZe23NVnSXElz29ra6hm2mdmA1rDEIWlz4FfA5yJiZWdVK5TFegUR0yJifESMHzFiRK3CNDOzdhpyA6CkDUlJ42cRcU0uflLSdhGxNJ+KWpbLW4HRZauPApb0XrRmNhD15OZB6N83EDaiV5WAi4GHIuK7ZYtmApPy9CTgurLyE3Pvqn2AFaVTWmZm1vsa0eLYF/gIcL+ke3PZGcBU4CpJJwOLgGPyslnAocB8YDVwUu+Ga2Zm5Xo9cUTErVS+bgEwoUL9AE6ta1BmZlY13zluZmaFOHGYmVkhThxmZlaIE4eZmRXixGFmZoU4cZiZWSFOHGZmVogTh5mZFeLEYWZmhThxmJlZIQ0ZHdfMrL/ryei6zT6yrlscZmZWiBOHmZkV4sRhZmaFOHGYmVkhThxmZlaIE4eZmRXi7rhmZk2m2bvyusVhZmaFOHGYmVkhfSZxSDpY0iOS5kua0uh4zMwGqj6ROCQNAn4EHAKMBY6XNLaxUZmZDUx9InEAewHzI2JBRKwBrgQmNjgmM7MBqa/0qhoJLC6bbwX2Lq8gaTIwOc8+J+mROsUyHHiqTtvuL3yMquPj1DUfo66tc4x0Xo+2tUM1lfpK4lCFslhnJmIaMK3ugUhzI2J8vffTl/kYVcfHqWs+Rl1rxDHqK6eqWoHRZfOjgCUNisXMbEDrK4njTmCMpB0lbQQcB8xscExmZgNSnzhVFRFrJX0KuAEYBEyPiHkNCqfup8P6AR+j6vg4dc3HqGu9fowUEV3XMjMzy/rKqSozM2sSThxmZlaIE0cHJI2WdLOkhyTNk/TZXD5M0mxJj+b3rRodazOQNEjSPZKuz/M7Sro9H6df5E4NA5akoZKulvRw/kz9mz9L65L0+fx/7QFJV0ga4s8RSJouaZmkB8rKKn52lPwgD810n6Rx9YjJiaNja4EvRMSuwD7AqXmYkynAjRExBrgxzxt8FniobP484Px8nJ4BTm5IVM3j+8DvI2IX4G2kY+XPUiZpJPAZYHxE7EbqBHMc/hwBXAIc3K6so8/OIcCY/JoMXFCPgJw4OhARSyPi7jy9ivQffSRpqJMZudoM4KjGRNg8JI0CDgMuyvMC3gtcnasM6OMk6XXAu4CLASJiTUQ8iz9L7Q0GNpE0GNgUWIo/R0TELcDydsUdfXYmApdGchswVNJ2tY7JiaMKklqAPYDbgW0jYimk5AJs07jImsb3gC8Dr+b5rYFnI2Jtnm8lJd2BaiegDfhpPp13kaTN8GfpXyLiceDbwCJSwlgB3IU/Rx3p6LNTaXimmh8zJ44uSNoc+BXwuYhY2eh4mo2kw4FlEXFXeXGFqgO53/dgYBxwQUTsATzPAD4tVUk+Rz8R2BF4A7AZ6bRLewP5c1SNXvm/58TRCUkbkpLGzyLimlz8ZKnpl9+XNSq+JrEvcKSkhaRRi99LaoEMzaccwEPEtAKtEXF7nr+alEj8WXrNAcBjEdEWES8D1wDvwJ+jjnT02emV4ZmcODqQz9NfDDwUEd8tWzQTmJSnJwHX9XZszSQiTo+IURHRQrqYeVNEnADcDBydqw3o4xQRTwCLJb05F00AHsSfpXKLgH0kbZr/75WOkT9HlXX02ZkJnJh7V+0DrCid0qol3zneAUn7AX8G7ue1c/dnkK5zXAVsT/qwHxMR7S9cDUiS9ge+GBGHS9qJ1AIZBtwDfDgiXmpkfI0kaXdS54GNgAXASaQfbv4sZZL+E/ggqUfjPcAppPPzA/pzJOkKYH/S8OlPAmcBv6bCZycn3R+SemGtBk6KiLk1j8mJw8zMivCpKjMzK8SJw8zMCnHiMDOzQpw4zMysECcOMzMrxInDBgRJr5d0paR/SHpQ0ixJb+rGdo7Kg102lKTBkp6S9M1Gx2IDjxOH9Xu5b/u1wJyI2DkixpLuydm2G5s7CujVxCFpUIXig4BHgGPz32fWa5w4bCB4D/ByRFxYKoiIeyPiz5L2Lz1DBEDSDyV9NE9Pza2T+yR9W9I7gCOBb0m6V9LOknaXdFuuc23ZcxHmSDpf0i35+Rt7SromPz/hnLL9fVjSHXl7Py4lCUnPSfq6pNuBf6vwNx1PGqp9EWnY/9L2Ds3P/Lg1P5eh9HyUzfJzHe7MAy1OrNnRtQHHicMGgt1II61WTdIw4P3AWyLircA5EfEX0pAOX4qI3SPiH8ClwFdynftJd/WWrImIdwEXkoaEODXH8lFJW0valXSn9L4RsTvwCnBCXncz4IGI2Dsibm0X2yakITmuB64gJREkDQF+DBwSEfsBI8pW+yppOJg9SYn0W3mEXrPCnDjMKlsJvAhcJOkDpOEb1iFpS2BoRPwpF80gPXejZGZ+vx+Yl5/x8hJpyJHRpC//twN3Sro3z++U13mFNMBmJYcDN0fE6lzn/bmlsguwICIey/WuKFvnIGBK3s8cYAhpuAqzwgZ3XcWsz5vHawPltbeWdX9ADQGIiLWS9iJ9mR8HfIo08m8RpTGVXi2bLs0PJg2BPSMiTq+w7osR8UoH2z0e2DePSAzp+SfvAZ7uJBYB/x4Rj1QZu1mH3OKwgeAmYGNJHy8V5GsO7wb+CYyVtHFuQUzIyzcHtoyIWcDngN3zqquALQAiYgXwjKR35mUfAUqtj2rcCBwtaZu8z2GSduhshfw0wf2A7SOiJY9KfCopmTwM7JQfPAbpNFjJDcCnSxfSJe1RIE6zdThxWL8XaSTP9wMH5u6484CzgSURsZg0yuh9wM9II7BCSg7XS7qPlAw+n8uvBL6ULzDvTBrS+lu53u7A1wvE9SBwJvCHvP5soKvHfH6AdK2ivAVzHemi/avAJ4HfS7qVNJLqilznG8CGwH2SHsjzZt3i0XHN+hFJm0fEc7ll8SPg0Yg4v9FxWf/iFodZ//LxfAF8HrAlqZeVWU25xWFmZoW4xWFmZoU4cZiZWSFOHGZmVogTh5mZFeLEYWZmhfwvPakQWertkSkAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYgAAAEWCAYAAAB8LwAVAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvhp/UCwAAHnVJREFUeJzt3Xm0HFW59/HvLwNDEMIUFELggEQFfVVCEO5VhgtckSAEhzgslIAI+l4cEAcisJTlC+8Cr4gziKAQZhkEHHgxIqBeBQwYmQImQEhCAgQIhFEIPu8fezepHHb36RNOn+4++X3W6nWqdu2qerqqTj21d3VXKyIwMzPrbVi7AzAzs87kBGFmZkVOEGZmVuQEYWZmRU4QZmZW5ARhZmZFThBdQNI8SXt1UhySjpF0ZjN1+7vsoUbSwZL+1O44rG+SQtI27Y6jUzhB9EPpJLa6/vNHxP+NiE+uyrySzpZ0wkDHZNYtJB0v6T5JT0r6jaRN2h1TiROE2SqQNLzdMXQ7JUPyHCRpRB9VRgC7A68F/gkc3+KQVsmQ3DntJGlbSddLekLSnZL2z+Vb5bJhefxMSY9U5jtP0pFNLH9NSd+RtCi/viNpzTxtd0kLJX1R0iOSFks6pDLvRpJ+KWmZpL9KOqFR60fSxyU9IOkxScf2mna8pPOaqdtrvsOBA4GvSHpa0i8rk98u6bZ8VXWxpLUq871X0qy8Df8s6a11lt+TuwlGVMqul/TJPLyNpBvyOh6VdHGl3pskzZD0uKR7JH2oMu1sSaflq71ngP+QNEnSXZKekvSgpC/Ve99pEfp+Xu/dkvasTBgt6ay8vx7M+2V4Zfphkmbn9dwlaUIuLx5rlXh/JOnqvJ3/R9Lr8vGyNMewfaX+ZpIuk7RE0v2SPtfgjYyWND3XfUDScZXjuvdxsdL+yPGeKOl/gGeBrQvLnyfpy/lYeCZvm9fm9/KUpN9J2qBSf+d8TDwh6e+Sdu+170/I05/Ox/9Gks6v/B/09AphktLV/aOS/luVJCbpE3lfLJV0jaQtK9NC0hGS5gBzlJyq9L/4ZH4/bwGIiOMiYn5EPA/cTEoUnSci/GryBcwD9upVdjDwpzw8EpgLHAOsAewBPAW8MU+fD+yQh+8B7gO2rUzbvq/1At8AbgQ2AcYAfwb+T562O7A81xkJTCL9E26Qp1+UX6OA7YAFtdgL69wOeBrYFVgT+HZedi2O44HzmqlbWPbZwAmF93gzsBmwITAb+HSeNgF4BNgJGA5MzfXXLCy7BwhgRKXseuCTefhC4FjSxdFawLty+Tp5exxCurqbADwKvLkS85PAOyvzLgZ2ydM3ACbUeb8H5+3xhbxfPpyXtWGefgXw4xzDJnk7fCpPmwI8COwICNgG2JK+j7Wzc/w75Fh/D9wPHJS34QnAdbnuMOAW4Gt5WVuTjs2967yf6cCVwLp5e/8DOLT3cVHaH3lfzAfenLfzyDrH+42kk+bYvO9vBbYnHV+/B76e644FHiMd68OA/8zjYyrrmwu8HhgN3JXj3Suvfzrws8q6A7iOdAxukevWjp0D8rK2zfMeB/y517wz8rxrA3vn7bp+3nfbApv2eq9vAJYA+7f7/Fbc1+0OoJte+cB9Gnii8nqWFQliF+AhYFhlnguB4/PwucBRwOtICeKbwKeBrfKyhjVYb+3EfC8wqTJtb2BeHt4deI6VT46PADuTTgovkk8gedoJ1E8QXwMuqoyvA7xAOUE0rFtY9tmUE8THKuPfBE7Pw6eRk2Bl+j3AboVl99A4QUwHzgA27zXfh4E/9ir7MStORGcD03tNnw98Clivj+PmYGARoErZzcDHWdHFsHZl2kdZcfK+Bvh8YZl9HWtnAz+pTPssMLsy/r+AJ/LwTsD8Xsv/KpUTZ6V8eI53u0rZp4Drex8Xpf2R98U3mvg/O7AyfhlwWq/3ckUePho4t9f81wBTK+s7tjLtFODqyvh+wKzKeADvqYz/F3BtHr6anAjz+DDS//+WlXn3qEzfg5Rgdqbwvw1slI+hoxptj3a+3MXUfwdExPq1F+kAqtkMWBAR/6qUPUC6ygG4gXQS3xX4A+ng3S2//thrvno2y8usLn+zyvhjEbG8Mv4s8BpSa2ME6Sq5pjpcWs/L0yPiGdKV2aut28hDleFa3JCumL+YuxCekPQEMI6V33ezvkK6mrs5d8t8orKOnXqt40BSMq/pvb0+QLpyfSB3W/1bg/U+GPmskNX2W601sLiy3h+TWhKQ3ue9heX1dawBPFwZfq4wXt2+m/V678dQ7vbYmNTK6H0Mji3UrafRcVfTn9in9Ir9XcCmq7CsUnzV/68tge9W1vM46VgaW5o3In4P/AD4IfCwpDMkrVep+wFgbkR8mw7lBDGwFgHjtPKNty1IXQSQEsQupCRxA/AnUpfFbnm82XVsWRnfIpf1ZQmpm2PzStm4BvUXV6dLGkW64nm1dSFdafXHAuDEamKOiFERcWGh7jP576hK2csn+Yh4KCIOi4jNSFe+P1L6WOMC4IZe63hNRPzvenFHxF8jYjLpZH4F8PMG72GsJFXGa/ttAemKfOPKeteLiDdX3vvrC8vr61jrjwXA/b3e+7oRMalQ91FSS7T3MVhb7zPU2fYVA/kI6QWkFkQ19nUi4qRXsczq/0X1/2sBqeuvuq61I+LPlfq9j5HvRcQOpC61NwBfrkzelOb+d9vGCWJg3UT6B/mKpJH5Ztl+pH5/ImIO6YrlY8AfImIZ6WrmAzSfIC4EjpM0RtLGpO6d8/qYh4h4CbgcOF7SKElvIvVH13Mp8F5J75K0Bum+Rr3jpT91Ib3nV9ycbOAnwKcl7ZRv/K0jaV9J6/auGBFLSCerj0kanlsIL59gJU2RVEuSS0n/0C8BvwLeoHSzfWR+7Shp21JAktaQdKCk0RHxIrAsL6eeTYDP5eVOIfVH/yYiFgO/BU6RtJ6kYZJeL2m3PN+ZwJck7ZDf+zb5xmjDY62fbgaWSTpa0tp5u71F0o69K+bj6OfAiZLWzbEcxYpjcBawq6QtJI0mdVW10nnAfpL2znGvpfRhjc37nLO+L0vaQNI44PNA7YMMpwNflfRmePlm/ZR6C8nHz06SRpL21fOsfIycAhzxKuJsOSeIARQRLwD7A/uQrrR+BBwUEXdXqt1A6gaaXxkX8LcmV3MCMBO4DbiddPOu2e8UfIZ0o+4h0v2QC0lXr6X3cifp4L2A1EJYCix8tXWzs4DtclP9ir6CjoiZwGGk5vpS0o3CgxvMchjpSu0x0pVb9QpvR+AmSU8DV5H69++PiKeAdwMfIV3VPQScTLopWs/HgXmSlpHuJX2sQd2bgPGk4+JE4IMRUeuGO4jUbXNXfn+XkrtIIuKSXP8C0k3oK0g3t5s51pqST/r7AW8n3ch+lJSYRteZ5bOkE959pFbwBcBP87JmkE6ot5Fu0P6qv/H0M/YFwGRSl9gS0lX+l3l157YrSbHPAn5NOl6JiF+QjomL8j6/g7T961mPdHGzlNRV9Rjwrcr0z5GSRMfSyt2itjqRdDLwuoiY2u5YzKzzuAWxGlH6nP9bc1fFO4BDgV+0Oy4z60x9fdvPhpZ1Sd1Km5E+/noKqTltZvYK7mIyM7MidzGZmVlRV3cxbbzxxtHT09PuMMzMusott9zyaESM6ateVyeInp4eZs6c2e4wzMy6iqQH+q7lLiYzM6vDCcLMzIqcIMzMrMgJwszMipwgzMysyAnCzMyKnCDMzKzICcLMzIqcIMzMrKirv0k91PRM+3WxfN5J+w5yJGZmbkGYmVkdThBmZlbkBGFmZkVOEGZmVuQEYWZmRU4QZmZW5ARhZmZF/h7EEOTvU5jZQHALwszMityC6AL1WgRmZq3kFoSZmRU5QZiZWZEThJmZFTlBmJlZkROEmZkVOUGYmVmRE4SZmRU5QZiZWZG/KNcG/uKbmXUDtyDMzKzICcLMzIqcIMzMrMgJwszMipwgzMysyAnCzMyKnCDMzKyopQlC0hck3SnpDkkXSlpL0laSbpI0R9LFktbIddfM43Pz9J5WxmZmZo21LEFIGgt8DpgYEW8BhgMfAU4GTo2I8cBS4NA8y6HA0ojYBjg11zMzszZpdRfTCGBtSSOAUcBiYA/g0jz9HOCAPDw5j5On7ylJLY7PzMzqaFmCiIgHgW8B80mJ4UngFuCJiFieqy0ExubhscCCPO/yXH+j3suVdLikmZJmLlmypFXhm5mt9lrZxbQBqVWwFbAZsA6wT6Fq1GZpMG1FQcQZETExIiaOGTNmoMI1M7NeWtnFtBdwf0QsiYgXgcuBfwfWz11OAJsDi/LwQmAcQJ4+Gni8hfGZmVkDrUwQ84GdJY3K9xL2BO4CrgM+mOtMBa7Mw1flcfL030fEK1oQZmY2OFp5D+Im0s3mW4Hb87rOAI4GjpI0l3SP4aw8y1nARrn8KGBaq2IzM7O+tfT3ICLi68DXexXfB7yjUPd5YEor4zEzs+b5m9RmZlbkBGFmZkVOEGZmVuQEYWZmRU4QZmZW5ARhZmZFThBmZlbkBGFmZkVOEGZmVuQEYWZmRU4QZmZW5ARhZmZFThBmZlbkBGFmZkVOEGZmVuQEYWZmRU4QZmZW5ARhZmZFThBmZlbkBGFmZkVOEGZmVuQEYWZmRU4QZmZW5ARhZmZFThBmZlbkBGFmZkVOEGZmVuQEYWZmRSPaHcBQ1jPt1+0OwcxslbkFYWZmRU4QZmZW5C6mJjXqLpp30r6DGImZ2eBwC8LMzIpW2xZEvRaBWwNmZolbEGZmVtTSFoSk9YEzgbcAAXwCuAe4GOgB5gEfioilkgR8F5gEPAscHBG3tjK+En801cwsaXUL4rvA/4uINwFvA2YD04BrI2I8cG0eB9gHGJ9fhwOntTg2MzNroGUJQtJ6wK7AWQAR8UJEPAFMBs7J1c4BDsjDk4HpkdwIrC9p01bFZ2ZmjTWVICS9ZRWWvTWwBPiZpL9JOlPSOsBrI2IxQP67Sa4/FlhQmX9hLusdy+GSZkqauWTJklUIy8zMmtFsC+J0STdL+q98X6EZI4AJwGkRsT3wDCu6k0pUKItXFEScERETI2LimDFjmgzFzMz6q6mb1BHxLknjSTeZZ0q6GfhZRMxoMNtCYGFE3JTHLyUliIclbRoRi3MX0iOV+uMq828OLOrHe2kb39g2s6Go6XsQETEHOA44GtgN+J6kuyW9v079h4AFkt6Yi/YE7gKuAqbmsqnAlXn4KuAgJTsDT9a6oszMbPA11YKQ9FbgEGBfYAawX0TcKmkz4C/A5XVm/SxwvqQ1gPvyMoYBP5d0KDAfmJLr/ob0Ede5pI+5HrJK78jMzAZEs9+D+AHwE+CYiHiuVhgRiyQdV2+miJgFTCxM2rNQN4AjmozHzMxarNkEMQl4LiJeApA0DFgrIp6NiHNbFp2ZmbVNs/cgfgesXRkflcvMzGyIajZBrBURT9dG8vCo1oRkZmadoNkE8YykCbURSTsAzzWob2ZmXa7ZexBHApdIqn0vYVPgw60JyczMOkGzX5T7q6Q3AW8kfeP57oh4saWRmZlZW/Xncd87kh7RPQLYXhIRMb0lUZmZWds1+0W5c4HXA7OAl3JxAE4QZmZDVLMtiInAdvnLbGZmthpo9lNMdwCva2UgZmbWWZptQWwM3JWf4vrPWmFE7N+SqMzMrO2aTRDHtzIIMzPrPM1+zPUGSVsC4yPid5JGAcNbG5qZmbVTsz85ehjpB39+nIvGAle0KigzM2u/Zm9SHwG8E1gGL/940CYN5zAzs67WbIL4Z0S8UBuRNILC70WbmdnQ0WyCuEHSMcDakv4TuAT4ZevCMjOzdms2QUwDlgC3A58i/Txo3V+SMzOz7tfsp5j+RfrJ0Z+0NhwzM+sUzT6L6X4K9xwiYusBj8jMzDpCf57FVLMWMAXYcODDMTOzTtHUPYiIeKzyejAivgPs0eLYzMysjZrtYppQGR1GalGs25KIzMysIzTbxXRKZXg5MA/40IBHY2ZmHaPZTzH9R6sDMTOzztJsF9NRjaZHxLcHJhwzM+sU/fkU047AVXl8P+APwIJWBGVmZu3Xnx8MmhARTwFIOh64JCI+2arAzMysvZp91MYWwAuV8ReAngGPxszMOkazLYhzgZsl/YL0jer3AdNbFpWZmbVds59iOlHS1cAuueiQiPhb68IyM7N2a7aLCWAUsCwivgsslLRVi2IyM7MO0OxPjn4dOBr4ai4aCZzXqqDMzKz9mm1BvA/YH3gGICIW4UdtmJkNac0miBciIsiP/Ja0TutCMjOzTtBsgvi5pB8D60s6DPgdTf54kKThkv4m6Vd5fCtJN0maI+liSWvk8jXz+Nw8vaf/b8fMzAZKs4/7/hZwKXAZ8EbgaxHx/SbX8XlgdmX8ZODUiBgPLAUOzeWHAksjYhvg1FzPzMzapM8EkVsAv4uIGRHx5Yj4UkTMaGbhkjYH9gXOzOMi/Y7EpbnKOcABeXhyHidP3zPXNzOzNugzQUTES8CzkkavwvK/A3wF+Fce3wh4IiKW5/GFwNg8PJb8bKc8/clcfyWSDpc0U9LMJUuWrEJIZmbWjGa/Sf08cLukGeRPMgFExOfqzSDpvcAjEXGLpN1rxYWq0cS0FQURZwBnAEycOPEV083MbGA0myB+nV/98U5gf0mTSL9jvR6pRbG+pBG5lbA5sCjXXwiMI30JbwQwGni8n+s0M7MB0jBBSNoiIuZHxDmN6pVExFfJX6zLLYgvRcSBki4BPghcBEwFrsyzXJXH/5Kn/z5/tNbMzNqgr3sQV9QGJF02QOs8GjhK0lzSPYazcvlZwEa5/Chg2gCtz8zMVkFfXUzV+wJbr+pKIuJ64Po8fB/wjkKd54Epq7oOMzMbWH21IKLOsJmZDXF9tSDeJmkZqSWxdh4mj0dErNfS6MzMrG0aJoiIGD5YgZiZWWfpz+9BmJnZasQJwszMipwgzMysyAnCzMyKnCDMzKzICcLMzIqcIMzMrMgJwszMipp93LfZkNIzrfz0+nkn7TvIkZh1LicIGxJ8wjcbeO5iMjOzIrcgzJrgFoqtjpwgViODcZLr9hNpvfjNVkdOEDYo+ps4uj3RmA0FThDmk7GZFTlBWL91UzdMN8Vq1mmcIMxeBbe+bChzgrC6BuPqe6he4a/K+3JSsU7jBGHWIQYqWTrR2EDxF+XMzKzILQjrKkO1S8qsE7kFYWZmRU4QZmZW5ARhZmZFThBmZlbkBGFmZkVOEGZmVuQEYWZmRU4QZmZW5ARhZmZFThBmZlbkBGFmZkUtSxCSxkm6TtJsSXdK+nwu31DSDElz8t8NcrkkfU/SXEm3SZrQqtjMzKxvrWxBLAe+GBHbAjsDR0jaDpgGXBsR44Fr8zjAPsD4/DocOK2FsZmZWR9aliAiYnFE3JqHnwJmA2OBycA5udo5wAF5eDIwPZIbgfUlbdqq+MzMrLFBuQchqQfYHrgJeG1ELIaURIBNcrWxwILKbAtzmZmZtUHLE4Sk1wCXAUdGxLJGVQtlUVje4ZJmSpq5ZMmSgQrTzMx6aWmCkDSSlBzOj4jLc/HDta6j/PeRXL4QGFeZfXNgUe9lRsQZETExIiaOGTOmdcGbma3mWvkpJgFnAbMj4tuVSVcBU/PwVODKSvlB+dNMOwNP1rqizMxs8LXyJ0ffCXwcuF3SrFx2DHAS8HNJhwLzgSl52m+AScBc4FngkBbGZmZmfWhZgoiIP1G+rwCwZ6F+AEe0Kh4zM+sff5PazMyKnCDMzKzICcLMzIqcIMzMrMgJwszMipwgzMysyAnCzMyKnCDMzKzICcLMzIqcIMzMrMgJwszMipwgzMysyAnCzMyKnCDMzKzICcLMzIqcIMzMrMgJwszMipwgzMysyAnCzMyKnCDMzKzICcLMzIpGtDsAM+suPdN+XSyfd9K+gxyJtZoThJkNWa1OZkM9WTpBmK3mhvpJrtu1c/84QZgNMfVOKN2kXe9hdVtvX5wgzKyovyetVbnSXd1OyJ2aCOpxgjCzluq2k6Kt4I+5mplZkVsQZmYDbKi0mtyCMDOzIicIMzMrcoIwM7MiJwgzMytygjAzsyInCDMzK3KCMDOzoo5KEJLeI+keSXMlTWt3PGZmq7OOSRCShgM/BPYBtgM+Kmm79kZlZrb66pgEAbwDmBsR90XEC8BFwOQ2x2RmttrqpEdtjAUWVMYXAjv1riTpcODwPPq0pHsKy9oYeHTAIxx43RBnN8QIjnMgdUOMsJrHqZNf1exbNlOpkxKECmXxioKIM4AzGi5ImhkREwcqsFbphji7IUZwnAOpG2IExzkYOqmLaSEwrjK+ObCoTbGYma32OilB/BUYL2krSWsAHwGuanNMZmarrY7pYoqI5ZI+A1wDDAd+GhF3ruLiGnZBdZBuiLMbYgTHOZC6IUZwnC2niFd085uZmXVUF5OZmXUQJwgzMyvqugQhaZyk6yTNlnSnpM/n8uMlPShpVn5Nqszz1fz4jnsk7T2Isc6TdHuOZ2Yu21DSDElz8t8NcrkkfS/HeZukCYMU4xsr22yWpGWSjuyE7Snpp5IekXRHpazf20/S1Fx/jqSpgxDjf0u6O8fxC0nr5/IeSc9VtunplXl2yMfK3Pw+Sh/7Hug4+72PW/04nDpxXlyJcZ6kWbm8LduzwTmoo47NARERXfUCNgUm5OF1gX+QHs1xPPClQv3tgL8DawJbAfcCwwcp1nnAxr3KvglMy8PTgJPz8CTgatL3QXYGbmrDth0OPET6Ek3btyewKzABuGNVtx+wIXBf/rtBHt6gxTG+GxiRh0+uxNhTrddrOTcD/5bjvxrYZxC2Zb/2cX7dC2wNrJHrbNfqOHtNPwX4Wju3Z4NzUEcdmwPx6roWREQsjohb8/BTwGzSt7DrmQxcFBH/jIj7gbmkx3q0y2TgnDx8DnBApXx6JDcC60vadJBj2xO4NyIeaFBn0LZnRPwBeLyw/v5sv72BGRHxeEQsBWYA72lljBHx24hYnkdvJH2np64c53oR8ZdIZ47plffVsjgbqLePW/44nEZx5lbAh4ALGy2j1duzwTmoo47NgdB1CaJKUg+wPXBTLvpMbsL9tNa8o/wIj0YJZSAF8FtJtyg9IgTgtRGxGNKBBmzSAXHWfISV//k6bXtC/7dfu+P9BOnqsWYrSX+TdIOkXXLZ2BxXzWDG2J993O5tuQvwcETMqZS1dXv2Ogd127HZp65NEJJeA1wGHBkRy4DTgNcDbwcWk5qi0OQjPFrknRExgfSE2iMk7dqgbjvjROnLifsDl+SiTtyejdSLq23xSjoWWA6cn4sWA1tExPbAUcAFktZrY4z93cft3vcfZeULmLZuz8I5qG7VOvG0e3v2qSsThKSRpB1zfkRcDhARD0fESxHxL+AnrOj2aNsjPCJiUf77CPCLHNPDta6j/PeRdseZ7QPcGhEPQ2duz6y/268t8eYbju8FDszdHOQum8fy8C2k/vw35Bir3VCDEuMq7OO27XtJI4D3AxfXytq5PUvnILrk2OyPrksQuR/yLGB2RHy7Ul7tr38fUPsUxFXARyStKWkrYDzpBlar41xH0rq1YdKNyztyPLVPK0wFrqzEeVD+xMPOwJO15uogWenqrNO2Z0V/t981wLslbZC7UN6dy1pG0nuAo4H9I+LZSvkYpd89QdLWpG13X47zKUk75+P7oMr7amWc/d3H7Xwczl7A3RHxctdRu7ZnvXMQXXBs9lu775L39wW8i9QMuw2YlV+TgHOB23P5VcCmlXmOJV1d3MMAfzqkQZxbkz7l8XfgTuDYXL4RcC0wJ//dMJeL9INJ9+b3MXEQt+ko4DFgdKWs7duTlLAWAy+SrrYOXZXtR7oPMDe/DhmEGOeS+pZrx+fpue4H8rHwd+BWYL/KciaSTtD3Aj8gP+WgxXH2ex/n/7V/5GnHDsY+z+VnA5/uVbct25P656COOjYH4uVHbZiZWVHXdTGZmdngcIIwM7MiJwgzMytygjAzsyInCDMzK+qYX5Qz63SSXiJ9THEk6RvS5wDfifRFM7MhxwnCrHnPRcTbASRtAlwAjAa+3taozFrEXUxmqyDS41MOJz3sTkq/TfBHSbfm178DSDpX0stPPJV0vqT9Jb1Z0s1Kv2Nwm6Tx7XovZvX4i3JmTZL0dES8plfZUuBNwFPAvyLi+XyyvzAiJkraDfhCRBwgaTTpW7fjgVOBGyPi/PzYiuER8dzgviOzxtzFZPbq1J7IORL4gaS3Ay+RHhpHRNwg6Ye5S+r9wGURsVzSX4BjJW0OXB4rP8LarCO4i8lsFeUHxL1EemrnF4CHgbeRngO0RqXqucCBwCHAzwAi4gLS49WfA66RtMfgRW7WHCcIs1UgaQxwOvCDSP20o4HF+RNNHyf9PGfN2cCRABFxZ55/a9KTR79HelDeWwcverPmuIvJrHlrS5rFio+5ngvUHvf8I+AySVOA64BnajNFxMOSZgNXVJb1YeBjkl4k/Q74NwYhfrN+8U1qsxaTNIr0/YkJEfFku+Mxa5a7mMxaSNJewN3A950crNu4BWFmZkVuQZiZWZEThJmZFTlBmJlZkROEmZkVOUGYmVnR/wclxjlybsCUyAAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAY8AAAEWCAYAAACe8xtsAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvhp/UCwAAHbFJREFUeJzt3XuYHVWZ7/HvjwTCnRDSIiSBBo0XZEQwIl6OMoByNzqPKAyjAaM5eFc4RxJxDjoOIxwd8DYKUdBwFUSFCDgYQUTHQzAg94v0QEyaRBIkhKtA4D1/rLVJpbO7e6/u3r13p3+f59lPV61aVfVW7er97rWqdpUiAjMzsxIbtToAMzMbeZw8zMysmJOHmZkVc/IwM7NiTh5mZlbMycPMzIo5edh6JJ0p6Z+HaFk7SXpC0pg8fp2kDw/FsvPyfiFpxlAtr2C9/yrpYUl/Ge51m7UDJ49RRtJiSU9LelzSo5J+L+k4SS8eCxFxXER8ucFlHdBXnYhYEhFbRsTzQxD7FyWd32P5B0fEvMEuuzCOKcAJwG4R8dJe6mwt6euSluTk2ZXHJw5y3f3u81Zq9/hs6Dh5jE6HR8RWwM7AqcCJwNlDvRJJY4d6mW1iZ+CvEbGi3kRJmwDXAK8BDgK2Bt4M/BXYe7iCbCYl/vwYzSLCr1H0AhYDB/Qo2xt4Adg9j/8Q+Nc8PBG4AngUeAT4LelLx3l5nqeBJ4DPAZ1AADOBJcD1lbKxeXnXAV8BbgRWA5cDE/K0fYHuevGSPoSfBZ7L67u1srwP5+GNgC8AfwZWAOcC2+RptThm5NgeBk7qYz9tk+dfmZf3hbz8A/I2v5Dj+GGdeT8MPARs2cfyA3h5ZXxA+zzXfxdwZ65/HfDqHvvvfwO3AU+SviRsD/wCeBz4FbBtpf4+wO/zsm4F9q1Muw44BfivHMPL62zXYvLxBRwD/A74GrAKeAA4uFJ3AvADYFmeflll2keArrz984Ede+y7jwH35W34MvAy4P8BjwGXAJtU6h8G3JK36ffAa1v9f7ghvFoegF/D/IbXSR65fAnw0Txc/SD7CnAmsHF+/Q9A9ZbF2g/oc4EtgM2onzweBHbPdX4CnJ+n7UsvySMPf7FWtzL9OtYmjw/lD5xdgS2BnwLn9YjtezmuPYBnqHzQ9ljuuaTEtlWe90/AzN7i7DHvj4B5/bwPfSWPkn3+ClJSeEeu+7m8Dzap1L+BlDAmkZLqzcCewDjgWuDkXHcSqXV0CClZvSOPd1T29RJSi2ossHFfxxcpeTxHSgRjgI+SEkVtW64ELga2zbG/PZfvR0rue+UYvwVc32PfzSe16F6T38dr8vu+DXAXMCPX3Stv8xtzDDNyjONa/b840l9udlrNMtI3wZ6eA3YAdo6I5yLit5H/K/vwxYh4MiKe7mX6eRFxR0Q8Cfwz8L7aCfVBOho4PSLuj4gngDnAkT26z74UEU9HxK2kb9Z79FxIjuX9wJyIeDwiFgP/DnygwTi2A5YPYjtK9vn7gSsjYkFEPEf6lr8ZqZus5lsR8VBEPEhqxSyMiD9GxDPAz0iJBOCfgKsi4qqIeCEiFgCLSMmk5ocRcWdErMnr68+fI+J7kc55zcvbtb2kHYCDgeMiYlXezt/keY4GzomIm3OMc4A3SeqsLPe0iHgsIu4E7gB+md/31aRWVW2bPgKcFRELI+L5SOfHniG1sGwQnDysZhKpi6Cnr5K+yf5S0v2SZjewrKUF0/9M+tY5qBPJ2Y55edVljyV9666pXh31FKmF0tNEYJM6y5rUYBx/JX1IDlTJPl9nmyPiBdL+rcb6UGX46TrjtX2wM3BEvpDiUUmPAm9l3W3p773t6cX9HRFP5cEtgSnAIxGxqs48PbfpCdI+Heg2ndBjm6bkddggOHkYkt5A+sf8Xc9p+Zv3CRGxK3A4cLyk/WuTe1lkfy2TKZXhnUjftB8mdb9sXolrDNBRsNxlpA+L6rLXsO4HSyMezjH1XNaDDc7/K+BASVv0UecpKtsKvHjVVuE+X2ebJYm0fxuNtWopqVU4vvLaIiJOrdQZqttwLwUmSBpfZ1rPbdqC1Job6Dad0mObNo+IiwYUtb3IyWMUy5eTHkbqoz8/Im6vU+cwSS/PH0qPAc/nF6QP5V0HsOp/krSbpM2BfwEuzd0afwI2lXSopI1JJ6nHVeZ7COjs4yqfi4DPStpF0pbAvwEXR8SakuByLJcAp0jaStLOwPHA+X3P+aLzSB9aP5H0KkkbSdpO0ucl1bqAbgH+UdIYSQcBb6/NXLjPLwEOlbR/3mcnkLplfl+yzdn5wOGSDsxxbSppX0mTB7CsPkXEclL30nckbStpY0lvy5MvBI6V9DpJ40jv48LcfVjqe8Bxkt6YrxDbIh9fWw3JhoxiTh6j088lPU76gDsJOB04tpe6U0nfpJ8gXc3ynYi4Lk/7CvCF3B3wvwrWfx7pBPFfgE2BTwHk/uqPAd8nfct8EuiuzPfj/Pevkm6us9xz8rKvJ13Z8zfgkwVxVX0yr/9+Uovswrz8fuV++gOAe4AFpARwI6k7bGGu9mlSq+JRUh//ZZVFNLzPI+Je0rmKb5FaTIeTLsV+tnSDI2IpMB34POkqs6WkK7Wa9TnxAVIL7x7SSe3P5DiuIZ0L+wnp3NHLgCMHsoKIWEQ67/Ft0hVdXaQT+TZItasezMzMGuaWh5mZFXPyMDOzYk4eZmZWzMnDzMyKbZA3rps4cWJ0dna2OgwzsxHlpptuejgiOvqvuYEmj87OThYtWtTqMMzMRhRJf+6/VuJuKzMzK+bkYWZmxZw8zMysmJOHmZkVc/IwM7NiTh5mZlbMycPMzIo5eZiZWTEnDzMzK7ZB/sLcRo7O2VcOeN7Fpx46hJGYWQm3PMzMrJiTh5mZFXPyMDOzYk4eZmZWzMnDzMyKOXmYmVkxJw8zMyvm5GFmZsWaljwknSNphaQ7KmVflXSPpNsk/UzS+Mq0OZK6JN0r6cBK+UG5rEvS7GbFa2ZmjWtmy+OHwEE9yhYAu0fEa4E/AXMAJO0GHAm8Js/zHUljJI0B/gM4GNgNOCrXNTOzFmpa8oiI64FHepT9MiLW5NEbgMl5eDrwo4h4JiIeALqAvfOrKyLuj4hngR/lumZm1kKtPOfxIeAXeXgSsLQyrTuX9VZuZmYt1JLkIekkYA1wQa2oTrXoo7zeMmdJWiRp0cqVK4cmUDMzq2vYk4ekGcBhwNERUUsE3cCUSrXJwLI+ytcTEXMjYlpETOvo6Bj6wM3M7EXDekt2SQcBJwJvj4inKpPmAxdKOh3YEZgK3EhqeUyVtAvwIOmk+j8OZ8xm9fhW8jbaNS15SLoI2BeYKKkbOJl0ddU4YIEkgBsi4riIuFPSJcBdpO6sj0fE83k5nwCuBsYA50TEnc2K2czMGtO05BERR9UpPruP+qcAp9Qpvwq4aghDMzOzQfIvzM3MrJgfQ2uj0mDOWZiZWx5mZjYAbnkY4KuHzKyMWx5mZlbMycPMzIo5eZiZWTEnDzMzK+bkYWZmxZw8zMysmJOHmZkVc/IwM7Ni/pGgDZpv9WE2+rjlYWZmxZw8zMysmJOHmZkVc/IwM7NiTh5mZlbMycPMzIo5eZiZWTEnDzMzK+bkYWZmxZw8zMysmJOHmZkVa1rykHSOpBWS7qiUTZC0QNJ9+e+2uVySvimpS9JtkvaqzDMj179P0oxmxWtmZo1rZsvjh8BBPcpmA9dExFTgmjwOcDAwNb9mAd+FlGyAk4E3AnsDJ9cSjpmZtU7TkkdEXA880qN4OjAvD88D3l0pPzeSG4DxknYADgQWRMQjEbEKWMD6CcnMzIbZcJ/z2D4ilgPkvy/J5ZOApZV63bmst/L1SJolaZGkRStXrhzywM3MbK12OWGuOmXRR/n6hRFzI2JaREzr6OgY0uDMzGxdw508HsrdUeS/K3J5NzClUm8ysKyPcjMza6HhTh7zgdoVUzOAyyvlH8xXXe0DrM7dWlcD75S0bT5R/s5cZmZmLdS0x9BKugjYF5goqZt01dSpwCWSZgJLgCNy9auAQ4Au4CngWICIeETSl4E/5Hr/EhE9T8Kbmdkwa1ryiIijepm0f526AXy8l+WcA5wzhKGZmdkgtcsJczMzG0Ga1vKwcp2zrxzwvItPPXQIIzEz65tbHmZmVszJw8zMirnbqg53H5mZ9c3Jw0aswSR5Mxscd1uZmVkxJw8zMyvm5GFmZsWcPMzMrJiTh5mZFXPyMDOzYk4eZmZWzL/zMBtm/hGqbQjc8jAzs2JOHmZmVszJw8zMijl5mJlZMScPMzMr5uRhZmbFnDzMzKyYk4eZmRVz8jAzs2INJQ9Juw/lSiV9VtKdku6QdJGkTSXtImmhpPskXSxpk1x3XB7vytM7hzIWMzMr12jL40xJN0r6mKTxg1mhpEnAp4BpEbE7MAY4EjgNOCMipgKrgJl5lpnAqoh4OXBGrmdmZi3UUPKIiLcCRwNTgEWSLpT0jkGsdyywmaSxwObAcmA/4NI8fR7w7jw8PY+Tp+8vSYNYt5mZDVLD5zwi4j7gC8CJwNuBb0q6R9I/lKwwIh4EvgYsISWN1cBNwKMRsSZX6wYm5eFJwNI875pcf7uey5U0S9IiSYtWrlxZEpKZmRVq9JzHayWdAdxNaiEcHhGvzsNnlKxQ0rak1sQuwI7AFsDBdapGbZY+pq0tiJgbEdMiYlpHR0dJSGZmVqjRW7J/G/ge8PmIeLpWGBHLJH2hcJ0HAA9ExEoAST8F3gyMlzQ2ty4mA8ty/W5Sd1l37ubaBnikcJ3DZjC32zYzGyka7bY6BLiwljgkbSRpc4CIOK9wnUuAfSRtns9d7A/cBfwaeG+uMwO4PA/Pz+Pk6ddGxHotDzMzGz6NJo9fAZtVxjfPZcUiYiHpxPfNwO05hrmkcynHS+oindM4O89yNrBdLj8emD2Q9ZqZ2dBptNtq04h4ojYSEU/UWh4DEREnAyf3KL4f2LtO3b8BRwx0XWZmNvQabXk8KWmv2oik1wNP91HfzMw2YI22PD4D/FhS7ST2DsD7mxOSmZm1u4aSR0T8QdKrgFeSLp29JyKea2pkZmbWthpteQC8AejM8+wpiYg4tylRWTFfImxmw6mh5CHpPOBlwC3A87k4ACcPM7NRqNGWxzRgN/++wszMoPGrre4AXtrMQMzMbORotOUxEbhL0o3AM7XCiHhXU6IyM7O21mjy+GIzgzCz5hvsRRWLTz10iCKxDUGjl+r+RtLOwNSI+FX+dfmY5oZmZmbtqtFbsn+EdD+qs3LRJOCyZgVlZmbtrdET5h8H3gI8Bi8+GOolzQrKzMzaW6PJ45mIeLY2kp+r4ct2zcxGqUaTx28kfZ703PF3AD8Gft68sMzMrJ01mjxmAytJz9/4n8BVpOeZm5nZKNTo1VYvkB5D+73mhmNmZiNBo/e2eoA65zgiYtchj8jMzNpeyb2tajYlPdlvwtCHY2ZmI0FD5zwi4q+V14MR8XVgvybHZmZmbarRbqu9KqMbkVoiWzUlIjMza3uNdlv9e2V4DbAYeN+QR2NmZiNCo1db/X2zAzEzs5Gj0W6r4/uaHhGnD004ZmY2EpRcbfUGYH4ePxy4Hlg6kJVKGg98H9iddAnwh4B7gYtJz0lfDLwvIlZJEvAN4BDgKeCYiLh5IOs1s9YYzO3gfSv49tToL8wnAntFxAkRcQLwemByRHwpIr40gPV+A/jPiHgVsAdwN+lX7NdExFTgmjwOcDAwNb9mAd8dwPrMzGwINZo8dgKerYw/S2ohFJO0NfA24GyAiHg2Ih4FpgPzcrV5wLvz8HTg3EhuAMZL2mEg6zYzs6HRaLfVecCNkn5G6mZ6D3DuANe5K+k+WT+QtAdwE/BpYPuIWA4QEcsl1W75Pol1u8e6c9nyAa7fzMwGqdEfCZ4CHAusAh4Fjo2IfxvgOscCewHfjYg9gSdZ20VVj+qFtF4laZakRZIWrVy5coChmZlZIxrttgLYHHgsIr4BdEvaZYDr7Aa6I2JhHr+UlEweqnVH5b8rKvWnVOafDCzrudCImBsR0yJiWkdHxwBDMzOzRjT6GNqTgROBObloY+D8gawwIv4CLJX0yly0P3AX6UquGblsBnB5Hp4PfFDJPsDqWveWmZm1RqPnPN4D7AncDBARyyQN5vYknwQukLQJcD+pS2wj4BJJM4ElpJsvQnp2yCFAF+lS3WMHsV4zMxsCjSaPZyMiJAWApC0Gs9KIuIV179Rbs3+dukF6hrqZmbWJRs95XCLpLNJlsh8BfoUfDGVmNmo1em+rr+Vnlz8GvBL4PxGxoKmRmZlZ2+o3eUgaA1wdEQcAThhmLTSY23yYDaV+u60i4nngKUnbDEM8ZmY2AjR6wvxvwO2SFpB+1AdARHyqKVGZmVlbazR5XJlfZmZmfScPSTtFxJKImNdXPTMzG136O+dxWW1A0k+aHIuZmY0Q/SWP6k0Jd21mIGZmNnL0lzyil2EzMxvF+jthvoekx0gtkM3yMHk8ImLrpkZnZmZtqc/kERFjhisQM2tv/oGiVZU8z8PMzAxw8jAzswFw8jAzs2JOHmZmVszJw8zMijl5mJlZMScPMzMr5uRhZmbFnDzMzKyYk4eZmRVz8jAzs2JOHmZmVqxlyUPSGEl/lHRFHt9F0kJJ90m6WNImuXxcHu/K0ztbFbOZmSWtbHl8Gri7Mn4acEZETAVWATNz+UxgVUS8HDgj1zMzsxZqSfKQNBk4FPh+HhewH3BprjIPeHcenp7HydP3z/XNzKxFWtXy+DrwOeCFPL4d8GhErMnj3cCkPDwJWAqQp6/O9dchaZakRZIWrVy5spmxm5mNesOePCQdBqyIiJuqxXWqRgPT1hZEzI2IaRExraOjYwgiNTOz3vT3GNpmeAvwLkmHAJsCW5NaIuMljc2ti8nAsly/G5gCdEsaC2wDPDL8YZuZWc2wtzwiYk5ETI6ITuBI4NqIOBr4NfDeXG0GcHkenp/HydOvjYj1Wh5mZjZ82ul3HicCx0vqIp3TODuXnw1sl8uPB2a3KD4zM8ta0W31ooi4DrguD98P7F2nzt+AI4Y1MDNrG52zrxzwvItPPXQII7Gqdmp5mJnZCOHkYWZmxZw8zMysmJOHmZkVc/IwM7NiTh5mZlbMycPMzIo5eZiZWTEnDzMzK+bkYWZmxZw8zMysmJOHmZkVc/IwM7NiTh5mZlaspbdkNzNrJt/OvXnc8jAzs2JOHmZmVszdVmZmTbChd5m55WFmZsWcPMzMrJiTh5mZFXPyMDOzYk4eZmZWbNivtpI0BTgXeCnwAjA3Ir4haQJwMdAJLAbeFxGrJAn4BnAI8BRwTETcPNxxm9noMpirpUaDVrQ81gAnRMSrgX2Aj0vaDZgNXBMRU4Fr8jjAwcDU/JoFfHf4QzYzs6phTx4RsbzWcoiIx4G7gUnAdGBerjYPeHceng6cG8kNwHhJOwxz2GZmVtHSHwlK6gT2BBYC20fEckgJRtJLcrVJwNLKbN25bHmPZc0itUzYaaedmhq3mVkzjYQfGLbshLmkLYGfAJ+JiMf6qlqnLNYriJgbEdMiYlpHR8dQhWlmZnW0JHlI2piUOC6IiJ/m4odq3VH574pc3g1Mqcw+GVg2XLGamdn6hj155KunzgbujojTK5PmAzPy8Azg8kr5B5XsA6yudW+ZmVlrtOKcx1uADwC3S7oll30eOBW4RNJMYAlwRJ52Feky3S7SpbrHDm+4ZmbW07Anj4j4HfXPYwDsX6d+AB9valBmZlbEvzA3M7NiTh5mZlbMycPMzIo5eZiZWTEnDzMzK+bkYWZmxZw8zMysmJOHmZkVc/IwM7NiTh5mZlbMycPMzIo5eZiZWTEnDzMzK+bkYWZmxZw8zMysmJOHmZkVc/IwM7NiTh5mZlbMycPMzIo5eZiZWTEnDzMzK+bkYWZmxZw8zMysmJOHmZkVGzHJQ9JBku6V1CVpdqvjMTMbzUZE8pA0BvgP4GBgN+AoSbu1Niozs9FrRCQPYG+gKyLuj4hngR8B01sck5nZqDW21QE0aBKwtDLeDbyxWkHSLGBWHn1C0r3DFFuzTAQebnUQbcT7Y13eH2t5X1TotEHtj50brThSkofqlMU6IxFzgbnDE07zSVoUEdNaHUe78P5Yl/fHWt4X6xqu/TFSuq26gSmV8cnAshbFYmY26o2U5PEHYKqkXSRtAhwJzG9xTGZmo9aI6LaKiDWSPgFcDYwBzomIO1scVrNtMF1wQ8T7Y13eH2t5X6xrWPaHIqL/WmZmZhUjpdvKzMzaiJOHmZkVc/IYBpLGSPqjpCvy+C6SFkq6T9LF+SIAJI3L4115emdlGXNy+b2SDqyUj6jbtkgaL+lSSfdIulvSmyRNkLQg748FkrbNdSXpm3nbbpO0V2U5M3L9+yTNqJS/XtLteZ5vSqp3mXfbkPRZSXdKukPSRZI2HU3Hh6RzJK2QdEelrOnHQ2/raKVe9sVX8//KbZJ+Jml8ZVrRez6Q46pPEeFXk1/A8cCFwBV5/BLgyDx8JvDRPPwx4Mw8fCRwcR7eDbgVGAfsAvw36cKBMXl4V2CTXGe3Vm9vP/tiHvDhPLwJMB74v8DsXDYbOC0PHwL8gvQ7n32Ahbl8AnB//rttHt42T7sReFOe5xfAwa3e5j72xSTgAWCzynFxzGg6PoC3AXsBd1TKmn489LaONtwX7wTG5uHTKvui+D0vPa76jbfVO2xDf5F+k3INsB9wRT6IH64cEG8Crs7DVwNvysNjcz0Bc4A5lWVened7cd5cvk69dnsBW5M+LNWj/F5ghzy8A3BvHj4LOKpnPeAo4KxK+Vm5bAfgnkr5OvXa7cXaOydMyO/3FcCBo+34ADp7fGA2/XjobR2tfvXcFz2mvQe4oN572d97PpDPnf5idbdV830d+BzwQh7fDng0Itbk8W7ShwhUbsOSp6/O9evdnmVSH+XtaldgJfADpW6870vaAtg+IpYD5L8vyfVLt3tSHu5Z3pYi4kHga8ASYDnp/b6J0Xt81AzH8dDbOtrZh0itJyjfFwP53OmTk0cTSToMWBERN1WL61SNfqaVlrersaRm+XcjYk/gSVKXQW826P2R+9mnk7oddgS2IN05uqfRcnz0Z9Ruv6STgDXABbWiOtUGui8GtJ+cPJrrLcC7JC0m3Ql4P1JLZLyk2g80q7daefE2LHn6NsAj9H57lpF225ZuoDsiFubxS0nJ5CFJOwDkvysq9Uu2uzsP9yxvVwcAD0TEyoh4Dvgp8GZG7/FRMxzHQ2/raDv5AoDDgKMj9y1Rvi8epvy46pOTRxNFxJyImBwRnaQTUddGxNHAr4H35mozgMvz8Pw8Tp5+bT5Y5gNH5qsidgGmkk4EjqjbtkTEX4Clkl6Zi/YH7mLd7e65Pz6Yr7LZB1iduxiuBt4padv87f2dpP7b5cDjkvbJV9V8sLKsdrQE2EfS5jne2v4YlcdHxXAcD72to61IOgg4EXhXRDxVmVT0nufjpPS46lurTxCNlhewL2uvtto1v9FdwI+Bcbl80zzelafvWpn/JNJVFPdSuYKIdAXKn/K0k1q9nQ3sh9cBi4DbgMtIV8dsR7qo4L78d0KuK9JDwP4buB2YVlnOh/J+6gKOrZRPA+7I83ybBk78tXh/fAm4J8d8HunqmVFzfAAXkc73PEf6BjxzOI6H3tbRhvuii3Q+4pb8OnOg7/lAjqu+Xr49iZmZFXO3lZmZFXPyMDOzYk4eZmZWzMnDzMyKOXmYmVkxJw+zApKeaHUMZu3AycPMzIo5eZgNgKR9JV2ntc8muaDyrIg3SPq9pFsl3ShpK6XndPwgP1vij5L+Ptc9RtJlkn4u6QFJn5B0fK5zg6QJud7LJP2npJsk/VbSq1q5/WZj+69iZr3YE3gN6R5B/wW8RdKNwMXA+yPiD5K2Bp4GPg0QEX+XP/h/KekVeTm752VtSvqV74kRsaekM0i31Pg6MBc4LiLuk/RG4Duke6WZtYSTh9nA3RgR3QCSbiE9i2E1sDwi/gAQEY/l6W8FvpXL7pH0Z6CWPH4dEY+T7sO0Gvh5Lr8deK2kLUk3TPyx1j4YcVyTt82sT04eZgP3TGX4edL/k6h/O+u+HodbXc4LlfEX8jI3Ij2L4XUDD9VsaPmch9nQugfYUdIbAPL5jrHA9cDRuewVwE6kG9r1K7deHpB0RJ5fkvZoRvBmjXLyMBtCEfEs8H7gW5JuBRaQzmV8Bxgj6XbSOZFjIuKZ3pe0nqOBmXmZd5IeImXWMr6rrpmZFXPLw8zMijl5mJlZMScPMzMr5uRhZmbFnDzMzKyYk4eZmRVz8jAzs2L/HxzFZ/0GzkggAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "display_customer_profile()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 256,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['offer received', 'offer viewed', 'transaction', 'offer completed'],\n",
       "      dtype=object)"
      ]
     },
     "execution_count": 256,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# explore transcript\n",
    "transcript['event'].unique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 257,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>event</th>\n",
       "      <th>person</th>\n",
       "      <th>time</th>\n",
       "      <th>value</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>offer received</td>\n",
       "      <td>78afa995795e4d85b5d9ceeca43f5fef</td>\n",
       "      <td>0</td>\n",
       "      <td>{'offer id': '9b98b8c7a33c4b65b9aebfe6a799e6d9'}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>offer received</td>\n",
       "      <td>a03223e636434f42ac4c3df47e8bac43</td>\n",
       "      <td>0</td>\n",
       "      <td>{'offer id': '0b1e1539f2cc45b7b9fa7c272da2e1d7'}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>offer received</td>\n",
       "      <td>e2127556f4f64592b11af22de27a7932</td>\n",
       "      <td>0</td>\n",
       "      <td>{'offer id': '2906b810c7d4411798c6938adc9daaa5'}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>offer received</td>\n",
       "      <td>8ec6ce2a7e7949b1bf142def7d0e0586</td>\n",
       "      <td>0</td>\n",
       "      <td>{'offer id': 'fafdcd668e3743c1bb461111dcafc2a4'}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>offer received</td>\n",
       "      <td>68617ca6246f4fbc85e91a2a49552598</td>\n",
       "      <td>0</td>\n",
       "      <td>{'offer id': '4d5c57ea9a6940dd891ad53e9dbe8da0'}</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "            event                            person  time  \\\n",
       "0  offer received  78afa995795e4d85b5d9ceeca43f5fef     0   \n",
       "1  offer received  a03223e636434f42ac4c3df47e8bac43     0   \n",
       "2  offer received  e2127556f4f64592b11af22de27a7932     0   \n",
       "3  offer received  8ec6ce2a7e7949b1bf142def7d0e0586     0   \n",
       "4  offer received  68617ca6246f4fbc85e91a2a49552598     0   \n",
       "\n",
       "                                              value  \n",
       "0  {'offer id': '9b98b8c7a33c4b65b9aebfe6a799e6d9'}  \n",
       "1  {'offer id': '0b1e1539f2cc45b7b9fa7c272da2e1d7'}  \n",
       "2  {'offer id': '2906b810c7d4411798c6938adc9daaa5'}  \n",
       "3  {'offer id': 'fafdcd668e3743c1bb461111dcafc2a4'}  \n",
       "4  {'offer id': '4d5c57ea9a6940dd891ad53e9dbe8da0'}  "
      ]
     },
     "execution_count": 257,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "transcript.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 258,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>event</th>\n",
       "      <th>person</th>\n",
       "      <th>time</th>\n",
       "      <th>value</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>55972</th>\n",
       "      <td>offer received</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>168</td>\n",
       "      <td>{'offer id': '5a8bc65990b245e5a138643cd4eb9837'}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>77705</th>\n",
       "      <td>offer viewed</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>192</td>\n",
       "      <td>{'offer id': '5a8bc65990b245e5a138643cd4eb9837'}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>89291</th>\n",
       "      <td>transaction</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>228</td>\n",
       "      <td>{'amount': 22.16}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>113605</th>\n",
       "      <td>offer received</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>336</td>\n",
       "      <td>{'offer id': '3f207df678b143eea3cee63160fa8bed'}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>139992</th>\n",
       "      <td>offer viewed</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>372</td>\n",
       "      <td>{'offer id': '3f207df678b143eea3cee63160fa8bed'}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>153401</th>\n",
       "      <td>offer received</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>408</td>\n",
       "      <td>{'offer id': 'f19421c1d4aa40978ebb69ca19b0e20d'}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>168412</th>\n",
       "      <td>transaction</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>414</td>\n",
       "      <td>{'amount': 8.57}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>168413</th>\n",
       "      <td>offer completed</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>414</td>\n",
       "      <td>{'offer_id': 'f19421c1d4aa40978ebb69ca19b0e20d...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>187554</th>\n",
       "      <td>offer viewed</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>456</td>\n",
       "      <td>{'offer id': 'f19421c1d4aa40978ebb69ca19b0e20d'}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>204340</th>\n",
       "      <td>offer received</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>504</td>\n",
       "      <td>{'offer id': 'fafdcd668e3743c1bb461111dcafc2a4'}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>228422</th>\n",
       "      <td>transaction</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>528</td>\n",
       "      <td>{'amount': 14.11}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>228423</th>\n",
       "      <td>offer completed</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>528</td>\n",
       "      <td>{'offer_id': 'fafdcd668e3743c1bb461111dcafc2a4...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>233413</th>\n",
       "      <td>offer viewed</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>540</td>\n",
       "      <td>{'offer id': 'fafdcd668e3743c1bb461111dcafc2a4'}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>237784</th>\n",
       "      <td>transaction</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>552</td>\n",
       "      <td>{'amount': 13.56}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>247879</th>\n",
       "      <td>offer received</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>576</td>\n",
       "      <td>{'offer id': '2906b810c7d4411798c6938adc9daaa5'}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>258883</th>\n",
       "      <td>transaction</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>576</td>\n",
       "      <td>{'amount': 10.27}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>258884</th>\n",
       "      <td>offer completed</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>576</td>\n",
       "      <td>{'offer_id': '2906b810c7d4411798c6938adc9daaa5...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>293497</th>\n",
       "      <td>transaction</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>660</td>\n",
       "      <td>{'amount': 12.36}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>300930</th>\n",
       "      <td>transaction</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>690</td>\n",
       "      <td>{'amount': 28.16}</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>302205</th>\n",
       "      <td>transaction</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>696</td>\n",
       "      <td>{'amount': 18.41}</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                  event                            person  time  \\\n",
       "55972    offer received  0009655768c64bdeb2e877511632db8f   168   \n",
       "77705      offer viewed  0009655768c64bdeb2e877511632db8f   192   \n",
       "89291       transaction  0009655768c64bdeb2e877511632db8f   228   \n",
       "113605   offer received  0009655768c64bdeb2e877511632db8f   336   \n",
       "139992     offer viewed  0009655768c64bdeb2e877511632db8f   372   \n",
       "153401   offer received  0009655768c64bdeb2e877511632db8f   408   \n",
       "168412      transaction  0009655768c64bdeb2e877511632db8f   414   \n",
       "168413  offer completed  0009655768c64bdeb2e877511632db8f   414   \n",
       "187554     offer viewed  0009655768c64bdeb2e877511632db8f   456   \n",
       "204340   offer received  0009655768c64bdeb2e877511632db8f   504   \n",
       "228422      transaction  0009655768c64bdeb2e877511632db8f   528   \n",
       "228423  offer completed  0009655768c64bdeb2e877511632db8f   528   \n",
       "233413     offer viewed  0009655768c64bdeb2e877511632db8f   540   \n",
       "237784      transaction  0009655768c64bdeb2e877511632db8f   552   \n",
       "247879   offer received  0009655768c64bdeb2e877511632db8f   576   \n",
       "258883      transaction  0009655768c64bdeb2e877511632db8f   576   \n",
       "258884  offer completed  0009655768c64bdeb2e877511632db8f   576   \n",
       "293497      transaction  0009655768c64bdeb2e877511632db8f   660   \n",
       "300930      transaction  0009655768c64bdeb2e877511632db8f   690   \n",
       "302205      transaction  0009655768c64bdeb2e877511632db8f   696   \n",
       "\n",
       "                                                    value  \n",
       "55972    {'offer id': '5a8bc65990b245e5a138643cd4eb9837'}  \n",
       "77705    {'offer id': '5a8bc65990b245e5a138643cd4eb9837'}  \n",
       "89291                                   {'amount': 22.16}  \n",
       "113605   {'offer id': '3f207df678b143eea3cee63160fa8bed'}  \n",
       "139992   {'offer id': '3f207df678b143eea3cee63160fa8bed'}  \n",
       "153401   {'offer id': 'f19421c1d4aa40978ebb69ca19b0e20d'}  \n",
       "168412                                   {'amount': 8.57}  \n",
       "168413  {'offer_id': 'f19421c1d4aa40978ebb69ca19b0e20d...  \n",
       "187554   {'offer id': 'f19421c1d4aa40978ebb69ca19b0e20d'}  \n",
       "204340   {'offer id': 'fafdcd668e3743c1bb461111dcafc2a4'}  \n",
       "228422                                  {'amount': 14.11}  \n",
       "228423  {'offer_id': 'fafdcd668e3743c1bb461111dcafc2a4...  \n",
       "233413   {'offer id': 'fafdcd668e3743c1bb461111dcafc2a4'}  \n",
       "237784                                  {'amount': 13.56}  \n",
       "247879   {'offer id': '2906b810c7d4411798c6938adc9daaa5'}  \n",
       "258883                                  {'amount': 10.27}  \n",
       "258884  {'offer_id': '2906b810c7d4411798c6938adc9daaa5...  \n",
       "293497                                  {'amount': 12.36}  \n",
       "300930                                  {'amount': 28.16}  \n",
       "302205                                  {'amount': 18.41}  "
      ]
     },
     "execution_count": 258,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# select one user and explore the transcript records\n",
    "transcript[transcript['person']=='0009655768c64bdeb2e877511632db8f']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [],
   "source": [
    "def clean_transcript(transcript):\n",
    "    '''\n",
    "    data cleaning the transcript dataframe, return usable dataframe need contain offer events\n",
    "    \n",
    "    INPUT:\n",
    "    transcript - the transcript dataframe to be cleaned\n",
    "    \n",
    "    OUTPUT:\n",
    "    offer - the cleaned offer dataframe\n",
    "    \n",
    "    '''\n",
    "    # extract the rows that are related to offer action (e.g. offer received, offer viewed, offer completed)\n",
    "    offer = transcript[transcript['value'].apply(lambda x: True if ('offer id' in x) or ('offer_id' in x) else False)]\n",
    "    \n",
    "    # extract the offer id from value column\n",
    "    offer['offer_id'] = offer['value'].apply(lambda x: x['offer id'] if ('offer id' in x) else x['offer_id'])\n",
    "    \n",
    "    return offer\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "d:\\data science\\data visualization\\venv\\lib\\site-packages\\ipykernel_launcher.py:16: SettingWithCopyWarning: \n",
      "A value is trying to be set on a copy of a slice from a DataFrame.\n",
      "Try using .loc[row_indexer,col_indexer] = value instead\n",
      "\n",
      "See the caveats in the documentation: http://pandas.pydata.org/pandas-docs/stable/indexing.html#indexing-view-versus-copy\n",
      "  app.launch_new_instance()\n"
     ]
    }
   ],
   "source": [
    "offer = clean_transcript(transcript)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 261,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>event</th>\n",
       "      <th>person</th>\n",
       "      <th>time</th>\n",
       "      <th>value</th>\n",
       "      <th>offer_id</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>offer received</td>\n",
       "      <td>78afa995795e4d85b5d9ceeca43f5fef</td>\n",
       "      <td>0</td>\n",
       "      <td>{'offer id': '9b98b8c7a33c4b65b9aebfe6a799e6d9'}</td>\n",
       "      <td>9b98b8c7a33c4b65b9aebfe6a799e6d9</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>offer received</td>\n",
       "      <td>a03223e636434f42ac4c3df47e8bac43</td>\n",
       "      <td>0</td>\n",
       "      <td>{'offer id': '0b1e1539f2cc45b7b9fa7c272da2e1d7'}</td>\n",
       "      <td>0b1e1539f2cc45b7b9fa7c272da2e1d7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>offer received</td>\n",
       "      <td>e2127556f4f64592b11af22de27a7932</td>\n",
       "      <td>0</td>\n",
       "      <td>{'offer id': '2906b810c7d4411798c6938adc9daaa5'}</td>\n",
       "      <td>2906b810c7d4411798c6938adc9daaa5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>offer received</td>\n",
       "      <td>8ec6ce2a7e7949b1bf142def7d0e0586</td>\n",
       "      <td>0</td>\n",
       "      <td>{'offer id': 'fafdcd668e3743c1bb461111dcafc2a4'}</td>\n",
       "      <td>fafdcd668e3743c1bb461111dcafc2a4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>offer received</td>\n",
       "      <td>68617ca6246f4fbc85e91a2a49552598</td>\n",
       "      <td>0</td>\n",
       "      <td>{'offer id': '4d5c57ea9a6940dd891ad53e9dbe8da0'}</td>\n",
       "      <td>4d5c57ea9a6940dd891ad53e9dbe8da0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "            event                            person  time  \\\n",
       "0  offer received  78afa995795e4d85b5d9ceeca43f5fef     0   \n",
       "1  offer received  a03223e636434f42ac4c3df47e8bac43     0   \n",
       "2  offer received  e2127556f4f64592b11af22de27a7932     0   \n",
       "3  offer received  8ec6ce2a7e7949b1bf142def7d0e0586     0   \n",
       "4  offer received  68617ca6246f4fbc85e91a2a49552598     0   \n",
       "\n",
       "                                              value  \\\n",
       "0  {'offer id': '9b98b8c7a33c4b65b9aebfe6a799e6d9'}   \n",
       "1  {'offer id': '0b1e1539f2cc45b7b9fa7c272da2e1d7'}   \n",
       "2  {'offer id': '2906b810c7d4411798c6938adc9daaa5'}   \n",
       "3  {'offer id': 'fafdcd668e3743c1bb461111dcafc2a4'}   \n",
       "4  {'offer id': '4d5c57ea9a6940dd891ad53e9dbe8da0'}   \n",
       "\n",
       "                           offer_id  \n",
       "0  9b98b8c7a33c4b65b9aebfe6a799e6d9  \n",
       "1  0b1e1539f2cc45b7b9fa7c272da2e1d7  \n",
       "2  2906b810c7d4411798c6938adc9daaa5  \n",
       "3  fafdcd668e3743c1bb461111dcafc2a4  \n",
       "4  4d5c57ea9a6940dd891ad53e9dbe8da0  "
      ]
     },
     "execution_count": 261,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "offer.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 262,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['offer received', 'offer viewed', 'offer completed'], dtype=object)"
      ]
     },
     "execution_count": 262,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "offer['event'].unique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 263,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([  0, 168, 336, 408, 504, 576], dtype=int64)"
      ]
     },
     "execution_count": 263,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# check how many times the offer has sent\n",
    "offer[offer['event']=='offer received']['time'].unique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 264,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>event</th>\n",
       "      <th>person</th>\n",
       "      <th>time</th>\n",
       "      <th>value</th>\n",
       "      <th>offer_id</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>55972</th>\n",
       "      <td>offer received</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>168</td>\n",
       "      <td>{'offer id': '5a8bc65990b245e5a138643cd4eb9837'}</td>\n",
       "      <td>5a8bc65990b245e5a138643cd4eb9837</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>77705</th>\n",
       "      <td>offer viewed</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>192</td>\n",
       "      <td>{'offer id': '5a8bc65990b245e5a138643cd4eb9837'}</td>\n",
       "      <td>5a8bc65990b245e5a138643cd4eb9837</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>113605</th>\n",
       "      <td>offer received</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>336</td>\n",
       "      <td>{'offer id': '3f207df678b143eea3cee63160fa8bed'}</td>\n",
       "      <td>3f207df678b143eea3cee63160fa8bed</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>139992</th>\n",
       "      <td>offer viewed</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>372</td>\n",
       "      <td>{'offer id': '3f207df678b143eea3cee63160fa8bed'}</td>\n",
       "      <td>3f207df678b143eea3cee63160fa8bed</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>153401</th>\n",
       "      <td>offer received</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>408</td>\n",
       "      <td>{'offer id': 'f19421c1d4aa40978ebb69ca19b0e20d'}</td>\n",
       "      <td>f19421c1d4aa40978ebb69ca19b0e20d</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>168413</th>\n",
       "      <td>offer completed</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>414</td>\n",
       "      <td>{'offer_id': 'f19421c1d4aa40978ebb69ca19b0e20d...</td>\n",
       "      <td>f19421c1d4aa40978ebb69ca19b0e20d</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>187554</th>\n",
       "      <td>offer viewed</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>456</td>\n",
       "      <td>{'offer id': 'f19421c1d4aa40978ebb69ca19b0e20d'}</td>\n",
       "      <td>f19421c1d4aa40978ebb69ca19b0e20d</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>204340</th>\n",
       "      <td>offer received</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>504</td>\n",
       "      <td>{'offer id': 'fafdcd668e3743c1bb461111dcafc2a4'}</td>\n",
       "      <td>fafdcd668e3743c1bb461111dcafc2a4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>228423</th>\n",
       "      <td>offer completed</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>528</td>\n",
       "      <td>{'offer_id': 'fafdcd668e3743c1bb461111dcafc2a4...</td>\n",
       "      <td>fafdcd668e3743c1bb461111dcafc2a4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>233413</th>\n",
       "      <td>offer viewed</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>540</td>\n",
       "      <td>{'offer id': 'fafdcd668e3743c1bb461111dcafc2a4'}</td>\n",
       "      <td>fafdcd668e3743c1bb461111dcafc2a4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>247879</th>\n",
       "      <td>offer received</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>576</td>\n",
       "      <td>{'offer id': '2906b810c7d4411798c6938adc9daaa5'}</td>\n",
       "      <td>2906b810c7d4411798c6938adc9daaa5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>258884</th>\n",
       "      <td>offer completed</td>\n",
       "      <td>0009655768c64bdeb2e877511632db8f</td>\n",
       "      <td>576</td>\n",
       "      <td>{'offer_id': '2906b810c7d4411798c6938adc9daaa5...</td>\n",
       "      <td>2906b810c7d4411798c6938adc9daaa5</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                  event                            person  time  \\\n",
       "55972    offer received  0009655768c64bdeb2e877511632db8f   168   \n",
       "77705      offer viewed  0009655768c64bdeb2e877511632db8f   192   \n",
       "113605   offer received  0009655768c64bdeb2e877511632db8f   336   \n",
       "139992     offer viewed  0009655768c64bdeb2e877511632db8f   372   \n",
       "153401   offer received  0009655768c64bdeb2e877511632db8f   408   \n",
       "168413  offer completed  0009655768c64bdeb2e877511632db8f   414   \n",
       "187554     offer viewed  0009655768c64bdeb2e877511632db8f   456   \n",
       "204340   offer received  0009655768c64bdeb2e877511632db8f   504   \n",
       "228423  offer completed  0009655768c64bdeb2e877511632db8f   528   \n",
       "233413     offer viewed  0009655768c64bdeb2e877511632db8f   540   \n",
       "247879   offer received  0009655768c64bdeb2e877511632db8f   576   \n",
       "258884  offer completed  0009655768c64bdeb2e877511632db8f   576   \n",
       "\n",
       "                                                    value  \\\n",
       "55972    {'offer id': '5a8bc65990b245e5a138643cd4eb9837'}   \n",
       "77705    {'offer id': '5a8bc65990b245e5a138643cd4eb9837'}   \n",
       "113605   {'offer id': '3f207df678b143eea3cee63160fa8bed'}   \n",
       "139992   {'offer id': '3f207df678b143eea3cee63160fa8bed'}   \n",
       "153401   {'offer id': 'f19421c1d4aa40978ebb69ca19b0e20d'}   \n",
       "168413  {'offer_id': 'f19421c1d4aa40978ebb69ca19b0e20d...   \n",
       "187554   {'offer id': 'f19421c1d4aa40978ebb69ca19b0e20d'}   \n",
       "204340   {'offer id': 'fafdcd668e3743c1bb461111dcafc2a4'}   \n",
       "228423  {'offer_id': 'fafdcd668e3743c1bb461111dcafc2a4...   \n",
       "233413   {'offer id': 'fafdcd668e3743c1bb461111dcafc2a4'}   \n",
       "247879   {'offer id': '2906b810c7d4411798c6938adc9daaa5'}   \n",
       "258884  {'offer_id': '2906b810c7d4411798c6938adc9daaa5...   \n",
       "\n",
       "                                offer_id  \n",
       "55972   5a8bc65990b245e5a138643cd4eb9837  \n",
       "77705   5a8bc65990b245e5a138643cd4eb9837  \n",
       "113605  3f207df678b143eea3cee63160fa8bed  \n",
       "139992  3f207df678b143eea3cee63160fa8bed  \n",
       "153401  f19421c1d4aa40978ebb69ca19b0e20d  \n",
       "168413  f19421c1d4aa40978ebb69ca19b0e20d  \n",
       "187554  f19421c1d4aa40978ebb69ca19b0e20d  \n",
       "204340  fafdcd668e3743c1bb461111dcafc2a4  \n",
       "228423  fafdcd668e3743c1bb461111dcafc2a4  \n",
       "233413  fafdcd668e3743c1bb461111dcafc2a4  \n",
       "247879  2906b810c7d4411798c6938adc9daaa5  \n",
       "258884  2906b810c7d4411798c6938adc9daaa5  "
      ]
     },
     "execution_count": 264,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# check the same user transcript records\n",
    "offer[offer['person']=='0009655768c64bdeb2e877511632db8f']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 265,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(167581, 5)"
      ]
     },
     "execution_count": 265,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "offer.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 298,
   "metadata": {},
   "outputs": [],
   "source": [
    "def create_user_item_matrix(offer, filename):\n",
    "    '''\n",
    "    Return the user item matrix that indicate the number of offer complete of a particular user\n",
    "    \n",
    "    INPUT:\n",
    "    offer - a cleaned transcript dataframe\n",
    "    filename(string) - the file name that save the user item matrix\n",
    "    \n",
    "    OUTPUT:\n",
    "    user_item_matrix - the user item matrix which \n",
    "        - row is user \n",
    "        - column is offer\n",
    "        - value is the number of offer complete by the user (NaN means no offer given)\n",
    "    \n",
    "    '''\n",
    "    # create an empty user item matrix\n",
    "    user_item_matrix = offer.groupby(['person', 'offer_id'])['event'].agg(lambda x: np.nan).unstack()\n",
    "    # we just focus on bogo and discount first\n",
    "    user_item_matrix.drop(list(portfolio[portfolio['offer_type']=='informational']['id']), axis=1, inplace=True)\n",
    "    \n",
    "    for offer_id in user_item_matrix.columns:\n",
    "        print(\"Now processing: \", offer_id)\n",
    "        num = 0\n",
    "        for person in user_item_matrix.index:\n",
    "            num += 1\n",
    "            if num % 1000 == 0:\n",
    "                print(\"finished \", num/16994*100, '%')\n",
    "            events = []\n",
    "            for event in offer[(offer['offer_id']==offer_id) & (offer['person']==person)]['event']:\n",
    "                events.append(event)\n",
    "            if len(events) >= 3:\n",
    "                user_item_matrix.loc[person, offer_id] = 0\n",
    "                for i in range(len(events)-2):\n",
    "                    # check if the transaction sequence is offer received -> offer viewed -> offer completed\n",
    "                    # if yes, we assume the user reacted positively with the offer we provided.\n",
    "                    if (events[i] == 'offer received') & (events[i+1] == 'offer viewed') & (events[i+2] == 'offer completed'):\n",
    "                        user_item_matrix.loc[person, offer_id] += 1\n",
    "            elif len(events) > 0:\n",
    "                user_item_matrix.loc[person, offer_id] = 0\n",
    "    \n",
    "    # store the large martix into file\n",
    "    fh = open(filename, 'wb')\n",
    "    pickle.dump(user_item_matrix,fh)\n",
    "    fh.close()\n",
    "    \n",
    "    return user_item_matrix\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 299,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Now processing:  0b1e1539f2cc45b7b9fa7c272da2e1d7\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "finished  94.15087678004002 %\n",
      "Now processing:  2298d6c36e964ae4a3e7e9706d1fb8c2\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "finished  94.15087678004002 %\n",
      "Now processing:  2906b810c7d4411798c6938adc9daaa5\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "finished  94.15087678004002 %\n",
      "Now processing:  4d5c57ea9a6940dd891ad53e9dbe8da0\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "finished  94.15087678004002 %\n",
      "Now processing:  9b98b8c7a33c4b65b9aebfe6a799e6d9\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "finished  94.15087678004002 %\n",
      "Now processing:  ae264e3637204a6fb9bb56bc8210ddfd\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "finished  94.15087678004002 %\n",
      "Now processing:  f19421c1d4aa40978ebb69ca19b0e20d\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "finished  94.15087678004002 %\n",
      "Now processing:  fafdcd668e3743c1bb461111dcafc2a4\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "finished  94.15087678004002 %\n"
     ]
    }
   ],
   "source": [
    "full_df = create_user_item_matrix(offer, 'user_item_matrix.p')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 300,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th>offer_id</th>\n",
       "      <th>0b1e1539f2cc45b7b9fa7c272da2e1d7</th>\n",
       "      <th>2298d6c36e964ae4a3e7e9706d1fb8c2</th>\n",
       "      <th>2906b810c7d4411798c6938adc9daaa5</th>\n",
       "      <th>4d5c57ea9a6940dd891ad53e9dbe8da0</th>\n",
       "      <th>9b98b8c7a33c4b65b9aebfe6a799e6d9</th>\n",
       "      <th>ae264e3637204a6fb9bb56bc8210ddfd</th>\n",
       "      <th>f19421c1d4aa40978ebb69ca19b0e20d</th>\n",
       "      <th>fafdcd668e3743c1bb461111dcafc2a4</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>person</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0009655768c64bdeb2e877511632db8f</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>00116118485d4dfda04fdbaba9a87b5c</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0011e0d4e6b944f998e987f904e8c1e5</th>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0020c2b971eb4e9188eac86d93036a77</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0020ccbbb6d84e358d3414a3ff76cffd</th>\n",
       "      <td>NaN</td>\n",
       "      <td>1.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1.0</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "offer_id                          0b1e1539f2cc45b7b9fa7c272da2e1d7  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               NaN   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               1.0   \n",
       "0020c2b971eb4e9188eac86d93036a77                               NaN   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               NaN   \n",
       "\n",
       "offer_id                          2298d6c36e964ae4a3e7e9706d1fb8c2  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               NaN   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               1.0   \n",
       "0020c2b971eb4e9188eac86d93036a77                               NaN   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               1.0   \n",
       "\n",
       "offer_id                          2906b810c7d4411798c6938adc9daaa5  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               0.0   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               NaN   \n",
       "0020c2b971eb4e9188eac86d93036a77                               NaN   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               NaN   \n",
       "\n",
       "offer_id                          4d5c57ea9a6940dd891ad53e9dbe8da0  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               NaN   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               NaN   \n",
       "0020c2b971eb4e9188eac86d93036a77                               1.0   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               NaN   \n",
       "\n",
       "offer_id                          9b98b8c7a33c4b65b9aebfe6a799e6d9  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               NaN   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               1.0   \n",
       "0020c2b971eb4e9188eac86d93036a77                               NaN   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               1.0   \n",
       "\n",
       "offer_id                          ae264e3637204a6fb9bb56bc8210ddfd  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               NaN   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               NaN   \n",
       "0020c2b971eb4e9188eac86d93036a77                               0.0   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               NaN   \n",
       "\n",
       "offer_id                          f19421c1d4aa40978ebb69ca19b0e20d  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               0.0   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               0.0   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               NaN   \n",
       "0020c2b971eb4e9188eac86d93036a77                               NaN   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               1.0   \n",
       "\n",
       "offer_id                          fafdcd668e3743c1bb461111dcafc2a4  \n",
       "person                                                              \n",
       "0009655768c64bdeb2e877511632db8f                               0.0  \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN  \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               NaN  \n",
       "0020c2b971eb4e9188eac86d93036a77                               1.0  \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               NaN  "
      ]
     },
     "execution_count": 300,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "full_df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 342,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(117306, 50275)"
      ]
     },
     "execution_count": 342,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "train_size = int(offer.shape[0]*0.7)\n",
    "test_size = offer.shape[0] - train_size\n",
    "train_size, test_size"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 343,
   "metadata": {},
   "outputs": [],
   "source": [
    "train_offer = offer[:train_size]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 344,
   "metadata": {},
   "outputs": [],
   "source": [
    "test_offer = offer[train_size:]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 345,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Now processing:  0b1e1539f2cc45b7b9fa7c272da2e1d7\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "finished  94.15087678004002 %\n",
      "Now processing:  2298d6c36e964ae4a3e7e9706d1fb8c2\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "finished  94.15087678004002 %\n",
      "Now processing:  2906b810c7d4411798c6938adc9daaa5\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "finished  94.15087678004002 %\n",
      "Now processing:  4d5c57ea9a6940dd891ad53e9dbe8da0\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "finished  94.15087678004002 %\n",
      "Now processing:  9b98b8c7a33c4b65b9aebfe6a799e6d9\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "finished  94.15087678004002 %\n",
      "Now processing:  ae264e3637204a6fb9bb56bc8210ddfd\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "finished  94.15087678004002 %\n",
      "Now processing:  f19421c1d4aa40978ebb69ca19b0e20d\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "finished  94.15087678004002 %\n",
      "Now processing:  fafdcd668e3743c1bb461111dcafc2a4\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "finished  94.15087678004002 %\n"
     ]
    }
   ],
   "source": [
    "train_df = create_user_item_matrix(train_offer, 'train_df.p')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 346,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th>offer_id</th>\n",
       "      <th>0b1e1539f2cc45b7b9fa7c272da2e1d7</th>\n",
       "      <th>2298d6c36e964ae4a3e7e9706d1fb8c2</th>\n",
       "      <th>2906b810c7d4411798c6938adc9daaa5</th>\n",
       "      <th>4d5c57ea9a6940dd891ad53e9dbe8da0</th>\n",
       "      <th>9b98b8c7a33c4b65b9aebfe6a799e6d9</th>\n",
       "      <th>ae264e3637204a6fb9bb56bc8210ddfd</th>\n",
       "      <th>f19421c1d4aa40978ebb69ca19b0e20d</th>\n",
       "      <th>fafdcd668e3743c1bb461111dcafc2a4</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>person</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0009655768c64bdeb2e877511632db8f</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>00116118485d4dfda04fdbaba9a87b5c</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0011e0d4e6b944f998e987f904e8c1e5</th>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0020c2b971eb4e9188eac86d93036a77</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0020ccbbb6d84e358d3414a3ff76cffd</th>\n",
       "      <td>NaN</td>\n",
       "      <td>1.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1.0</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "offer_id                          0b1e1539f2cc45b7b9fa7c272da2e1d7  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               NaN   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               0.0   \n",
       "0020c2b971eb4e9188eac86d93036a77                               NaN   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               NaN   \n",
       "\n",
       "offer_id                          2298d6c36e964ae4a3e7e9706d1fb8c2  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               NaN   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               1.0   \n",
       "0020c2b971eb4e9188eac86d93036a77                               NaN   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               1.0   \n",
       "\n",
       "offer_id                          2906b810c7d4411798c6938adc9daaa5  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               NaN   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               NaN   \n",
       "0020c2b971eb4e9188eac86d93036a77                               NaN   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               NaN   \n",
       "\n",
       "offer_id                          4d5c57ea9a6940dd891ad53e9dbe8da0  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               NaN   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               NaN   \n",
       "0020c2b971eb4e9188eac86d93036a77                               0.0   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               NaN   \n",
       "\n",
       "offer_id                          9b98b8c7a33c4b65b9aebfe6a799e6d9  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               NaN   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               0.0   \n",
       "0020c2b971eb4e9188eac86d93036a77                               NaN   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               0.0   \n",
       "\n",
       "offer_id                          ae264e3637204a6fb9bb56bc8210ddfd  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               NaN   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               NaN   \n",
       "0020c2b971eb4e9188eac86d93036a77                               0.0   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               NaN   \n",
       "\n",
       "offer_id                          f19421c1d4aa40978ebb69ca19b0e20d  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               0.0   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               0.0   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               NaN   \n",
       "0020c2b971eb4e9188eac86d93036a77                               NaN   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               1.0   \n",
       "\n",
       "offer_id                          fafdcd668e3743c1bb461111dcafc2a4  \n",
       "person                                                              \n",
       "0009655768c64bdeb2e877511632db8f                               0.0  \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN  \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               NaN  \n",
       "0020c2b971eb4e9188eac86d93036a77                               1.0  \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               NaN  "
      ]
     },
     "execution_count": 346,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "train_df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 347,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Now processing:  0b1e1539f2cc45b7b9fa7c272da2e1d7\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "Now processing:  2298d6c36e964ae4a3e7e9706d1fb8c2\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "Now processing:  2906b810c7d4411798c6938adc9daaa5\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "Now processing:  4d5c57ea9a6940dd891ad53e9dbe8da0\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "Now processing:  9b98b8c7a33c4b65b9aebfe6a799e6d9\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "Now processing:  ae264e3637204a6fb9bb56bc8210ddfd\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "Now processing:  f19421c1d4aa40978ebb69ca19b0e20d\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n",
      "Now processing:  fafdcd668e3743c1bb461111dcafc2a4\n",
      "finished  5.884429798752501 %\n",
      "finished  11.768859597505003 %\n",
      "finished  17.653289396257502 %\n",
      "finished  23.537719195010006 %\n",
      "finished  29.422148993762505 %\n",
      "finished  35.306578792515005 %\n",
      "finished  41.19100859126751 %\n",
      "finished  47.07543839002001 %\n",
      "finished  52.95986818877251 %\n",
      "finished  58.84429798752501 %\n",
      "finished  64.7287277862775 %\n",
      "finished  70.61315758503001 %\n",
      "finished  76.4975873837825 %\n",
      "finished  82.38201718253502 %\n",
      "finished  88.26644698128752 %\n"
     ]
    }
   ],
   "source": [
    "test_df = create_user_item_matrix(test_offer, 'test_df.p')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 348,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th>offer_id</th>\n",
       "      <th>0b1e1539f2cc45b7b9fa7c272da2e1d7</th>\n",
       "      <th>2298d6c36e964ae4a3e7e9706d1fb8c2</th>\n",
       "      <th>2906b810c7d4411798c6938adc9daaa5</th>\n",
       "      <th>4d5c57ea9a6940dd891ad53e9dbe8da0</th>\n",
       "      <th>9b98b8c7a33c4b65b9aebfe6a799e6d9</th>\n",
       "      <th>ae264e3637204a6fb9bb56bc8210ddfd</th>\n",
       "      <th>f19421c1d4aa40978ebb69ca19b0e20d</th>\n",
       "      <th>fafdcd668e3743c1bb461111dcafc2a4</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>person</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0009655768c64bdeb2e877511632db8f</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>00116118485d4dfda04fdbaba9a87b5c</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0011e0d4e6b944f998e987f904e8c1e5</th>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0020c2b971eb4e9188eac86d93036a77</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0020ccbbb6d84e358d3414a3ff76cffd</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "offer_id                          0b1e1539f2cc45b7b9fa7c272da2e1d7  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               NaN   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               0.0   \n",
       "0020c2b971eb4e9188eac86d93036a77                               NaN   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               NaN   \n",
       "\n",
       "offer_id                          2298d6c36e964ae4a3e7e9706d1fb8c2  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               NaN   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               NaN   \n",
       "0020c2b971eb4e9188eac86d93036a77                               NaN   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               NaN   \n",
       "\n",
       "offer_id                          2906b810c7d4411798c6938adc9daaa5  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               0.0   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               NaN   \n",
       "0020c2b971eb4e9188eac86d93036a77                               NaN   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               NaN   \n",
       "\n",
       "offer_id                          4d5c57ea9a6940dd891ad53e9dbe8da0  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               NaN   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               NaN   \n",
       "0020c2b971eb4e9188eac86d93036a77                               0.0   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               NaN   \n",
       "\n",
       "offer_id                          9b98b8c7a33c4b65b9aebfe6a799e6d9  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               NaN   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               0.0   \n",
       "0020c2b971eb4e9188eac86d93036a77                               NaN   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               0.0   \n",
       "\n",
       "offer_id                          ae264e3637204a6fb9bb56bc8210ddfd  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               NaN   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               NaN   \n",
       "0020c2b971eb4e9188eac86d93036a77                               NaN   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               NaN   \n",
       "\n",
       "offer_id                          f19421c1d4aa40978ebb69ca19b0e20d  \\\n",
       "person                                                               \n",
       "0009655768c64bdeb2e877511632db8f                               NaN   \n",
       "00116118485d4dfda04fdbaba9a87b5c                               0.0   \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               NaN   \n",
       "0020c2b971eb4e9188eac86d93036a77                               NaN   \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               NaN   \n",
       "\n",
       "offer_id                          fafdcd668e3743c1bb461111dcafc2a4  \n",
       "person                                                              \n",
       "0009655768c64bdeb2e877511632db8f                               0.0  \n",
       "00116118485d4dfda04fdbaba9a87b5c                               NaN  \n",
       "0011e0d4e6b944f998e987f904e8c1e5                               NaN  \n",
       "0020c2b971eb4e9188eac86d93036a77                               0.0  \n",
       "0020ccbbb6d84e358d3414a3ff76cffd                               NaN  "
      ]
     },
     "execution_count": 348,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "test_df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "def FunkSVD(complete_mat, latent_features=12, learning_rate=0.0001, iters=100):\n",
    "    '''\n",
    "    This function performs matrix factorization using a basic form of FunkSVD with no regularization\n",
    "    \n",
    "    INPUT:\n",
    "    complete_mat - (numpy array) a matrix with users as rows, offers as columns, and offer completed as values\n",
    "    latent_features - (int) the number of latent features used\n",
    "    learning_rate - (float) the learning rate \n",
    "    iters - (int) the number of iterations\n",
    "    \n",
    "    OUTPUT:\n",
    "    user_mat - (numpy array) a user by latent feature matrix\n",
    "    offer_mat - (numpy array) a latent feature by offer matrix\n",
    "    '''\n",
    "    \n",
    "    # Set up useful values to be used through the rest of the function\n",
    "    n_users = complete_mat.shape[0]\n",
    "    n_offers = complete_mat.shape[1]\n",
    "    num_complete = np.count_nonzero(~np.isnan(complete_mat))\n",
    "    \n",
    "    # initialize the user and movie matrices with random values\n",
    "    user_mat = np.random.rand(n_users, latent_features)\n",
    "    offer_mat = np.random.rand(latent_features, n_offers)\n",
    "    \n",
    "    # initialize sse at 0 for first iteration\n",
    "    sse_accum = 0\n",
    "    \n",
    "    # keep track of iteration and MSE\n",
    "    print(\"Optimizaiton Statistics\")\n",
    "    print(\"Iterations | Mean Squared Error \")\n",
    "    \n",
    "    # for each iteration\n",
    "    for iteration in range(iters):\n",
    "\n",
    "        # update our sse\n",
    "        old_sse = sse_accum\n",
    "        sse_accum = 0\n",
    "        \n",
    "        # For each user-offer pair\n",
    "        for i in range(n_users):\n",
    "            for j in range(n_offers):\n",
    "                \n",
    "                # if the rating exists\n",
    "                if complete_mat[i, j] >= 0:\n",
    "                    \n",
    "                    # compute the error as the actual minus the dot product of the user and offer latent features\n",
    "                    diff = complete_mat[i, j] - np.dot(user_mat[i, :], offer_mat[:, j])\n",
    "                    \n",
    "                    # Keep track of the sum of squared errors for the matrix\n",
    "                    sse_accum += diff**2\n",
    "                    \n",
    "                    # update the values in each matrix in the direction of the gradient\n",
    "                    for k in range(latent_features):\n",
    "                        user_mat[i, k] += learning_rate * (2*diff*offer_mat[k, j])\n",
    "                        offer_mat[k, j] += learning_rate * (2*diff*user_mat[i, k])\n",
    "\n",
    "        # print results\n",
    "        print(\"%d \\t\\t %f\" % (iteration+1, sse_accum / num_complete))\n",
    "        \n",
    "    return user_mat, offer_mat \n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 52,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Run this cell if you want to omit the long process of matrix creation\n",
    "# full_df = pd.read_pickle('user_item_matrix.p')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Run this cell if you want to omit the long process of matrix creation\n",
    "# train_df = pd.read_pickle('train_df.p')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Run this cell if you want to omit the long process of matrix creation\n",
    "# test_df = pd.read_pickle('train_df.p')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Optimizaiton Statistics\n",
      "Iterations | Mean Squared Error \n",
      "1 \t\t 0.320741\n",
      "2 \t\t 0.267338\n",
      "3 \t\t 0.266980\n",
      "4 \t\t 0.266610\n",
      "5 \t\t 0.266234\n",
      "6 \t\t 0.265853\n",
      "7 \t\t 0.265466\n",
      "8 \t\t 0.265074\n",
      "9 \t\t 0.264674\n",
      "10 \t\t 0.264268\n",
      "11 \t\t 0.263855\n",
      "12 \t\t 0.263433\n",
      "13 \t\t 0.263003\n",
      "14 \t\t 0.262564\n",
      "15 \t\t 0.262115\n",
      "16 \t\t 0.261656\n",
      "17 \t\t 0.261185\n",
      "18 \t\t 0.260702\n",
      "19 \t\t 0.260206\n",
      "20 \t\t 0.259697\n",
      "21 \t\t 0.259172\n",
      "22 \t\t 0.258632\n",
      "23 \t\t 0.258075\n",
      "24 \t\t 0.257500\n",
      "25 \t\t 0.256905\n",
      "26 \t\t 0.256290\n",
      "27 \t\t 0.255652\n",
      "28 \t\t 0.254992\n",
      "29 \t\t 0.254306\n",
      "30 \t\t 0.253593\n",
      "31 \t\t 0.252853\n",
      "32 \t\t 0.252082\n",
      "33 \t\t 0.251279\n",
      "34 \t\t 0.250442\n",
      "35 \t\t 0.249570\n",
      "36 \t\t 0.248659\n",
      "37 \t\t 0.247708\n",
      "38 \t\t 0.246715\n",
      "39 \t\t 0.245677\n",
      "40 \t\t 0.244592\n",
      "41 \t\t 0.243458\n",
      "42 \t\t 0.242271\n",
      "43 \t\t 0.241031\n",
      "44 \t\t 0.239734\n",
      "45 \t\t 0.238377\n",
      "46 \t\t 0.236960\n",
      "47 \t\t 0.235478\n",
      "48 \t\t 0.233931\n",
      "49 \t\t 0.232315\n",
      "50 \t\t 0.230630\n",
      "51 \t\t 0.228873\n",
      "52 \t\t 0.227042\n",
      "53 \t\t 0.225136\n",
      "54 \t\t 0.223155\n",
      "55 \t\t 0.221097\n",
      "56 \t\t 0.218962\n",
      "57 \t\t 0.216749\n",
      "58 \t\t 0.214459\n",
      "59 \t\t 0.212093\n",
      "60 \t\t 0.209651\n",
      "61 \t\t 0.207136\n",
      "62 \t\t 0.204548\n",
      "63 \t\t 0.201890\n",
      "64 \t\t 0.199165\n",
      "65 \t\t 0.196376\n",
      "66 \t\t 0.193526\n",
      "67 \t\t 0.190620\n",
      "68 \t\t 0.187662\n",
      "69 \t\t 0.184656\n",
      "70 \t\t 0.181607\n",
      "71 \t\t 0.178520\n",
      "72 \t\t 0.175401\n",
      "73 \t\t 0.172255\n",
      "74 \t\t 0.169086\n",
      "75 \t\t 0.165902\n",
      "76 \t\t 0.162706\n",
      "77 \t\t 0.159505\n",
      "78 \t\t 0.156304\n",
      "79 \t\t 0.153108\n",
      "80 \t\t 0.149922\n",
      "81 \t\t 0.146750\n",
      "82 \t\t 0.143598\n",
      "83 \t\t 0.140469\n",
      "84 \t\t 0.137367\n",
      "85 \t\t 0.134296\n",
      "86 \t\t 0.131259\n",
      "87 \t\t 0.128259\n",
      "88 \t\t 0.125300\n",
      "89 \t\t 0.122383\n",
      "90 \t\t 0.119510\n",
      "91 \t\t 0.116684\n",
      "92 \t\t 0.113905\n",
      "93 \t\t 0.111176\n",
      "94 \t\t 0.108497\n",
      "95 \t\t 0.105869\n",
      "96 \t\t 0.103293\n",
      "97 \t\t 0.100770\n",
      "98 \t\t 0.098299\n",
      "99 \t\t 0.095880\n",
      "100 \t\t 0.093514\n",
      "101 \t\t 0.091200\n",
      "102 \t\t 0.088939\n",
      "103 \t\t 0.086729\n",
      "104 \t\t 0.084571\n",
      "105 \t\t 0.082463\n",
      "106 \t\t 0.080406\n",
      "107 \t\t 0.078398\n",
      "108 \t\t 0.076439\n",
      "109 \t\t 0.074528\n",
      "110 \t\t 0.072664\n",
      "111 \t\t 0.070846\n",
      "112 \t\t 0.069075\n",
      "113 \t\t 0.067348\n",
      "114 \t\t 0.065665\n",
      "115 \t\t 0.064025\n",
      "116 \t\t 0.062427\n",
      "117 \t\t 0.060871\n",
      "118 \t\t 0.059355\n",
      "119 \t\t 0.057878\n",
      "120 \t\t 0.056441\n",
      "121 \t\t 0.055041\n",
      "122 \t\t 0.053679\n",
      "123 \t\t 0.052353\n",
      "124 \t\t 0.051062\n",
      "125 \t\t 0.049805\n",
      "126 \t\t 0.048583\n",
      "127 \t\t 0.047393\n",
      "128 \t\t 0.046236\n",
      "129 \t\t 0.045110\n",
      "130 \t\t 0.044014\n",
      "131 \t\t 0.042949\n",
      "132 \t\t 0.041912\n",
      "133 \t\t 0.040904\n",
      "134 \t\t 0.039923\n",
      "135 \t\t 0.038969\n",
      "136 \t\t 0.038042\n",
      "137 \t\t 0.037139\n",
      "138 \t\t 0.036262\n",
      "139 \t\t 0.035408\n",
      "140 \t\t 0.034578\n",
      "141 \t\t 0.033771\n",
      "142 \t\t 0.032986\n",
      "143 \t\t 0.032222\n",
      "144 \t\t 0.031479\n",
      "145 \t\t 0.030757\n",
      "146 \t\t 0.030054\n",
      "147 \t\t 0.029370\n",
      "148 \t\t 0.028705\n",
      "149 \t\t 0.028058\n",
      "150 \t\t 0.027428\n",
      "151 \t\t 0.026815\n",
      "152 \t\t 0.026218\n",
      "153 \t\t 0.025638\n",
      "154 \t\t 0.025073\n",
      "155 \t\t 0.024523\n",
      "156 \t\t 0.023987\n",
      "157 \t\t 0.023465\n",
      "158 \t\t 0.022957\n",
      "159 \t\t 0.022462\n",
      "160 \t\t 0.021980\n",
      "161 \t\t 0.021511\n",
      "162 \t\t 0.021053\n",
      "163 \t\t 0.020607\n",
      "164 \t\t 0.020172\n",
      "165 \t\t 0.019749\n",
      "166 \t\t 0.019335\n",
      "167 \t\t 0.018932\n",
      "168 \t\t 0.018539\n",
      "169 \t\t 0.018156\n",
      "170 \t\t 0.017782\n",
      "171 \t\t 0.017417\n",
      "172 \t\t 0.017061\n",
      "173 \t\t 0.016713\n",
      "174 \t\t 0.016374\n",
      "175 \t\t 0.016042\n",
      "176 \t\t 0.015718\n",
      "177 \t\t 0.015402\n",
      "178 \t\t 0.015094\n",
      "179 \t\t 0.014792\n",
      "180 \t\t 0.014497\n",
      "181 \t\t 0.014209\n",
      "182 \t\t 0.013927\n",
      "183 \t\t 0.013652\n",
      "184 \t\t 0.013383\n",
      "185 \t\t 0.013120\n",
      "186 \t\t 0.012862\n",
      "187 \t\t 0.012610\n",
      "188 \t\t 0.012364\n",
      "189 \t\t 0.012123\n",
      "190 \t\t 0.011888\n",
      "191 \t\t 0.011657\n",
      "192 \t\t 0.011431\n",
      "193 \t\t 0.011210\n",
      "194 \t\t 0.010994\n",
      "195 \t\t 0.010782\n",
      "196 \t\t 0.010575\n",
      "197 \t\t 0.010372\n",
      "198 \t\t 0.010173\n",
      "199 \t\t 0.009978\n",
      "200 \t\t 0.009788\n",
      "201 \t\t 0.009601\n",
      "202 \t\t 0.009418\n",
      "203 \t\t 0.009239\n",
      "204 \t\t 0.009063\n",
      "205 \t\t 0.008891\n",
      "206 \t\t 0.008723\n",
      "207 \t\t 0.008558\n",
      "208 \t\t 0.008396\n",
      "209 \t\t 0.008237\n",
      "210 \t\t 0.008082\n",
      "211 \t\t 0.007930\n",
      "212 \t\t 0.007780\n",
      "213 \t\t 0.007634\n",
      "214 \t\t 0.007491\n",
      "215 \t\t 0.007350\n",
      "216 \t\t 0.007212\n",
      "217 \t\t 0.007077\n",
      "218 \t\t 0.006945\n",
      "219 \t\t 0.006815\n",
      "220 \t\t 0.006688\n",
      "221 \t\t 0.006563\n",
      "222 \t\t 0.006440\n",
      "223 \t\t 0.006320\n",
      "224 \t\t 0.006203\n",
      "225 \t\t 0.006087\n",
      "226 \t\t 0.005974\n",
      "227 \t\t 0.005863\n",
      "228 \t\t 0.005754\n",
      "229 \t\t 0.005647\n",
      "230 \t\t 0.005543\n",
      "231 \t\t 0.005440\n",
      "232 \t\t 0.005339\n",
      "233 \t\t 0.005241\n",
      "234 \t\t 0.005144\n",
      "235 \t\t 0.005049\n",
      "236 \t\t 0.004955\n",
      "237 \t\t 0.004864\n",
      "238 \t\t 0.004774\n",
      "239 \t\t 0.004686\n",
      "240 \t\t 0.004600\n",
      "241 \t\t 0.004516\n",
      "242 \t\t 0.004433\n",
      "243 \t\t 0.004351\n",
      "244 \t\t 0.004271\n",
      "245 \t\t 0.004193\n",
      "246 \t\t 0.004116\n",
      "247 \t\t 0.004041\n",
      "248 \t\t 0.003967\n",
      "249 \t\t 0.003894\n",
      "250 \t\t 0.003823\n"
     ]
    }
   ],
   "source": [
    "# Create user-by-item matrix - nothing to do here\n",
    "train_data_np = np.array(train_df)\n",
    "\n",
    "# Fit FunkSVD with the specified hyper parameters to the training data\n",
    "user_mat, offer_mat = FunkSVD(train_data_np, latent_features=15, learning_rate=0.005, iters=250)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Optimizaiton Statistics\n",
      "Iterations | Mean Squared Error \n",
      "1 \t\t 0.293689\n",
      "2 \t\t 0.266818\n",
      "3 \t\t 0.266351\n",
      "4 \t\t 0.265873\n",
      "5 \t\t 0.265393\n",
      "6 \t\t 0.264909\n",
      "7 \t\t 0.264422\n",
      "8 \t\t 0.263932\n",
      "9 \t\t 0.263437\n",
      "10 \t\t 0.262939\n",
      "11 \t\t 0.262435\n",
      "12 \t\t 0.261927\n",
      "13 \t\t 0.261414\n",
      "14 \t\t 0.260895\n",
      "15 \t\t 0.260370\n",
      "16 \t\t 0.259839\n",
      "17 \t\t 0.259300\n",
      "18 \t\t 0.258755\n",
      "19 \t\t 0.258201\n",
      "20 \t\t 0.257639\n",
      "21 \t\t 0.257067\n",
      "22 \t\t 0.256486\n",
      "23 \t\t 0.255894\n",
      "24 \t\t 0.255291\n",
      "25 \t\t 0.254675\n",
      "26 \t\t 0.254047\n",
      "27 \t\t 0.253405\n",
      "28 \t\t 0.252748\n",
      "29 \t\t 0.252076\n",
      "30 \t\t 0.251386\n",
      "31 \t\t 0.250679\n",
      "32 \t\t 0.249952\n",
      "33 \t\t 0.249205\n",
      "34 \t\t 0.248436\n",
      "35 \t\t 0.247644\n",
      "36 \t\t 0.246828\n",
      "37 \t\t 0.245985\n",
      "38 \t\t 0.245116\n",
      "39 \t\t 0.244217\n",
      "40 \t\t 0.243287\n",
      "41 \t\t 0.242325\n",
      "42 \t\t 0.241329\n",
      "43 \t\t 0.240297\n",
      "44 \t\t 0.239227\n",
      "45 \t\t 0.238118\n",
      "46 \t\t 0.236967\n",
      "47 \t\t 0.235774\n",
      "48 \t\t 0.234535\n",
      "49 \t\t 0.233250\n",
      "50 \t\t 0.231917\n",
      "51 \t\t 0.230534\n",
      "52 \t\t 0.229099\n",
      "53 \t\t 0.227612\n",
      "54 \t\t 0.226070\n",
      "55 \t\t 0.224473\n",
      "56 \t\t 0.222820\n",
      "57 \t\t 0.221109\n",
      "58 \t\t 0.219341\n",
      "59 \t\t 0.217514\n",
      "60 \t\t 0.215629\n",
      "61 \t\t 0.213685\n",
      "62 \t\t 0.211684\n",
      "63 \t\t 0.209625\n",
      "64 \t\t 0.207509\n",
      "65 \t\t 0.205338\n",
      "66 \t\t 0.203113\n",
      "67 \t\t 0.200835\n",
      "68 \t\t 0.198507\n",
      "69 \t\t 0.196131\n",
      "70 \t\t 0.193709\n",
      "71 \t\t 0.191244\n",
      "72 \t\t 0.188738\n",
      "73 \t\t 0.186195\n",
      "74 \t\t 0.183618\n",
      "75 \t\t 0.181010\n",
      "76 \t\t 0.178374\n",
      "77 \t\t 0.175714\n",
      "78 \t\t 0.173034\n",
      "79 \t\t 0.170336\n",
      "80 \t\t 0.167625\n",
      "81 \t\t 0.164904\n",
      "82 \t\t 0.162176\n",
      "83 \t\t 0.159445\n",
      "84 \t\t 0.156714\n",
      "85 \t\t 0.153986\n",
      "86 \t\t 0.151264\n",
      "87 \t\t 0.148552\n",
      "88 \t\t 0.145852\n",
      "89 \t\t 0.143167\n",
      "90 \t\t 0.140499\n",
      "91 \t\t 0.137851\n",
      "92 \t\t 0.135225\n",
      "93 \t\t 0.132623\n",
      "94 \t\t 0.130048\n",
      "95 \t\t 0.127499\n",
      "96 \t\t 0.124981\n",
      "97 \t\t 0.122493\n",
      "98 \t\t 0.120037\n",
      "99 \t\t 0.117615\n",
      "100 \t\t 0.115227\n",
      "101 \t\t 0.112874\n",
      "102 \t\t 0.110557\n",
      "103 \t\t 0.108277\n",
      "104 \t\t 0.106035\n",
      "105 \t\t 0.103830\n",
      "106 \t\t 0.101663\n",
      "107 \t\t 0.099534\n",
      "108 \t\t 0.097444\n",
      "109 \t\t 0.095393\n",
      "110 \t\t 0.093379\n",
      "111 \t\t 0.091404\n",
      "112 \t\t 0.089468\n",
      "113 \t\t 0.087569\n",
      "114 \t\t 0.085708\n",
      "115 \t\t 0.083884\n",
      "116 \t\t 0.082097\n",
      "117 \t\t 0.080347\n",
      "118 \t\t 0.078633\n",
      "119 \t\t 0.076955\n",
      "120 \t\t 0.075312\n",
      "121 \t\t 0.073703\n",
      "122 \t\t 0.072129\n",
      "123 \t\t 0.070588\n",
      "124 \t\t 0.069080\n",
      "125 \t\t 0.067604\n",
      "126 \t\t 0.066160\n",
      "127 \t\t 0.064748\n",
      "128 \t\t 0.063366\n",
      "129 \t\t 0.062014\n",
      "130 \t\t 0.060691\n",
      "131 \t\t 0.059398\n",
      "132 \t\t 0.058133\n",
      "133 \t\t 0.056895\n",
      "134 \t\t 0.055685\n",
      "135 \t\t 0.054502\n",
      "136 \t\t 0.053344\n",
      "137 \t\t 0.052213\n",
      "138 \t\t 0.051106\n",
      "139 \t\t 0.050025\n",
      "140 \t\t 0.048967\n",
      "141 \t\t 0.047933\n",
      "142 \t\t 0.046923\n",
      "143 \t\t 0.045935\n",
      "144 \t\t 0.044969\n",
      "145 \t\t 0.044026\n",
      "146 \t\t 0.043104\n",
      "147 \t\t 0.042203\n",
      "148 \t\t 0.041322\n",
      "149 \t\t 0.040462\n",
      "150 \t\t 0.039622\n",
      "151 \t\t 0.038801\n",
      "152 \t\t 0.037999\n",
      "153 \t\t 0.037216\n",
      "154 \t\t 0.036451\n",
      "155 \t\t 0.035704\n",
      "156 \t\t 0.034975\n",
      "157 \t\t 0.034262\n",
      "158 \t\t 0.033567\n",
      "159 \t\t 0.032888\n",
      "160 \t\t 0.032224\n",
      "161 \t\t 0.031577\n",
      "162 \t\t 0.030945\n",
      "163 \t\t 0.030328\n",
      "164 \t\t 0.029725\n",
      "165 \t\t 0.029137\n",
      "166 \t\t 0.028563\n",
      "167 \t\t 0.028002\n",
      "168 \t\t 0.027455\n",
      "169 \t\t 0.026920\n",
      "170 \t\t 0.026398\n",
      "171 \t\t 0.025889\n",
      "172 \t\t 0.025391\n",
      "173 \t\t 0.024905\n",
      "174 \t\t 0.024430\n",
      "175 \t\t 0.023967\n",
      "176 \t\t 0.023514\n",
      "177 \t\t 0.023071\n",
      "178 \t\t 0.022639\n",
      "179 \t\t 0.022216\n",
      "180 \t\t 0.021803\n",
      "181 \t\t 0.021400\n",
      "182 \t\t 0.021005\n",
      "183 \t\t 0.020619\n",
      "184 \t\t 0.020242\n",
      "185 \t\t 0.019873\n",
      "186 \t\t 0.019512\n",
      "187 \t\t 0.019159\n",
      "188 \t\t 0.018813\n",
      "189 \t\t 0.018475\n",
      "190 \t\t 0.018143\n",
      "191 \t\t 0.017819\n",
      "192 \t\t 0.017501\n",
      "193 \t\t 0.017190\n",
      "194 \t\t 0.016886\n",
      "195 \t\t 0.016587\n",
      "196 \t\t 0.016294\n",
      "197 \t\t 0.016007\n",
      "198 \t\t 0.015726\n",
      "199 \t\t 0.015450\n",
      "200 \t\t 0.015180\n",
      "201 \t\t 0.014914\n",
      "202 \t\t 0.014654\n",
      "203 \t\t 0.014398\n",
      "204 \t\t 0.014148\n",
      "205 \t\t 0.013901\n",
      "206 \t\t 0.013660\n",
      "207 \t\t 0.013422\n",
      "208 \t\t 0.013189\n",
      "209 \t\t 0.012960\n",
      "210 \t\t 0.012735\n",
      "211 \t\t 0.012514\n",
      "212 \t\t 0.012297\n",
      "213 \t\t 0.012084\n",
      "214 \t\t 0.011874\n",
      "215 \t\t 0.011668\n",
      "216 \t\t 0.011465\n",
      "217 \t\t 0.011266\n",
      "218 \t\t 0.011070\n",
      "219 \t\t 0.010878\n",
      "220 \t\t 0.010688\n",
      "221 \t\t 0.010502\n",
      "222 \t\t 0.010319\n",
      "223 \t\t 0.010139\n",
      "224 \t\t 0.009961\n",
      "225 \t\t 0.009787\n",
      "226 \t\t 0.009616\n",
      "227 \t\t 0.009447\n",
      "228 \t\t 0.009281\n",
      "229 \t\t 0.009118\n",
      "230 \t\t 0.008957\n",
      "231 \t\t 0.008799\n",
      "232 \t\t 0.008644\n",
      "233 \t\t 0.008491\n",
      "234 \t\t 0.008340\n",
      "235 \t\t 0.008192\n",
      "236 \t\t 0.008047\n",
      "237 \t\t 0.007903\n",
      "238 \t\t 0.007762\n",
      "239 \t\t 0.007624\n",
      "240 \t\t 0.007487\n",
      "241 \t\t 0.007353\n",
      "242 \t\t 0.007221\n",
      "243 \t\t 0.007092\n",
      "244 \t\t 0.006964\n",
      "245 \t\t 0.006838\n",
      "246 \t\t 0.006715\n",
      "247 \t\t 0.006593\n",
      "248 \t\t 0.006474\n",
      "249 \t\t 0.006357\n",
      "250 \t\t 0.006241\n"
     ]
    }
   ],
   "source": [
    "# Test for the best number of latent feature. (with latent features 10)\n",
    "user_mat_10, offer_mat_10 = FunkSVD(train_data_np, latent_features=10, learning_rate=0.005, iters=250)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Optimizaiton Statistics\n",
      "Iterations | Mean Squared Error \n",
      "1 \t\t 0.279275\n",
      "2 \t\t 0.267474\n",
      "3 \t\t 0.266634\n",
      "4 \t\t 0.265789\n",
      "5 \t\t 0.264945\n",
      "6 \t\t 0.264100\n",
      "7 \t\t 0.263254\n",
      "8 \t\t 0.262409\n",
      "9 \t\t 0.261563\n",
      "10 \t\t 0.260716\n",
      "11 \t\t 0.259870\n",
      "12 \t\t 0.259023\n",
      "13 \t\t 0.258176\n",
      "14 \t\t 0.257328\n",
      "15 \t\t 0.256480\n",
      "16 \t\t 0.255632\n",
      "17 \t\t 0.254783\n",
      "18 \t\t 0.253934\n",
      "19 \t\t 0.253084\n",
      "20 \t\t 0.252234\n",
      "21 \t\t 0.251383\n",
      "22 \t\t 0.250531\n",
      "23 \t\t 0.249678\n",
      "24 \t\t 0.248824\n",
      "25 \t\t 0.247969\n",
      "26 \t\t 0.247114\n",
      "27 \t\t 0.246256\n",
      "28 \t\t 0.245398\n",
      "29 \t\t 0.244538\n",
      "30 \t\t 0.243676\n",
      "31 \t\t 0.242813\n",
      "32 \t\t 0.241947\n",
      "33 \t\t 0.241080\n",
      "34 \t\t 0.240210\n",
      "35 \t\t 0.239337\n",
      "36 \t\t 0.238462\n",
      "37 \t\t 0.237584\n",
      "38 \t\t 0.236703\n",
      "39 \t\t 0.235818\n",
      "40 \t\t 0.234930\n",
      "41 \t\t 0.234037\n",
      "42 \t\t 0.233141\n",
      "43 \t\t 0.232240\n",
      "44 \t\t 0.231334\n",
      "45 \t\t 0.230423\n",
      "46 \t\t 0.229507\n",
      "47 \t\t 0.228585\n",
      "48 \t\t 0.227657\n",
      "49 \t\t 0.226722\n",
      "50 \t\t 0.225781\n",
      "51 \t\t 0.224833\n",
      "52 \t\t 0.223877\n",
      "53 \t\t 0.222913\n",
      "54 \t\t 0.221940\n",
      "55 \t\t 0.220959\n",
      "56 \t\t 0.219969\n",
      "57 \t\t 0.218970\n",
      "58 \t\t 0.217960\n",
      "59 \t\t 0.216941\n",
      "60 \t\t 0.215910\n",
      "61 \t\t 0.214869\n",
      "62 \t\t 0.213816\n",
      "63 \t\t 0.212751\n",
      "64 \t\t 0.211673\n",
      "65 \t\t 0.210584\n",
      "66 \t\t 0.209481\n",
      "67 \t\t 0.208365\n",
      "68 \t\t 0.207235\n",
      "69 \t\t 0.206091\n",
      "70 \t\t 0.204933\n",
      "71 \t\t 0.203760\n",
      "72 \t\t 0.202573\n",
      "73 \t\t 0.201371\n",
      "74 \t\t 0.200153\n",
      "75 \t\t 0.198920\n",
      "76 \t\t 0.197672\n",
      "77 \t\t 0.196408\n",
      "78 \t\t 0.195128\n",
      "79 \t\t 0.193833\n",
      "80 \t\t 0.192522\n",
      "81 \t\t 0.191196\n",
      "82 \t\t 0.189854\n",
      "83 \t\t 0.188496\n",
      "84 \t\t 0.187123\n",
      "85 \t\t 0.185735\n",
      "86 \t\t 0.184332\n",
      "87 \t\t 0.182915\n",
      "88 \t\t 0.181482\n",
      "89 \t\t 0.180036\n",
      "90 \t\t 0.178576\n",
      "91 \t\t 0.177103\n",
      "92 \t\t 0.175616\n",
      "93 \t\t 0.174117\n",
      "94 \t\t 0.172605\n",
      "95 \t\t 0.171082\n",
      "96 \t\t 0.169547\n",
      "97 \t\t 0.168001\n",
      "98 \t\t 0.166446\n",
      "99 \t\t 0.164880\n",
      "100 \t\t 0.163305\n",
      "101 \t\t 0.161721\n",
      "102 \t\t 0.160129\n",
      "103 \t\t 0.158529\n",
      "104 \t\t 0.156921\n",
      "105 \t\t 0.155308\n",
      "106 \t\t 0.153688\n",
      "107 \t\t 0.152063\n",
      "108 \t\t 0.150432\n",
      "109 \t\t 0.148798\n",
      "110 \t\t 0.147160\n",
      "111 \t\t 0.145518\n",
      "112 \t\t 0.143874\n",
      "113 \t\t 0.142228\n",
      "114 \t\t 0.140580\n",
      "115 \t\t 0.138932\n",
      "116 \t\t 0.137283\n",
      "117 \t\t 0.135635\n",
      "118 \t\t 0.133987\n",
      "119 \t\t 0.132342\n",
      "120 \t\t 0.130698\n",
      "121 \t\t 0.129057\n",
      "122 \t\t 0.127420\n",
      "123 \t\t 0.125787\n",
      "124 \t\t 0.124158\n",
      "125 \t\t 0.122535\n",
      "126 \t\t 0.120918\n",
      "127 \t\t 0.119307\n",
      "128 \t\t 0.117704\n",
      "129 \t\t 0.116108\n",
      "130 \t\t 0.114521\n",
      "131 \t\t 0.112942\n",
      "132 \t\t 0.111374\n",
      "133 \t\t 0.109815\n",
      "134 \t\t 0.108267\n",
      "135 \t\t 0.106731\n",
      "136 \t\t 0.105206\n",
      "137 \t\t 0.103694\n",
      "138 \t\t 0.102195\n",
      "139 \t\t 0.100709\n",
      "140 \t\t 0.099237\n",
      "141 \t\t 0.097779\n",
      "142 \t\t 0.096336\n",
      "143 \t\t 0.094908\n",
      "144 \t\t 0.093496\n",
      "145 \t\t 0.092099\n",
      "146 \t\t 0.090719\n",
      "147 \t\t 0.089356\n",
      "148 \t\t 0.088009\n",
      "149 \t\t 0.086679\n",
      "150 \t\t 0.085366\n",
      "151 \t\t 0.084071\n",
      "152 \t\t 0.082794\n",
      "153 \t\t 0.081534\n",
      "154 \t\t 0.080292\n",
      "155 \t\t 0.079069\n",
      "156 \t\t 0.077863\n",
      "157 \t\t 0.076675\n",
      "158 \t\t 0.075506\n",
      "159 \t\t 0.074354\n",
      "160 \t\t 0.073221\n",
      "161 \t\t 0.072106\n",
      "162 \t\t 0.071008\n",
      "163 \t\t 0.069929\n",
      "164 \t\t 0.068867\n",
      "165 \t\t 0.067824\n",
      "166 \t\t 0.066797\n",
      "167 \t\t 0.065788\n",
      "168 \t\t 0.064797\n",
      "169 \t\t 0.063822\n",
      "170 \t\t 0.062864\n",
      "171 \t\t 0.061923\n",
      "172 \t\t 0.060999\n",
      "173 \t\t 0.060091\n",
      "174 \t\t 0.059199\n",
      "175 \t\t 0.058323\n",
      "176 \t\t 0.057462\n",
      "177 \t\t 0.056618\n",
      "178 \t\t 0.055788\n",
      "179 \t\t 0.054973\n",
      "180 \t\t 0.054174\n",
      "181 \t\t 0.053388\n",
      "182 \t\t 0.052617\n",
      "183 \t\t 0.051861\n",
      "184 \t\t 0.051118\n",
      "185 \t\t 0.050388\n",
      "186 \t\t 0.049672\n",
      "187 \t\t 0.048969\n",
      "188 \t\t 0.048279\n",
      "189 \t\t 0.047602\n",
      "190 \t\t 0.046937\n",
      "191 \t\t 0.046285\n",
      "192 \t\t 0.045644\n",
      "193 \t\t 0.045015\n",
      "194 \t\t 0.044398\n",
      "195 \t\t 0.043792\n",
      "196 \t\t 0.043197\n",
      "197 \t\t 0.042613\n",
      "198 \t\t 0.042039\n",
      "199 \t\t 0.041476\n",
      "200 \t\t 0.040924\n",
      "201 \t\t 0.040381\n",
      "202 \t\t 0.039848\n",
      "203 \t\t 0.039325\n",
      "204 \t\t 0.038811\n",
      "205 \t\t 0.038306\n",
      "206 \t\t 0.037811\n",
      "207 \t\t 0.037324\n",
      "208 \t\t 0.036846\n",
      "209 \t\t 0.036376\n",
      "210 \t\t 0.035914\n",
      "211 \t\t 0.035461\n",
      "212 \t\t 0.035015\n",
      "213 \t\t 0.034577\n",
      "214 \t\t 0.034146\n",
      "215 \t\t 0.033723\n",
      "216 \t\t 0.033307\n",
      "217 \t\t 0.032898\n",
      "218 \t\t 0.032496\n",
      "219 \t\t 0.032100\n",
      "220 \t\t 0.031711\n",
      "221 \t\t 0.031328\n",
      "222 \t\t 0.030951\n",
      "223 \t\t 0.030581\n",
      "224 \t\t 0.030216\n",
      "225 \t\t 0.029857\n",
      "226 \t\t 0.029503\n",
      "227 \t\t 0.029155\n",
      "228 \t\t 0.028812\n",
      "229 \t\t 0.028475\n",
      "230 \t\t 0.028142\n",
      "231 \t\t 0.027814\n",
      "232 \t\t 0.027491\n",
      "233 \t\t 0.027173\n",
      "234 \t\t 0.026859\n",
      "235 \t\t 0.026550\n",
      "236 \t\t 0.026245\n",
      "237 \t\t 0.025944\n",
      "238 \t\t 0.025647\n",
      "239 \t\t 0.025354\n",
      "240 \t\t 0.025065\n",
      "241 \t\t 0.024780\n",
      "242 \t\t 0.024498\n",
      "243 \t\t 0.024221\n",
      "244 \t\t 0.023946\n",
      "245 \t\t 0.023675\n",
      "246 \t\t 0.023408\n",
      "247 \t\t 0.023144\n",
      "248 \t\t 0.022883\n",
      "249 \t\t 0.022625\n",
      "250 \t\t 0.022370\n"
     ]
    }
   ],
   "source": [
    "# Test for the best number of latent feature. (with latent features 5)\n",
    "user_mat_5, offer_mat_5 = FunkSVD(train_data_np, latent_features=5, learning_rate=0.005, iters=250)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [],
   "source": [
    "def predict_reaction(user_matrix, offer_matrix, user_id, offer_id):\n",
    "    '''\n",
    "    We can use this to make predictions for how users would react with the offers\n",
    "    \n",
    "    INPUT:\n",
    "    user_matrix - user by latent factor matrix\n",
    "    offer_matrix - latent factor by offer matrix\n",
    "    user_id - the user_id from the reviews df\n",
    "    offer_id - the offer_id according the offers df\n",
    "    \n",
    "    OUTPUT:\n",
    "    pred - the predicted reaction for user_id-offer_id according to FunkSVD\n",
    "    '''\n",
    "    try:\n",
    "        # Use the training data to create a series of users and movies that matches the ordering in training data\n",
    "        user_ids_series = np.array(train_df.index)\n",
    "        offer_ids_series = np.array(train_df.columns)\n",
    "\n",
    "        # User row and Movie Column\n",
    "        user_row = np.where(user_ids_series == user_id)[0][0]\n",
    "        offer_col = np.where(offer_ids_series == offer_id)[0][0]\n",
    "\n",
    "        # Take dot product of that row and column in U and V to make prediction\n",
    "        pred = np.dot(user_matrix[user_row, :], offer_matrix[:, offer_col])\n",
    "        \n",
    "        return pred\n",
    "    \n",
    "    except:\n",
    "        #print(\"I'm sorry, but a prediction cannot be made for this user-offer pair.  It looks like one of these items does not exist in our current database.\")\n",
    "    \n",
    "        return None\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [],
   "source": [
    "def validation(test_df, user_mat, offer_mat):\n",
    "    '''Measure the squared errors for the prediction'''\n",
    "    num_complete = np.count_nonzero(~np.isnan(test_df))\n",
    "    \n",
    "    sse_accum = 0\n",
    "    \n",
    "    for user_id in test_df.index:\n",
    "        for offer_id in test_df.columns:\n",
    "            if ~np.isnan(test_df.loc[user_id, offer_id]):\n",
    "                predict_value = predict_reaction(user_mat, offer_mat, user_id, offer_id)\n",
    "                if predict_value != None:\n",
    "                    # compute the error as the actual minus the dot product of the user and offer latent features\n",
    "                    diff = test_df.loc[user_id, offer_id] - predict_reaction(user_mat, offer_mat, user_id, offer_id)\n",
    "\n",
    "                    # Keep track of the sum of squared errors for the matrix\n",
    "                    sse_accum += diff**2\n",
    "    \n",
    "    print(sse_accum / num_complete)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 384,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0.33037353189698154\n"
     ]
    }
   ],
   "source": [
    "# Evaluation for latent features of 15\n",
    "validation(test_df, user_mat, offer_mat)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0.00917476430491666\n"
     ]
    }
   ],
   "source": [
    "# Evaluation for latent features of 10\n",
    "validation(test_df, user_mat_10, offer_mat_10)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0.023911395735760205\n"
     ]
    }
   ],
   "source": [
    "# Evaluation for latent features of 5\n",
    "validation(test_df, user_mat_5, offer_mat_5)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 54,
   "metadata": {},
   "outputs": [],
   "source": [
    "def recommend_offer(user_id, user_mat, offer_mat):\n",
    "    recommend = {}\n",
    "    for offer_id in train_df.columns:\n",
    "        pred_val = predict_reaction(user_mat, offer_mat, user_id, offer_id)\n",
    "        if pred_val != None:\n",
    "            recommend[offer_id] = pred_val\n",
    "        else:\n",
    "            break\n",
    "    if pred_val == None:\n",
    "        print(\"Because this user wasn't in our database, we are giving back the top best sale offer recommendations for all users.\")\n",
    "        top_offer = best_sale_offer(full_df)\n",
    "        for offer_id in top_offer['offer_id']:\n",
    "            print(\"offer id: \", offer_id)\n",
    "    else:\n",
    "        print(\"recommend offer for user \", user_id)\n",
    "        for offer_id, pred_val in sorted(recommend.items(), key=lambda kv:(kv[1], kv[0]), reverse=True):\n",
    "            print(\"offer id: \", offer_id, \" predicted value: \", round(pred_val,2))\n",
    "        \n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 55,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "recommend offer for user  0610b486422d4921ae7d2bf64640c50b\n",
      "offer id:  ae264e3637204a6fb9bb56bc8210ddfd  predicted value:  1.3\n",
      "offer id:  fafdcd668e3743c1bb461111dcafc2a4  predicted value:  0.99\n",
      "offer id:  2298d6c36e964ae4a3e7e9706d1fb8c2  predicted value:  0.73\n",
      "offer id:  4d5c57ea9a6940dd891ad53e9dbe8da0  predicted value:  0.54\n",
      "offer id:  2906b810c7d4411798c6938adc9daaa5  predicted value:  0.28\n",
      "offer id:  0b1e1539f2cc45b7b9fa7c272da2e1d7  predicted value:  0.24\n",
      "offer id:  f19421c1d4aa40978ebb69ca19b0e20d  predicted value:  0.09\n",
      "offer id:  9b98b8c7a33c4b65b9aebfe6a799e6d9  predicted value:  0.06\n"
     ]
    }
   ],
   "source": [
    "# recommend offer for a particular user\n",
    "recommend_offer('0610b486422d4921ae7d2bf64640c50b', user_mat, offer_mat)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 58,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Because this user wasn't in our database, we are giving back the top best sale offer recommendations for all users.\n",
      "                           offer_id       gain\n",
      "7  fafdcd668e3743c1bb461111dcafc2a4  596220.84\n",
      "1  2298d6c36e964ae4a3e7e9706d1fb8c2  538027.98\n",
      "6  f19421c1d4aa40978ebb69ca19b0e20d  480555.03\n",
      "3  4d5c57ea9a6940dd891ad53e9dbe8da0  441918.93\n",
      "5  ae264e3637204a6fb9bb56bc8210ddfd  423683.27\n",
      "2  2906b810c7d4411798c6938adc9daaa5  305568.42\n",
      "4  9b98b8c7a33c4b65b9aebfe6a799e6d9  304361.77\n",
      "0  0b1e1539f2cc45b7b9fa7c272da2e1d7  218905.94\n",
      "offer id:  fafdcd668e3743c1bb461111dcafc2a4\n",
      "offer id:  2298d6c36e964ae4a3e7e9706d1fb8c2\n",
      "offer id:  f19421c1d4aa40978ebb69ca19b0e20d\n",
      "offer id:  4d5c57ea9a6940dd891ad53e9dbe8da0\n",
      "offer id:  ae264e3637204a6fb9bb56bc8210ddfd\n",
      "offer id:  2906b810c7d4411798c6938adc9daaa5\n",
      "offer id:  9b98b8c7a33c4b65b9aebfe6a799e6d9\n",
      "offer id:  0b1e1539f2cc45b7b9fa7c272da2e1d7\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAZsAAAETCAYAAADge6tNAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvhp/UCwAAIABJREFUeJzt3X+8VVWd//HXW/wB/sCfaMglMMVSK1GvYOmUZSJqipmWNjOgUzE1WtY0M1LTd/yBlj7Gxh81aZikNP7ISUtMTRmNSlPhIv5CUlApbvgDARFEFPDz/WOtm4fruefue7mbA8f38/E4j7v32mvv9dnnwvnctfc6aysiMDMzK9Mm9Q7AzMwan5ONmZmVzsnGzMxK52RjZmalc7IxM7PSOdmYmVnpnGxsvZA0T9In6h3HhkzSeyXNlLRM0le7eYxvSfpxxfqnJM2XtFzSfj3RxoZA0pclvZDPa0dJB0uak9ePq3d89nZONlaYpEMk/UHSUkmLJd0n6cD11PZukt6U9MP10V53SJoq6QvrcIh/A6ZGxDYRcVkHx1+ZE8UrkmZIGidpi7Y6EfGdiKiM4SLg9IjYOiJmdtZGmSQdKqm1QL0PS7onn+dSSbdK2rti+2bAfwEj8nktAs4FfpDXf1neWVh3OdlYIZL6Ar8Cvg/sAAwAzgFeX08hjAaWACdVfrg2mEHArE7qnB4R2wD9gW8AJwG3S1LBYxZpoypJm3Znvy628SHgLuAWYFdgN+AR4D5J78nVdgF6sxGdlwER4Zdfnb6AZuDlGtt3B+4BFgEvAdcC21Vsnwd8Ii9vAowDns71bwR26KT9p4EvAy8AJ7TbFsA/AXOAZcD4HM/9wCv5+JtX1P8iMBdYDEwGds3lg/OxNq2oOxX4Ql4+BbiX1FtYAjwLHJm3nQ+sAVYCy0l/ZVc7j2NJH4ov52Pvlcvvabf/nlX2/WssFWXvBlYAn8zrZwP/A2yRjxPAq/n9e1sbud5FwJ/ze3sF0Ccf61CgFTgTeB74aS7/JPBwPoc/AB9s93v+F+BRYCnwM1Ji2Ap4DXgzt7287X1vdz6/B35YpfwOYFKO+dV8XsvzOT2dj/taLtsC2Ba4CngO+AtwHtCr4vd4H3Bx/jdwHrAH8Nsc80vAz+r9f67RXnUPwK+N4wX0JSWGa4Ajge3bbd8DODz/R+8H/A64pGL7PN5KNl8DHgCacv0fAdfXaPtvSD2o7Uk9q8nttgcpafQF9sl17wbekz90ngDG5Lofzx8m++e2vw/8Lm8bTOfJZhUpWfUiJb8FgNrX7eA82j4oDwc2I13SmktOhAX2r7o9v9cX5uWzgf9p997s0dExgEvye7cDsA1wK/DdvO1QYDVwYX6v+uT37UVgeH4PxuTf7RYVv+dppF7JDsBs4EsVx2utcX5bkpLhx6psOxV4rsbvaR7531de/yXp39VWwM45pn+s+D2uBr4CbJrP63rg30l/CPUGDqn3/7lGe/kymhUSEa8Ah5D+k18JLJQ0WdIuefvciJgSEa9HxELSNfWPdnC4fwT+PSJaI+J10gfkCTUuZ4wB7oiIJcB1wJGSdm5X58KIeCUiZgGPA3dFxDMRsZT0V/F+ud7fAhMj4qHc9jeBD0kaXPCt+FNEXBkRa0iJtz/psk4RnwVuy+/TKlKPog/w4YL7d2QB6YO9S/Klty8CX4+IxRGxDPgO6dJcmzeBs/Lv9bVc/0cR8WBErImIa0jJ/aCKfS6LiAURsZiUvIYWDGkH0of9c1W2PQfsVPC8diH9QfS1iHg1Il4k9WIqz2tBRHw/Ilbn81pFuhS3a0SsjIh7C8ZsBTnZWGERMTsiTomIJuD9pL9eLwGQtLOkGyT9RdIrpEs5HX04DAJ+IellSS+T/vpdQ5UPbUl9gBNJl+WIiPtJl3w+167qCxXLr1VZ3zov7wr8qeKclpN6bAM6Of02z1fsuyIvbt1B3fbat/0mML8LbXdkAOlyUFf1I/UmZlT8Ln6dy9ssjIiVFeuDgG+01c/7DCSdW5vnK5ZXUPz9WUJKbv2rbOtP6pEWMYjUc3yuIsYfkXo4bea32+ffAAHTJM2S9A8F27KCnGysWyLij8DVpKQD8F1Sr+eDEdEX+DvSf95q5pPudWxX8eodEX+pUvdTpMtjP5T0vKTnSR+uo7sZ+gLShxEAkrYCdiRd1381F29ZUf9dXTh2Z1Oot29bpA/qauddiKSBwAGkex1d9RIpEe9T8XvYNiIqk0P7c5oPnN/ud7dlRFxfoL2a709EvEq6z3Zilc2fIV0aLWI+qbe1U0WMfSNin45iiYjnI+KLEbErqef9Q0l7FGzPCnCysUIkvU/SNyQ15fWBwMmkey+QrvcvB16WNAD41xqHuwI4X9KgfKx+kkZ1UHcMMBH4AOlyzFDgYGCopA9041SuA06VNDSPavsO8GBEzMuX//4C/J2kXvmv2927cOwXSPeJOnIjcLSkw/Lw3W+QPhT/0NWTkLSlpI+SRm1NA27v6jFyz+pK4OK2y5KSBkg6osZuVwJfkjRcyVaSjpa0TYEmXwB2lLRtjTrjgDGSvippG0nbSzoP+BBp9GOR83qONKLte5L6StpE0u75/apK0olt/7ZJPawg9bathzjZWFHLSDeFH5T0KinJPE76wIT0QbA/aTTPbcDNNY51Kemm9F2SluVjDW9fKSetw0gDDZ6veM0gXe4Z09WTiIi7gf8H3ES6D7A7a1/L/yIpUS4iDTboSiK4lHTvaYmkt32HJSKeJPX4vk/qVRwDHBMRb3ShjR/k9+wF0iXMm4CROXF0x5mkQQoP5Muf/we8t6PKEdFCeo9+QPpQnku64d6p3Bu+HngmX97atUqde4EjgONJv58/ke63HRIRc4qfFqOBzUmDQ5YAP6f65bk2B5L+bS8n/ds8IyKe7UJ71om2UTRmZmalcc/GzMxK52RjZmalc7IxM7PSOdmYmVnpnGzMzKx0nu0022mnnWLw4MH1DsPMbKMyY8aMlyKiX2f1nGyywYMH09LSUu8wzMw2KpL+1HktX0YzM7P1wMnGzMxK52RjZmalK/WejaTtgB+TZgYO4B+AJ0lP7xtMeuDRZyJiSZ4B91LgKNK05KdExEP5OGOAb+fDnpefoYGkA0gzD/chTUR4RkSEpB2qtVHmuZrZO9eqVatobW1l5cqVnVfeSPXu3ZumpiY222yzbu1f9gCBS4FfR8QJkjYnTd3+LeDuiLhA0jjSLK9nkh52NCS/hgOXA8Nz4jiL9FjiID17Y3JOHpcDY0kTOd4OjCQ9KGtcB22YmfW41tZWttlmGwYPHkz6u7mxRASLFi2itbWV3XbbrVvHKO0ymqS+wEdIzwEnIt6IiJeBUaQnHJJ/HpeXRwGTInkA2E5Sf9IMsFPykwSXAFOAkXlb34i4P9JsopPaHataG2ZmPW7lypXsuOOODZloACSx4447rlPPrcx7Nu8BFgI/kTRT0o/zg6p2yc+baHvuRNvT8waw9tPzWnNZrfLWKuXUaMPMrBSNmmjarOv5lZlsNiU93+TyiNiP9BTEcTXqVzuT6EZ5YZLGSmqR1LJw4cKu7GpmttG64oormDRp0npts8x7Nq1Aa0Q8mNd/Tko2L0jqHxHP5UthL1bUH1ixfxPpMbqtwKHtyqfm8qYq9anRxloiYgIwAaC5ublQoho87rYi1bpk3gVH9/gxzax+evpzoqc/I770pS/16PGKKK1nExHPA/MltT317zDSU/Mm89YTFseQHmtLLh+dHzV7ELA0XwK7ExiRHw+7PTACuDNvWybpoDySbXS7Y1Vrw8ysIY0fP573ve99HH744Zx88slcdNFFXHnllRx44IHsu+++fPrTn2bFihUAnH322Vx00UUAHHrooZx55pkMGzaMPffck9///velxFf292y+Alwr6VHSs+O/A1wAHC5pDnB4Xoc0muwZ0mNmrwT+CSAiFgPjgen5dW4uA/gyaWj1XOBp0kg0arRhZtZwWlpauOmmm5g5cyY333zzX6feOv7445k+fTqPPPIIe+21F1dddVXV/VevXs20adO45JJLOOecc0qJsdShzxHxMGnIcnuHVakbwGkdHGciMLFKeQvpOzztyxdVa8PMrBHde++9jBo1ij59+gBwzDHHAPD444/z7W9/m5dffpnly5dzxBFHVN3/+OOPB+CAAw5g3rx5pcToiTjNzDZy6W/1tzvllFP45S9/yb777svVV1/N1KlTq9bbYostAOjVqxerV68uJUZPV2NmtpE75JBDuPXWW1m5ciXLly/nttvSAIVly5bRv39/Vq1axbXXXlvXGN2zMTPbyB144IEce+yx7LvvvgwaNIjm5ma23XZbxo8fz/Dhwxk0aBAf+MAHWLZsWd1iVEfdr3ea5ubmKPI8Gw99NrP2Zs+ezV577VXXGJYvX87WW2/NihUr+MhHPsKECRPYf//9e7SNaucpaUZEVLs3vxb3bMzMGsDYsWN54oknWLlyJWPGjOnxRLOunGzMzBrAddddV+8QavIAATMzK52TjZlZD2j0+9/ren5ONmZm66h3794sWrSoYRNO2/Nsevfu3e1j+J6Nmdk6ampqorW1lUaePb7tSZ3d5WRjZraONttss24/wfKdwpfRzMysdE42ZmZWOicbMzMrnZONmZmVzsnGzMxK52RjZmal89DnBuXZqc1sQ+KejZmZlc7JxszMSudkY2ZmpXOyMTOz0jnZmJlZ6ZxszMysdE42ZmZWOicbMzMrXanJRtI8SY9JelhSSy7bQdIUSXPyz+1zuSRdJmmupEcl7V9xnDG5/hxJYyrKD8jHn5v3Va02zMysPtZHz+ZjETE0Iprz+jjg7ogYAtyd1wGOBIbk11jgckiJAzgLGA4MA86qSB6X57pt+43spA0zM6uDelxGGwVck5evAY6rKJ8UyQPAdpL6A0cAUyJicUQsAaYAI/O2vhFxf6QHf09qd6xqbZiZWR2UnWwCuEvSDEljc9kuEfEcQP65cy4fAMyv2Lc1l9Uqb61SXqsNMzOrg7In4jw4IhZI2hmYIumPNeqqSll0o7ywnADHArz73e/uyq5mZtYFpfZsImJB/vki8AvSPZcX8iUw8s8Xc/VWYGDF7k3Agk7Km6qUU6ON9vFNiIjmiGju169fd0/TzMw6UVqykbSVpG3aloERwOPAZKBtRNkY4Ja8PBkYnUelHQQszZfA7gRGSNo+DwwYAdyZty2TdFAehTa63bGqtWFmZnVQ5mW0XYBf5NHImwLXRcSvJU0HbpT0eeDPwIm5/u3AUcBcYAVwKkBELJY0Hpie650bEYvz8peBq4E+wB35BXBBB22YmVkdlJZsIuIZYN8q5YuAw6qUB3BaB8eaCEysUt4CvL9oG2ZmVh+eQcDMzErnZGNmZqUre+izWU2Dx93W48ecd8HRPX5MM1s37tmYmVnpnGzMzKx0TjZmZlY6JxszMyudk42ZmZXOycbMzErnZGNmZqVzsjEzs9I52ZiZWemcbMzMrHRONmZmVjonGzMzK50n4jQrwBOGmq0b92zMzKx0TjZmZlY6JxszMyudk42ZmZXOycbMzErn0WhmDcSj5mxD5Z6NmZmVzsnGzMxK52RjZmalc7IxM7PSlZ5sJPWSNFPSr/L6bpIelDRH0s8kbZ7Lt8jrc/P2wRXH+GYuf1LSERXlI3PZXEnjKsqrtmFmZvWxPno2ZwCzK9YvBC6OiCHAEuDzufzzwJKI2AO4ONdD0t7AScA+wEjghzmB9QL+GzgS2Bs4Odet1YaZmdVBqclGUhNwNPDjvC7g48DPc5VrgOPy8qi8Tt5+WK4/CrghIl6PiGeBucCw/JobEc9ExBvADcCoTtowM7M66DTZSDqxSFkHLgH+DXgzr+8IvBwRq/N6KzAgLw8A5gPk7Utz/b+Wt9uno/JabbQ/j7GSWiS1LFy4sOApmZlZVxXp2XyzYNlaJH0SeDEiZlQWV6kanWzrqfK3F0ZMiIjmiGju169ftSpmZtYDOpxBQNKRwFHAAEmXVWzqC6yuvtdaDgaOlXQU0DvvdwmwnaRNc8+jCViQ67cCA4FWSZsC2wKLK8rbVO5TrfylGm2YmVkd1OrZLABagJXAjIrXZOCIGvsBEBHfjIimiBhMusF/T0T8LfAb4IRcbQxwS16enNfJ2++JiMjlJ+XRarsBQ4BpwHRgSB55tnluY3Lep6M2zMysDjrs2UTEI8Ajkq6LiFU92OaZwA2SzgNmAlfl8quAn0qaS+rRnJTjmCXpRuAJUo/qtIhYAyDpdOBOoBcwMSJmddKGmZnVQZGJOIdJOhsYlOsLiIh4T9FGImIqMDUvP0MaSda+zkqg6sCDiDgfOL9K+e3A7VXKq7ZhZmb1USTZXAV8nXQJbU254ZiZWSMqkmyWRsQdpUdiZmYNq0iy+Y2k/wRuBl5vK4yIh0qLyszMGkqRZDM8/2yuKAvSt/TNzMw61WmyiYiPrY9AzMyscXWabCT9R7XyiDi358MxM7NGVOQy2qsVy72BT7L2LM5mZmY1FbmM9r3KdUkXkb7Vb2ZmVkh3HjGwJVD4C51mZmZF7tk8xluzJvcC+gG+X2NmZoUVuWfzyYrl1cALFc+KMTMz61Snl9Ei4k/AdsAxwKdIj2A2MzMrrMiTOs8ArgV2zq9rJX2l7MDMzKxxFLmM9nlgeES8CiDpQuB+4PtlBmZmZo2jyGg0sfZsz2uo/uhlMzOzqor0bH4CPCjpF3n9OPwwMjMz64IiX+r8L0lTgUNIPZpTI2Jm2YGZmVnjKNKzAXiWNOx5U0CS9vcjBszMrKgiX+ocD5wCPM1bX+70IwbMzKywIj2bzwC7R8QbZQdjZmaNqchotMdJX+o0MzPrliI9m+8CMyU9ztqPhT62tKjMzKyhFEk21wAXAo8Bb5YbjpmZNaIiyealiLis9EjMzKxhFUk2MyR9l/TAtMrLaB76bGZmhRQZILAfcBDwHeB7+XVRZztJ6i1pmqRHJM2SdE4u303Sg5LmSPqZpM1z+RZ5fW7ePrjiWN/M5U9KOqKifGQumytpXEV51TbMzKw+ijxi4GPtX8DJBY79OvDxiNgXGAqMlHQQ6f7PxRExBFhCmuiT/HNJROwBXJzrIWlv4CRgH2Ak8ENJvST1Av4bOJL02IOTc11qtGFmZnVQdAYBJG0LfBr4HLAXMKBW/YgIYHle3Sy/2r4M+rlcfg1wNnA5MCovA/wc+IEk5fIbIuJ14FlJc4Fhud7ciHgmx3cDMErS7BptmNkGYPC423r0ePMuOLpHj2c9r2aykdQHOJb0wb0/sA1pIs7fFTl47n3MAPYg9UKeBl6ueNJnK28lrQHAfICIWC1pKbBjLn+g4rCV+8xvVz4879NRG2ZmhfR0QoR3dlLs8DKapGuBp4ARwA+AwaTLXFMjotAQ6IhYExFDgSZSb2SvatXamuxgW0+Vv42ksZJaJLUsXLiwWhUzM+sBte7ZvJ90v2M28MeIWEMHH9qdiYiXgamkgQbbSWrrUTUBC/JyKzAQIG/fFlhcWd5un47KX6rRRvu4JkREc0Q09+vXrzunZmZmBXSYbPKN/c8AfYH/k/R7YBtJ7ypyYEn9JG2Xl/sAnyAlrt8AJ+RqY4Bb8vLkvE7efk++7zMZOCmPVtsNGAJMA6YDQ/LIs81Jgwgm5306asPMzOqg5j2biPgj8B/Af0hqJo1CmyapNSI+3Mmx+wPX5Ps2mwA3RsSvJD0B3CDpPGAmbz2I7Srgp3kAwGJS8iAiZkm6EXiC9JiD03IvC0mnA3cCvYCJETErH+vMDtowM7M6KDwaLSJagBZJ/wJ8pED9R0nf0Wlf/gxvjSarLF8JnNjBsc4Hzq9Sfjtwe9E2zMysPgonmzb5MtVvS4jFzMwaVJEZBMzMzNaJk42ZmZWu02QjaRdJV0m6I6/vLcnTv5iZWWFFejZXk0Z87ZrXnwK+VlZAZmbWeIokm50i4kbyg9PyNDBrSo3KzMwaSpFk86qkHcmzB+SZm5eWGpWZmTWUIkOf/5n0Lf7dJd0H9OOtb+ebmZl1qtNkExEPSfoo8F7SJJdPRsSq0iMzM7OG0WGykXR8B5v2lERE3FxSTGZm1mBq9WyOqbEtACcbMzMrpMNkExGnrs9AzMyscRWaG03S0cA+QO+2sog4t6ygzMyssRSZQeAK4LPAV0gDBE4EBpUcl5mZNZAi37P5cESMJj0S+hzgQ6z9hEwzM7OaiiSb1/LPFZJ2BVYBu5UXkpmZNZoi92x+lR/v/J/AQ6SRaFeWGpWZmTWUIl/qHJ8Xb5L0K6B3RHi6GjMzK6zDy2iSDpT0ror10cCNwHhJO6yP4MzMrDHUumfzI+ANAEkfAS4AJpEm4ZxQfmhmZtYoal1G6xURi/PyZ4EJEXET6XLaw+WHZmZmjaJWz6aXpLZkdBhwT8W2Ql8GNTMzg9pJ43rgt5JeIg1//j2ApD3w82zMzKwLas2Ndr6ku4H+wF0REXnTJqTZBMzMrM4Gj7utx48574Kje/yYNS+HRcQDVcqe6vEozMysoRWZQcDMzGydlJZsJA2U9BtJsyXNknRGLt9B0hRJc/LP7XO5JF0maa6kRyXtX3GsMbn+HEljKsoPkPRY3ucySarVhpmZ1UeZPZvVwDciYi/gIOA0SXsD44C7I2IIcHdeBzgSGJJfY4HLISUO4CxgODAMOKsieVye67btNzKXd9SGmZnVQWnJJiKei4iH8vIyYDYwABgFXJOrXQMcl5dHAZMieQDYTlJ/4AhgSkQsjoglwBRgZN7WNyLuz4MXJrU7VrU2zMysDtbLPRtJg4H9gAeBXSLiOUgJCdg5VxsAzK/YrTWX1SpvrVJOjTbMzKwOSk82krYGbgK+FhGv1KpapSy6Ud6V2MZKapHUsnDhwq7samZmXVBqspG0GSnRXBsRN+fiF/IlMPLPF3N5K2s/lK0JWNBJeVOV8lptrCUiJkREc0Q09+vXr3snaWZmnSpzNJqAq4DZEfFfFZsmA20jysYAt1SUj86j0g4CluZLYHcCIyRtnwcGjADuzNuWSTootzW63bGqtWFmZnVQ5hxnBwN/DzxWMXHnt0izR98o6fPAn4ET87bbgaOAucAK4FSAiFgsaTwwPdc7t2KC0C8DVwN9gDvyixptmJlZHZSWbCLiXqrfV4E0sWf7+gGc1sGxJgITq5S3AO+vUr6oWhtmZlYfnkHAzMxK52RjZmalc7IxM7PSOdmYmVnpnGzMzKx0TjZmZlY6JxszMyudk42ZmZXOycbMzErnZGNmZqVzsjEzs9I52ZiZWemcbMzMrHRONmZmVjonGzMzK52TjZmZlc7JxszMSudkY2ZmpXOyMTOz0jnZmJlZ6ZxszMysdE42ZmZWOicbMzMrnZONmZmVzsnGzMxK52RjZmalKy3ZSJoo6UVJj1eU7SBpiqQ5+ef2uVySLpM0V9Kjkvav2GdMrj9H0piK8gMkPZb3uUySarVhZmb1U2bP5mpgZLuyccDdETEEuDuvAxwJDMmvscDlkBIHcBYwHBgGnFWRPC7Pddv2G9lJG2ZmVielJZuI+B2wuF3xKOCavHwNcFxF+aRIHgC2k9QfOAKYEhGLI2IJMAUYmbf1jYj7IyKASe2OVa0NMzOrk/V9z2aXiHgOIP/cOZcPAOZX1GvNZbXKW6uU12rDzMzqZEMZIKAqZdGN8q41Ko2V1CKpZeHChV3d3czMClrfyeaFfAmM/PPFXN4KDKyo1wQs6KS8qUp5rTbeJiImRERzRDT369ev2ydlZma1re9kMxloG1E2Brilonx0HpV2ELA0XwK7Exghafs8MGAEcGfetkzSQXkU2uh2x6rWhpmZ1cmmZR1Y0vXAocBOklpJo8ouAG6U9Hngz8CJufrtwFHAXGAFcCpARCyWNB6YnuudGxFtgw6+TBrx1ge4I7+o0YaZmdVJackmIk7uYNNhVeoGcFoHx5kITKxS3gK8v0r5omptmJlZ/WwoAwTMzKyBOdmYmVnpnGzMzKx0TjZmZlY6JxszMyudk42ZmZXOycbMzErnZGNmZqVzsjEzs9I52ZiZWemcbMzMrHRONmZmVjonGzMzK52TjZmZlc7JxszMSudkY2ZmpXOyMTOz0jnZmJlZ6ZxszMysdE42ZmZWOicbMzMrnZONmZmVzsnGzMxK52RjZmalc7IxM7PSOdmYmVnpGjbZSBop6UlJcyWNq3c8ZmbvZA2ZbCT1Av4bOBLYGzhZ0t71jcrM7J2rIZMNMAyYGxHPRMQbwA3AqDrHZGb2jqWIqHcMPU7SCcDIiPhCXv97YHhEnN6u3lhgbF59L/BkD4eyE/BSDx+zDBtDnBtDjOA4e5rj7FllxDkoIvp1VmnTHm50Q6EqZW/LqhExAZhQWhBSS0Q0l3X8nrIxxLkxxAiOs6c5zp5Vzzgb9TJaKzCwYr0JWFCnWMzM3vEaNdlMB4ZI2k3S5sBJwOQ6x2Rm9o7VkJfRImK1pNOBO4FewMSImFWHUEq7RNfDNoY4N4YYwXH2NMfZs+oWZ0MOEDAzsw1Lo15GMzOzDYiTjZmZlc7JxszMSudk00MkfVXSwM5rWmckDZfUNy/3kXSOpFslXShp23rHV0nSMEkH5uW9Jf2zpKPqHVctkg7JcY6odyztSXqfpMMkbd2ufGS9YuqMpEn1jqGa/F6eKekySZfm5b3qFo8HCPQMSUuBV4GngeuB/42IhfWNqmsknRoRP9kA4pgF7JtHFU4AVgA/Bw7L5cfXNcBM0lmk+fc2BaYAw4GpwCeAOyPi/PpF9xZJ0yJiWF7+InAa8AtgBHBrRFxQz/jaSPoqKbbZwFDgjIi4JW97KCL2r2d8OY72X6EQ8DHgHoCIOHa9B1WFpDOBk0lTdbXm4ibS10BuqMfv3Mmmh0iaCRxA+qD5LHAsMIOUeG6OiGV1DK8QSX+OiHdvAHHMjoi98vJaHzKSHo6IofWL7i2SHiN9KG4BPA80RcQrkvoAD0bEB+saYCZpZkTsl5enA0dFxEJJWwEPRMQH6hthkt/PD0XEckmDSX9g/DQiLq08h3qS9BDwBPBj0qwkIv0fPwkgIn5bv+jeIukpYJ+IWNWufHNgVkQMWd8xNeT3bOokIuJN4C7gLkmbkf7qPRm4COh07qD1QdKjHW0CdllV4vawAAAEBElEQVSfsdTweEUv6xFJzRHRImlPYFVnO69HqyNiDbBC0tMR8QpARLwm6c06x1ZpE0nbky6bq63HHRGvSlpd39DW0isilgNExDxJhwI/lzSI6lNQ1UMzcAbw78C/RsTDkl7bUJJMhTeBXYE/tSvvn7etd042PWet/wz5L4rJwOT8l+6GYhfgCGBJu3IBf1j/4VT1BeBSSd8mTRp4v6T5wPy8bUPxhqQtI2IFqVcLQL6vtCElm21JvWwBIeldEfF8vi+yoXyIAzwvaWhEPAyQezifBCYCG0TvK/9BebGk/80/X2DD/Bz9GnC3pDmk/zcA7wb2AE7vcK8S+TJaD5G0Z0Q8Ve84OiPpKuAnEXFvlW3XRcTn6hBWVZK2Ad5D+s/cGhEv1DmktUjaIiJer1K+E9A/Ih6rQ1iFSdoS2CUinq13LACSmki9xeerbDs4Iu6rQ1g1SToaODgivlXvWNqTtAnpcSsDSH9UtALTc298/cfjZGNmZmXz0GczMyudk42ZmZXOycasE5KaJN0iaY6kp/MX5Dav2H69pEclfT1/ke5hSTMl7V7PuNuTdIqkH9Q7DntncrIxq0GSgJuBX+bvJuwJbA2cn7e/C/hwRHwwIi4GjgNuiYj9IuLpgm30Kif6nrWxxGkbJicbs9o+Dqxsm1khj+T5OvAPeTTXXcDOuTdzFmnI6Rck/QZA0t9Jmpa3/6jtA1vScknnSnoQ+FBlg5Km5ql5pkl6StLf5PK1eiaSfpW/i9J2vAslzZD0f3kanamSnpFU+a32gZJ+LenJHG/bsbocp1lXONmY1bYP6Tsqf5W/vPln0ncWjgWejoihEXEOcAVwcUR8LM9D9VnS0NihwBrgb/NhtgIej4jh1YahA5vmKWa+BpxVZXt7WwFTI+IAYBlwHnA48Cng3Ip6w3IMQ4ETJTWvY5xmhWyIX0Yy25CINC1J0fJKh5G+7Dk9XY2jD/Bi3rYGuKnGvjfnnzOAwQXifAP4dV5+DHg9IlblKWAq958SEYsAJN0MHAKsXoc4zQpxsjGrbRbw6coCpRmpB5ImXd25xr4CromIb1bZtrKTL9e1fVl0DW/9P13N2lcjelcsr4q3vjT3Ztv+EfGmpMr/5+0TZNv8Xt2N06wQX0Yzq+1uYEtJo+GvN8m/B1ydp6npbN8TJO2c990hz/PVXfOAoZI2UXqcxbBuHOPwHEcf0mCG+0qI0+xtnGzMasi9hU+R7m/MAZ4CVgKdTk8SEU8A3yZNzPoo6TEE/dchnPuAZ0mXyS4CHurGMe4Ffgo8DNwUES0lxGn2Np6uxszMSueejZmZlc7JxszMSudkY2ZmpXOyMTOz0jnZmJlZ6ZxszMysdE42ZmZWOicbMzMr3f8Hc8T1+rSTKXYAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# we recommend top best sale offer to a new user\n",
    "recommend_offer('new_user', user_mat, offer_mat)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 308,
   "metadata": {},
   "outputs": [],
   "source": [
    "def gender_offer(full_df):\n",
    "    '''\n",
    "    Find out which type of offer (bogo/discount) attracts most to different gender\n",
    "    Return with a plotted bar chart\n",
    "    '''\n",
    "    \n",
    "    # initialize the gender response and the gender sent dataframe\n",
    "    gender_response = pd.DataFrame(data=[[0,0],[0,0],[0,0]], index=['M', 'F', 'O'], columns=['bogo', 'discount'])\n",
    "    gender_sent = pd.DataFrame(data=[[0,0],[0,0],[0,0]], index=['M', 'F', 'O'], columns=['bogo', 'discount'])\n",
    "\n",
    "    # We count the number of offer completed base on the customer gender\n",
    "    for offer_type in ['bogo', 'discount']:\n",
    "        for offer_id in portfolio[portfolio['offer_type']==offer_type]['id']:\n",
    "            # count the total number of customers responsed our offers.\n",
    "            gender_response[offer_type] = gender_response[offer_type].add(profile[profile['id'].isin(full_df[full_df[offer_id]>0].index)]['gender'].value_counts(), fill_value=0)\n",
    "            # count the total number of offer sent\n",
    "            gender_sent[offer_type] = gender_sent[offer_type].add(profile[profile['id'].isin(full_df[full_df[offer_id]>=0].index)]['gender'].value_counts(), fill_value=0)\n",
    "        \n",
    "    gender_offer = (gender_response / gender_sent * 100).plot(kind='bar', title='Percentage of customer response')\n",
    "    gender_offer.set_xlabel(\"Gender\")\n",
    "    gender_offer.set_ylabel(\"Percentage\")\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 309,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYIAAAEVCAYAAADtmeJyAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvhp/UCwAAHzhJREFUeJzt3XucXfO9//HXWxImIXFLKIJEhbiFxEj4KXGJVlXdnZYicWmiVRzllNPTQyit9qjLry11q6aqRFUopUUIUiom5MQt+VEN0iBpNDeSMPH5/bG+EztjLjvJrL0ns97Px2Mee93XZ6+1Z3/29/td67sUEZiZWXGtVe0AzMysupwIzMwKzonAzKzgnAjMzArOicDMrOCcCMzMCs6JwApDmVsk/UvSpGrHY9ZeOBGsYSTNkLRY0iJJ76YvtvWqHVepFOOwasfRhM8BBwG9I2JwJXbYjo+F2XJOBGumL0fEesAgYA/geyu7AUmd2zyq9m9rYEZEvF/tQCotlYZa/H8v6GfCcCJYo0XEP4AHgZ0BJK0v6WZJb0v6h6RLJXVK80ZI+oukqyS9B4xO078u6RVJCyW9LGlQmr65pN9LmiPp75LOativpNGS7pT067TeS5Jq07xbga2A+1Kp5Ttp+u8kvSNpvqQnJO1Usr2NJd0naYGkZ1PcE0vm95f0sKT3JE2X9G/NHZMU9x/Ssq9J+nqafipwE7BXiuviZtZv7niEpG1LlvuVpEvTcE9J90ual/b7pKS1WjgWh6VjNk/SBEk7lGx3hqT/kDRV0vvpfG4q6cEU0yOSNixZfk9JT6Vt/a+k/UrmTZB0maS/AB8A2zTxfmdIOl/SVOB9SZ1bOfeDJdWlc/WupCvT9D7pGI2UNCt9Bs8tWW8dSVenebPS8Dpp3n6SZko6V9LstO7JJeseks7FwvS5Pq9k3qGSpqT3/5SkAc19NqwFEeG/NegPmAEMS8NbAi8B30/j9wDXA+sCmwCTgFFp3gigHjgT6Ax0BY4F/kFWqhCwLdmv5rWAycCFwNpkXyCvA19I2xoNLAEOAToBPwT+2lSMJdNOAboD6wBXA1NK5t2R/roBOwJvARPTvHXT+Mkp7kHAP4Gdmjk+jwPXAjXAbsAc4MCSYzCxhWPb5PFI8wLYtmTZXwGXpuEfAr8AuqS/fQA1dSyA7YD3yaqougDfAV4D1i5Z/q/ApsAWwGzgOWBgOnaPAhelZbcA5qbzsFba5lygV5o/AXgT2Ckduy7NfJ6mkH2WupZx7p8GTkzD6wF7puE+6Rjdns7ZLunYN3xWL0nvaxOgF/AUn3xu9yP7bF6SjskhZIlrwzT/bWCfNLwhMCgND0rHZwjZ53B4ej/rVPv/dE37q3oA/lvJE5Z90BcB84A3yL70uqYvjqVA15JljwMeS8MjgDcbbevPwNlN7GNIE8v+J3BLGh4NPFIyb0dgcaMYh7XwHjZIXxrrp3/gj4DtS+ZfyieJ4CvAk43Wv77hy7DR9C2BZUD3kmk/BH5VcgxaSgRNHo80r6VEcAlwb+n85o4F8N/AnSXja5Eln/1Klv9ayfzfA9eVjJ8J3JOGzwdubeI9DE/DE4BLyvg8nbIS5/4J4GKgZ6Nl+qRj1L9k2o+Bm9Pw34BDSuZ9gayaDrJEsBjoXDJ/Np8kmTeBUUCPRvu8jpRMSqZNB4bm9f/XUf9cNbRmOiIiNoiIrSPimxGxmOyXfBfg7VRMnkf2hblJyXpvNdrOlmT/oI1tDWzesJ20re+SJZsG75QMfwDUqJk6ZkmdJF0u6W+SFpB9+QD0JPt12LlRbKXDWwNDGsXyNeAzTexqc+C9iFhYMu0Nsl/O5WjueLTmf8h+1T8k6XVJF7Sw7OYpJgAi4mOy91sa47slw4ubGG+4OGBr4NhGx+ZzwGYlyzc+501pfLxbOvenkpVqpqVqvENb2NYbZO8XGr3vRvMA5kZEfcn4ByXv82iyUsIbkh6XtFdJrOc2inXLRtu1MrhxqON4i6xE0LPRP1Spxl3NvgV8tplt/T0i+q1iLI33czxwODCMLAmsD/yLrPplDlm1QG/g/6Xlt2wUy+MRcVAZ+50FbCSpe0ky2IrsF3c5mjsekH0xdSsZ/wwwEyDt61yyL6WdgMckPRsR4/n0sZhFVm0CZI24ZO+33Bgbx3trRHy9hWXK6V64dJkWz31EvAocp6zh+SjgLkkblyyyJTAtDW9F9n5Jr1uTVWU2ntdycBHPAodL6gJ8C7gz7ect4LKIuKyc7VjzXCLoICLibeAh4CeSeqTGys9KGtrCajcB50naXZltJW1N1rawIDUidk2/6HeWtEeZ4bzLig2T3cmS1FyyL9MflMS9DLgbGC2pm6T+wEkl694PbCfpREld0t8epQ2sJdt6i6zu+YeSalLD4anAbWXG3dzxgKwe/fh0LA4Glh/X1GC5bfpSX0BWPbWsmWNxJ/AlSQemL7Zz07F5qswYS/0G+LKkL6S4alLDa+9V2FaDFs+9pBMk9UolmXlpnWUl6/93Oo87kbXrjE3Tbwe+J6mXpJ5kbRC/aS0YSWtL+pqk9SPiIz45vgA3AqdLGpLO17qSviSp+2q8/0JyIuhYTiJr4HuZ7Bf3XaxYTbCCiPgdcBnwW2AhWWPzRunL+ctkja1/J2ucvYnsl3w5fkj2Tz8vXeHxa7KqgH+k2P7aaPlvpW2/A9xK9qWxNMW4EPg88FWyX5DvAD8iazhtynFk9dWzgHFkbQkPlxN0c8cjzT6b7Jg0VE3dU7JqP+ARsrabp4FrI2JCU8ciIqYDJwA/JTuuXya7HPjDcmJsFO9bZCWt75KVrN4C/oPV+L8u49wfDLwkaRFwDfDViFhSsonHyarJxgNXRMRDafqlQB0wFXiBrAH80jLDOhGYkaoVTyc7fkREHfB14Gdkn/fXyNqBbCU1XNlg1m5I+hHwmYgYXu1YrDyS+pAlji4tVE1aO+USgVWdsvsEBqTi/WCy6pxx1Y7LrCjcWGztQXey6qDNyS4b/AnZ5ZhmVgGuGjIzKzhXDZmZFVyuiUDSBpLukjRNWf8te0naSFm/Ma+m1w1b35KZmeUl16ohSWPIuge4SdLaZNeQf5fs7s/L0x2YG0bE+S1tp2fPntGnT5/c4jQz64gmT578z4jo1dpyuSUCST2A/wW2iZKdSJpO1q/K25I2AyZExPYtbau2tjbq6upyidPMrKOSNDkialtbLs+qoW3IbnK5RdLzkm6StC6waboLtuFu2E2aWllZd7Z1kurmzJmTY5hmZsWWZyJo6DL4uogYSNb1bkudca0gIm6IiNqIqO3Vq9WSjZmZraI8E8FMYGZEPJPG7yJLDO+mKiHS6+wcYzAzs1bkdkNZRLwj6S1J26f+VQ4k62fmZbIHSFyeXlfpxqGPPvqImTNnsmTJktYXNgBqamro3bs3Xbp0qXYoZtaO5H1n8ZnAbemKodfJeiNcC7hT2aMD3yR7KtRKmzlzJt27d6dPnz5knT5aSyKCuXPnMnPmTPr27VvtcMysHck1EUTEFKCpFusDV3fbS5YscRJYCZLYeOONccO7mTW2Rt9Z7CSwcny8zKwpa3QiqLYZM2aw8847VzsMM7PV0mF6H+1zwR/bdHszLv9Sm27PzNqh0eU+a6mt9je/svsrk0sEq6m+vp7hw4czYMAAjjnmGD744APGjx/PwIED2WWXXTjllFNYunQpAA888AD9+/fnc5/7HGeddRaHHpo99/u9997jiCOOYMCAAey5555MnTq1mm/JzArGiWA1TZ8+nZEjRzJ16lR69OjBlVdeyYgRIxg7diwvvPAC9fX1XHfddSxZsoRRo0bx4IMPMnHixBUabS+66CIGDhzI1KlT+cEPfsBJJ53Uwh7NzNqWE8Fq2nLLLdl7770BOOGEExg/fjx9+/Zlu+22A2D48OE88cQTTJs2jW222Wb5pZvHHXfc8m1MnDiRE088EYADDjiAuXPnMn9++yxCmlnH02HaCKql3CtxWurcr6l5vsLHiqit2/paM6Omortrt1wiWE1vvvkmTz/9NAC33347w4YNY8aMGbz22msA3HrrrQwdOpT+/fvz+uuvM2PGDADGjh27fBv77rsvt912GwATJkygZ8+e9OjRo7JvxMwKyyWC1bTDDjswZswYRo0aRb9+/bjmmmvYc889OfbYY6mvr2ePPfbg9NNPZ5111uHaa6/l4IMPpmfPngwePHj5NkaPHs3JJ5/MgAED6NatG2PGjKniOzKzoukwiaAal3v26dOHl19++VPTDzzwQJ5//vlPTd9///2ZNm0aEcEZZ5xBbW120/VGG23Evff6We1mVh2uGqqgG2+8kd12242ddtqJ+fPnM2rUqGqHZGbWcUoEa4JzzjmHc845p9phmJmtwCUCM7OCcyIwMys4JwIzs4JzIjAzKzg3FreR0aNHs95667FgwQL23Xdfhg0bVpU4pkyZwqxZszjkkEOqsn8zW/N0nETQ1t3JrmJ3sZdccknbxrGSpkyZQl1dnROBmZXNVUOr4bLLLmP77bdn2LBhTJ8+HYARI0Zw1113AXDBBRew4447MmDAAM477zwA3n33XY488kh23XVXdt11V5566ikArrzySnbeeWd23nlnrr76auDTD7654oorGD16NAD77bcf559/PoMHD2a77bbjySef5MMPP+TCCy9k7Nix7Lbbbit0Y2Fm1pyOUyKosMmTJ3PHHXfw/PPPU19fz6BBg9h9992Xz3/vvfcYN24c06ZNQxLz5s0D4KyzzmLo0KGMGzeOZcuWsWjRIiZPnswtt9zCM888Q0QwZMgQhg4dyoYbbthiDPX19UyaNIkHHniAiy++mEceeYRLLrmEuro6fvazn+X6/s2s43CJYBU9+eSTHHnkkXTr1o0ePXpw2GGHrTC/R48e1NTUcNppp3H33XfTrVs3AB599FG+8Y1vANCpUyfWX399Jk6cyJFHHsm6667Leuutx1FHHcWTTz7ZagxHHXUUALvvvvvyzuzMzFaWE8FqaKmr6M6dOzNp0iSOPvpo7rnnHg4++OBml22ui+rOnTvz8ccfLx9fsmTJCvPXWWcdIEso9fX1KxO6mdlyTgSraN9992XcuHEsXryYhQsXct99960wf9GiRcyfP59DDjmEq6++milTpgBZh3TXXXcdAMuWLVt+ldE999zDBx98wPvvv8+4cePYZ5992HTTTZk9ezZz585l6dKl3H///a3G1b17dxYuXNj2b9jMOiwnglU0aNAgvvKVr7Dbbrtx9NFHs88++6wwf+HChRx66KEMGDCAoUOHctVVVwFwzTXX8Nhjj7HLLruw++6789JLLzFo0CBGjBjB4MGDGTJkCKeddhoDBw6kS5cuXHjhhQwZMoRDDz2U/v37txrX/vvvz8svv+zGYjMrm1p6clZ7UVtbG3V1dStMe+WVV9hhhx2qFNGay8fN2rPKP6Hs+Irub1UvS19VkiZHRG1ry/mqIetQKv5FUoXnYJi1tVwTgaQZwEJgGVAfEbWSNgLGAn2AGcC/RcS/8ozDzMyaV4kSwf4R8c+S8QuA8RFxuaQL0vj5FYjDrO219R3tre6vslULVgzVaCw+HGh4KO8Y4IhV3dCa0L7Rnvh4mVlT8k4EATwkabKkkWnaphHxNkB63WRVNlxTU8PcuXP95VamiGDu3LnU1NRUOxQza2fyrhraOyJmSdoEeFjStHJXTIljJMBWW231qfm9e/dm5syZzJkzp82C7ehqamro3bt3tcMws3Ym10QQEbPS62xJ44DBwLuSNouItyVtBsxuZt0bgBsgu3y08fwuXbrQt2/f/II3MyuI3KqGJK0rqXvDMPB54EXgD8DwtNhw4N68YjAzs9blWSLYFBiX+uPpDPw2Iv4k6VngTkmnAm8Cx+YYg5mZtSK3RBARrwO7NjF9LnBgXvs1M7OV476GzMwKzonAzKzgnAjMzArOicDMrOCcCMzMCs6JwMys4JwIzMwKzonAzKzgnAjMzArOicDMrOCcCMzMCs6JwMys4JwIzMwKzonAzKzgnAjMzAou72cWWzlGr1/h/c2v7P7MrF1zicDMrOCcCMzMCs6JwMys4JwIzMwKzonAzKzgnAjMzArOicDMrOCcCMzMCs6JwMys4JwIzMwKzonAzKzgck8EkjpJel7S/Wm8r6RnJL0qaayktfOOwczMmleJEsHZwCsl4z8CroqIfsC/gFMrEIOZmTUj10QgqTfwJeCmNC7gAOCutMgY4Ig8YzAzs5blXSK4GvgO8HEa3xiYFxH1aXwmsEXOMZiZWQtySwSSDgVmR8Tk0slNLBrNrD9SUp2kujlz5uQSo5mZ5Vsi2Bs4TNIM4A6yKqGrgQ0kNTwQpzcwq6mVI+KGiKiNiNpevXrlGKaZWbHllggi4j8jondE9AG+CjwaEV8DHgOOSYsNB+7NKwYzM2tdNe4jOB/4tqTXyNoMbq5CDGZmllTkmcURMQGYkIZfBwZXYr9mZtY631lsZlZwTgRmZgXnRGBmVnBlJwJJXSVtn2cwZmZWeWU1Fkv6MnAFsDbQV9JuwCURcViewVVLnwv+WNH9zaip6O7MzFZQbolgNNmVPvMAImIK0CefkMzMrJLKTQT1ETE/10jMzKwqyr2P4EVJxwOdJPUDzgKeyi8sMzOrlHJLBGcCOwFLgduBBcC/5xWUmZlVTlklgoj4APiv9GdmZh1IuVcN3cenu4ueD9QB10fEkrYOzMzMKqPcqqHXgUXAjelvAfAusF0aNzOzNVS5jcUDI2LfkvH7JD0REftKeimPwMzMrDLKLRH0krRVw0ga7plGP2zzqMzMrGLKLRGcC0yU9Deyx032Bb4paV2yB9Cbmdkaqtyrhh5I9w/0J0sE00oaiK/OKzgzM8vfyjyYph+wPVADDJBERPw6n7DMzKxSyr189CJgP2BH4AHgi8BEwInAzGwNV25j8THAgcA7EXEysCuwTm5RmZlZxZSbCBZHxMdAvaQewGxgm/zCMjOzSim3jaBO0gZkN49NJru5bFJuUZmZWcWUe9XQN9PgLyT9CegREVPzC8vMzCqlrKohSeMbhiNiRkRMLZ1mZmZrrhZLBJJqgG5AT0kbkt1DANAD2Dzn2MzMrAJaqxoaRfbcgc3J2gYaEsEC4Oc5xmVmZhXSYiKIiGuAaySdGRE/rVBMZmZWQeU2Fv9U0v8he2B955LpvqHMzGwNV+6dxbcCnwWmAMvS5KCFO4tT+8ITZDeedQbuioiLJPUF7gA2Ap4DTowI92BqZlYl5d5HUAvsGBGNn1LWkqXAARGxSFIXst5LHwS+DVwVEXdI+gVwKnDdSkVtZmZtptw7i18EPrMyG47MojTaJf0FcABwV5o+BjhiZbZrZmZtq9wSQU/gZUmTyH7pAxARh7W0kqROZFcbbUt2ldHfgHkRUZ8WmQlssbJBm5lZ2yk3EYxelY1HxDJgt9Q9xThgh6YWa2pdSSOBkQBbbbVVU4uYmVkbKKtqKCIeB2YAXdLws2QNvWWJiHnABGBPYANJDQmoNzCrmXVuiIjaiKjt1atXubsyM7OVVG4XE18nq9e/Pk3aArinlXV6pZIAkroCw4BXgMfIurUGGA7cu/Jhm5lZWym3sfgMYG+yO4qJiFeBTVpZZzPgMUlTyUoQD0fE/cD5wLclvQZsDNy8KoGbmVnbKLeNYGlEfChlPUykqp0WLyVNvZMObGL668DglYzTzMxyUm6J4HFJ3wW6SjoI+B1wX35hmZlZpZSbCC4A5gAvkHVE9wDwvbyCMjOzyim3aqgr8MuIuBGW3x/QFfggr8DMzKwyyi0RjCf74m/QFXik7cMxM7NKKzcR1JR0F0Ea7pZPSGZmVknlJoL3JQ1qGJG0O7A4n5DMzKySym0jOBv4naSGu4A3A76ST0hmZlZJrSYCSWsBawP9ge3JHlc5LSI+yjk2MzOrgFYTQUR8LOknEbEXWXfUZmbWgZTbRvCQpKPVcGuxmZl1GOW2EXwbWBdYJmkxWfVQRESP3CIzM7OKKPfh9d3zDsTMzKqj3G6oJekESf+dxreU5I7jzMw6gHLbCK4F9gKOT+OLyB49aWZma7hy2wiGRMQgSc8DRMS/JK2dY1xmZlYh5ZYIPkodzQVkTx8DPs4tKjMzq5hyE8H/JXv4/CaSLgMmAj/ILSozM6uYcq8auk3SZOBAsktHj4iIV3KNzMzMKqLFRCCpBjgd2JbsoTTXR0R9JQIzM7PKaK1qaAxQS5YEvghckXtEZmZWUa1VDe0YEbsASLoZmJR/SGZmVkmtlQiW9zDqKiEzs46ptRLBrpIWpGEBXdO4+xoyM+sgWkwEEdGpUoGYmVl1lHsfgZmZdVBOBGZmBedEYGZWcLklgtRV9WOSXpH0kqSz0/SNJD0s6dX0umFeMZiZWevyLBHUA+dGxA7AnsAZknYELgDGR0Q/YHwaNzOzKsktEUTE2xHxXBpeCLwCbAEcTnbHMun1iLxiMDOz1lWkjUBSH2Ag8AywaUS8DVmyADZpZp2Rkuok1c2ZM6cSYZqZFVLuiUDSesDvgX+PiAWtLd8gIm6IiNqIqO3Vq1d+AZqZFVyuiUBSF7IkcFtE3J0mvytpszR/M2B2njGYmVnL8rxqSMDNwCsRcWXJrD8Aw9PwcODevGIwM7PWlfvM4lWxN3Ai8IKkKWnad4HLgTslnQq8CRybYwxmZtaK3BJBREwk65yuKQfmtV8zM1s5vrPYzKzgnAjMzArOicDMrOCcCMzMCs6JwMys4JwIzMwKzonAzKzgnAjMzArOicDMrOCcCMzMCs6JwMys4JwIzMwKzonAzKzgnAjMzArOicDMrOCcCMzMCs6JwMys4JwIzMwKzonAzKzgnAjMzArOicDMrOCcCMzMCs6JwMys4JwIzMwKzonAzKzgnAjMzArOicDMrOBySwSSfilptqQXS6ZtJOlhSa+m1w3z2r+ZmZUnzxLBr4CDG027ABgfEf2A8WnczMyqKLdEEBFPAO81mnw4MCYNjwGOyGv/ZmZWnkq3EWwaEW8DpNdNmltQ0khJdZLq5syZU7EAzcyKpt02FkfEDRFRGxG1vXr1qnY4ZmYdVqUTwbuSNgNIr7MrvH8zM2uk0ongD8DwNDwcuLfC+zczs0byvHz0duBpYHtJMyWdClwOHCTpVeCgNG5mZlXUOa8NR8Rxzcw6MK99mpnZymu3jcVmZlYZTgRmZgXnRGBmVnBOBGZmBedEYGZWcE4EZmYF50RgZlZwTgRmZgXnRGBmVnBOBGZmBedEYGZWcE4EZmYF50RgZlZwTgRmZgXnRGBmVnBOBGZmBedEYGZWcE4EZmYF50RgZlZwTgRmZgXnRGBmVnBOBGZmBedEYGZWcE4EZmYF50RgZlZwTgRmZgXnRGBmVnBVSQSSDpY0XdJrki6oRgxmZpapeCKQ1An4OfBFYEfgOEk7VjoOMzPLVKNEMBh4LSJej4gPgTuAw6sQh5mZAZ2rsM8tgLdKxmcCQxovJGkkMDKNLpI0vQKxVYWgJ/DPiu3wYlVsVx2dz92arQDnb+tyFqpGImjqSMSnJkTcANyQfzjVJ6kuImqrHYetPJ+7NZvPX6YaVUMzgS1LxnsDs6oQh5mZUZ1E8CzQT1JfSWsDXwX+UIU4zMyMKlQNRUS9pG8BfwY6Ab+MiJcqHUc7U4gqsA7K527N5vMHKOJT1fNmZlYgvrPYzKzgnAjMzAquGpePmplVhaQaYFuyS9b/FhFLqhxSu+ASgVmZJG1V7Rhs1UjqLOnHZJevjwF+A7wl6ceSulQ3uupzY3GFSWrxUtmIOKxSsdjKkfRcRAxKw7+PiKOrHZOVR9JVQHfgnIhYmKb1AK4AFkfE2dWMr9qcCCpM0hyyLjZuB56h0Z3WEfF4NeKy1kl6PiIGNh629k/Sq8B20egLL3WCOS0i+lUnsvbBbQSV9xngIOA44Hjgj8DtvpdijRDNDFv7F42TQJq4TFLhz6XbCCosIpZFxJ8iYjiwJ/AaMEHSmVUOzVq3q6QFkhYCA9LwAkkLJS2odnDWopclndR4oqQTgGlViKddcdVQFUhaB/gSWamgD1kXG7+MiH9UMy6zjkrSFsDdwGJgMlmJbg+gK3Bk0f/3nAgqTNIYYGfgQeCOiHixyiGZFYakA4CdyNrmXoqI8VUOqV1wIqgwSR8D76fR0oMvsnrMHpWPysyKzInAzKzg3FhsZlZwTgRmZgXnRGCFJWlTSb+V9LqkyZKelnRkG2x3P0n3t0WMZpXgRGCFJEnAPcATEbFNROxO9rS83lWIxTd2WlU5EVhRHQB8GBG/aJgQEW9ExE8ldZL0P5KelTRV0ihY/kt/gqS7JE2TdFtKKEg6OE2bCBzVsE1J60r6ZdrW85IOT9NHSPqdpPuAhyr6zs0a8S8RK6qdgOeamXcqMD8i9kg3//1FUsOX9cC07izgL8DekuqAG8mSy2vA2JJt/RfwaEScImkDYJKkR9K8vYABEfFeW74xs5XlRGAGSPo58DngQ+ANsi4kjkmz1wf6pXmTImJmWmcK2Z3hi4C/R8SrafpvgJFp3c8Dh0k6L43XAA3dWT/sJGDtgROBFdVLwPJupCPiDEk9gTrgTeDMiPhz6QqS9gOWlkxaxif/Q83dkCPg6IiY3mhbQ/jkxkKzqnIbgRXVo0CNpG+UTOuWXv8MfKPhgSWStpO0bgvbmgb0lfTZNH5cybw/A2eWtCW462prd5wIrJBSl8RHAEMl/V3SJLInV50P3AS8DDwn6UXgelooPafHHY4E/pgai98omf19oAswNW3r+3m8H7PV4S4mzMwKziUCM7OCcyIwMys4JwIzs4JzIjAzKzgnAjOzgnMiMDMrOCcCM7OCcyIwMyu4/w8aeKhc2/m7ngAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "gender_offer(full_df)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 317,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>difficulty</th>\n",
       "      <th>duration</th>\n",
       "      <th>id</th>\n",
       "      <th>reward</th>\n",
       "      <th>web</th>\n",
       "      <th>email</th>\n",
       "      <th>mobile</th>\n",
       "      <th>social</th>\n",
       "      <th>bogo</th>\n",
       "      <th>discount</th>\n",
       "      <th>informational</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>10</td>\n",
       "      <td>168</td>\n",
       "      <td>ae264e3637204a6fb9bb56bc8210ddfd</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>10</td>\n",
       "      <td>120</td>\n",
       "      <td>4d5c57ea9a6940dd891ad53e9dbe8da0</td>\n",
       "      <td>10</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0</td>\n",
       "      <td>96</td>\n",
       "      <td>3f207df678b143eea3cee63160fa8bed</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>5</td>\n",
       "      <td>168</td>\n",
       "      <td>9b98b8c7a33c4b65b9aebfe6a799e6d9</td>\n",
       "      <td>5</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>20</td>\n",
       "      <td>240</td>\n",
       "      <td>0b1e1539f2cc45b7b9fa7c272da2e1d7</td>\n",
       "      <td>5</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>7</td>\n",
       "      <td>168</td>\n",
       "      <td>2298d6c36e964ae4a3e7e9706d1fb8c2</td>\n",
       "      <td>3</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>10</td>\n",
       "      <td>240</td>\n",
       "      <td>fafdcd668e3743c1bb461111dcafc2a4</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>0</td>\n",
       "      <td>72</td>\n",
       "      <td>5a8bc65990b245e5a138643cd4eb9837</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>5</td>\n",
       "      <td>120</td>\n",
       "      <td>f19421c1d4aa40978ebb69ca19b0e20d</td>\n",
       "      <td>5</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>10</td>\n",
       "      <td>168</td>\n",
       "      <td>2906b810c7d4411798c6938adc9daaa5</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   difficulty  duration                                id  reward  web  email  \\\n",
       "0          10       168  ae264e3637204a6fb9bb56bc8210ddfd      10    0      1   \n",
       "1          10       120  4d5c57ea9a6940dd891ad53e9dbe8da0      10    1      1   \n",
       "2           0        96  3f207df678b143eea3cee63160fa8bed       0    1      1   \n",
       "3           5       168  9b98b8c7a33c4b65b9aebfe6a799e6d9       5    1      1   \n",
       "4          20       240  0b1e1539f2cc45b7b9fa7c272da2e1d7       5    1      1   \n",
       "5           7       168  2298d6c36e964ae4a3e7e9706d1fb8c2       3    1      1   \n",
       "6          10       240  fafdcd668e3743c1bb461111dcafc2a4       2    1      1   \n",
       "7           0        72  5a8bc65990b245e5a138643cd4eb9837       0    0      1   \n",
       "8           5       120  f19421c1d4aa40978ebb69ca19b0e20d       5    1      1   \n",
       "9          10       168  2906b810c7d4411798c6938adc9daaa5       2    1      1   \n",
       "\n",
       "   mobile  social  bogo  discount  informational  \n",
       "0       1       1     1         0              0  \n",
       "1       1       1     1         0              0  \n",
       "2       1       0     0         0              1  \n",
       "3       1       0     1         0              0  \n",
       "4       0       0     0         1              0  \n",
       "5       1       1     0         1              0  \n",
       "6       1       1     0         1              0  \n",
       "7       1       1     0         0              1  \n",
       "8       1       1     1         0              0  \n",
       "9       1       0     0         1              0  "
      ]
     },
     "execution_count": 317,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cleaned_portfolio"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 336,
   "metadata": {},
   "outputs": [],
   "source": [
    "def gender_offer_channel(full_df):\n",
    "    '''\n",
    "    Find out which type of offer (bogo/discount) attracts most to different gender\n",
    "    Return with a plotted bar chart\n",
    "    '''\n",
    "    \n",
    "    # initialize the gender response and the gender sent dataframe\n",
    "    gender_response = pd.DataFrame(data=[[0,0,0,0],[0,0,0,0],[0,0,0,0]], index=['M', 'F', 'O'], columns=['web', 'email', 'mobile', 'social'])\n",
    "    gender_sent = pd.DataFrame(data=[[0,0,0,0],[0,0,0,0],[0,0,0,0]], index=['M', 'F', 'O'], columns=['web', 'email', 'mobile', 'social'])\n",
    "\n",
    "    # We count the number of offer completed base on the customer gender\n",
    "    for channel_type in ['web', 'email', 'mobile', 'social']:\n",
    "        for offer_id in cleaned_portfolio[(cleaned_portfolio[channel_type]==1)&(cleaned_portfolio['informational']!=1)]['id']:\n",
    "            # count the total number of customers responsed our offers.\n",
    "            gender_response[channel_type] = gender_response[channel_type].add(profile[profile['id'].isin(full_df[full_df[offer_id]>0].index)]['gender'].value_counts(), fill_value=0)\n",
    "            # count the total number of offer sent\n",
    "            gender_sent[channel_type] = gender_sent[channel_type].add(profile[profile['id'].isin(full_df[full_df[offer_id]>=0].index)]['gender'].value_counts(), fill_value=0)\n",
    "        \n",
    "    gender_offer = (gender_response / gender_sent * 100).plot(kind='bar', title='Percentage of customer response')\n",
    "    gender_offer.set_xlabel(\"Gender\")\n",
    "    gender_offer.set_ylabel(\"Percentage\")\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 337,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYIAAAEVCAYAAADtmeJyAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvhp/UCwAAIABJREFUeJzt3XmYFeWZ9/Hvj0W6VXBjCYjaqCBRGgEbBB0IgkQnmOhMdBKjkagTzThqzKuJxokJk2A0iaPx9XVckqiMKy6jos4YAUXFJdgo4gIqGhACUYJhEYEA3u8fVd0e214OTZ9z6K7f57r6OrU9VXfVOX3uU89T9ZQiAjMzy652pQ7AzMxKy4nAzCzjnAjMzDLOicDMLOOcCMzMMs6JwMws45wILDOUuFnSXyXNLnU8ZtsLJ4JWRtIiSeslfSjpvfSLbedSx5UrjfHIUsdRj78DxgG9I2JYMTa4HR8Ls1pOBK3TlyNiZ2AIMBT40dauQFKHFo9q+7cPsCgi1pU6kGJLz4Ya/X/P6GfCcCJo1SLiT8D/AgMAJO0i6XeSlkv6k6RJktqn874l6RlJV0n6AJiYTv+2pPmS1kp6XdKQdHovSfdJWiHpj5LOrdmupImS7pb0X2m51yRVpfNuBfYGHkrPWn6QTr9H0p8lrZb0lKSDcta3h6SHJK2R9EIa96yc+f0lTZP0gaQ3JP1TQ8ckjXtquuxCSd9Op58O/BYYkcb17w2Ub+h4hKT9c5a7RdKkdLirpIclrUq3+7Skdo0ci6+kx2yVpJmSPp+z3kWSvi9pnqR16fvZQ9L/pjFNl7RbzvLDJT2brutlSaNz5s2UdKmkZ4CPgH3r2d9Fki6UNA9YJ6lDE+/9MEnV6Xv1nqQr0+kV6TE6Q9Ky9DN4fk65TpJ+nc5blg53SueNlrRU0vmS3k/LnppT9kvpe7E2/VxfkDPvGElz0/1/VtLAhj4b1oiI8F8r+gMWAUemw3sBrwE/S8cfAG4AdgK6A7OBM9N53wI2A+cAHYBy4ATgTyRnFQL2J/nV3A6YA/wY2IHkC+Qd4Kh0XROBDcCXgPbAZcDz9cWYM+00oDPQCfg1MDdn3l3p347AgcASYFY6b6d0/NQ07iHAX4CDGjg+TwL/CZQBg4AVwNicYzCrkWNb7/FI5wWwf86ytwCT0uHLgOuBjunfSED1HQugH7COpIqqI/ADYCGwQ87yzwM9gD2B94EXgcHpsXsc+Em67J7AyvR9aJeucyXQLZ0/E3gXOCg9dh0b+DzNJfkslefx3j8HfDMd3hkYng5XpMfozvQ9q0yPfc1n9afpfnUHugHP8snndjTJZ/On6TH5Ekni2i2dvxwYmQ7vBgxJh4ekx+dQks/hhHR/OpX6/7S1/ZU8AP9t5RuWfNA/BFYBi0m+9MrTL46NQHnOsicCT6TD3wLerbOu3wPfrWcbh9az7A+Bm9PhicD0nHkHAuvrxHhkI/uwa/qlsUv6D7wJOCBn/iQ+SQRfA56uU/6Gmi/DOtP3ArYAnXOmXQbcknMMGksE9R6PdF5jieCnwIO58xs6FsAlwN054+1Iks/onOVPypl/H3Bdzvg5wAPp8IXArfXsw4R0eCbw0zw+T6dtxXv/FPDvQNc6y1Skx6h/zrRfAr9Lh98GvpQz7yiSajpIEsF6oEPO/Pf5JMm8C5wJdKmzzetIk0nOtDeALxTq/6+t/rlqqHU6LiJ2jYh9IuKsiFhP8ku+I7A8PU1eRfKF2T2n3JI669mL5B+0rn2AXjXrSdd1MUmyqfHnnOGPgDI1UMcsqb2kyyW9LWkNyZcPQFeSX4cd6sSWO7wPcGidWE4CPlfPpnoBH0TE2pxpi0l+OeejoePRlF+R/Kp/TNI7ki5qZNleaUwARMTHJPubG+N7OcPr6xmvuThgH+CEOsfm74CeOcvXfc/rU/d4N/ben05yVrMgrcY7ppF1LSbZX6iz33XmAayMiM054x/l7OdXSc4SFkt6UtKInFjPrxPrXnXWa3lw41DbsYTkjKBrnX+oXHW7ml0C7NfAuv4YEX2bGUvd7XwDOBY4kiQJ7AL8laT6ZQVJtUBv4M10+b3qxPJkRIzLY7vLgN0ldc5JBnuT/OLOR0PHA5Ivph1zxj8HLAVIt3U+yZfSQcATkl6IiBl89lgsI6k2AZJGXJL9zTfGuvHeGhHfbmSZfLoXzl2m0fc+It4CTlTS8PyPwL2S9shZZC9gQTq8N8n+kr7uQ1KVWXde48FFvAAcK6kjcDZwd7qdJcClEXFpPuuxhvmMoI2IiOXAY8B/SOqSNlbuJ+kLjRT7LXCBpEOU2F/SPiRtC2vSRsTy9Bf9AElD8wznPT7dMNmZJEmtJPky/XlO3FuA/wYmStpRUn/glJyyDwP9JH1TUsf0b2huA2vOupaQ1D1fJqksbTg8Hbg9z7gbOh6Q1KN/Iz0WRwO1xzVtsNw//VJfQ1I9taWBY3E3MF7S2PSL7fz02DybZ4y5bgO+LOmoNK6ytOG1dzPWVaPR917SyZK6pWcyq9IyW3LKX5K+jweRtOtMSaffCfxIUjdJXUnaIG5rKhhJO0g6SdIuEbGJT44vwG+A70g6NH2/dpI0XlLnbdj/THIiaFtOIWnge53kF/e9fLqa4FMi4h7gUuAOYC1JY/Pu6Zfzl0kaW/9I0jj7W5Jf8vm4jOSfflV6hcd/kVQF/CmN7fk6y5+drvvPwK0kXxob0xjXAl8Evk7yC/LPwC9IGk7rcyJJffUy4H6StoRp+QTd0PFIZ3+X5JjUVE09kFO0LzCdpO3mOeA/I2JmfcciIt4ATgauITmuXya5HPhv+cRYJ94lJGdaF5OcWS0Bvs82/F/n8d4fDbwm6UPgauDrEbEhZxVPklSTzQCuiIjH0umTgGpgHvAKSQP4pDzD+iawKK1W/A7J8SMiqoFvA/+P5PO+kKQdyLZSzZUNZtsNSb8APhcRE0odi+VHUgVJ4ujYSNWkbad8RmAlp+Q+gYHp6f0wkuqc+0sdl1lWuLHYtgedSaqDepFcNvgfJJdjmlkRuGrIzCzjXDVkZpZxTgRmZhnXKtoIunbtGhUVFaUOw8ysVZkzZ85fIqJbU8u1ikRQUVFBdXV1qcMwM2tVJC1ueilXDZmZZZ4TgZlZxjkRmJllXKtoI6jPpk2bWLp0KRs2bGh64YwoKyujd+/edOzYsdShmFkr0moTwdKlS+ncuTMVFRUknT5mW0SwcuVKli5dSp8+fUodjpm1Iq22amjDhg3sscceTgIpSeyxxx4+QzKzrdZqEwHgJFCHj4eZNUerTgStUUVFBX/5y19KHYaZWa1W20ZQV8VFj7To+hZdPr5F12dmbcf8/p95QF5ePr9gfgtH0jLaTCIotl/+8peUlZVx7rnn8r3vfY+XX36Zxx9/nBkzZnDzzTdzyimn8JOf/ISNGzey3377cfPNN7PzzsmzuH/1q1/xxBNPAHDHHXew//77l3JXrATa2heJtW6uGmqmUaNG8fTTTwNQXV3Nhx9+yKZNm5g1axaVlZVMmjSJ6dOn8+KLL1JVVcWVV15ZW7ZLly7Mnj2bs88+m/POO69Uu2BmBjgRNNshhxzCnDlzWLt2LZ06dWLEiBFUV1fz9NNPU15ezuuvv87hhx/OoEGDmDx5MosXf9Llx4knnlj7+txzz5VqF8zMAFcNNVvHjh2pqKjg5ptv5rDDDmPgwIE88cQTvP322/Tp04dx48Zx55131ls29+oeX+ljZqVW0DMCSbtKulfSAknzJY2QtLukaZLeSl93K2QMhTRq1CiuuOIKRo0axciRI7n++usZNGgQw4cP55lnnmHhwoUAfPTRR7z55pu15aZMmVL7OmLEiJLEbmZWo9BVQ1cDj0ZEf+BgYD5wETAjIvoCM9LxVmnkyJEsX76cESNG0KNHD8rKyhg5ciTdunXjlltu4cQTT2TgwIEMHz6cBQsW1JbbuHEjhx56KFdffTVXXXVVCffAzKyAzyyW1AV4Gdg3cjYi6Q1gdEQsl9QTmBkRBzS2rqqqqqj7PIL58+fz+c8378qLtszHpXXwVUOtW2t5/yTNiYiqppYr5BnBvsAK4GZJL0n6raSdgB4RsRwgfe1ewBjMzKwJhUwEHYAhwHURMRhYx1ZUA0k6Q1K1pOoVK1YUKkYzs8wrZCJYCiyNiD+k4/eSJIb30ioh0tf36yscETdGRFVEVHXr1uQjN83MrJkKdvloRPxZ0hJJB0TEG8BY4PX0bwJwefr6YKFiMDNrTOXkymaVu7uF4yi1Qt9HcA5wu6QdgHeAU0nOQu6WdDrwLnBCgWMwM7NGFDQRRMRcoL4W67GF3K6ZtU7N7TzSnURuG3cxsR1ZtmwZxx9/PAAzZ87kmGOOKXFEZpYFbaeLiYm7tPD6Vrfs+vLQq1cv7r333qJv18yyzWcE2+C2225j2LBhDBo0iDPPPJMtW7aw8847c+GFF3LIIYdw5JFHMnv2bEaPHs2+++7L1KlTAVi0aBEjR45kyJAhDBkyhGeffbZ2+oABA0q5S2aWQU4EzTR//nymTJnCM888w9y5c2nfvj23334769atY/To0cyZM4fOnTvzox/9iGnTpnH//ffz4x//GIDu3bszbdo0XnzxRaZMmcK5555b4r0xsyxrO1VDRTZjxgzmzJnD0KFDAVi/fj3du3dnhx124OijjwagsrKSTp060bFjRyorK1m0aBEAmzZt4uyzz65NILkd0plZMzS3arjP3i0bRyvlRNBMEcGECRO47LLLPjX9iiuuqO1aul27dnTq1Kl2ePPmzQBcddVV9OjRg5dffpmPP/6YsrKy4gZvZpbDVUPNNHbsWO69917efz+5MfqDDz741MNnGrN69Wp69uxJu3btuPXWW9myZUshQzUza5QTQTMdeOCBTJo0iS9+8YsMHDiQcePGsXz58rzKnnXWWUyePJnhw4fz5ptvstNOOxU4WjOzhhWsG+qW5G6o8+fj0jq0lm6Mi63ZN5SVfaNZ5Sqb2UZw92Wbm1Uui91Qm5lZK+BEYGaWcb5qyGwbuPdKawt8RmBmlnFOBGZmGedEYGaWcU4EJTJx4kSuuOKKz0x3V9RmVmxtprG4uY12DXllwistur58uStqMys2nxFsg0WLFtG/f3/++Z//mQEDBnDSSScxffp0Dj/8cPr27cvs2bP54IMPOO644xg4cCDDhw9n3rx5teVffvllxowZQ9++ffnNb35Tu876uqJet24dp512GkOHDmXw4ME8+KAf9WxmLaPNnBGUysKFC7nnnnu48cYbGTp0KHfccQezZs1i6tSp/PznP2evvfZi8ODBPPDAAzz++OOccsopzJ07F4B58+bx/PPPs27dOgYPHsz48Q0/bu/SSy9lzJgx3HTTTaxatYphw4Zx5JFHunsKM9tmTgTbqE+fPlRWJtVSBx10EGPHjkVSbbfTixcv5r777gNgzJgxrFy5ktWrk6efHXvssZSXl1NeXs4RRxzB7NmzGTRoUL3beeyxx5g6dWptu8KGDRt499133Z2EmW0zJ4JtVNPNNNTf7XSHDp89xDXdVNe81p1en4jgvvvu44ADDmiJsM3MarmNoMBGjRrF7bffDiRXAXXt2pUuXboA8OCDD7JhwwZWrlzJzJkzax9yU5+jjjqKa665hppOAl966aXCB29mmeAzggKbOHEip556KgMHDmTHHXdk8uTJtfOGDRvG+PHjeffdd7nkkkvo1atX7VPM6rrkkks477zzGDhwIBFBRUUFDz/8cJH2wszaMndD3cb4uBRXs/saaiXdGBebu6FuWfl2Q+0zAmtTiv1F4mfeWltQ0EQgaRGwFtgCbI6IKkm7A1OACmAR8E8R8ddCxmFmZg0rRmPxERExKOf05CJgRkT0BWak42ZmViKluGroWKCmxXQycFwJYjAzs1ShE0EAj0maI+mMdFqPiFgOkL52r6+gpDMkVUuqXrFiRYHDNDPLrkI3Fh8eEcskdQemSVqQb8GIuBG4EZKrhgoVoJlZ1hX0jCAilqWv7wP3A8OA9yT1BEhf3y9kDNur6upqzj333EaXcTfUZlYMBTsjkLQT0C4i1qbDXwR+CkwFJgCXp68t0o3m/P4te+18oa/3raqqoqqqyct7G7X+1Vc/M23Te+8x/x/+sdFybf1adDPbOoU8I+gBzJL0MjAbeCQiHiVJAOMkvQWMS8dbnXXr1jF+/HgOPvhgBgwYwJQpU5gxYwaDBw+msrKS0047jY0bNwLwwgsvcNhhh3HwwQczbNgw1q5d+6lf+7Nnz+awww5j8ODBHHbYYbzxxhul3DUzy5iCnRFExDvAwfVMXwmMLdR2i+XRRx+lV69ePPJIcgPT6tWrGTBgADNmzKBfv36ccsopXHfddZx11ll87WtfY8qUKQwdOpQ1a9ZQXl7+qXX179+fp556ig4dOjB9+nQuvvji2h5LzcwKzXcWN1NlZSUXXHABF154IccccwxdunShT58+9OvXD4AJEyZw7bXXMnbsWHr27FnboVxNh3O5Vq9ezYQJE3jrrbeQxKZNm4q6L2aWbe59tJn69evHnDlzqKys5Ic//GGDTwyLiEa7l4akQ7kjjjiCV199lYceeogNGzYUImQzs3o5ETTTsmXL2HHHHTn55JO54IILePbZZ1m0aBELFy4E4NZbb+ULX/gC/fv3Z9myZbzwwgsArF27ls2bP91h1erVq9lzzz0BuOWWW4q6H2ZmrhpqpldeeYXvf//7tGvXjo4dO3LdddexevVqTjjhBDZv3szQoUP5zne+ww477MCUKVM455xzWL9+PeXl5UyfPv1T6/rBD37AhAkTuPLKKxkzZkyJ9sjMsqrNJIJiXxJ51FFHcdRRR31men0PjBk6dCjPP//8p6aNHj2a0aNHAzBixAjefPPN2nk/+9nPPrOMmVmhuGrIzCzjnAjMzDLOicDMLONadSJoDY/ZLKaIgI8/LnUYZtbKtNpEUFZWxsqVK50MUhHBqk2b0JIlpQ7FzFqZVnvVUO/evVm6dClZflbBpvfe+2Tk44/RkiW0v/6G0gVkZq1Sq00EHTt2pE+fPqUOo6Sa6mXUzCwfrbZqyMzMWoYTgZlZxrXaqqG2pHJyZbPK3d3CcZhZNvmMwMws45wIzMwyzonAzCzjnAjMzDLOicDMLOOcCMzMMs6Xj9aj4qJHmlVu0eXjWzgSM7PC8xmBmVnGORGYmWVc3lVDksqBvSPija3ZgKT2QDXwp4g4RlIf4C5gd+BF4JsR8betWed2a+IuzSvXZ++WjcPMbCvkdUYg6cvAXODRdHyQpKl5buO7QO6T5X8BXBURfYG/AqfnH66ZmbW0fKuGJgLDgFUAETEXqGiqkKTewHjgt+m4gDHAvekik4HjtiZgMzNrWfkmgs0RsboZ6/818AOg5vmJewCrImJzOr4U2LO+gpLOkFQtqTrLD58xMyu0fBPBq5K+AbSX1FfSNcCzjRWQdAzwfkTMyZ1cz6L1PmsyIm6MiKqIqOrWrVueYZqZ2dbKNxGcAxwEbATuBNYA5zVR5nDgK5IWkTQOjyE5Q9hVUk0jdW9g2VbGbGZmLSivRBARH0XEv0XE0PRX+r9FxIYmyvwwInpHRAXwdeDxiDgJeAI4Pl1sAvDgNsRvZmbbKK/LRyU9xGercFaTXBZ6Q1NJoY4LgbskTQJeAn63FWXNzKyF5XsfwTtAN5JqIYCvAe8B/YDfAN9srHBEzARmpsPvkFyBZGZm24F8E8HgiBiVM/6QpKciYpSk1woRmJmZFUe+jcXdJNXe/poOd01H28ZdwWZmGZXvGcH5wCxJb5NcAtoHOEvSTiQ3hZmZWSuVVyKIiP+R1BfoT5IIFuQ0EP+6UMGZmVnhbc3zCPoCBwBlwEBJRMR/FSYsMzMrlnwvH/0JMBo4EPgf4O+BWYATgZlZK5dvY/HxwFjgzxFxKnAw0KlgUZmZWdHkmwjWR8THwGZJXYD3gX0LF5aZmRVLvm0E1ZJ2Jbl5bA7wITC7YFGZmVnR5HvV0Fnp4PWSHgW6RMS8woVlZmbFku8TymbUDEfEooiYlzvNzMxar0bPCCSVATsCXSXtxifPE+gC9CpwbGZmVgRNVQ2dSfLcgV4kbQM1iWANcG0B4zIzsyJpNBFExNXA1ZLOiYhrihSTmZkVUb6NxddIOozkgfUdcqb7hjIzs1Yu3zuLbwX2A+YCW9LJge8sNjNr9fK9j6AKODAi6n3QvJmZtV753ln8KvC5QgZiZmalke8ZQVfgdUmzgY01EyPiKwWJyszMiibfRDCxkEGYmVnp5HvV0JOS9gH6RsR0STsC7QsbmpmZFUO+XUx8G7gXuCGdtCfwQKGCMjOz4sm3sfhfgcNJ7igmIt4CuhcqKDMzK558E8HGiPhbzYikDiT3EZiZWSuXbyJ4UtLFQLmkccA9wEONFZBUJmm2pJclvSbp39PpfST9QdJbkqZI2mHbdsHMzLZFvongImAF8ApJR3T/A/yoiTIbgTERcTAwCDha0nDgF8BVEdEX+CtwenMCNzOzlpFvIigHboqIEyLieOCmdFqDIvFhOtox/QtgDEnDM8Bk4LitjtrMzFpMvolgBp/+4i8HpjdVSFJ7SXNJnnE8DXgbWBURm9NFlpJcgVRf2TMkVUuqXrFiRZ5hmpnZ1so3EZTl/LonHd6xqUIRsSUiBgG9gWHA5+tbrIGyN0ZEVURUdevWLc8wzcxsa+WbCNZJGlIzIukQYH2+G4mIVcBMYDiwa3rVESQJYlm+6zEzs5aXbxcT3wXukVTzpd0T+FpjBSR1AzZFxCpJ5cCRJA3FTwDHA3cBE4AHmxO4mZm1jCYTgaR2wA5Af+AAksdVLoiITU0U7QlMltSe5Mzj7oh4WNLrwF2SJgEvAb/blh0wM7Nt02QiiIiPJf1HRIwg6Y46LxExDxhcz/R3SNoLzMxsO5BvG8Fjkr4qSU0vamZmrUm+bQT/B9gJ2CJpPUn1UEREl4JFZmZmRZFvN9SdCx2ImZmVRr7dUEvSyZIuScf3kuR6fjOzNiDfNoL/BEYA30jHPwSuLUhEZmZWVPm2ERwaEUMkvQQQEX91r6FmZm1DvmcEm9L7AQJqbxb7uGBRmZlZ0eSbCP4vcD/QXdKlwCzg5wWLyszMiibfq4ZulzQHGEty6ehxETG/oJGZmVlRNJoIJJUB3wH2J3kozQ05XUibmVkb0FTV0GSgiiQJ/D1wRcEjMjOzomqqaujAiKgEkPQ7YHbhQzIzs2Jq6oygtodRVwmZmbVNTZ0RHCxpTTosoDwdd19DZmZtRKOJICLaFysQMzMrjXzvIzAzszbKicDMLOOcCMzMMs6JwMws45wIzMwyzonAzCzjnAjMzDLOicDMLOOcCMzMMq5giSB9wP0TkuZLek3Sd9Ppu0uaJumt9HW3QsVgZmZNK+QZwWbg/Ij4PDAc+FdJBwIXATMioi8wIx03M7MSKVgiiIjlEfFiOrwWmA/sCRxL8pwD0tfjChWDmZk1rShtBJIqgMHAH4AeEbEckmQBdG+gzBmSqiVVr1ixohhhmpllUsETgaSdgfuA8yJiTVPL14iIGyOiKiKqunXrVrgAzcwyrqCJQFJHkiRwe0T8dzr5PUk90/k9gfcLGYOZmTWukFcNCfgdMD8irsyZNRWYkA5PAB4sVAxmZta0pp5Qti0OB74JvCJpbjrtYuBy4G5JpwPvAicUMAYzM2tCwRJBRMwieaRlfcYWartmZrZ1fGexmVnGORGYmWWcE4GZWcY5EZiZZZwTgZlZxjkRmJllnBOBmVnGORGYmWWcE4GZWcY5EZiZZZwTgZlZxjkRmJllnBOBmVnGORGYmWWcE4GZWcY5EZiZZZwTgZlZxjkRmJllnBOBmVnGORGYmWWcE4GZWcY5EZiZZZwTgZlZxjkRmJllXMESgaSbJL0v6dWcabtLmibprfR1t0Jt38zM8lPIM4JbgKPrTLsImBERfYEZ6biZmZVQwRJBRDwFfFBn8rHA5HR4MnBcobZvZmb5KXYbQY+IWA6QvnZvaEFJZ0iqllS9YsWKogVoZpY1221jcUTcGBFVEVHVrVu3UodjZtZmFTsRvCepJ0D6+n6Rt29mZnUUOxFMBSakwxOAB4u8fTMzq6OQl4/eCTwHHCBpqaTTgcuBcZLeAsal42ZmVkIdCrXiiDixgVljC7VNMzPbetttY7GZmRWHE4GZWcY5EZiZZZwTgZlZxjkRmJllnBOBmVnGORGYmWWcE4GZWcY5EZiZZZwTgZlZxjkRmJllnBOBmVnGORGYmWWcE4GZWcY5EZiZZZwTgZlZxjkRmJllnBOBmVnGORGYmWWcE4GZWcY5EZiZZZwTgZlZxjkRmJllnBOBmVnGlSQRSDpa0huSFkq6qBQxmJlZouiJQFJ74Frg74EDgRMlHVjsOMzMLFGKM4JhwMKIeCci/gbcBRxbgjjMzAzoUIJt7gksyRlfChxadyFJZwBnpKMfSnqjCLFtEzW75Ktdgb9sbalmn0ap+ZG2VX7vWje/fw3aJ5+FSpEI6jsS8ZkJETcCNxY+nNKTVB0RVaWOw7ae37vWze9fohRVQ0uBvXLGewPLShCHmZlRmkTwAtBXUh9JOwBfB6aWIA4zM6MEVUMRsVnS2cDvgfbATRHxWrHj2M5kogqsjfJ717r5/QMU8ZnqeTMzyxDfWWxmlnFOBGZmGVeKy0fNzEpCUhmwP8kl629HxIYSh7Rd8BmBWZ4k7V3qGKx5JHWQ9EuSy9cnA7cBSyT9UlLH0kZXem4sLjJJjV4qGxFfKVYstnUkvRgRQ9Lh+yLiq6WOyfIj6SqgM/C9iFibTusCXAGsj4jvljK+UnMiKDJJK0i62LgT+AN17rSOiCdLEZc1TdJLETG47rBt/yS9BfSLOl94aSeYCyKib2ki2z64jaD4PgeMA04EvgE8AtzpeylahWhg2LZ/UTcJpBO3SMr8e+k2giKLiC0R8WhETACGAwuBmZLOKXFo1rSDJa2RtBYYmA6vkbRW0ppSB2eNel3SKXUnSjoZWFCCeLYrrhoqAUmdgPEkZwUVJF1s3BQRfyplXGZtlaQ9gf8G1gNzSM7ohgLlwD9k/X/PiaDIJE0GBgD/C9wVEa+WOCSzzJA0BjiIpG3utYiYUeKQtgtOBEWg2oLlAAACE0lEQVQm6WNgXTqae/BFUo/ZpfhRmVmWORGYmWWcG4vNzDLOicDMLOOcCCyzJPWQdIekdyTNkfScpH9ogfWOlvRwS8RoVgxOBJZJkgQ8ADwVEftGxCEkT8vrXYJYfGOnlZQTgWXVGOBvEXF9zYSIWBwR10hqL+lXkl6QNE/SmVD7S3+mpHslLZB0e5pQkHR0Om0W8I8165S0k6Sb0nW9JOnYdPq3JN0j6SHgsaLuuVkd/iViWXUQ8GID804HVkfE0PTmv2ck1XxZD07LLgOeAQ6XVA38hiS5LASm5Kzr34DHI+I0SbsCsyVNT+eNAAZGxActuWNmW8uJwAyQdC3wd8DfgMUkXUgcn87eBeibzpsdEUvTMnNJ7gz/EPhjRLyVTr8NOCMt+0XgK5IuSMfLgJrurKc5Cdj2wInAsuo1oLYb6Yj4V0ldgWrgXeCciPh9bgFJo4GNOZO28Mn/UEM35Aj4akS8UWddh/LJjYVmJeU2Asuqx4EySf+SM23H9PX3wL/UPLBEUj9JOzWyrgVAH0n7peMn5sz7PXBOTluCu6627Y4TgWVS2iXxccAXJP1R0mySJ1ddCPwWeB14UdKrwA00cvacPu7wDOCRtLF4cc7snwEdgXnpun5WiP0x2xbuYsLMLON8RmBmlnFOBGZmGedEYGaWcU4EZmYZ50RgZpZxTgRmZhnnRGBmlnFOBGZmGff/Abgc7wsb13ltAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "gender_offer_channel(full_df)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": 49,
   "metadata": {},
   "outputs": [],
   "source": [
    "def best_sale_offer(user_item_matrix):\n",
    "    # Find out which offer sells the best\n",
    "\n",
    "    offer_gain = []\n",
    "    for offer_id in user_item_matrix.columns:\n",
    "        offer_gain.append([offer_id, transcript[(transcript['person'].isin(list(user_item_matrix[user_item_matrix[offer_id]>=1].index)))&(transcript['event']=='transaction')]['value'].apply(lambda x: x['amount']).sum()])\n",
    "\n",
    "    offer_value = pd.DataFrame(offer_gain, columns=['offer_id', 'gain'])\n",
    "    offer_value['gain'] = pd.to_numeric(offer_value['gain'])\n",
    "    offer_value.sort_values(by='gain', ascending=False, inplace=True)\n",
    "    print(offer_value)\n",
    "    \n",
    "    best_sale = offer_value.plot(kind='bar', title='Sale Amount of Different Offers')\n",
    "    best_sale.set_xlabel('Offer number')\n",
    "    best_sale.set_ylabel('Sale Amount')\n",
    "    \n",
    "    return offer_value"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 53,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "                           offer_id       gain\n",
      "7  fafdcd668e3743c1bb461111dcafc2a4  596220.84\n",
      "1  2298d6c36e964ae4a3e7e9706d1fb8c2  538027.98\n",
      "6  f19421c1d4aa40978ebb69ca19b0e20d  480555.03\n",
      "3  4d5c57ea9a6940dd891ad53e9dbe8da0  441918.93\n",
      "5  ae264e3637204a6fb9bb56bc8210ddfd  423683.27\n",
      "2  2906b810c7d4411798c6938adc9daaa5  305568.42\n",
      "4  9b98b8c7a33c4b65b9aebfe6a799e6d9  304361.77\n",
      "0  0b1e1539f2cc45b7b9fa7c272da2e1d7  218905.94\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>offer_id</th>\n",
       "      <th>gain</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>fafdcd668e3743c1bb461111dcafc2a4</td>\n",
       "      <td>596220.84</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2298d6c36e964ae4a3e7e9706d1fb8c2</td>\n",
       "      <td>538027.98</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>f19421c1d4aa40978ebb69ca19b0e20d</td>\n",
       "      <td>480555.03</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>4d5c57ea9a6940dd891ad53e9dbe8da0</td>\n",
       "      <td>441918.93</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>ae264e3637204a6fb9bb56bc8210ddfd</td>\n",
       "      <td>423683.27</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2906b810c7d4411798c6938adc9daaa5</td>\n",
       "      <td>305568.42</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>9b98b8c7a33c4b65b9aebfe6a799e6d9</td>\n",
       "      <td>304361.77</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0b1e1539f2cc45b7b9fa7c272da2e1d7</td>\n",
       "      <td>218905.94</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                           offer_id       gain\n",
       "7  fafdcd668e3743c1bb461111dcafc2a4  596220.84\n",
       "1  2298d6c36e964ae4a3e7e9706d1fb8c2  538027.98\n",
       "6  f19421c1d4aa40978ebb69ca19b0e20d  480555.03\n",
       "3  4d5c57ea9a6940dd891ad53e9dbe8da0  441918.93\n",
       "5  ae264e3637204a6fb9bb56bc8210ddfd  423683.27\n",
       "2  2906b810c7d4411798c6938adc9daaa5  305568.42\n",
       "4  9b98b8c7a33c4b65b9aebfe6a799e6d9  304361.77\n",
       "0  0b1e1539f2cc45b7b9fa7c272da2e1d7  218905.94"
      ]
     },
     "execution_count": 53,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAZsAAAETCAYAAADge6tNAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvhp/UCwAAIABJREFUeJzt3X+8VVWd//HXW/wB/sCfaMglMMVSK1GvYOmUZSJqipmWNjOgUzE1WtY0M1LTd/yBlj7Gxh81aZikNP7ISUtMTRmNSlPhIv5CUlApbvgDARFEFPDz/WOtm4fruefue7mbA8f38/E4j7v32mvv9dnnwvnctfc6aysiMDMzK9Mm9Q7AzMwan5ONmZmVzsnGzMxK52RjZmalc7IxM7PSOdmYmVnpnGxsvZA0T9In6h3HhkzSeyXNlLRM0le7eYxvSfpxxfqnJM2XtFzSfj3RxoZA0pclvZDPa0dJB0uak9ePq3d89nZONlaYpEMk/UHSUkmLJd0n6cD11PZukt6U9MP10V53SJoq6QvrcIh/A6ZGxDYRcVkHx1+ZE8UrkmZIGidpi7Y6EfGdiKiM4SLg9IjYOiJmdtZGmSQdKqm1QL0PS7onn+dSSbdK2rti+2bAfwEj8nktAs4FfpDXf1neWVh3OdlYIZL6Ar8Cvg/sAAwAzgFeX08hjAaWACdVfrg2mEHArE7qnB4R2wD9gW8AJwG3S1LBYxZpoypJm3Znvy628SHgLuAWYFdgN+AR4D5J78nVdgF6sxGdlwER4Zdfnb6AZuDlGtt3B+4BFgEvAdcC21Vsnwd8Ii9vAowDns71bwR26KT9p4EvAy8AJ7TbFsA/AXOAZcD4HM/9wCv5+JtX1P8iMBdYDEwGds3lg/OxNq2oOxX4Ql4+BbiX1FtYAjwLHJm3nQ+sAVYCy0l/ZVc7j2NJH4ov52Pvlcvvabf/nlX2/WssFWXvBlYAn8zrZwP/A2yRjxPAq/n9e1sbud5FwJ/ze3sF0Ccf61CgFTgTeB74aS7/JPBwPoc/AB9s93v+F+BRYCnwM1Ji2Ap4DXgzt7287X1vdz6/B35YpfwOYFKO+dV8XsvzOT2dj/taLtsC2Ba4CngO+AtwHtCr4vd4H3Bx/jdwHrAH8Nsc80vAz+r9f67RXnUPwK+N4wX0JSWGa4Ajge3bbd8DODz/R+8H/A64pGL7PN5KNl8DHgCacv0fAdfXaPtvSD2o7Uk9q8nttgcpafQF9sl17wbekz90ngDG5Lofzx8m++e2vw/8Lm8bTOfJZhUpWfUiJb8FgNrX7eA82j4oDwc2I13SmktOhAX2r7o9v9cX5uWzgf9p997s0dExgEvye7cDsA1wK/DdvO1QYDVwYX6v+uT37UVgeH4PxuTf7RYVv+dppF7JDsBs4EsVx2utcX5bkpLhx6psOxV4rsbvaR7531de/yXp39VWwM45pn+s+D2uBr4CbJrP63rg30l/CPUGDqn3/7lGe/kymhUSEa8Ah5D+k18JLJQ0WdIuefvciJgSEa9HxELSNfWPdnC4fwT+PSJaI+J10gfkCTUuZ4wB7oiIJcB1wJGSdm5X58KIeCUiZgGPA3dFxDMRsZT0V/F+ud7fAhMj4qHc9jeBD0kaXPCt+FNEXBkRa0iJtz/psk4RnwVuy+/TKlKPog/w4YL7d2QB6YO9S/Klty8CX4+IxRGxDPgO6dJcmzeBs/Lv9bVc/0cR8WBErImIa0jJ/aCKfS6LiAURsZiUvIYWDGkH0of9c1W2PQfsVPC8diH9QfS1iHg1Il4k9WIqz2tBRHw/Ilbn81pFuhS3a0SsjIh7C8ZsBTnZWGERMTsiTomIJuD9pL9eLwGQtLOkGyT9RdIrpEs5HX04DAJ+IellSS+T/vpdQ5UPbUl9gBNJl+WIiPtJl3w+167qCxXLr1VZ3zov7wr8qeKclpN6bAM6Of02z1fsuyIvbt1B3fbat/0mML8LbXdkAOlyUFf1I/UmZlT8Ln6dy9ssjIiVFeuDgG+01c/7DCSdW5vnK5ZXUPz9WUJKbv2rbOtP6pEWMYjUc3yuIsYfkXo4bea32+ffAAHTJM2S9A8F27KCnGysWyLij8DVpKQD8F1Sr+eDEdEX+DvSf95q5pPudWxX8eodEX+pUvdTpMtjP5T0vKTnSR+uo7sZ+gLShxEAkrYCdiRd1381F29ZUf9dXTh2Z1Oot29bpA/qauddiKSBwAGkex1d9RIpEe9T8XvYNiIqk0P7c5oPnN/ud7dlRFxfoL2a709EvEq6z3Zilc2fIV0aLWI+qbe1U0WMfSNin45iiYjnI+KLEbErqef9Q0l7FGzPCnCysUIkvU/SNyQ15fWBwMmkey+QrvcvB16WNAD41xqHuwI4X9KgfKx+kkZ1UHcMMBH4AOlyzFDgYGCopA9041SuA06VNDSPavsO8GBEzMuX//4C/J2kXvmv2927cOwXSPeJOnIjcLSkw/Lw3W+QPhT/0NWTkLSlpI+SRm1NA27v6jFyz+pK4OK2y5KSBkg6osZuVwJfkjRcyVaSjpa0TYEmXwB2lLRtjTrjgDGSvippG0nbSzoP+BBp9GOR83qONKLte5L6StpE0u75/apK0olt/7ZJPawg9bathzjZWFHLSDeFH5T0KinJPE76wIT0QbA/aTTPbcDNNY51Kemm9F2SluVjDW9fKSetw0gDDZ6veM0gXe4Z09WTiIi7gf8H3ES6D7A7a1/L/yIpUS4iDTboSiK4lHTvaYmkt32HJSKeJPX4vk/qVRwDHBMRb3ShjR/k9+wF0iXMm4CROXF0x5mkQQoP5Muf/we8t6PKEdFCeo9+QPpQnku64d6p3Bu+HngmX97atUqde4EjgONJv58/ke63HRIRc4qfFqOBzUmDQ5YAP6f65bk2B5L+bS8n/ds8IyKe7UJ71om2UTRmZmalcc/GzMxK52RjZmalc7IxM7PSOdmYmVnpnGzMzKx0nu0022mnnWLw4MH1DsPMbKMyY8aMlyKiX2f1nGyywYMH09LSUu8wzMw2KpL+1HktX0YzM7P1wMnGzMxK52RjZmalK/WejaTtgB+TZgYO4B+AJ0lP7xtMeuDRZyJiSZ4B91LgKNK05KdExEP5OGOAb+fDnpefoYGkA0gzD/chTUR4RkSEpB2qtVHmuZrZO9eqVatobW1l5cqVnVfeSPXu3ZumpiY222yzbu1f9gCBS4FfR8QJkjYnTd3+LeDuiLhA0jjSLK9nkh52NCS/hgOXA8Nz4jiL9FjiID17Y3JOHpcDY0kTOd4OjCQ9KGtcB22YmfW41tZWttlmGwYPHkz6u7mxRASLFi2itbWV3XbbrVvHKO0ymqS+wEdIzwEnIt6IiJeBUaQnHJJ/HpeXRwGTInkA2E5Sf9IMsFPykwSXAFOAkXlb34i4P9JsopPaHataG2ZmPW7lypXsuOOODZloACSx4447rlPPrcx7Nu8BFgI/kTRT0o/zg6p2yc+baHvuRNvT8waw9tPzWnNZrfLWKuXUaMPMrBSNmmjarOv5lZlsNiU93+TyiNiP9BTEcTXqVzuT6EZ5YZLGSmqR1LJw4cKu7GpmttG64oormDRp0npts8x7Nq1Aa0Q8mNd/Tko2L0jqHxHP5UthL1bUH1ixfxPpMbqtwKHtyqfm8qYq9anRxloiYgIwAaC5ublQoho87rYi1bpk3gVH9/gxzax+evpzoqc/I770pS/16PGKKK1nExHPA/MltT317zDSU/Mm89YTFseQHmtLLh+dHzV7ELA0XwK7ExiRHw+7PTACuDNvWybpoDySbXS7Y1Vrw8ysIY0fP573ve99HH744Zx88slcdNFFXHnllRx44IHsu+++fPrTn2bFihUAnH322Vx00UUAHHrooZx55pkMGzaMPffck9///velxFf292y+Alwr6VHSs+O/A1wAHC5pDnB4Xoc0muwZ0mNmrwT+CSAiFgPjgen5dW4uA/gyaWj1XOBp0kg0arRhZtZwWlpauOmmm5g5cyY333zzX6feOv7445k+fTqPPPIIe+21F1dddVXV/VevXs20adO45JJLOOecc0qJsdShzxHxMGnIcnuHVakbwGkdHGciMLFKeQvpOzztyxdVa8PMrBHde++9jBo1ij59+gBwzDHHAPD444/z7W9/m5dffpnly5dzxBFHVN3/+OOPB+CAAw5g3rx5pcToiTjNzDZy6W/1tzvllFP45S9/yb777svVV1/N1KlTq9bbYostAOjVqxerV68uJUZPV2NmtpE75JBDuPXWW1m5ciXLly/nttvSAIVly5bRv39/Vq1axbXXXlvXGN2zMTPbyB144IEce+yx7LvvvgwaNIjm5ma23XZbxo8fz/Dhwxk0aBAf+MAHWLZsWd1iVEfdr3ea5ubmKPI8Gw99NrP2Zs+ezV577VXXGJYvX87WW2/NihUr+MhHPsKECRPYf//9e7SNaucpaUZEVLs3vxb3bMzMGsDYsWN54oknWLlyJWPGjOnxRLOunGzMzBrAddddV+8QavIAATMzK52TjZlZD2j0+9/ren5ONmZm66h3794sWrSoYRNO2/Nsevfu3e1j+J6Nmdk6ampqorW1lUaePb7tSZ3d5WRjZraONttss24/wfKdwpfRzMysdE42ZmZWOicbMzMrnZONmZmVzsnGzMxK52RjZmal89DnBuXZqc1sQ+KejZmZlc7JxszMSudkY2ZmpXOyMTOz0jnZmJlZ6ZxszMysdE42ZmZWOicbMzMrXanJRtI8SY9JelhSSy7bQdIUSXPyz+1zuSRdJmmupEcl7V9xnDG5/hxJYyrKD8jHn5v3Va02zMysPtZHz+ZjETE0Iprz+jjg7ogYAtyd1wGOBIbk11jgckiJAzgLGA4MA86qSB6X57pt+43spA0zM6uDelxGGwVck5evAY6rKJ8UyQPAdpL6A0cAUyJicUQsAaYAI/O2vhFxf6QHf09qd6xqbZiZWR2UnWwCuEvSDEljc9kuEfEcQP65cy4fAMyv2Lc1l9Uqb61SXqsNMzOrg7In4jw4IhZI2hmYIumPNeqqSll0o7ywnADHArz73e/uyq5mZtYFpfZsImJB/vki8AvSPZcX8iUw8s8Xc/VWYGDF7k3Agk7Km6qUU6ON9vFNiIjmiGju169fd0/TzMw6UVqykbSVpG3aloERwOPAZKBtRNkY4Ja8PBkYnUelHQQszZfA7gRGSNo+DwwYAdyZty2TdFAehTa63bGqtWFmZnVQ5mW0XYBf5NHImwLXRcSvJU0HbpT0eeDPwIm5/u3AUcBcYAVwKkBELJY0Hpie650bEYvz8peBq4E+wB35BXBBB22YmVkdlJZsIuIZYN8q5YuAw6qUB3BaB8eaCEysUt4CvL9oG2ZmVh+eQcDMzErnZGNmZqUre+izWU2Dx93W48ecd8HRPX5MM1s37tmYmVnpnGzMzKx0TjZmZlY6JxszMyudk42ZmZXOycbMzErnZGNmZqVzsjEzs9I52ZiZWemcbMzMrHRONmZmVjonGzMzK50n4jQrwBOGmq0b92zMzKx0TjZmZlY6JxszMyudk42ZmZXOycbMzErn0WhmDcSj5mxD5Z6NmZmVzsnGzMxK52RjZmalc7IxM7PSlZ5sJPWSNFPSr/L6bpIelDRH0s8kbZ7Lt8jrc/P2wRXH+GYuf1LSERXlI3PZXEnjKsqrtmFmZvWxPno2ZwCzK9YvBC6OiCHAEuDzufzzwJKI2AO4ONdD0t7AScA+wEjghzmB9QL+GzgS2Bs4Odet1YaZmdVBqclGUhNwNPDjvC7g48DPc5VrgOPy8qi8Tt5+WK4/CrghIl6PiGeBucCw/JobEc9ExBvADcCoTtowM7M66DTZSDqxSFkHLgH+DXgzr+8IvBwRq/N6KzAgLw8A5gPk7Utz/b+Wt9uno/JabbQ/j7GSWiS1LFy4sOApmZlZVxXp2XyzYNlaJH0SeDEiZlQWV6kanWzrqfK3F0ZMiIjmiGju169ftSpmZtYDOpxBQNKRwFHAAEmXVWzqC6yuvtdaDgaOlXQU0DvvdwmwnaRNc8+jCViQ67cCA4FWSZsC2wKLK8rbVO5TrfylGm2YmVkd1OrZLABagJXAjIrXZOCIGvsBEBHfjIimiBhMusF/T0T8LfAb4IRcbQxwS16enNfJ2++JiMjlJ+XRarsBQ4BpwHRgSB55tnluY3Lep6M2zMysDjrs2UTEI8Ajkq6LiFU92OaZwA2SzgNmAlfl8quAn0qaS+rRnJTjmCXpRuAJUo/qtIhYAyDpdOBOoBcwMSJmddKGmZnVQZGJOIdJOhsYlOsLiIh4T9FGImIqMDUvP0MaSda+zkqg6sCDiDgfOL9K+e3A7VXKq7ZhZmb1USTZXAV8nXQJbU254ZiZWSMqkmyWRsQdpUdiZmYNq0iy+Y2k/wRuBl5vK4yIh0qLyszMGkqRZDM8/2yuKAvSt/TNzMw61WmyiYiPrY9AzMyscXWabCT9R7XyiDi358MxM7NGVOQy2qsVy72BT7L2LM5mZmY1FbmM9r3KdUkXkb7Vb2ZmVkh3HjGwJVD4C51mZmZF7tk8xluzJvcC+gG+X2NmZoUVuWfzyYrl1cALFc+KMTMz61Snl9Ei4k/AdsAxwKdIj2A2MzMrrMiTOs8ArgV2zq9rJX2l7MDMzKxxFLmM9nlgeES8CiDpQuB+4PtlBmZmZo2jyGg0sfZsz2uo/uhlMzOzqor0bH4CPCjpF3n9OPwwMjMz64IiX+r8L0lTgUNIPZpTI2Jm2YGZmVnjKNKzAXiWNOx5U0CS9vcjBszMrKgiX+ocD5wCPM1bX+70IwbMzKywIj2bzwC7R8QbZQdjZmaNqchotMdJX+o0MzPrliI9m+8CMyU9ztqPhT62tKjMzKyhFEk21wAXAo8Bb5YbjpmZNaIiyealiLis9EjMzKxhFUk2MyR9l/TAtMrLaB76bGZmhRQZILAfcBDwHeB7+XVRZztJ6i1pmqRHJM2SdE4u303Sg5LmSPqZpM1z+RZ5fW7ePrjiWN/M5U9KOqKifGQumytpXEV51TbMzKw+ijxi4GPtX8DJBY79OvDxiNgXGAqMlHQQ6f7PxRExBFhCmuiT/HNJROwBXJzrIWlv4CRgH2Ak8ENJvST1Av4bOJL02IOTc11qtGFmZnVQdAYBJG0LfBr4HLAXMKBW/YgIYHle3Sy/2r4M+rlcfg1wNnA5MCovA/wc+IEk5fIbIuJ14FlJc4Fhud7ciHgmx3cDMErS7BptmNkGYPC423r0ePMuOLpHj2c9r2aykdQHOJb0wb0/sA1pIs7fFTl47n3MAPYg9UKeBl6ueNJnK28lrQHAfICIWC1pKbBjLn+g4rCV+8xvVz4879NRG2ZmhfR0QoR3dlLs8DKapGuBp4ARwA+AwaTLXFMjotAQ6IhYExFDgSZSb2SvatXamuxgW0+Vv42ksZJaJLUsXLiwWhUzM+sBte7ZvJ90v2M28MeIWEMHH9qdiYiXgamkgQbbSWrrUTUBC/JyKzAQIG/fFlhcWd5un47KX6rRRvu4JkREc0Q09+vXrzunZmZmBXSYbPKN/c8AfYH/k/R7YBtJ7ypyYEn9JG2Xl/sAnyAlrt8AJ+RqY4Bb8vLkvE7efk++7zMZOCmPVtsNGAJMA6YDQ/LIs81Jgwgm5306asPMzOqg5j2biPgj8B/Af0hqJo1CmyapNSI+3Mmx+wPX5Ps2mwA3RsSvJD0B3CDpPGAmbz2I7Srgp3kAwGJS8iAiZkm6EXiC9JiD03IvC0mnA3cCvYCJETErH+vMDtowM7M6KDwaLSJagBZJ/wJ8pED9R0nf0Wlf/gxvjSarLF8JnNjBsc4Hzq9Sfjtwe9E2zMysPgonmzb5MtVvS4jFzMwaVJEZBMzMzNaJk42ZmZWu02QjaRdJV0m6I6/vLcnTv5iZWWFFejZXk0Z87ZrXnwK+VlZAZmbWeIokm50i4kbyg9PyNDBrSo3KzMwaSpFk86qkHcmzB+SZm5eWGpWZmTWUIkOf/5n0Lf7dJd0H9OOtb+ebmZl1qtNkExEPSfoo8F7SJJdPRsSq0iMzM7OG0WGykXR8B5v2lERE3FxSTGZm1mBq9WyOqbEtACcbMzMrpMNkExGnrs9AzMyscRWaG03S0cA+QO+2sog4t6ygzMyssRSZQeAK4LPAV0gDBE4EBpUcl5mZNZAi37P5cESMJj0S+hzgQ6z9hEwzM7OaiiSb1/LPFZJ2BVYBu5UXkpmZNZoi92x+lR/v/J/AQ6SRaFeWGpWZmTWUIl/qHJ8Xb5L0K6B3RHi6GjMzK6zDy2iSDpT0ror10cCNwHhJO6yP4MzMrDHUumfzI+ANAEkfAS4AJpEm4ZxQfmhmZtYoal1G6xURi/PyZ4EJEXET6XLaw+WHZmZmjaJWz6aXpLZkdBhwT8W2Ql8GNTMzg9pJ43rgt5JeIg1//j2ApD3w82zMzKwLas2Ndr6ku4H+wF0REXnTJqTZBMzMrM4Gj7utx48574Kje/yYNS+HRcQDVcqe6vEozMysoRWZQcDMzGydlJZsJA2U9BtJsyXNknRGLt9B0hRJc/LP7XO5JF0maa6kRyXtX3GsMbn+HEljKsoPkPRY3ucySarVhpmZ1UeZPZvVwDciYi/gIOA0SXsD44C7I2IIcHdeBzgSGJJfY4HLISUO4CxgODAMOKsieVye67btNzKXd9SGmZnVQWnJJiKei4iH8vIyYDYwABgFXJOrXQMcl5dHAZMieQDYTlJ/4AhgSkQsjoglwBRgZN7WNyLuz4MXJrU7VrU2zMysDtbLPRtJg4H9gAeBXSLiOUgJCdg5VxsAzK/YrTWX1SpvrVJOjTbMzKwOSk82krYGbgK+FhGv1KpapSy6Ud6V2MZKapHUsnDhwq7samZmXVBqspG0GSnRXBsRN+fiF/IlMPLPF3N5K2s/lK0JWNBJeVOV8lptrCUiJkREc0Q09+vXr3snaWZmnSpzNJqAq4DZEfFfFZsmA20jysYAt1SUj86j0g4CluZLYHcCIyRtnwcGjADuzNuWSTootzW63bGqtWFmZnVQ5hxnBwN/DzxWMXHnt0izR98o6fPAn4ET87bbgaOAucAK4FSAiFgsaTwwPdc7t2KC0C8DVwN9gDvyixptmJlZHZSWbCLiXqrfV4E0sWf7+gGc1sGxJgITq5S3AO+vUr6oWhtmZlYfnkHAzMxK52RjZmalc7IxM7PSOdmYmVnpnGzMzKx0TjZmZlY6JxszMyudk42ZmZXOycbMzErnZGNmZqVzsjEzs9I52ZiZWemcbMzMrHRONmZmVjonGzMzK52TjZmZlc7JxszMSudkY2ZmpXOyMTOz0jnZmJlZ6ZxszMysdE42ZmZWOicbMzMrnZONmZmVzsnGzMxK52RjZmalKy3ZSJoo6UVJj1eU7SBpiqQ5+ef2uVySLpM0V9Kjkvav2GdMrj9H0piK8gMkPZb3uUySarVhZmb1U2bP5mpgZLuyccDdETEEuDuvAxwJDMmvscDlkBIHcBYwHBgGnFWRPC7Pddv2G9lJG2ZmVielJZuI+B2wuF3xKOCavHwNcFxF+aRIHgC2k9QfOAKYEhGLI2IJMAUYmbf1jYj7IyKASe2OVa0NMzOrk/V9z2aXiHgOIP/cOZcPAOZX1GvNZbXKW6uU12rDzMzqZEMZIKAqZdGN8q41Ko2V1CKpZeHChV3d3czMClrfyeaFfAmM/PPFXN4KDKyo1wQs6KS8qUp5rTbeJiImRERzRDT369ev2ydlZma1re9kMxloG1E2Brilonx0HpV2ELA0XwK7Exghafs8MGAEcGfetkzSQXkU2uh2x6rWhpmZ1cmmZR1Y0vXAocBOklpJo8ouAG6U9Hngz8CJufrtwFHAXGAFcCpARCyWNB6YnuudGxFtgw6+TBrx1ge4I7+o0YaZmdVJackmIk7uYNNhVeoGcFoHx5kITKxS3gK8v0r5omptmJlZ/WwoAwTMzKyBOdmYmVnpnGzMzKx0TjZmZlY6JxszMyudk42ZmZXOycbMzErnZGNmZqVzsjEzs9I52ZiZWemcbMzMrHRONmZmVjonGzMzK52TjZmZlc7JxszMSudkY2ZmpXOyMTOz0jnZmJlZ6ZxszMysdE42ZmZWOicbMzMrnZONmZmVzsnGzMxK52RjZmalc7IxM7PSOdmYmVnpGjbZSBop6UlJcyWNq3c8ZmbvZA2ZbCT1Av4bOBLYGzhZ0t71jcrM7J2rIZMNMAyYGxHPRMQbwA3AqDrHZGb2jqWIqHcMPU7SCcDIiPhCXv97YHhEnN6u3lhgbF59L/BkD4eyE/BSDx+zDBtDnBtDjOA4e5rj7FllxDkoIvp1VmnTHm50Q6EqZW/LqhExAZhQWhBSS0Q0l3X8nrIxxLkxxAiOs6c5zp5Vzzgb9TJaKzCwYr0JWFCnWMzM3vEaNdlMB4ZI2k3S5sBJwOQ6x2Rm9o7VkJfRImK1pNOBO4FewMSImFWHUEq7RNfDNoY4N4YYwXH2NMfZs+oWZ0MOEDAzsw1Lo15GMzOzDYiTjZmZlc7JxszMSudk00MkfVXSwM5rWmckDZfUNy/3kXSOpFslXShp23rHV0nSMEkH5uW9Jf2zpKPqHVctkg7JcY6odyztSXqfpMMkbd2ufGS9YuqMpEn1jqGa/F6eKekySZfm5b3qFo8HCPQMSUuBV4GngeuB/42IhfWNqmsknRoRP9kA4pgF7JtHFU4AVgA/Bw7L5cfXNcBM0lmk+fc2BaYAw4GpwCeAOyPi/PpF9xZJ0yJiWF7+InAa8AtgBHBrRFxQz/jaSPoqKbbZwFDgjIi4JW97KCL2r2d8OY72X6EQ8DHgHoCIOHa9B1WFpDOBk0lTdbXm4ibS10BuqMfv3Mmmh0iaCRxA+qD5LHAsMIOUeG6OiGV1DK8QSX+OiHdvAHHMjoi98vJaHzKSHo6IofWL7i2SHiN9KG4BPA80RcQrkvoAD0bEB+saYCZpZkTsl5enA0dFxEJJWwEPRMQH6hthkt/PD0XEckmDSX9g/DQiLq08h3qS9BDwBPBj0qwkIv0fPwkgIn5bv+jeIukpYJ+IWNWufHNgVkQMWd8xNeT3bOokIuJN4C7gLkmbkf7qPRm4COh07qD1QdKjHW0CdllV4vawAAAEBElEQVSfsdTweEUv6xFJzRHRImlPYFVnO69HqyNiDbBC0tMR8QpARLwm6c06x1ZpE0nbky6bq63HHRGvSlpd39DW0isilgNExDxJhwI/lzSI6lNQ1UMzcAbw78C/RsTDkl7bUJJMhTeBXYE/tSvvn7etd042PWet/wz5L4rJwOT8l+6GYhfgCGBJu3IBf1j/4VT1BeBSSd8mTRp4v6T5wPy8bUPxhqQtI2IFqVcLQL6vtCElm21JvWwBIeldEfF8vi+yoXyIAzwvaWhEPAyQezifBCYCG0TvK/9BebGk/80/X2DD/Bz9GnC3pDmk/zcA7wb2AE7vcK8S+TJaD5G0Z0Q8Ve84OiPpKuAnEXFvlW3XRcTn6hBWVZK2Ad5D+s/cGhEv1DmktUjaIiJer1K+E9A/Ih6rQ1iFSdoS2CUinq13LACSmki9xeerbDs4Iu6rQ1g1SToaODgivlXvWNqTtAnpcSsDSH9UtALTc298/cfjZGNmZmXz0GczMyudk42ZmZXOycasE5KaJN0iaY6kp/MX5Dav2H69pEclfT1/ke5hSTMl7V7PuNuTdIqkH9Q7DntncrIxq0GSgJuBX+bvJuwJbA2cn7e/C/hwRHwwIi4GjgNuiYj9IuLpgm30Kif6nrWxxGkbJicbs9o+Dqxsm1khj+T5OvAPeTTXXcDOuTdzFmnI6Rck/QZA0t9Jmpa3/6jtA1vScknnSnoQ+FBlg5Km5ql5pkl6StLf5PK1eiaSfpW/i9J2vAslzZD0f3kanamSnpFU+a32gZJ+LenJHG/bsbocp1lXONmY1bYP6Tsqf5W/vPln0ncWjgWejoihEXEOcAVwcUR8LM9D9VnS0NihwBrgb/NhtgIej4jh1YahA5vmKWa+BpxVZXt7WwFTI+IAYBlwHnA48Cng3Ip6w3IMQ4ETJTWvY5xmhWyIX0Yy25CINC1J0fJKh5G+7Dk9XY2jD/Bi3rYGuKnGvjfnnzOAwQXifAP4dV5+DHg9IlblKWAq958SEYsAJN0MHAKsXoc4zQpxsjGrbRbw6coCpRmpB5ImXd25xr4CromIb1bZtrKTL9e1fVl0DW/9P13N2lcjelcsr4q3vjT3Ztv+EfGmpMr/5+0TZNv8Xt2N06wQX0Yzq+1uYEtJo+GvN8m/B1ydp6npbN8TJO2c990hz/PVXfOAoZI2UXqcxbBuHOPwHEcf0mCG+0qI0+xtnGzMasi9hU+R7m/MAZ4CVgKdTk8SEU8A3yZNzPoo6TEE/dchnPuAZ0mXyS4CHurGMe4Ffgo8DNwUES0lxGn2Np6uxszMSueejZmZlc7JxszMSudkY2ZmpXOyMTOz0jnZmJlZ6ZxszMysdE42ZmZWOicbMzMr3f8Hc8T1+rSTKXYAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "best_sale_offer(full_df)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}