WhatsApp-Analyzer

Analyze WhatsApp chat

The script reads an exported WhatsApp chat and then extracts the data. You may need to install some packages before running it.

Supported Analysis

• Chat Count
• Chat Average
• Member/Sender Rank
• Website/URL/Link Domain Rank
• Word Count and Rank
• Most Used Word by Sender
• Emoji Usage Rank
• Most Used Emoji by Sender
• Timestamp Heatmap
• Attachment Classification (In Android, there is no difference pattern for attachment. But in iOS we can actually classify between Image, Video, Audio, GIF, Sticker, Document and Contact Card)

Preview

• Sender Rank
• Domain rank
• Word Rank
• Most used word by sender
• Emoji rank
• Most used emoji by sender
• Chat activity heatmap

Requirements

• Python 3.6+

pip install -r requirements.txt

Usage

$ git clone https://github.com/PetengDedet/WhatsApp-Analyzer.git

$ cd WhatsApp-Analyzer
$ python whatsapp_analyzer.py chat_example.txt --stopword indonesian 

usage: python whatsapp_analyzer.py FILE [-h] [-d] [-s] [-c]

Read and analyze whatsapp chat

positional arguments:
  FILE                  Chat file path

optional arguments:
  -h, --help            show this help message and exit
  -d, --debug           Debug mode. Shows details for every parsed line.
  -s , --stopword       Stop Words: A stop word is a commonly used word (such
                        as 'the', 'a', 'an', 'in'). In order to get insightful
                        most common word mentioned in the chat, we need to
                        skip these type of word. The Allowed values are:
                        arabic, bulgarian, catalan, czech, danish, dutch,
                        english, finnish, french, german, hebrew, hindi,
                        hungarian, indonesian, italian, malaysian, norwegian,
                        polish, portuguese, romanian, russian, slovak,
                        spanish, swedish, turkish, ukrainian, vietnamese
  -c , --customstopword 
                        Custom Stop Words. File path to stop word. File must a
                        raw text. One word for every line

Stop Words

I've included stop words for several languages from https://github.com/Alir3z4/stop-words. You can use your own stop word file. Just use -c argument followed by filepath. One word for each file like below

able
ableabout
about
above
abroad
abst

Notes

• This script uses regex to extract the data.
• Currently supports the chat pattern below:

   "14/10/18, 11:16 - Contact Name: this is a message"
   "2/30/18, 2:07 AM - Contact Name:  Test👌"
   "[30/12/18 4.59.25 PM] Nama User: 🙏test"
   "[06/07/17 13.23.30] ‪+62 123-456-78910‬: image omitted"

• Some date formats may not be supported

Flowchart

Describe how the script identify and classify the chat

           +------------------+
      +----+    Empty line?   +----+
      |    +------------------+    |
      |                            |
      |                            |
  +---v---+                   +----v---+
  |  Yes  | +-----------------+   No   |
  +-------+ |                 +---+----+
            |                     |
  +---------+-+             +-----v-----+
  | Event Log |        +----+    Chat   +----+
  +-----------+        |    +-----------+    |
                       |                     |
                +------v-----+         +-----v------+   +--------------------+
          +-----+Regular Chat+----+    | Attachment +-->+ Clasify Attachment |
          |     +------------+    |    +------------+   +-------+------------+
          v                       v                             |
+---------+---------+   +---------+----------+                  |
|   Starting Line   |   |   Following Line   |                  |
+------+------------+   +-+------------------+                  |
       |                  |                                     |
       |                  |                                     |
       |           +------v-------+                             |
       |           | COUNTER      |                             |
       |           | 1 Chat       |                             |
       +---------->+ 2 Timestamp  +<----------------------------+
                   | 3 Sender     |
                   | 4 Domain     |
                   | 5 Words      |
                   | 6 Attachment |
                   | 7 Emoji      |
                   +-----+--------+
                         |
                         |
                         |
                         v
              +----------+----------------+
              |          Visualize        |
              +---------------------------+

Getting chat source

Android:

• Open a chat/group chat
• Tap on three dots on the top right
• Tap "More"
• Choose "Export chat"
• Choose "Without Media"

iOS

• Open a chat/group chat
• Tap on contact name/group name on the top to see the details
• Scroll down to find "Export Chat" menu
• Choose "Without Media"

Other Tech Port

• Web: Coming soon
• Jupyter Notebook: Coming soon
• NodeJS: Coming soon

Help Needed

• Need contributor to rearrange directory structure to match python best practice.
• iOS exported example needed

Buy me a coffee