Table 1 Tweet pre-processing.

From: Examining spread of emotional political content among Democratic and Republican candidates during the 2018 US mid-term elections

Tweet

Cleaning functions

Amazing to see @TOMS taking a stroonga stand to support universal background checks and encouraging customers to #endgunviolencetogether. & amp https://t.co/8h6OA1vUi4

Original tweet was published by Chris Murphy on 22 Nov 2018.

Amazing to see @TOMS taking a stroong stand to support universal background checks and encouraging customers to #endgunviolencetogether. https://t.co/8h6OA1vUi4

Decoding the complex symbols to simple and human-readable characters by UTF-8.

Amazing to see @TOMS taking a stroong stand to support universal background checks and encouraging customers to #endgunviolencetogether.

Removing URL, http, ftp, etc.

Amazing to see taking a stroong stand to support universal background checks and encouraging customers to #endgunviolencetogether.

Removing a user-mention, including the word fixed with @.

Amazing to see taking a stroong stand to support universal background checks and encouraging customers to endgunviolencetogether.

Removing the hashtag and keeping the word prefixed with #.

Amazing to see taking a strong stand to support universal background checks and encouraging customers to endgunviolencetogether.

Checking spelling errors with repeated characters.

  1. aWe have modified the original tweet by replacing “strong” to “stroong” to present the spelling correction function in this sample.
Back to article page