Twint - An Advanced Twitter Scraping And OSINT Tool

• Can fetch almost all Tweets (Twitter API limits to last 3200 Tweets only)
• Fast initial setup
• Can be used anonymously and without Twitter sign up
• No rate limitations

• Python 3.6

git clone https://github.com/twintproject/twint.git
pip3 install -r requirements.txt

pip3 install --upgrade -e git+https://github.com/twintproject/twint.git@origin/master#egg=twint

pipenv install -e git+https://github.com/twintproject/twint.git#egg=twint

• twint -u username - Scrape all the Tweets from user's timeline.
• twint -u username -s pineapple - Scrape all Tweets from the user's timeline containing pineapple.
• twint -s pineapple - Collect every Tweet containing pineapple from everyone's Tweets.
• twint -u username --year 2014 - Collect Tweets that were tweeted before 2014.
• twint -u username --since 2015-12-20 - Collect Tweets that were tweeted since 2015-12-20.
• twint -u username -o file.txt - Scrape Tweets and save to file.txt.
• twint -u username -o file.csv --csv - Scrape Tweets and save as a csv file.
• twint -u username --email --phone - Show Tweets that might have phone numbers or email addresses.
• twint -s "Donald Trump" --verified - Display Tweets by verified users that Tweeted about Donald Trump.
• twint -g="48.880048,2.385939,1km" -o file.csv --csv - Scrape Tweets from a radius of 1km around a place in Paris and export them to a csv file.
• twint -u username -es localhost:9200 - Output Tweets to Elasticsearch
• twint -u username -o file.json --json - Scrape Tweets and save as a json file.
• twint -u username --database tweets.db - Save Tweets to a SQLite database.
• twint -u username --followers - Scrape a Twitter user's followers.
• twint -u username --following - Scrape who a Twitter user follows.
• twint -u username --favorites - Collect all the Tweets a user has favorited.
• twint -u username --following --user-full - Collect full user information a person follows
• twint -u username --profile-full - Use a slow, but effective method to gather Tweets from a user's profile (Gathers ~3200 Tweets, Including Retweets).
• twint -u username --retweets - Use a quick method to gather the last 900 Tweets (that includes retweets) from a user's profile.
• twint -u username --resume 10940389583058 - Resume a search starting from the specified Tweet ID.

import twint

# Configure
c = twint.Config()
c.Username = "noneprivacy"
c.Search = "#osint"
c.Format = "Tweet id: {id} | Tweet: {tweet}"

# Run
twint.run.Search(c)

Output

import twint

c = twint.Config()

c.Username = "noneprivacy"
c.Custom["tweet"] = ["id"]
c.Custom["user"] = ["bio"]
c.Limit = 10
c.Store_csv = True
c.Output = "none"

twint.run.Search(c)

• Write to file
• CSV
• JSON
• SQLite
• Elasticsearch

I tried scraping tweets from a user, I know that they exist but I'm not getting them

To get only follower usernames/following usernames

To get user info of followers/following users

To get only user info of user

To get user info of users from a userlist