OSINT-Cheat-sheet/Script/SOCMINT-Twitter

Jieyab ft Xquik

Sett up

1. Config your Google api console here, enable and manage API Custom Search by Google

2. Sett the api key in web console Google

Check the result in the table

3. Settings CSE Google to put the cx key

4. Add site want to crawll e.g twitter.com and x.com

Data Source

1. Xquik API (subs there is a price)
2. Cookie (your account cookie session)
3. Wayback Machine (Cdx API)
4. Goole CSE API (free quota 100 per day u can increase u limit with buy the service)

Update Note

1. Update infinity scroll and load new data for twitter reply and retweets
2. Update data corelation
3. Fix business logic flow
4. Monitoring (Soon)
5. MCP (Soon)
6. Add more parameter for enrichment
7. Add no rate limit (throttle)
8. Add Google CSE data source

Setup

pip install -r requirements.txt

Edit config.ini.example to config.ini

Run Local Web Server

python app.py

Open http://127.0.0.1:5000

Results

Xquik Dashboard

Dasboard Home

Archive

Graph

Vidio

Dir Output

Help

About SnowflakeID -> Twitter userid : https://en.wikipedia.org/wiki/Snowflake_ID

About paramater was provided in data and dump with json file type

Xquik API DOC

Offc doc: https://docs.xquik.com/api-reference/overview

Soon i will check more detail about Twitter or X mechanism and business logic also endpoint API was listed in Mobile and Web

Wayback archive data source

The server connection to the Wayback Machine archive is often down, so try bumping the thread and don't set the throttle too high, and try checking the connection manually using curl.