Fun with Real-Time Data ๐
September 25, 2020โข1,223 words
A curated collection of data-related awesomeness, with a focus on internet, communication & security
Work in progress- I'm continuing to update the list, whenever I come across something epic
My respect goes out to the legends behind each of these projects ๐
Awesome Real-Time Data Visualizations
- Internet
- Tor Flow - Real-time data flow between Tor nodes
- Internet Census - 24-hour world map of average utilization of IPv4 addresses
- ICMP ping requests sent out with Carna botnet. Learn more on the Official Site / see similar datasets
- Map of Mobile Internet - Shows world data coverage, according to Twitter data
- IKnow - Live data showing what content is being downloaded + distributed via torrents
- Semantic Internet Map - Shows how different websites link together
- Wiggle - Worlds largest WiFi Map showing personal hotspot statistics geographically
- BGP Stream - Shows all current outages (see also live maps from Pingdom, Thousand Eyes)
- DomainTools Statistics - Domain registration Numbers and Charts
- Freedom House - Censorship Map - Global internet freedom and democracy status per country, over time
- Insecam - A directory and feed of insecure or public live webcams
- Air & Sea
- StarLink Satellite Map - Real-time positions of StarLink and OneWeb Satellites, showing heights, IDs and more
- Submarine Cable Map - An up-to-date map of major global internet cables (see also he.net and this)
- FlightRadar24 - World-wide map of live aircraft positions (see also opensky-network)
- Marine Traffic - World-wide map of live ships, tankers, cargo & passenger vessels and more
- Stuff in Space - Shows objects orbiting Earth
- Asterank - A scientific and economic database of over 600,000 asteroids
- Flight Misery Map - Real-time US geographical flight delay & cancellation trends
- Meteor Showers - Shows commit locations, simulating meteor showers with time
- Airport WiFi Map - Shows WiFi networks and their passwords for airports around the world
- Crypto
- FiatLeak - Real-time crypto asset movement stats
- Coin360 - Customizable heatmap shows the current state of prices and market caps across the Cryptoverse
- BitCoin Rain - Real BTC transactions and values falling from the sky
- BitNodes - Network map of all currently reachable nodes in the BTC network, can also be viewed on a geographical map
- BitListen - The sound of BitCoin, live transactions represented by bubbles and tones
- Symphony - BTC transactions rendered in a 3D outer-space virtual world, with flight simulator mode
- Crypto Watch - Real-time professional crypto market dashboards and trading data
- LiveCoinWatch - Crypto coin listings, and customizable dashboards and widgets
- Mempool - A BTC block explorer with real-time stats inferred from recent blocks, with a TV mode
- TX Watch - Live BCH and BTC transactions
- TxStreet - a live blockchain and mempool visualizer, where data is represented by crowds on the street
- Mempool - Real-time visualization of the Bitcoin transaction fee market
- Polkadot Telemetry - Live Polkadot staking and transaction blocks
- utxo - Static charts generated daily, showing inputs, outputs and spend dates
- Social
- One in a Million - A real-time Twitter map
- Sentiment Sweep - Geographic sentiment analysis on real-time Twitter data (- I made this one)
- Misc
- ListenToWikipedia - Wikipedia edits, represented by a tone, depending on size, built by Hatnote
- Google Search Terms - Hourly Google Search Trends, in your location
- Three Thousand Years - Shows major events throughout history, using Wikipedia data
- Wiki-Atlas - Wikipedia articles, categorized and plotted on a map
- ncov2019/live - Real-time Covid-19 data, map and dashboard (by Avi Schiffmann)
- National Grid: Live Status - Real-time UK energy stats (by Kate Morley) (similar to Grid Watch)
- Globe of Economic Complexity - Visualize's 15 Trillion dollars of world trade, where each dot is $100,000,000 of export
- GitHub Audio - Real-time GitHub commits and PR merges, represented by audio and bubbles
- Cyber
- Comparitech Ransomware Attack Map - Geographically plotted ransomware attacks
- Checkpoint - Geographical plotting of Malware, Phishing and Exploits
- FortiGuard - Incoming & Outgoing Attacks per Country
- Cloud Security Risk Map - Map of the world's safest and riskiest data locations
- Kaspersky Stats - Shows detailed threats per second from a variety of categories
- Kaspersky LogBook - Historic Threat Time Line
- See also
- Every AV-provider and wannabe security company has a matrix-style cyber map nowadays, here are some less-spectacular ones, which didn't make it onto the list: Fire Eye, BitDefender, ESET, Looking Glass Cyber Map, Digital Attack Map
- pewpew is a sweet web component, that you can use to build your own threat map (with sound effects!)
Info Sec - Databases, APIs, References
Want to build your own live data visualization? The below data sources may be of help
- Exodus - Trackers in Android Apps
- Exploit Database - A database or Current software vulnerabilities
- URLScan - Service scanning for malicious domains, with historical results
- Dehashed - Data Breaches and Credentials
- VirusTotal - Detailed virus scans of software
- Abuse IP DB - Database of IPs reported for abuse
- SnusBase - Long standing database hosting breached data
- OpenPhish - A feed of current phishing endpoints
- HashToolkit - Database of 'cracked' hashes
- SecLists - Starter list of leaked databases, passwords, usernames etc (Great for programming)
- Qualys SSL Pulse - A continuous and global dashboard for monitoring the quality of SSL / TLS support over time across 150,000 SSL- and TLS-enabled websites, based on Alexaโs list of the most popular sites in the world
- Tor Bulk Exit List - List of all exit nodes (IP) in use on the Tor network
- Mempool API - API for Bitcoin addresses, blocks, feed, memory, transactions and a real-time websocket feed
Info Sec - Data Research & Results
A collection of interesting studies that have collected, analysed and presented findings using internet data
- Internet Census Data - Includes data on address space allocation, traffic, DNS, service enumeration, internet outages and other internet topology data
- Web Tracking Data by Princeton University - This is the largest and most detailed analysis of online tracking to date, and measures both stateful (cookie-based) and stateless (fingerprinting-based) tracking. The crawls were made with OpenWPM
- Who has your Back? by EFF - Anual report assessing how companies handle personal data
- Lists of Websites Abusing Session Replay - Third-party sesssion replay scripts, record all your acions and allow them to be watched by a human. This list of websites include this
- Sensor Access Data - A Crawl of the Mobile Web Measuring Sensor Accesses, Illinois
- Canalys Newsroom - Research Studies on Security, Privacy, Technology and Finance
- Data Never Sleeps - An infographic visualizing how much data is generated every minute (2019)
- What they Know about You - An Infographic showing what information are Giant Tech Companies collecting from you (2020)
Finally- Here's a selection of pretty screenshots...
