The latest scan for websites running TYPO3 resulted in a total of 209.207 websites running TYPO3.
A list of ~301 million domains have been crawled and a new major version statistics has been generated.
After running the scan, I noticed that the detection engine still needs some tweaks. A few requests don’t go through the configured proxy server, which sometimes leads to websites being removed from the database by mistake.
With the upcoming Django major update, I’ll probably need to do some bigger refactorings, since a couple of the packages I’m using aren’t really maintained anymore. One of them is the one handling the API task queue. I’m thinking about switching the whole queue system (check API and crawler) over to Celery.