Update GSoC 2021 authored by hackhard's avatar hackhard
...@@ -47,14 +47,14 @@ One could find in more details [here](https://hackhard.github.io/my-blog//My-App ...@@ -47,14 +47,14 @@ One could find in more details [here](https://hackhard.github.io/my-blog//My-App
## Nearby Goals and Roadmap: ## Nearby Goals and Roadmap:
- [X] Get the website list ([Alexa](https://www.alexa.com/topsites) and [Moz](https://moz.com/top500)) - [X] Get the website list ([Alexa](https://www.alexa.com/topsites) and [Moz](https://moz.com/top500))
- [ ] Check with a few handful websites : - [X] Check with a few handful websites :
- [ ] Check if the website blocks Tor fully _(Response errors or difference in status codes)_ - [X] Check if the website blocks Tor fully _(Response errors or difference in status codes)_
- [ ] Add script to continue checking or return `Blocking` - [X] Add script to continue checking or return `Blocking`
- [ ] Check if the website returns `Captcha` - [X] Check if the website returns `Captcha`
- [ ] Add script to continue checking or return `Captcha` - [X] Add script to continue checking or return `Captcha`
- [ ] Check if the website redirects to another error page (without blocking it) - [X] Check if the website redirects to another error page (without blocking it)
- [ ] Add script to continue checking or return `Error page` - [X] Add script to continue checking or return `Error page`
- [ ] Check if the website allows anonymous visiting, and works fine - [X] Check if the website allows anonymous visiting, and works fine
- [ ] Repeat the above steps with some random websites. - [ ] Repeat the above steps with some random websites.
- [ ] If the above works good run for more number of websites - [ ] If the above works good run for more number of websites
- [ ] Else, check for the problem - [ ] Else, check for the problem
...@@ -66,6 +66,8 @@ One could find in more details [here](https://hackhard.github.io/my-blog//My-App ...@@ -66,6 +66,8 @@ One could find in more details [here](https://hackhard.github.io/my-blog//My-App
- [ ] Start working with the dashboard - [ ] Start working with the dashboard
- [ ] Adding graphs as discussed with the community - [ ] Adding graphs as discussed with the community
##### Do check out the [Nearby Roadmaps](GSoc-2021/Roadmap-Updates). It contains more details regarding the Updates.
## Posts : ## Posts :
...@@ -127,3 +129,4 @@ style NT stroke-width:3px,fill:#FFFF00 ...@@ -127,3 +129,4 @@ style NT stroke-width:3px,fill:#FFFF00
+ I've also proposed to check the final status code for a website redirected to another ([Mastercard](https://www.mastercard.de/) redirects to [this link](https://www.mastercard.de/de-de.html), and thus checking status code for "this link". Similar example would be for http://adsabs.harvard.edu/ which redirects to [here1](https://ui.adsabs.harvard.edu/) but for tor it redirects sometimes to [here2](http://adsabs.harvard.edu/cgi-bin/access_denied). + I've also proposed to check the final status code for a website redirected to another ([Mastercard](https://www.mastercard.de/) redirects to [this link](https://www.mastercard.de/de-de.html), and thus checking status code for "this link". Similar example would be for http://adsabs.harvard.edu/ which redirects to [here1](https://ui.adsabs.harvard.edu/) but for tor it redirects sometimes to [here2](http://adsabs.harvard.edu/cgi-bin/access_denied).
For more details one you could look into the [Experimental code](https://raw.githubusercontent.com/Hackhard/Fetcher/main/status%20code/test_run4/tr.py) and it's [output](https://raw.githubusercontent.com/Hackhard/Fetcher/main/status%20code/test_run4/tr_bash_output) to gain an even more insight. For more details one you could look into the [Experimental code](https://raw.githubusercontent.com/Hackhard/Fetcher/main/status%20code/test_run4/tr.py) and it's [output](https://raw.githubusercontent.com/Hackhard/Fetcher/main/status%20code/test_run4/tr_bash_output) to gain an even more insight.