Blocked.org.uk/Roadmap

< Blocked.org.uk

Next steps in development for blocked.org.uk, netblocked.eu and 451unavailable.org

Milestone Task Category EU / UK Status
2018 Q1.01
  • Netblocked.eu
    • make it usable, to list all EU results [done]
    • Editable text, remove UK text, links and replace [done]
    • Per country results as well as whole EU [done]
    • Stats: blocks detected per country (including UK) [done]
netblocked.eu EU Complete
2018 Q1.02
  • Data management
    • Admin tools to manage priority check lists, eg add data for regular court order checking [done]
    • Export tools [done]
    • Flagging and managing likely ISP/ rights holder errors [done]

(requires documentation)

Court orders EU / UK Complete
2018 Q1.03
  • Court order blocks
    • Retain DNS expiry dates [done]
    • List expiry dates on admin side [done]
Court orders UK Complete
2018 Q1.04
  • Error 451 generator
    • Create 451 generator [done]
    • Request, collate, publish documents [in progress]
    • Link to documents
    • Implement 451 for EU blocks (will require language localisation)
Netblocked.eu EU / UK Next
2018 Q1.05
  • Probe management (UK / EU)
    • Create tools to record who is administrating a probe and alert them to problems [in ansible, frontend in progress]
    • Expand number of probes to at least five more EU countries [in progress]
Netblocked.eu EU / UK In Progress
2018 Q2.02
  • Testing capacity
    • Ensure we can use full capacity of lines to check blocks
    • Ready ourselves for at-scale testing of zone files
Data EU / UK Forthcoming
2018 Q2.03
  • Filtering complaints and email system
    • Use unique email address so we see replies to complaints [in progress]
    • Route emails through the system and store them to be ready to publish email trails
Filter complaints UK In progress
2018 Q2.04
  • netblocked.eu
    • Per country pages / microsites
    • Front end language customisation and editing
    • Move to Wordpress for editing both systems (UK and EU)
    • Ask groups to collate court information for 451 pages
Netblocked.eu EU Forthcoming
2018 Q2.05
  • API submissions and retrieval
    • Create API to submit test data and retrieve results
    • Lay foundation for Wordpress checking tool
Data EU / UK Forthcoming
2018 Q2.06
  • BBFC tools
    • Recording decisions
    • Referring decisions
Filter complaints UK Forthcoming
2018 Q2.07
  • User management
    • User accounts for people making complaints
    • Admin users and levels [DONE #209]
Filter complaints UK In Progress
2018 Q2.08
  • Domain seizures
    • Add system to spot and group domain seizures
Domain seizures EU / UK Forthcoming
2018 Q2.09
  • Error 451
    • Expose Error 451 results on page
Domain seizures EU / UK Forthcoming
2018 Q2.10
  • Lumen integration
    • API linkage to file relevant information to Lumen
    • API linkage to extract infringing domain information
Data EU / UK Forthcoming
2018 Q2.11
  • Data sources and tests
    • Expand range of ZF data
    • Automate imports
    • Run tests on Common Crawl, .com etc
Data EU / UK Forthcoming
2018 Q2.12
  • 451unavailable
    • Simplify content
    • Add links to current projects
    • Internationalise
    • Move to Wordpress
Data EU / UK Forthcoming
2018 Q3.01
  • Wordpress checking tool
    • Using API, allow website owner to check for blocks
    • Automatically report to plug in users when and where a site is blocked
Filter complaints EU / UK Forthcoming
2018 Q3.02
  • Anomaly detection
    • Build ways for the system to flag likely detection problems, eg when a set of sites on a particular network appear to be suddenly "unblocked"
    • Cache and link to cached html pages for court order blocks
Court orders EU / UK Forthcoming
2018 Q3.03
  • Lumen integration
    • API linkage to file relevant information to Lumen
    • API linkage to extract infringing domain information
Filter complaints EU / UK Forthcoming
2018 Q3.04
  • Data sources and tests
    • Expand range of ZF data
    • Automate imports
    • Run tests on Common Crawl, .com etc
Filter complaints EU / UK Forthcoming
2018 Q3.05
  • Add third party DNS services
Filter complaints UK Forthcoming
2018 Q3.06
  • Email threads
    • Publish whole email threads per complaint
Filter complaints UK Forthcoming
2018 Q3.07
  • Get test data from EU zone files
Domain seizures EU Forthcoming
2018 Q3.08
  • Direct ISP unblock complaints to relevant rights holder
    • Add in email contact details for each court order
    • Allow front end users to ask; only forward legitimate complaints
    • File as “counter notices” to Lumen?
Court orders EU / UK Forthcoming
2018 Q3.09
  • Classify ISP responses
    • Allow user / admin user to flag as "wontfix"
    • Sorting features to see responses that are flagged as "wontfix"
    • Features for follow up, automatic emails reminding ISPs that responses have not been received
Filter complaints UK Forthcoming
2018 Q3.10
  • Allow admin users to manage testing regime
    • Tools to administrate what tests are done
    • Show bulk schedules etc
Data EU / UK Forthcoming
2018 Q3.11
  • Comparison tools for mobile
    • Compare mobile results for inconsistencies
    • Public pages or lists to report
Filter complaints UK Forthcoming
2018 Q3.12
  • Ooni integration
    • Retest court order blocked URLs via OoniProbe
    • Publish Ooni results
    • Submit Ooni results
    • Run and submit standard Ooni tests (against filtered and unfiltered lines?)
    • Link from blocked to full Ooni results for comparison
Data EU / UK Forthcoming
2099 ZZ.ZZ
  • Maximise data testing and coverage
    • Gain access to as many EU domain ZF files as possible
    • Increase probe capacity to be able to test for bulk domain seizures
Domain seizures EU Forthcoming
2099 ZZ.ZZ
  • Federation and integration
    • Work with other projects to provide “single check” services
Data EU / UK Forthcoming
2099 ZZ.ZZ
  • Commercial applications
    • Regular checking of domains for companies and hosting providers
Data UK Forthcoming

For discussion

  • Splitting the copyright and filter tools
    • Focus the filter tool on the idea of users making unblock requests (since this is the main use case now)
    • Find ways to optimise the site for people to find re unblocking search; understand common search terms, provide pages and info using the provider names
  • Copyright unblock reports
  • Data refresh strategy: ensuring we retest blocks and re-index content
  • Cache the html from the initial blocked requests, store with details of when / where requested etc

Todo

  • Redate tasks