2.5 KiB
2.5 KiB
TODO
- chore: initial commit (+ mirror on GitHub)
- Deploy first staging version (v1.0.0-staging.1)
- Wikipedia Database Dump
- Download SQL files
- Extract SQL files
- Tables structure
CREATE TABLE
page.sql
(pages
tables)pagelinks.sql
(internal_links
tables)
- Adapt downloaded SQL files
page.sql
(pages
tables)pagelinks.sql
(internal_links
tables)
- Import SQL files
- Try
SELECT count(*) FROM internal_links il WHERE il.source_id = (SELECT p.id FROM pages WHERE p.title = 'Linux'); -- Count of internal links for 'Linux' page
- Move from POC (Proof of concept) in
data
folder toapps/cli
folder - Documentation how to use + Last execution date
- Rewrite bash script to download and extract SQL files from Wikipedia Database Dump to Node.js for better cross-platform support and easier maintenance + automation, preferably one Node.js script to generate everything to create the database
- Verify file content up to before inserts, to check if it matches last version, and diff with last version
- Implement REST API (
api
) with JSON responses (AdonisJS) to get shortest paths between 2 pages - Implement Wikipedia Game Solver (
website
) with inputs, button to submit, and list all pages to go from one to another, or none if it is not possible - Check how to deal with redirects (+ Wikipedia Database Dump related)
- Implement toast notifications for errors, warnings, and success messages
- Implement CLI (
cli
) - Add docs to add locale/edit translations, create component, install a dependency in a package, create a new package, technology used, architecture, links where it's deployed, how to use/install for end users, how to update dependencies with
npx taze -l
etc.
Links
- https://www.sixdegreesofwikipedia.com/ and https://github.com/jwngr/sdow
- https://github.com/shyamupa/wikidump_preprocessing
- https://www.mediawiki.org/wiki/API:Allpages
- https://www.thewikigame.com/
- How to get all URLs in a Wikipedia page: https://stackoverflow.com/questions/14882571/how-to-get-all-urls-in-a-wikipedia-page
- https://en.wikipedia.org/w/api.php?action=query&titles=Title&prop=links&pllimit=max&format=json
- YouTube (Amixem) - WIKIPEDIA CHALLENGE ! (ce jeu est génial)
- YouTube (adumb) - I Made a Graph of Wikipedia... This Is What I Found