Monday, May 4, 2020

Wiktionary


  • Parsing raw compressed dump file. Example to extract the title of all pages().
    bzcat pages-articles.xml.bz2 | grep '<title>[^[:space:][:punct:]]*</title>' | sed 's:.*<title>\(.*\)</title>.*:\1:'
    https://stackoverflow.com/questions/3364279/has-anyone-parsed-wiktionary/9735019
  • Regular expression which include unicode characters. For instance if Arabic,
    ^[\p{Arabic}\s\p{N}]+$
    https://stackoverflow.com/questions/29729391/regular-expression-arabic-characters-and-numbers-only

No comments:

Post a Comment

Writing a post in Markdown in Blogger

Following articles are helpful. * [【令和最新版】Blogger で Markdown を用いて記事を書く方法](https://qiita.com/hoge_fu-ga/items/267ea5ad4f8c120eaeb8) * [Bl...