Skip to content

Latest commit

 

History

History
28 lines (18 loc) · 783 Bytes

README.md

File metadata and controls

28 lines (18 loc) · 783 Bytes
Raw

nodeca.search

Build Status

Nodeca search app.

See main repo for install instructions: https://github.com/nodeca/nodeca

Stopwords dump memo

prepare

  1. Rebuild index.
  2. Run optimize index forum_posts if not optimized yet.

dump

cd <root>/sphinx_data/node<X>
indextool --dumpdict tables/forum_posts.<XX>.spi -c searchd.conf > dump.txt
cat dump.txt | sed -e '0,/keyword,docs,hits,offset/d' | sort -t"," -k 2 -g -r | head -n 1000 | sed -e '/^\x02/d' > dump_top.txt
cat dump_top.txt | sed  's/,.*//' > stopwords.txt

Then edit stopwords.txt, remove unnecessary words. Use dump_top.txt to check documents number (second column).