DOKK / manpages / debian 11 / sunpinyin-utils / idngram_merge.1.en
IDNGRAM_MERGE(1) User Contributed Perl Documentation IDNGRAM_MERGE(1)

idngram_merge - merge idngram file into one

idngram_merge [option]... idngram_file...

idngram_merge merge multiple idngram file, each of them are sorted [id1,...,idN,freq] array, into one idngram file. For those id1..idN which appear in more than one files, only one item will appear in the final file, and its freq are summed. The idngram files are original generated by ids2ngram.

Specify the N-gram of source data file.
Specify the final merged idngram file.

Following example merge 2 id3gram files into a large one:

    B<idngram_merge -n3 -o all.id3gram first.id3gram second.id3gram>

Originally written by Phill.Zhang <phill.zhang@sun.com>. Currently maintained by Kov.Chai <tchaikov@gmail.com>.

ids2ngram(1).

2020-11-19 perl v5.32.0