My source data grew and grew until I encounted the problem with the version 0.9.9.<\/p>\n
1. INDEXER<\/strong><\/p>\n While building index I received the following warning: I checked it twice and the source data were not duplicated.<\/p>\n This is the sample of the indexer output when the a\/b warning occurred. 2. SEARCHD<\/strong><\/p>\n The next problem was that the searchd was unable to bring this index up (I received the message “Segmentation fault”). While examaning the sorces I think the problem in indexer was at: When the searchd started it has the following problems:<\/p>\n And the index worked (but no concistency).<\/p>\n The solution is to use the latest version (2.0.4).<\/p>\n","protected":false},"excerpt":{"rendered":" My source data grew and grew until I encounted the problem with the version 0.9.9. 1. INDEXER While building index I received the following warning: WARNING: duplicate document ids found I checked it twice and the source data were not duplicated. This is the sample of the indexer output when the a\/b warning occurred. collected […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[11,12],"tags":[],"_links":{"self":[{"href":"http:\/\/10sa.com\/sql_stories\/index.php?rest_route=\/wp\/v2\/posts\/513"}],"collection":[{"href":"http:\/\/10sa.com\/sql_stories\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/10sa.com\/sql_stories\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/10sa.com\/sql_stories\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/10sa.com\/sql_stories\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=513"}],"version-history":[{"count":12,"href":"http:\/\/10sa.com\/sql_stories\/index.php?rest_route=\/wp\/v2\/posts\/513\/revisions"}],"predecessor-version":[{"id":525,"href":"http:\/\/10sa.com\/sql_stories\/index.php?rest_route=\/wp\/v2\/posts\/513\/revisions\/525"}],"wp:attachment":[{"href":"http:\/\/10sa.com\/sql_stories\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=513"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/10sa.com\/sql_stories\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=513"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/10sa.com\/sql_stories\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=513"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
\nWARNING: duplicate document ids found<\/p>\n
\ncollected 37556684 docs, 88183.8 MB
\ncollected 203872754 attr values
\nsorted 203.9 Mvalues, 100.0
\nsorted 53924.6 Mhits, 100.0<\/p>\n
\nI observed the following errors in \/var\/log\/messages
\nFeb 15 15:54:57 shp01 kernel: searchd[4860]: segfault at 0000000000000000 rip 000000000048291e rsp 00007ffff30ebba0 error 4
\nFeb 17 08:32:12 shp01 kernel: searchd[2692]: segfault at 0000000000000020 rip 00000000004d627b rsp 00007ffff30eabf0 error 6<\/p>\n
\n# in the loop
\nwhile ( qDocinfo.GetLength() )
\nWith the following code I noticed many of id had the value 0:
\nbool bPBiszero = DOCINFO2ID ( pEntry ) ==0;<\/p>\n\r\n# in the method:\r\nbool CSphIndex_VLN::Preread () \r\n# int the loop:\r\nfor ( DWORD i=1; i