solr - langid UpdateRequestProcessor only mapping first field -

-

i trying use solr's langid updaterequestprocessor. here config:

<updaterequestprocessorchain name="languages">     <processor class="solr.langdetectlanguageidentifierupdateprocessorfactory">         <lst name="invariants">             <str name="langid.fl">focus, expertise, platforms, partners, participation, additional</str>             <str name="langid.whitelist">en,fr</str>             <str name="langid.fallback">en</str>             <str name="langid.langfield">detectedlang</str>             <bool name="langid.map">true</bool>             <bool name="langid.map.keeporig">false</bool>         </lst>     </processor>     <processor class="solr.runupdateprocessorfactory" /> </updaterequestprocessorchain>

my fields this:

<fields>     <field name="_root_" type="string" indexed="true" stored="false"/>     <field name="_version_" type="long" indexed="true" stored="true" multivalued="false"/>      <field name="id" type="string" indexed="true" stored="true" required="true" />      <!-- raw fields sql db -->     <field name="expertise_id" type="int" indexed="true" stored="true" />     <field name="person_id" type="int" indexed="true" stored="true" />     <field name="mod_date" type="date" indexed="true" stored="true" />     <field name="lang" type="string" indexed="true" stored="true" />     <field name="focus" type="text_general" indexed="true" stored="true" />     <field name="expertise" type="text_general" indexed="true" stored="true" />     <field name="platforms" type="text_general" indexed="true" stored="true" />     <field name="partners" type="text_general" indexed="true" stored="true" />     <field name="participation" type="text_general" indexed="true" stored="true" />     <field name="additional" type="text_general" indexed="true" stored="true" />     <field name="tag" type="text_general" termvectors="true" multivalued="true" />           <field name="facet_tag" type="string" stored="false" indexed="false" docvalues="true" multivalued="true" default=""/>      <!-- language detected solr -->     <field name="detectedlang" type="string" indexed="true" stored="true" />      <!-- defined locale fields -->     <dynamicfield name="*_en" type="text_en" indexed="true" stored="true" />     <dynamicfield name="*_fr" type="text_fr" indexed="true" stored="true" />      <copyfield source="tag" target="facet_tag"/>  </fields>

when run update or dataimport know "languages" update chain used because focus mapped focus_en , detectedlang set. however, none of other fields in langid.fl mapped. why?

an example update query:

{   "additional": "here other information me.",   "expertise_id": "10000",   "id": "foo_10000",   "focus": "this new focus. exciting. when done expect super experienced." }

and here result of query expertise_id=10000. note additional has not been moved additional_en:

  "response":{"numfound":1,"start":0,"docs":[       {         "additional":"here other information me.",         "expertise_id":10000,         "id":"foo_10000",         "detectedlang":"en",         "focus_en":"this new focus. exciting. when done expect super experienced.",         "_version_":1447088846110982144}]   }

turns out problem syntax error. line:

<str name="langid.fl">focus, expertise, platforms, partners, participation, additional</str>

must 

<str name="langid.fl">focus,expertise,platforms,partners,participation,additional</str>

the docs state field list should comma or space separated values. evidently, comma , space screws things (though works fine in other solr contexts fl in requesthandler langid.fl supposedly modelled on). tried space-separated syntax well, did not fix issue.

i hope helps someone.


Comments

Post a Comment

Popular posts from this blog

c# - How Configure Devart dotConnect for SQLite Code First? -

-
can configure following sample code ? when run following code, error : no entity framework provider found ado.net provider invariant name 'devart.data.sqlite' setting in machine.config <system.data> <dbproviderfactories> <add name="dotconnect sqlite" invariant="devart.data.sqlite" description="devart dotconnect sqlite" type="devart.data.sqlite.sqliteproviderfactory, devart.data.sqlite, version=4.6.287.0, culture=neutral, publickeytoken=09af7300eec23701" /> </dbproviderfactories> </system.data> after add below block code in app.config <?xml version="1.0"?> <configuration>   <configsections> <!-- more information on entity framework configuration, visit http://go.microsoft.com/fwlink/?linkid=237468 --> <section name="entityframework" type="system.data.entity.internal.configfile.entityframeworksection, entit...
Read more

java - Copying object fields -

-
what best way of copying classes when need have 2 independent variables? have simple class: public class myclass { boolean = false; string b= "not empty"; } do need make method : assign(myclass data ) { a= data.a; b= data.b; } is there automatic method copy (duplicate) objects in java? do need make method : pretty close. instead of making method, should make constructor. such constructors called copy constructor , , create them this: myclass(myclass data) { = data.a; b = data.b; } and create copy of instance, use constructor this: myclass obj1 = new myclass(); myclass obj2 = new myclass(obj1); copy constructor can tedious : using copy constructor create deep-copy can tedious, when class has mutable fields. in case, assignment create copy of reference, , not object itself. have create copy of fields (if want deep copy). can go recursive. a better way create deep copy serialize , deserialize object. why not use clone()? ...
Read more

c++ - Clear the memory after returning a vector in a function -

-
i have function processes , stores lot of data in , returns results vector of class. amount of data stored in function tremendous , want clear storage memory of function after finished job. necessary (does function automatically clear memory) or should clear memory function? update: vector<customers> process(char* const *filename, vector<int> id) { vector<customers> list_of_customers; (perform actions) return list_of_customers; } variables defined locally within function automatically released @ end of function scope. destructors objects called, should free memory allocated objects (if objects coded correctly). example of such object std::vector . anything you've allocated new must have corresponding delete release storage. try avoid doing own allocation , use raii instead, i.e. containers or smart pointers.
Read more