xml - Solr filters are them good? -


do think filters french search? 

<fieldtype name="text" class="solr.textfield" positionincrementgap="100">   <analyzer type="index">     <tokenizer class="solr.whitespacetokenizerfactory"/>     <!--      in example, use synonyms @ query time             <filter class="solr.synonymfilterfactory" synonyms="index_synonyms.txt" ignorecase="true" expand="false"/>           -->     <!--      case insensitive stop word removal.               add enablepositionincrements=true in both index , query               analyzers leave 'gap' more accurate phrase queries.     -->     <filter class="solr.stopfilterfactory" ignorecase="true" words="stopwords.txt" enablepositionincrements="true"/>     <filter class="solr.worddelimiterfilterfactory" generatewordparts="1" generatenumberparts="1" catenatewords="1" catenatenumbers="1" catenateall="0" splitoncasechange="1"/>     <filter class="solr.lowercasefilterfactory"/>     <filter class="solr.asciifoldingfilterfactory"/>     <filter class="solr.snowballporterfilterfactory" language="french" protected="protwords.txt"/>     <filter class="solr.removeduplicatestokenfilterfactory"/>     <filter class="solr.elisionfilterfactory" />           </analyzer>   <analyzer type="query">     <tokenizer class="solr.whitespacetokenizerfactory"/>     <filter class="solr.lowercasefilterfactory"/>     <filter class="solr.asciifoldingfilterfactory"/>     <filter class="solr.synonymfilterfactory" synonyms="synonyms.txt" ignorecase="true" expand="true"/>     <filter class="solr.stopfilterfactory" ignorecase="true" words="stopwords.txt" enablepositionincrements="true"/>     <filter class="solr.worddelimiterfilterfactory" generatewordparts="1" generatenumberparts="1" catenatewords="0" catenatenumbers="0" catenateall="0" splitoncasechange="1"/>     <filter class="solr.snowballporterfilterfactory" language="french" protected="protwords.txt"/>     <filter class="solr.removeduplicatestokenfilterfactory"/>     <filter class="solr.elisionfilterfactory" />   </analyzer> </fieldtype>

i have problems "electricitré" returns 6 occurences, when "electricite" returns 9 occurences.

  1. you can use solr admin page understand why electricitré , electricite doesn't give same results:

http://exemple.com:8983/solr/#/yourcorename/analysis?analysis.fieldvalue=electricit%c3%a9+electricite&analysis.query=electricit%c3%a9+electricite&analysis.fieldtype=text&verbose_output=1

here suppose due typo: electricitré instead of electricité without r?

  1. solr advises use synonyms @ index time:

keep in mind while synonymfilter happily work synonyms containing multiple words (ie: "sea biscuit, sea biscit, seabiscuit") recommended approach dealing synonyms this, expand synonym when indexing. because there 2 potential issues can arrise @ query time:

  1. the lucene queryparser tokenizes on white space before giving text analyzer, if person searches words sea biscit analyzer given words "sea" , "biscit" seperately, , not know match synonym.
  2. phrase searching (ie: "sea biscit") cause queryparser pass entire string analyzer, if synonymfilter configured expand synonyms, when queryparser gets resulting list of tokens analyzer, construct multiphrasequery not have desired effect. because of limited mechanism available analyzer indicate 2 terms occupy same position: there no way indicate "phrase" occupies same position term. our example resulting multiphrasequery "(sea | sea | seabiscuit) (biscuit | biscit)" not match simple case of "seabiscuit" occuring in document

even when aren't worried multi-word synonyms, idf differences still make index time synonyms idea. consider following scenario:

  • an index "text" field, @ query time uses synonymfilter synonym tv, televesion , expand="true"
  • many thousands of documents containing term "text:tv"
  • a few hundred documents containing term "text:television"

a query text:tv expand (text:tv text:television) , lower docfreq text:television give documents match "television" higher score docs match "tv" comparably -- may counter intuitive client. index time expansion (or reduction) result in same idf documents regardless of term original text contained.

  1. solr advises use elisionfilter before worddelimiterfilter:

note: best use elisionfilter before worddelimiterfilter. prevent slow phrase queries.


Comments

Post a Comment

Popular posts from this blog

Magento/PHP - Get phones on all members in a customer group -

i working on custom magento extension. working around adminhtml part , i've created custom form there. here form code: <?php class vivasindustries_smsnotification_block_adminhtml_sms_sendmass_edit_form extends mage_adminhtml_block_widget_form { public function _preparelayout() { $extensionpath = mage::getmoduledir('js', 'vivasindustries_smsnotification'); $head = $this->getlayout()->getblock('head'); $head->addjs('jquery.js'); $head->addjs('vivas.js'); return parent::_preparelayout(); } protected function _prepareform() { $form = new varien_data_form(array( 'id' => 'edit_form', 'action' => $this->geturl('*/*/save', array('id' => $this->getrequest()->get...
Read more

php - Bypass Geo Redirect for specific directories -

i'm trying bypass redirect specific url within site. wondering if might able help. the code below code use, original urls replaces example.com i'd able access http://example.com/admin without redirect occuring. is there way this, , there way using own ip? function country_geo_redirect() { $country = getenv('http_geoip_country_code'); if ($country == "us" ) { wp_redirect("http://usa.example.com/"); exit; } else if ($country == "gb" ) { wp_redirect("http://uk.example.com/"); exit; } } add_action('init', 'country_geo_redirect'); you can bypass redirection code if server found ip address. if ip address == <my ip address> ' nothing here else country_georedirect() end if
Read more

php - .htaccess mod_rewrite for dynamic url which has domain names -

i want convert url ex:( example.com/link.php?url=facebook.com ) ( example.com/facebook.com.php ) how can using .htaccess. or there other process make job easier ? i tried adding script .htaccess file options +followsymlinks rewriteengine on rewriterule url-(.*)\.htm$ link.php?url=$1 but converting url adding "url-" ( example.com/url-facebook.com.php ) i want remove "url-" , want make ( example.com/facebook.com.php ) rewriteengine on rewritecond %{the_request} ^get.*link\.php\?url\= [nc] rewritecond %{request_uri} !/system/.* [nc] rewriterule (.*?)link\.php\?url\=/*(.*) /$1$2 [r=301,ne,l] not sure how above work edit of used use remove index.php url
Read more