List of docFreq() Examples

Examples of docFreq()

org.apache.lucene.index.DirectoryReader.docFreq()
org.apache.lucene.index.IndexReader.docFreq()
Returns the number of documents containing the term t. @throws IOException if there is a low-level IO error
org.apache.lucene.index.MultiReader.docFreq()
org.apache.lucene.index.TermContext.docFreq()
Returns the accumulated document frequency of all {@link TermState}instances passed to {@link #register(TermState,int,int,long)}. @return the accumulated document frequency of all {@link TermState}instances passed to {@link #register(TermState,int,int,long)}.
org.apache.lucene.index.TermEnum.docFreq()
Returns the docFreq of the current Term in the enumeration.
org.apache.lucene.index.TermsEnum.docFreq()
Returns the number of documents containing the current term. Do not call this when the enum is unpositioned. {@link SeekStatus#END}.
org.apache.lucene.search.FuzzyTermsEnum.docFreq()
org.apache.lucene.search.IndexSearcher.docFreq()
Returns total docFreq for this term.
org.apache.lucene.search.TermStatistics.docFreq()
returns the number of documents this term occurs in @see TermsEnum#docFreq()

Examples of org.apache.lucene.index.TermEnum.docFreq()

        if( junkWords != null && junkWords.contains( t ) ) {
          continue;
        }
        
        if( terms.docFreq() > tiq.minFreq ) {
          tiq.add(new TopTermQueue.TermInfo(terms.term(), terms.docFreq()));
            if (tiq.size() > numTerms) { // if tiq full
            tiq.pop(); // remove lowest in tiq
            tiq.minFreq = ((TopTermQueue.TermInfo)tiq.top()).docFreq; // reset minFreq
          }
        }

View Full Code Here

Examples of org.apache.lucene.index.TermEnum.docFreq()

      int result = 1;
      currentTerm = currentTerm.createTerm(term);
      try {
        final TermEnum termEnum = reader.terms(currentTerm);
        if (termEnum != null && termEnum.term().equals(currentTerm)) {
          result = termEnum.docFreq();
        }
      } catch (IOException e) {
        throw new RuntimeException(e);
      }
      return result;

View Full Code Here

Examples of org.apache.lucene.index.TermEnum.docFreq()

    do {
      Term term = te.term();
      if (term == null || term.field().equals(field) == false) {
        break;
      }
      out.printf("%s %d\n", term.text(), te.docFreq());
    } while (te.next());
    te.close();
  }
  
  /** dump the values stored in the specified field for each document.

View Full Code Here

Examples of org.apache.lucene.index.TermEnum.docFreq()


  protected float calculateWeight(Term term, IndexReader reader) throws IOException {
    //if a term is not in the index, then it's weight is 0
    TermEnum termEnum = reader.terms(term);
    if (termEnum != null && termEnum.term() != null && termEnum.term().equals(term)) {
      return 1.0f / termEnum.docFreq();
    } else {
      log.warn("Couldn't find doc freq for term {}", term);
      return 0;
    }

View Full Code Here

Examples of org.apache.lucene.index.TermEnum.docFreq()

    do {
      Term term = te.term();
      if (term == null || term.field().equals(field) == false) {
        break;
      }
      System.err.printf("%s %d\n", term.text(), te.docFreq());
    } while (te.next());
    te.close();
  }
  
  public static void emitTextForTags(File file, File output) throws IOException {

View Full Code Here

Examples of org.apache.lucene.index.TermEnum.docFreq()

      Term term = te.term();
      if (term == null || term.field().equals(field) == false) {
        break;
      }
      
      if (te.docFreq() > 30) {
        File f = new File(output, term.text() + ".txt");
        PrintWriter pw = new PrintWriter(new FileWriter(f));
        System.err.printf("%s %d\n", term.text(), te.docFreq());
        
        TermDocs td = reader.termDocs(term);

View Full Code Here

Examples of org.apache.lucene.index.TermEnum.docFreq()

      }
      
      if (te.docFreq() > 30) {
        File f = new File(output, term.text() + ".txt");
        PrintWriter pw = new PrintWriter(new FileWriter(f));
        System.err.printf("%s %d\n", term.text(), te.docFreq());
        
        TermDocs td = reader.termDocs(term);
        while (td.next()) {
          int doc = td.doc();
          buf.setLength(0);

View Full Code Here

Examples of org.apache.lucene.index.TermEnum.docFreq()

      if (terms != null && terms.term() != null) {
        do {
          if (!terms.term().field().equals(field)) {
            break;
          }
          tiq.insertWithOverflow(new TermStats(terms.term(), terms.docFreq()));
        } while (terms.next());
      } else {
        System.out.println("No terms for field \"" + field + "\"");
      }
    } else {

View Full Code Here

Examples of org.apache.lucene.index.TermEnum.docFreq()

        System.out.println("No terms for field \"" + field + "\"");
      }
    } else {
      TermEnum terms = reader.terms();
      while (terms.next()) {
        tiq.insertWithOverflow(new TermStats(terms.term(), terms.docFreq()));
      }
    }


    TermStats[] result = new TermStats[tiq.size()];

View Full Code Here

Examples of org.apache.lucene.index.TermEnum.docFreq()

      if (fields == null || fields.contains(termEnum.term().field())) { // todo skipto if not using field
        InstantiatedTerm instantiatedTerm = new InstantiatedTerm(termEnum.term().field(), termEnum.term().text());
        getTermsByFieldAndText().get(termEnum.term().field()).put(termEnum.term().text(), instantiatedTerm);
        instantiatedTerm.setTermIndex(terms.size());
        terms.add(instantiatedTerm);
        instantiatedTerm.setAssociatedDocuments(new InstantiatedTermDocumentInformation[termEnum.docFreq()]);
      }
    }
    termEnum.close();
    orderedTerms = terms.toArray(new InstantiatedTerm[terms.size()]);

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.