Examples of TweetQuery

de.jetwick.es.TweetQuery
@author Peter Karich, peat_hal 'at' users 'dot' sourceforge 'dot' net
tutorial.storm.trident.example.elasticsearch.TweetQuery
Trident needs to know how to access your custom state when querying it. This implementation is what we need to query ElasticSearch. Queries are made in two steps: batchRetrieve (1) and execute (2). See below. PS: please note, that size of inputs for step (2) must be of the same size of the returned values of step (1). @author Davide Palmisano (davide.palmisano@peerindex.com)

Examples of de.jetwick.es.TweetQuery


    @Test
    public void testWhithNoSolrSearch() throws InterruptedException {
        TweetSearchPage page = getInstance(TweetSearchPage.class);
        page.setTwitterFallback(true);
        page.init(new TweetQuery("java"), new PageParameters());


        page.getQueueThread().run();
        assertNotNull(sentTweets);
        assertEquals("", uString);
        assertEquals("#java", qString);


        // do not trigger background search for the same query
        page.doSearch(new TweetQuery("java"), 0, true);
        assertNull(page.getQueueThread());


        // if only user search then set twitterFallback = true
        reset();
        page.doSearch(new TweetQuery().addFilterQuery("user", "test"), 0, true);
        assertEquals("#test", uString);
        assertEquals("", qString);
        page.getQueueThread().run();


        // if 'normal query' AND 'user search' then set twitterFallback = false but trigger backgr. thread
        reset();
        page.doSearch(new TweetQuery("java").addFilterQuery("user", "test"), 0, true);
        page.getQueueThread().join();
        assertEquals("#test", uString);
        assertEquals("", qString);
    }

View Full Code Here

Examples of de.jetwick.es.TweetQuery

        tweetConsumer.interrupt();
        tweetProducerThread.interrupt();
        checkExceptions(exceptionMap);


        tweetSearch.forceEmptyQueueAndRefresh();
        List<JTweet> res = tweetSearch.searchTweets(new TweetQuery().addFilterQuery(ElasticTweetSearch.USER, "timetabling"));
        assertEquals(1, res.size());
        assertEquals(1, res.get(0).getUrlEntries().size());
        // no resolving for now
        assertTrue(res.get(0).getUrlEntries().iterator().next().getResolvedUrl().equals("http://apne.ws/dERa4A"));
    }

View Full Code Here

Examples of de.jetwick.es.TweetQuery

        tweetConsumer.interrupt();
        checkExceptions(exceptionMap);
        tweetSearch.forceEmptyQueueAndRefresh();


        Set<JUser> users = new LinkedHashSet<JUser>();
        tweetSearch.query(users, new TweetQuery().addFilterQuery(ElasticTweetSearch.USER, "timetabling"));
        assertEquals(2, users.iterator().next().getOwnTweets().size());


        List<JUser> res = new ArrayList<JUser>();
        tweetSearch.query(res, new TweetQuery("java"));
        assertEquals(1, res.size());


        Collection<JTweet> coll = tweetSearch.searchTweets(new TweetQuery("duplicate"));
        assertEquals(1, coll.size());
        assertEquals("duplication tweet", coll.iterator().next().getText());


        coll = tweetSearch.searchTweets(new TweetQuery("duplication"));
        assertEquals(1, coll.size());
        assertEquals("duplication tweet", coll.iterator().next().getText());
    }

View Full Code Here

Examples of de.jetwick.es.TweetQuery

        tweetProducerThread.start();
        // let tweetconsumer do its work
        Thread.sleep(500);
                
        tweetSearch.forceEmptyQueueAndRefresh();
        List<JTweet> tweets = tweetSearch.searchTweets(new TweetQuery().setSort(ElasticTweetSearch.RT_COUNT, "desc"));
        assertEquals(2, tweets.size());
        assertEquals(1, tweets.get(0).getRetweetCount());
        assertEquals(0, tweets.get(1).getRetweetCount());        
    }

View Full Code Here

Examples of de.jetwick.es.TweetQuery

        Collection<String> f = new ArrayList<String>();
        for (int i = 0; i < 50000; i++) {
            f.add("user" + i);
        }


        TweetQuery q = new TweetQuery("").createFriendsQuery(f);


        // create tweet to map some indirectly mapped (not defined) fields like dt
        twSearchTester.getSearch().store(new JTweet(1L, "test", new JUser("user")), true);


        // should not throw an exception

View Full Code Here

Examples of de.jetwick.es.TweetQuery

            }
        }
    }


    public Collection<JTweet> search() {
        JetwickQuery query = new TweetQuery(). // should be not too old
                addFilterQuery(DATE, "[" + new MyDate().minusDays(1).toLocalString() + " TO *]").
                // should be high quality
                addFilterQuery(QUALITY, "[90 TO *]").
                // should be the first tweet with this content
                addFilterQuery(DUP_COUNT, 0).

View Full Code Here

Examples of tutorial.storm.trident.example.elasticsearch.TweetQuery

         */
        TridentState elasticSearchState = topology.newStaticState(new ElasticSearchStateFactory());
        topology
                .newDRPCStream("search")
                .each(new Fields("args"), new Split(" "), new Fields("keywords")) // let's split the arguments
                .stateQuery(elasticSearchState, new Fields("keywords"), new TweetQuery(), new Fields("ids")) // and pass them as query parameters
                .project(new Fields("ids"));
        return topology.build();
    }

View Full Code Here

0 1

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.