Stack Exchange
log in   chat   discuss   faq   users   badges

Area 51 » Science

definition commitment
180
followers
Follow It!
Share This

Information Retrieval and Search Engines

Proposed Q&A site for researchers and practitioners who specialize in building systems that help people organize data and extract information from it.
flag

1
vote
0
answers

Does this site include Semantic Web Search?

feb 26 at 10:40 tbraun89 151
5
votes
2
answers

Is this the right place for search engine optimization questions?

jan 25 at 9:12 unor 397
2
votes
2
answers

Who is this for?

oct 23 at 1:06 PatomaS 151
2
votes
3
answers

How do I distribute my votes?

sep 6 at 14:29 woliveirajr 1,788
2
votes
0
answers

Related Stack Exchange sites to information retrieval and search engines

jul 22 at 20:47 Jakob 306

show 3 more discussions
create new discussion

This proposal is now in the Commitment phase — example questions are locked!

65 Example Questions (4 closed)

active oldest votes
up vote 11 down vote
Can clickthrough data replace expert judgments for retrieval evaluation?
added by dyaa albakour Mar 20 '12 at 13:09
link|flag
1  
This is a complicated question and one with lots of active research. Could generate good discussion! – Ian Soboroff Mar 20 '12 at 13:34
Nice to have a discussion of tradeoffs about this topic – Gene Golovchinsky Mar 20 '12 at 21:29
1  
Per the FAQ, it might be best to rephrase this as, "How can I use the 10k queries and clicks in my log to improve my site search?" – Ian Soboroff Mar 22 '12 at 20:33
1  
Would some of those who voted for this question move their votes to other questions (maintaining at least 10 votes on this one!) so that we can get reach our quota of questions with 10 votes? – Gene Golovchinsky Mar 27 '12 at 19:35
up vote 11 down vote
How to conduct significance test for cross validation on information retrieval experiments?
added by ameertawfik, edited by WikiSpeedia hang-around Mar 22 '12 at 18:37
link|flag
1  
Please distribute your votes to other questions to maximize the number of questions with 10 votes. Votes over 10 don't help at this stage. If you voted for a question, the up-vote button is shown in red; click on it again to remove your vote. – Gene Golovchinsky Mar 28 '12 at 18:04
up vote 11 down vote
Where should junior information retrieval researchers publish their works?
added by ameertawfik, edited by WikiSpeedia hang-around Mar 22 '12 at 18:38
link|flag
If someone (just one person) could un-upvote this question and vote on other questions, that almost have 10 points, this site would move to the next phase... – woliveirajr Sep 6 '12 at 14:23
up vote 10 down vote
What is the current size and growth rate of the web?
added by Martin Potthast Mar 19 '12 at 20:16
link|flag
up vote 10 down vote
What are good pre-retrieval query difficulty predictors?
added by Matthias Hagen Mar 20 '12 at 13:03
link|flag
<comments removed> Please do not use comments to answer these questions. Comments are here to discuss and improve the viability of the proposed question. This is a proposal and not a Q&A site. – Robert Cartaino♦ Mar 20 '12 at 16:59
up vote 10 down vote
How do I add spelling correction to a search interface?
added by Ian Soboroff Mar 20 '12 at 13:33
link|flag
<comments removed> Please do not use comments to answer these questions. Comments are here to discuss and improve the viability of the proposed question. This is a proposal and not a Q&A site. – Robert Cartaino♦ Mar 20 '12 at 17:00
up vote 10 down vote
Inverted index postlists sorted by retrieval score or doc-ID: what are pros and cons?
added by Matthias Hagen Mar 20 '12 at 13:33
link|flag
up vote 10 down vote
Search engine index sharding by documents or keywords: what to choose in which situation?
added by Matthias Hagen Mar 20 '12 at 13:37
link|flag
up vote 10 down vote
Are there any public data sets that reveal the impact of social plugins (Like-button, Twitter-Follow, etc.) on web page success?
added by Martin Potthast Mar 20 '12 at 13:48
link|flag
up vote 10 down vote
What are some research areas/topics at the intersection of information retrieval, machine learning and natural language processing?
added by beeb, edited by WikiSpeedia hang-around Mar 22 '12 at 18:38
link|flag
up vote 10 down vote
Are there any recent public query log data sets?
added by andrew Mar 20 '12 at 21:24
link|flag
up vote 10 down vote
Which corpus/document/result set statistics are useful for visualizing search results?
added by Gene Golovchinsky Mar 20 '12 at 22:05
link|flag
up vote 10 down vote
How to customize parsing in Nutch? To extract and index specific HTML tags.
added by balajinix, edited by WikiSpeedia hang-around Mar 22 '12 at 18:39
link|flag
this discussion may look like this one on stackoverflow. a good answer is linked from one of the answers. this blogpost from someone who has already done such customization. more such comments from experienced IR people will help. – balajinix Mar 21 '12 at 5:10
Should this site go down the path of supporting users of Nutch, Lucene, Solr, etc etc, or is it aiming for a more researchy level? We should have a FAQ that links these questions to those developers' sites and forums. – Ian Soboroff Mar 21 '12 at 20:10
StackOverflow already supports specific tool API questions; seems like we should differentiate this site to be more researchy. Would a different standard for what is a good answer be useful here? – Gene Golovchinsky Mar 22 '12 at 21:21
1  
There are only 25 questions regarding FAST on Stackoverflow, and just a handful regarding Autonomy, so clearly Stackoverflow is not a popular forum for these commercial search tools. A dedicated site, such as this, would provide better answers and scores, and a way to compare the same or similar questions across search engines. – Jeff Bloom Mar 28 '12 at 15:22
up vote 10 down vote
In the TREC Web Track 2009, what does prel mean as opposed to qrel? There is no proper explanation, anywhere...
added by Martin Potthast Mar 21 '12 at 7:45
link|flag
up vote 10 down vote
What is the state-of-the-art in providing a semantic search of web pages, rather than a simple word / N-gram search? How does the approach work?
added by winwaed Mar 21 '12 at 12:30
link|flag
up vote 10 down vote
How can I extract the different interpretations of an ambiguous query?
added by saulvargas Mar 21 '12 at 12:49
link|flag
up vote 10 down vote
Which are the information retrieval frameworks that could be used to teach information retrieval?
added by Srikanta Bedathur, edited by WikiSpeedia hang-around Mar 22 '12 at 18:39
link|flag
up vote 10 down vote
What are good, large sources of seed URLs for web crawling?
added by Martin Potthast Mar 21 '12 at 14:56
link|flag
up vote 10 down vote
Do we have any good studies that prove proximity/bigram models actually improve retrieval effectiveness?
added by Leonid Boytsov Mar 22 '12 at 2:26
link|flag
up vote 10 down vote
What are good cross-language retrieval approaches for European languages?
added by Claudia Hauff Mar 22 '12 at 6:21
link|flag
up vote 10 down vote
How can I programatically search the web for a moderate number of phrases without paying potentially expensive service fees to Google, Bing, etc.?
added by winwaed, edited by WikiSpeedia hang-around Mar 22 '12 at 18:40
link|flag
up vote 10 down vote
Query operators considered harmful? Are there studies on why only few users actually use query operators like quotes for phrasal search, etc.?
added by Matthias Hagen, edited by WikiSpeedia hang-around Mar 22 '12 at 18:41
link|flag
up vote 10 down vote
How do I measure whether users are satisfied by my search engine? How do I tell what works and what doesn't?
added by Ian Soboroff Mar 22 '12 at 17:21
link|flag
This is an attempt to rephrase the question about user studies. Transfer your votes here if you think this works better. – Ian Soboroff Mar 22 '12 at 17:22
Can you provide a link to the original question? I can't seem to find it in the list – Gene Golovchinsky Mar 22 '12 at 20:53
That's because I deleted it so I could add another question. – Ian Soboroff Mar 23 '12 at 13:21
up vote 10 down vote
What are the best ways to automatically add titles to documents with missing or inferior titles?
added by Jeff Bloom Mar 22 '12 at 17:26
link|flag
up vote 10 down vote
What are the best ways to detect duplicate documents?
added by Jeff Bloom Mar 22 '12 at 17:29
link|flag
up vote 10 down vote
Is there any open-source implementation of state-of-art LETOR algorithms? (lambdaMART, ...)
added by user54868 Mar 22 '12 at 18:48
link|flag
...or, at least, free to use – Anonymous Mar 22 '12 at 18:52
up vote 10 down vote
Why did various click models (UBM, DBN, ...) show performance worse than feature-based ML approaches (random forests) in the WSDM WSCD2012 Challenge?
added by user54868 Mar 22 '12 at 18:58
link|flag
up vote 10 down vote
I see in my logs lots of search queries which have no clicks afterwards. What's going on?
added by Ian Soboroff Mar 22 '12 at 20:42
link|flag
up vote 10 down vote
I can't decide if my search engine should stem query words or not. Why not just make everything a prefix search?
added by Ian Soboroff Mar 22 '12 at 20:49
link|flag
up vote 10 down vote
How can I remove spam and junk pages from a large web crawl?
added by Timothy Jones Mar 22 '12 at 23:42
link|flag
up vote 10 down vote
How can I clean automated queries (such as vulnerability scanners or other bot submitted queries) from my query log?
added by Timothy Jones Mar 23 '12 at 4:23
link|flag
up vote 10 down vote
What material should one cover in a 14 week undergraduate information retrieval course in 2012?
added by Matthias Hagen Mar 23 '12 at 7:59
link|flag
This is somehow ment to replace the "What textbooks to use for and undergraduate IR course?" question ... Is this one specific and narrow enough? – Matthias Hagen Mar 23 '12 at 10:22
up vote 10 down vote
What is the algorithm for Statistically Improbable Phrases?
added by Guy Coder Mar 23 '12 at 20:07
link|flag
up vote 10 down vote
How do I rank 'thumbs up' and 'thumbs down'? Is the ranking scheme used in this Web site good enough?
added by dyaa albakour Mar 27 '12 at 13:03
link|flag
up vote 10 down vote
How do I tell good abandonment from poor abandonment?
added by Gene Golovchinsky Mar 27 '12 at 19:46
link|flag
up vote 10 down vote
Under which circumstances do web crawlers need artifical intelligence?
added by vakufo, edited by WikiSpeedia hang-around Apr 21 '12 at 9:06
link|flag
up vote 10 down vote
What are good ways to measure user satisfaction/task completion in search interfaces, as opposed to simply measuring CTR?
added by Abhi Apr 17 '12 at 4:04
link|flag
up vote 10 down vote
What is the best way to randomly sample a single web page from the World Wide Web?
added by ssn May 17 '12 at 15:37
link|flag
up vote 10 down vote
What are the top research journals in information retrieval?
added by ssn, edited by WikiSpeedia hang-around Jun 11 '12 at 18:13
link|flag
up vote 10 down vote
What is the best way to handle compound words in languages like German?
added by Marco Hemminger, edited by WikiSpeedia hang-around Aug 12 '12 at 20:22
link|flag
1 2 next

This proposal is in:

Commitment

Before the site is created, it needs people to commit to use it. Right now, it's

30%

complete. When it reaches 100%, the beta will begin.

▾ more info

proposed by

Martin Potthast
1,537●1●2●12

1 year ago (edited 1 year ago)

viewed

3,414 times

latest activity

12 days ago

followers

users also following

7.2% Raspberry Pi
6.7% Freelancing
6.7% Repurpose Hacking
6.7% Machine Learning
55.0% only this proposal

followers active in

36.1% Stack Overflow
8.9% Super User
7.8% Meta Stack Overflow
6.1% Programmers
5.0% English Language...
5.0% Ask Ubuntu

recent followers

added May 8 at 0:27
Bjørn Bråthen
51●2
added May 6 at 22:22
Gayathri Athreya
106●4
added Apr 21 at 9:23
Alessandro Cosentino
2,725●16●42
added Apr 11 at 17:07
Julián Urbano
1,967●2●19
added Mar 31 at 19:35
unor
9,561●10●143
added Mar 23 at 12:37
ShuklaSannidhya
1,909●4●42
added Mar 21 at 19:53
WilliamKF
13.4k●21●92●306
added Mar 13 at 17:09
Drag0nR3b0rn
51●2
added Mar 8 at 10:08
bendaizer
116●4
added Mar 2 at 22:54
Wesley Baugh
1,299●1●1●24
added Mar 2 at 13:21
Vijay
2,000●9●25
added Jan 9 at 7:16
rueycheng
51●1
added Dec 10 '12 at 18:34
user71323
51●1
added Oct 9 '12 at 18:45
user66894
51●1
added Oct 3 '12 at 9:34
Douglas S. Stones
15.4k●4●40●174
added Sep 30 '12 at 13:11
James McMinn
51●1
added Sep 7 '12 at 1:41
JustinY
8,089●1●24●131
added Sep 7 '12 at 0:16
silverasm
51●3
added Sep 6 '12 at 0:25
sam
1,177●3●10●42
added Sep 5 '12 at 13:48
Max
802●2●21
added Sep 4 '12 at 21:26
dvdgrs
51●2
added Sep 4 '12 at 17:10
woliveirajr
10.9k●23●135
added Sep 4 '12 at 0:58
Rob Hoare
3,082●6●36
added Aug 30 '12 at 12:54
A.J.
111●6
added Aug 28 '12 at 12:13
tricasse
1,914●4●31
added Aug 25 '12 at 17:59
problemzebra
51●2
added Aug 24 '12 at 11:35
user63154
51●1
added Aug 23 '12 at 12:46
user63103
51●1
added Aug 22 '12 at 19:01
Gaffi
5,703●6●25●126
added Aug 21 '12 at 1:43
Jeffrey L. Roberts
1,026●3●18
added Aug 20 '12 at 15:38
Brian Anthony Dillingham
771●3●18
added Aug 19 '12 at 7:13
user62902
51●1
added Aug 17 '12 at 19:30
user62853
51●1
added Aug 14 '12 at 22:27
user62673
51●1
added Aug 14 '12 at 7:58
Richard Boulton
479●5●11
added Aug 11 '12 at 1:18
Xitcod13
3,261●2●12●88
added Aug 9 '12 at 15:14
mt_
51●1
added Aug 9 '12 at 2:47
user692704
51●2
added Jul 31 '12 at 16:04
ND Geek
1,704●2●22
added Jul 30 '12 at 12:37
zuberuber
977●4●26
feed icon proposal feed
faq | blog | legal | privacy policy | contact us | feedback always welcome
site design / logo © 2011 stack exchange, inc.; user contributions licensed under cc-wiki with attribution required
rev 2013.5.22.149