Thank you very much Michael for your answer.
Below the extra information you asked for, and a sample result
QUERY INFORMATION
query=covid
back query = *:*
fore query = mitochondria
sample gene id ="57506" / "54205"
facet code:
"json.facet": "{'titles_gene': {'type': 'terms', 'field':
'titles_gene_pubtator_annotation_ids', 'limit': 10, 'sort': {'rtitles0':
'desc'}, 'facet': {'rtitles0': 'relatedness($fore,$back)'}}
CARDINALITY
q=157120
back=157120
fore=321385
fore & back=343
"57506" & back=8
"57506" & fore & back=5
"54205" & back=5
"54205" & fore & back=5
RESULTS
titles_gene
"val": "57506",
"count": 8,
"rtitles0": {
"relatedness": 0.69182,
"foreground_popularity": 1e-05,
"background_popularity": 1e-05
}
abstracts_gene
"val": "54205",
"count": 5,
"rabstracts0": {
"relatedness": 0.94975,
"foreground_popularity": 0.00025,
"background_popularity": 0.00043
}
Here it looks like that the fpopularity and bpopularity are the same for
titles_gene (but I expected 5/343 and 8/157120 instead..)
but the relatedness of 0.69182 (it should range between -1 and 1) suggests me
that "57506" is strongly "characteristic"
(meaning that it is occourring more in the fore than in the back, that is a
superset of fore)
to the fore corpus with respect to the back corpus.
I would like to ask:
1. is my interpretation of relatedness correct?
2. why foreground_popularity and background_popularity are like this?
3. how should I change my json.facet query to require a min_popularity?
should this solve the strange relatedness values?
4. is it possible to 'test' (statistically) the significativity of a
z-score, like we do with a p-value?
thank you
D
Danilo Tomasoni
Fondazione The Microsoft Research - University of Trento Centre for
Computational and Systems Biology (COSBI)
Piazza Manifattura 1, 38068 Rovereto (TN), Italy
tomas...@cosbi.eu<https://webmail.cosbi.eu/owa/redir.aspx?C=VNXi3_8-qSZTBi-FPvMwmwSB3IhCOjY8nuCBIfcNIs_5SgD-zNPWCA..&URL=mailto%3acalabro%40cosbi.eu>
http://www.cosbi.eu<https://webmail.cosbi.eu/owa/redir.aspx?C=CkilyF54_imtLHzZqF1gCGvmYXjsnf4bzGynd8OXm__5SgD-zNPWCA..&URL=http%3a%2f%2fwww.cosbi.eu%2f>
As for the European General Data Protection Regulation 2016/679 on the
protection of natural persons with regard to the processing of personal data,
we inform you that all the data we possess are object of treatment in the
respect of the normative provided for by the cited GDPR.
It is your right to be informed on which of your data are used and how; you may
ask for their correction, cancellation or you may oppose to their use by
written request sent by recorded delivery to The Microsoft Research –
University of Trento Centre for Computational and Systems Biology Scarl, Piazza
Manifattura 1, 38068 Rovereto (TN), Italy.
P Please don't print this e-mail unless you really need to
