create_qrels_from_dicts

lightning_ir.base.validation_utils.create_qrels_from_dicts(qrels: Sequence[Dict[str, int]]) → DataFrame

Convience function to create a qrels DataFrame from a list of dictionaries.

Parameters:

qrels (Sequence[Dict[str, int]]) – Mappings of doc_id -> relevance for each query, defaults to None

Returns:

DataFrame with query_id, q0, doc_id, and relevance columns

Return type:

pd.DataFrame