ai4data/datause-classifier

Dataset Mention Classification Model

This is a fine-tuned sequence classification model for identifying the presence of dataset mentions in text. It is built as a LoRA adapter on top of the fastino/gliner2-large-v1 base model.

It serves as the default pre-filtering stage (page-relevance classifier) in the ai4data dataset extraction pipeline, helping skip pages/documents that do not contain dataset references before performing detailed entity and relation extraction.

Model Details

• Base Model: fastino/gliner2-large-v1
• Adapter Type: PEFT / LoRA
• Task: Sequence Classification
• Task Name: has_data_mention
• Labels: ["has_mention", "no_mention"]

How to Use

You can load and use this model directly via gliner2 and the PeftModel interface:

from gliner2 import GLiNER2
from peft import PeftModel

# Load base model and apply adapter
base_model = GLiNER2.from_pretrained("fastino/gliner2-large-v1")
model = PeftModel.from_pretrained(base_model, "ai4data/datause-classifier")
model.eval()

# Define classification tasks
TASKS = {"has_data_mention": ["has_mention", "no_mention"]}

text_with_data = "This paper uses microdata from the 2018 Nigeria General Household Survey."
text_no_data = "The project will strengthen institutional capacity and governance frameworks."

# Run inference
res1 = model.classify_text(text_with_data, TASKS, threshold=0.0, include_confidence=True)
print(res1)
# Output: {'has_data_mention': {'label': 'has_mention', 'confidence': 1.0}}

res2 = model.classify_text(text_no_data, TASKS, threshold=0.0, include_confidence=True)
print(res2)
# Output: {'has_data_mention': {'label': 'no_mention', 'confidence': 0.998}}