cartgr/embeddings-for-preferences-st5-xl
Sentence Similarity • 1B • Updated • 519 • 2
Edit Models filters
Model Tree
Apps
Inference Providers
Models
170
Active filters: preference-learning
Haleshot/Mathmate-7B-DELLA-ORPO
7B • Updated • 5
ilgee/Binary-Think-RM-8B
8B • Updated • 3
ilgee/Multiclass-Think-RM-8B
8B • Updated • 5
codelion/gemma-3-1b-it-reasoning-grpo-lora
Text Generation • Updated • 11 • 5
ilgee/Binary-Think-RM-3B
3B • Updated • 16 • 1
codelion/Qwen2.5-Coder-0.5B-Instruct-security-grpo-lora
Text Generation • Updated • 4
pyamy/llama3-dpo-pairrm
Updated • 1
pyamy/llama3-dpo-llm-judge
Updated
5456es/selective_dpo_Llama-3.2-1B-Instruct_prune_0.7-sigmoid
1B • Updated • 66
5456es/selective_dpo_Qwen2.5-1.5B-Instruct_prune_0.7-sigmoid
2B • Updated
5456es/cluster_prune_Qwen2.5-1.5B-Instruct_prune_0.7-sigmoid
2B • Updated
5456es/cluster_prune_Llama-3.2-1B-Instruct_prune_0.7-sigmoid
1B • Updated
5456es/implicit_reward_Qwen2.5-1.5B-Instruct_prune_0.7-sigmoid
2B • Updated
5456es/cluster_prune_Llama-3.2-1B-Instruct_prune_0.3-sigmoid
1B • Updated
5456es/implicit_reward_Llama-3.2-1B-Instruct_prune_0.3-sigmoid
1B • Updated
5456es/implicit_reward_Qwen2.5-0.5B-Instruct_prune_0.7-sigmoid
0.5B • Updated
5456es/cluster_prune_Qwen2.5-1.5B-Instruct_prune_0.3-sigmoid
2B • Updated
5456es/cluster_prune_Qwen2.5-0.5B-Instruct_prune_0.3-sigmoid
0.5B • Updated
5456es/selective_dpo_Qwen2.5-0.5B-Instruct_prune_0.7-sigmoid
0.5B • Updated
5456es/selective_dpo_Qwen2.5-1.5B-Instruct_prune_0.3-sigmoid
2B • Updated
5456es/cluster_prune_Qwen2.5-0.5B-Instruct_prune_0.7-sigmoid
0.5B • Updated
5456es/selective_dpo_Llama-3.2-1B-Instruct_prune_0.3-sigmoid
1B • Updated • 2
5456es/implicit_reward_Qwen2.5-1.5B-Instruct_prune_0.3-sigmoid
2B • Updated
5456es/cluster_prune_Qwen2.5-0.5B-Instruct_prune_0.5-sigmoid
0.5B • Updated
5456es/selective_dpo_Qwen2.5-0.5B-Instruct_prune_0.3-sigmoid
0.5B • Updated
5456es/selective_dpo_Llama-3.2-1B-Instruct_prune_0.5-sigmoid
1B • Updated
5456es/selective_dpo_Qwen2.5-0.5B-Instruct_prune_0.5-sigmoid
0.5B • Updated
5456es/implicit_reward_Llama-3.2-1B-Instruct_prune_0.5-sigmoid
1B • Updated
5456es/selective_dpo_Qwen2.5-1.5B-Instruct_prune_0.5-sigmoid
2B • Updated • 2