Physical AI AV Reasoning Challenge
🚗
11
Generate and submit reasoning for AV safety scenarios
🔄 In a Training Loop
Minjae Park
Teora
·
AI & ML interests
None yet
Recent Activity
liked a Space 6 days ago
nvidia/PhysicalAI-AV-OOD-Reasoning-Challenge-2026 liked a Space 6 days ago
nvidia/AlpasimE2EClosedLoopChallenge2026 liked a dataset about 2 months ago
nvidia/Nemotron-Personas-KoreaOrganizations
liked 2
Spaces 6 days ago
liked a
dataset about 2 months ago
liked a
dataset 6 months ago
updated a
model 9 months ago
published a
model 9 months ago
liked a
Space 9 months ago
liked 3
models 10 months ago
liked a
model 11 months ago
upvoted 2
collections 11 months ago
liked a
Space about 1 year ago
liked a
model about 1 year ago
liked 2
Spaces over 1 year ago
reacted to singhsidhukuldeep's post with 👍 over 1 year ago
Post
3458
Exciting breakthrough in e-commerce recommendation systems!
Walmart Global Tech researchers have developed a novel Triple Modality Fusion (TMF) framework that revolutionizes how we make product recommendations.
>> Key Innovation
The framework ingeniously combines three distinct data types:
- Visual data to capture product aesthetics and context
- Textual information for detailed product features
- Graph data to understand complex user-item relationships
>> Technical Architecture
The system leverages a Large Language Model (Llama2-7B) as its backbone and introduces several sophisticated components:
Modality Fusion Module
- All-Modality Self-Attention (AMSA) for unified representation
- Cross-Modality Attention (CMA) mechanism for deep feature integration
- Custom FFN adapters to align different modality embeddings
Advanced Training Strategy
- Curriculum learning approach with three complexity levels
- Parameter-Efficient Fine-Tuning using LoRA
- Special token system for behavior and item representation
>> Real-World Impact
The results are remarkable:
- 38.25% improvement in Electronics recommendations
- 43.09% boost in Sports category accuracy
- Significantly higher human evaluation scores compared to traditional methods
Currently deployed in Walmart's production environment, this research demonstrates how combining multiple data modalities with advanced LLM architectures can dramatically improve recommendation accuracy and user satisfaction.
Walmart Global Tech researchers have developed a novel Triple Modality Fusion (TMF) framework that revolutionizes how we make product recommendations.
>> Key Innovation
The framework ingeniously combines three distinct data types:
- Visual data to capture product aesthetics and context
- Textual information for detailed product features
- Graph data to understand complex user-item relationships
>> Technical Architecture
The system leverages a Large Language Model (Llama2-7B) as its backbone and introduces several sophisticated components:
Modality Fusion Module
- All-Modality Self-Attention (AMSA) for unified representation
- Cross-Modality Attention (CMA) mechanism for deep feature integration
- Custom FFN adapters to align different modality embeddings
Advanced Training Strategy
- Curriculum learning approach with three complexity levels
- Parameter-Efficient Fine-Tuning using LoRA
- Special token system for behavior and item representation
>> Real-World Impact
The results are remarkable:
- 38.25% improvement in Electronics recommendations
- 43.09% boost in Sports category accuracy
- Significantly higher human evaluation scores compared to traditional methods
Currently deployed in Walmart's production environment, this research demonstrates how combining multiple data modalities with advanced LLM architectures can dramatically improve recommendation accuracy and user satisfaction.
- 2 replies
liked a
dataset over 1 year ago
liked a
Space about 2 years ago