⚗️ Knowledge Distillation - codenm.no2 · Scour

Knowledge Distillation for Visual Autoregressive Models

👁️Multimodal AI Academic

Less-relevant results

apple/coreai-models: Model export recipes, Python primitives, and Swift runtime utilities for on-device AI

🐍Python Code

github.com··Hacker News

Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency

💬NLP News Blog

blog.google··Hacker News

Cross-Modal Knowledge Distillation without Paired Data: Theoretical Foundation and Algorithm

📡Information Theory Academic

1/ Now that we're running out of data, how do you optimally scale multi-epoch pretraining to hundreds of epochs?

🤖LLM Inference

threadreaderapp.com·

Unsupervised Continual Clustering via Forward-Backward Knowledge Distillation

💬LLMs Academic

Sigma-Branch: Hierarchical Single-Path Network Reconstruction for Dynamic Inference with Reduced Active Parameters

🤖LLM Inference Academic

google/gemma-4-12B-it-qat-q4_0-gguf

huggingface.co·

Heterophily-Aware Adaptive Knowledge Distillation for Hypergraph Neural Networks

💬LLMs Academic

LRMIL: Efficient Low-Resolution Multiple Instance Learning via High-Resolution Knowledge Distillation for Whole Slide Image Classification

🤖LLM Inference Academic

iblameandrew/open-deepthink: Grok-heavy at the price of API cost. You choose the model. An unlimited army to think about your problem.

🎯AI Agents Code

github.com··r/LocalLLaMA

Invariant Gradient Alignment for Robust Reasoning Distillation

✍️Prompt Engineering Academic

Compress-Distill: Reasoning Trace Compression for Efficient Knowledge Distillation

✍️Prompt Engineering Academic

Improving the Efficiency and Effectiveness of LLM Knowledge Distillation for Conversational Search

🧠LLM Academic

Recover-LoRA for Aggressive Quantization: Reclaiming Accuracy in 2-Bit Language Models via Low-Rank Adaptation with Knowledge Distillation on Synthetic Data

🧠LLM Academic

LLMCodec: Adapting Video Codecs for Efficient Weight Compression of Large Language Models

💬NLP Academic

TempoVLA: Learning Speed-Controllable Vision-Language-Action Policies

🎮Reinforcement Learning Academic

SecRL-Prune: Structured Reinforcement Learning-Based Pruning of CodeLLMs for Preserving Adversarial Code Mutation

🔐InfoSec Academic

Unveiling the Unknown: Open Vocabulary Object Detection with Scene Graphs

👁️Multimodal AI Academic

Geometry-Aware Distillation for Prompt Tuning Biomedical Vision-Language Models

👁️Multimodal AI Academic

Log in to enable infinite scrolling