882 technical terms and definitions
attention mechanisms transformers self attention parallelization, attention mechanisms, transformers self attention, bert glue gpt nlp passed qk, mechanisms transformers
Attention Mechanisms & Transformers: Self-Attention & Parallelization Introduction & Motivation Attention weights relevant input elements for each output; Transformers stack…
Attention Mechanisms in Vision Introduction & Motivation Attention Mechanisms in Vision addresses a central problem in vision processing and channel-spatial-focus prediction: how…
Attention Mechanisms for Memory in RL Introduction & Motivation Attention Mechanisms for Memory in RL addresses a central problem in reinforcement policy learning…
Attention for Multimodal Fusion Introduction & Motivation Attention for Multimodal Fusion addresses a central problem in multimodal learning and attention-focus-quality alignment…
graph neural networks
Attention Pooling Graph is graph readout methods that weight node contributions through learned attention gates. - They prioritize informative nodes and suppress irrelevant…
Attention Head Pruning via Attribution Score Ranking Introduction & Motivation Attention Head Pruning via Attribution Score Ranking addresses a central problem in explainability…
explainable ai
Attention Rollout is a visualization technique that aggregates attention weights across all transformer layers — recursively multiplying attention matrices to reveal which input…
Attention Rollout for Transformer Interpretability Introduction & Motivation Attention Rollout for Transformer Interpretability addresses a central problem in interpretability…
Attention Rollout for Transformer Interpretability (Extended Study) Introduction & Motivation Attention Rollout for Transformer Interpretability (Extended Study) addresses…
Attention Rollout for Transformer Interpretability (Extended Study) Introduction & Motivation Attention Rollout for Transformer Interpretability (Extended Study) addresses…
explainable ai
Attention rollout in ViT is the layer-wise aggregation method that composes attention matrices across depth to estimate end-to-end token influence on final predictions - instead…
Attention Rollout and Flow in Vision Transformers Introduction & Motivation Attention Rollout and Flow in Vision Transformers addresses a central problem in explainability…
streaming llm, infinite context, initial token attention, attention pattern
Attention Sinks and StreamingLLM are the architectural phenomenon and inference technique where the first few tokens in a sequence consistently receive disproportionately high…
model compression
Attention Transfer is a feature-based knowledge distillation method where the student is trained to mimic the teacher's spatial attention maps — ensuring the student focuses on…
Attention Transfer Distillation Introduction & Motivation Attention Transfer Distillation addresses a central problem in reducing the size and cost of compression models: how…
Attention Transfer Distillation (Extended Study) Introduction & Motivation Attention Transfer Distillation (Extended Study) addresses a central problem in reducing the size…
Attention Transfer Distillation (Extended Study) Introduction & Motivation Attention Transfer Distillation (Extended Study) addresses a central problem in reducing the size…
Attention Transfer Distillation (Extended Study) Introduction & Motivation Attention Transfer Distillation (Extended Study) addresses a central problem in reducing the size…
Attention Transfer Learning Introduction & Motivation Attention Transfer Learning addresses a central problem in transfer learning and {target} adaptation: how to Apply {subject}…
ai safety
Attention visualization displays attention weights to understand what the model focuses on during prediction. What attention shows: Which input tokens/positions influence each…
explainable ai
Attention visualization in ViT is the process of mapping attention weights to image space so engineers can inspect where each head and layer allocates focus - it is a core…
Attention Mechanism Visualization Introduction & Motivation Attention Mechanism Visualization addresses a central problem in explainability interpretation and model understanding…
attention visualization model focus prediction, attention visualization model, visualization model focus, model focus prediction, attention visualization, visualization model
Attention Visualization Model Focus Prediction with Machine Learning Introduction & Motivation Attention Visualization Model Focus Prediction with Machine Learning addresses…
Attention Weight Visualization Introduction & Motivation Attention Weight Visualization addresses a central problem in interpretability and explanation of xai predictions: how…
Attention Weight Visualization (Extended Study) Introduction & Motivation Attention Weight Visualization (Extended Study) addresses a central problem in interpretability…
Attention Weight Visualization (Extended Study) Introduction & Motivation Attention Weight Visualization (Extended Study) addresses a central problem in interpretability…
neural architecture search
AttentionNAS is neural architecture search including attention-block placement and configuration as search variables. - It discovers where and how attention modules should be…
neural architecture search
AttentiveNAS is a hardware-aware once-for-all NAS method that prioritizes Pareto-critical subnetworks during training. - Training attention is focused on weak frontier regions…
attenuator temperature coefficient prediction, attenuator temperature coefficient, temperature coefficient prediction, attenuator temperature, temperature coefficient
Attenuator Temperature Coefficient Prediction with Machine Learning Introduction & Motivation Attenuator Temperature Coefficient Prediction with Machine Learning addresses…
generative models
Attribute manipulation is the controlled editing of specific visual properties in generated or inverted images while preserving other content - it is a core function of modern…
Attributed Graph Neural Networks Introduction & Motivation Attributed Graph Neural Networks addresses a central problem in graph network representation…
Causal Attribution and Contribution Introduction & Motivation Causal Attribution and Contribution addresses a central problem in causal inference and {target} analysis: how…
explainable ai
Attribution patching is the approximate patching method that estimates intervention effects using gradient-based attribution rather than exhaustive full patches - it accelerates…
Feature Attribution Priors for Neural Network Guidance Introduction & Motivation Feature Attribution Priors for Neural Network Guidance addresses a central problem…
auc-roc curve performance and threshold-agnostic evaluation, auc-roc curve performance, curve performance threshold-agnostic, performance threshold-agnostic evaluation, auc-roc curve
AUC-ROC Curve Performance and Threshold-Agnostic Evaluation Introduction & Motivation AUC-ROC Curve Performance and Threshold-Agnostic Evaluation addresses a central problem…
Auction Design and Mechanism Learning Introduction & Motivation Auction Design and Mechanism Learning addresses a central problem in reinforcement policy learning…
speech, asr, tts, voice, whisper, speech recognition, text to speech, voice ai
Audio and Speech AI encompasses technologies for speech recognition (ASR), text-to-speech synthesis (TTS), and voice-based AI interfaces — using deep learning models to convert…
deep, learning, speech, recognition, acoustic, model, language
Audio Deep Learning Speech Recognition is neural network-based systems converting speech signals to text through acoustic modeling and language modeling, achieving human-level…
Audio Captioning Generation Introduction & Motivation Audio Captioning Generation addresses a central problem in multimodal learning and caption-relevance-accuracy alignment: how…
audio codec thd drift prediction, audio codec thd, codec thd drift, thd drift prediction, audio codec, codec thd, thd drift, drift prediction
Audio Codec THD Drift Prediction with Machine Learning Introduction & Motivation Audio Codec THD Drift Prediction with Machine Learning addresses a central problem in audio codec…
audio codec thd+n prediction, audio codec thd+n, codec thd+n prediction, audio codec, codec thd+n, thd+n prediction
Audio Codec THD+N Prediction with Machine Learning Introduction & Motivation Audio Codec THD+N Prediction with Machine Learning addresses a central problem in audio codec total…
generative models
Audio generation uses AI to create music, speech, sound effects, and ambient soundscapes, leveraging deep generative models that learn the statistical patterns of audio waveforms…
music generation ai, musicgen, audio diffusion, sound synthesis neural
Neural Audio and Music Generation is the application of generative AI to synthesize music, sound effects, and audio from text descriptions or other conditioning inputs — using…
music synthesis, neural audio processing, waveform generation, sound synthesis networks
Audio and Music Generation Models — Neural audio generation produces realistic speech, music, and sound effects by modeling complex temporal patterns in waveforms, spectrograms…
audio
Audio inpainting fills in missing, corrupted, or intentionally removed portions of audio signals with plausible content that sounds natural and seamlessly blends with surrounding…
Audio Self-Supervised Learning Introduction & Motivation Audio Self-Supervised Learning addresses a central problem in selfsupervised and audio-augmentation-strategy architecture…
SSAST Self-Supervised Audio Spectrogram Transformer Introduction & Motivation SSAST Self-Supervised Audio Spectrogram Transformer addresses a central problem in selfsupervised…
Audio Synthesis and Generation Introduction & Motivation Audio Synthesis and Generation addresses a central problem in generative generation and audio-quality-naturalness…
Audio-Text Learning Methods Introduction & Motivation Audio-Text Learning Methods addresses a central problem in multimodal learning and audio-text-alignment-quality alignment…
multimodal ai
Audio-Visual Correspondence (AVC) is a brilliant, self-supervised learning protocol designed to force a multimodal artificial intelligence to build deep, semantic understanding…