nonlinear transformations, relu variants, gelu swish activations, neural network nonlinearities
Activation functions are the reason depth means anything. Stack a hundred linear layers with no nonlinearity between them and the whole thing collapses algebraically into a single…
activation functions non linearity, activation functions, functions non, cifar gelu glu glue nlp, activation functions & non-linearity, functions non-linearity
Activation Functions & Non-linearity Introduction & Motivation Activation Functions: introduce non-linearity. ReLU, Sigmoid, Tanh, GELU. Applications: deep networks, improved…
activation functions, relu sigmoid tanh, bert elu gelu gpt nlp passed, activation functions relu sigmoid tanh & gelu, activation functions relu, functions relu sigmoid, sigmoid tanh gelu
Activation Functions: ReLU, Sigmoid, Tanh & GELU Introduction & Motivation Activation functions: non-linearities enabling deep learning. ReLU: simple, efficient; dead neuron risk.…
ReLU GELU SiLU, function characteristics, gradient properties, modern architecture choices
Activation Functions Survey (ReLU, GELU, SiLU) compares fundamental non-linearities used in deep learning that introduce non-linearity enabling neural networks to learn complex…
activation gradient recomputation vs storage memory trade-offs, activation gradient recomputation, gradient recomputation vs, recomputation vs storage, vs storage memory, vs storage
Activation Gradient Recomputation vs Storage Memory Trade-Offs Introduction & Motivation Activation Gradient Recomputation vs Storage Memory Trade-Offs addresses a central problem…
explainable ai
Activation Maximization is the optimization-based approach to generating inputs that maximally activate a target neuron or output class in a neural network — using gradient ascent…
interpretability
Activation Maximization is optimization of input patterns to maximize a chosen neuron, channel, or class activation - It exposes preferred stimulus patterns encoded by model…
explainable ai
Activation maximization for text is the optimization approach that searches for text inputs which maximize a chosen internal activation in a language model - it is used…
causal, intervention
Activation Patching (Causal Tracing) is the mechanistic interpretability technique that identifies which specific components of a neural network causally store particular…
ai safety
Activation patching edits internal activations to understand the causal role of specific neurons, layers, or circuits. Technique: Run model on two inputs (clean and corrupted)…
explainable ai
Activation patching is the causal intervention method that replaces selected activations in one run with activations from another run to test influence on outputs - it is one…
sparse activation, relu sparsity, conditional computation, sparse inference
Activation Sparsity in Neural Networks is the phenomenon and optimization technique where a large fraction of neuron activations are zero or near-zero during inference — enabling…
interpretability
Activation Steering is a control technique that modifies hidden activations to bias model outputs - It enables behavior shaping at inference time without full retraining. What Is…
interposer, chiplet, integration, routing
Active Interposer Design Integration is a silicon substrate containing embedded logic, routing resources, and power management circuits that actively orchestrates communication…
Active Anomaly Discovery with Human Feedback Integration Introduction & Motivation Active Anomaly Discovery with Human Feedback Integration addresses a central problem in anomaly…
Active Fairness Auditing for Disparate Subgroups Introduction & Motivation Active Fairness Auditing for Disparate Subgroups addresses a central problem in {subject} learning…
Active Class Selection for Controlled Class Proportions Introduction & Motivation Active Class Selection for Controlled Class Proportions addresses a central problem in {subject}…
Active Clustering and Labeling Introduction & Motivation Active Clustering and Labeling addresses a central problem in {subject} learning and efficient {target} annotation: how…
Active Continual Learning with Information-Theoretic Queries Introduction & Motivation Active Continual Learning with Information-Theoretic Queries addresses a central problem…
active cooling control stability prediction, active cooling control, cooling control stability, control stability prediction, active cooling, cooling control, control stability
Active Cooling Control Stability Prediction with Machine Learning Introduction & Motivation Active Cooling Control Stability Prediction with Machine Learning addresses a central…
active cooling fan design, active cooling fan, cooling fan design, active cooling, cooling fan, fan design
Active Cooling Fan Design Introduction & Motivation Active Cooling Fan Design addresses a central problem in cooling process control and cooling-capacity-watts prediction: how…
Active Feature Acquisition for Costly Missing Attributes Introduction & Motivation Active Feature Acquisition for Costly Missing Attributes addresses a central problem…
Active Feature Exploration via Gaussian Process Uncertainty Introduction & Motivation Active Feature Exploration via Gaussian Process Uncertainty addresses a central problem…
Active Few-Shot Learning Introduction & Motivation Active Few-Shot Learning addresses a central problem in fewshot and sample-selection-few-shot architecture: how to Implement…
uncertainty sampling, query by committee, diversity sampling, human annotation
Active learning iteratively chooses which unlabeled examples should receive costly labels to maximize information gained per annotation. It reduces labeling burden when expert…
query strategy active learning, uncertainty sampling, pool based active learning, annotation efficient learning
Active Learning is the iterative machine learning framework where the model itself selects the most informative unlabeled examples to be annotated by a human oracle, minimizing…
active learning annotation, active learning, learning annotation
Active Learning Annotation Introduction & Motivation Active Learning Annotation addresses a central problem in nlp process control and active-learning-sample-selection prediction…
Active Learning for Computer Vision Introduction & Motivation Active Learning for Computer Vision addresses a central problem in {subject} learning and efficient {target}…
Curriculum Active Learning Introduction & Motivation Curriculum Active Learning addresses a central problem in {subject} learning and efficient {target} annotation: how to Achieve…
Ensemble Diversity in Active Learning Introduction & Motivation Ensemble Diversity in Active Learning addresses a central problem in {subject} learning and efficient {target}…
data
Active learning for annotation is a machine learning strategy that intelligently selects which unlabeled examples should be annotated next, focusing human effort on the examples…
data analysis
Active Learning for Inspection is a strategy where the ML model selectively requests labels for the most informative samples — minimizing the total labeling effort…
Active Learning for Learning-to-Rank Listwise Acquisition Introduction & Motivation Active Learning for Learning-to-Rank Listwise Acquisition addresses a central problem…
Active Learning on Graph Data Introduction & Motivation Active Learning on Graph Data addresses a central problem in {subject} learning and efficient {target} annotation: how…
Active Learning for Imbalanced Data Introduction & Motivation Active Learning for Imbalanced Data addresses a central problem in {subject} learning and efficient {target}…
active learning inspection sampling prediction machine learning, active learning, inspection sampling prediction, active learning inspection sampling prediction
Active Learning Inspection Sampling Prediction with Machine Learning Introduction & Motivation Active Learning Inspection Sampling Prediction with Machine Learning addresses…
active learning labeling, active learning, learning labeling
Active Learning Labeling Introduction & Motivation Active Learning Labeling addresses a central problem in systems process control and labeling-cost-reduction-efficiency…
Active Learning for Medical Diagnosis Introduction & Motivation Active Learning for Medical Diagnosis addresses a central problem in {subject} learning and efficient {target}…
Active Cross-Modal Alignment for Vision-Language Models Introduction & Motivation Active Cross-Modal Alignment for Vision-Language Models addresses a central problem in {subject}…
Active Learning for NLP Tasks Introduction & Motivation Active Learning for NLP Tasks addresses a central problem in {subject} learning and efficient {target} annotation: how…
Active Outlier Filtering and Quarantine Acquisition Introduction & Motivation Active Outlier Filtering and Quarantine Acquisition addresses a central problem in {subject} learning…
active learning, query strategy sample, bald cifar mc ner nlp passed, active learning query strategy & sample selection, active learning query, learning query strategy, learning query
Active Learning: Query Strategy & Sample Selection Introduction & Motivation Active learning selects informative samples for labeling, reducing annotation cost. Uncertainty…
Active Learning for Recommendations Introduction & Motivation Active Learning for Recommendations addresses a central problem in recsys systems and {target} optimization: how…
Active Learning for Regression Tasks Introduction & Motivation Active Learning for Regression Tasks addresses a central problem in {subject} learning and efficient {target}…
active learning and sample selection prediction, active learning sample, learning sample selection, sample selection prediction, active learning, learning sample
Active Learning and Sample Selection Prediction with Machine Learning Introduction & Motivation Active Learning and Sample Selection Prediction with Machine Learning addresses…
active learning sample selection, active learning sample, learning sample selection, active learning, learning sample, sample selection
Active Learning Sample Selection Introduction & Motivation Active Learning Sample Selection addresses a central problem in ml-training process control…
active learning, selective annotation strategy, bald cifar mc mnist nlp passed, active learning selective, learning selective annotation, learning selective, selective annotation
Active Learning: Selective Annotation Strategy Introduction & Motivation Active Learning: select most informative samples for labeling. Reduce annotation cost. Uncertainty…
active learning, strategic sample selection, al cifar mnist nlp passed qbc, active learning strategic sample selection & uncertainty sampling, active learning strategic
Active Learning: Strategic Sample Selection & Uncertainty Sampling Introduction & Motivation Active learning: select informative samples to label. Uncertainty sampling: query…
active learning, learning strategies
Active Learning Strategies Introduction & Motivation Active Learning Strategies addresses a central problem in label-efficient machine learning: how to choose which unlabeled…
Active Synthesis of Informative Boundary Edge Cases Introduction & Motivation Active Synthesis of Informative Boundary Edge Cases addresses a central problem in {subject} learning…